Methodology
HistoryRank is both a historical resource and a living experiment in how large language models (LLMs) reason about historical importance. The project blends academic, public attention, and model-generated signals to make the assumptions behind âimportanceâ visible and debatable.
Overview
The dataset combines three perspectives: academic historiometry (MIT Pantheon), public attention (Wikipedia pageviews), and model judgments (LLM rankings and explanations). The resulting list is not a claim to a final truth. It is a benchmark that shows how different sources agree or disagree, where omissions occur, and which figures are contested.
Goals
This project has two intertwined aims. First, to offer a public, readable reference for learning about history at scale. Second, to use the âtop 1,000â task as a probe into model behavior: what do LLMs remember, overlook, or exaggerate when asked to weigh human impact across centuries?
Choosing the 1,000 most influential people is inherently value-laden and historically contingent. That is precisely why it is a useful test: the models must reveal (and justify) their implicit criteria in the descriptions shown in each figureâs detail panel.
Data sources
MIT Pantheon (HPI). A historiometric ranking built from Wikipedia biography data (language coverage, article length, and other factors).
Wikipedia pageviews. 2025 annual pageviews act as a proxy for public attention.
LLM rankings. Multiple models each produce ranked lists of 1,000 figures using a shared prompt and format. Each entry includes a brief explanation of the figure's importance.
Current Model Roster
As of January 2025, the consensus ranking draws from the following models:
| Model | Developer | Lists | Notes |
|---|---|---|---|
| Claude Opus 4.5 | Anthropic | 8 | Flagship reasoning model |
| Claude Sonnet 4.5 | Anthropic | 8 | Balanced performance/cost |
| GPT-5.2-Thinking | OpenAI | 8 | Extended reasoning variant |
| Gemini Pro 3 | 7 | Multimodal flagship | |
| Grok 4.1 Fast | xAI | 7 | Speed-optimized |
| Gemini Flash 3 | 5 | Efficiency variant | |
| Mistral Large 3 | Mistral AI | 5 | European-developed |
| Grok 4 | xAI | 5 | Full capability variant |
| DeepSeek v3.2 | DeepSeek | 4 | Chinese-developed |
| Qwen 3 | Alibaba | 3 | Chinese-developed |
Total: ~60 independent lists comprising ~41,000 individual figure rankings.
Core prompt (current)
Every list is generated with the same prompt to maintain comparability. This prompt is reused verbatim across models.
Role: You are a senior historian and data scientist specializing in "Historiometry"âthe statistical analysis of historical data. Task: Generate a ranked list of the 1,000 most influential figures in world history. Ranking Criteria: "Importance" must be calculated based on the following three metrics: Breadth: The geographic extent of their influence (Global vs. Regional). Depth: The degree to which they fundamentally altered human behavior, thought, or the state of the world. Longevity: The duration of their impact across centuries. Strict Constraints to Prevent Clustering: No Categorical Grouping: Do not group figures by profession, era, or nationality. This is a singular, linear competition of impact. For example, if rank #450 is a scientist and #451 is a poet, it must be because the scientistâs total score marginally exceeds the poetâs, not because you are listing "famous scientists" and then "famous poets." Linear Degradation: The list must represent a true descending order of influence. Rank #1 must be demonstrably more influential than #100, and #500 more than #1000. Global Balance: Ensure the list reflects major figures based on what you determine to be their objective historical weight, not just fame in one culture or region. Output Format: Provide the data in a raw JSON array of objects. Each object must contain: {"rank": integer, "name": "string", "primary_contribution": "string"} Technical Instruction: Do not include introductory or concluding conversational textâoutput the JSON block only. output the FULL list with no duplicates.Ranking method
Each model contributes multiple lists. We average ranks within a model, then compute a consensus rank across models. If a model omits a figure, that omission is treated as rank 1001 (just below the top 1,000 cutoff). This prevents two-model outliers from dominating and captures the implicit judgment that a missing figure is less important than any ranked entry.
Variance and disagreement
Variance is calculated across the padded model ranks (including 1001 for omissions). High variance indicates contested figures, sparse agreement, or strong model disagreement. These are often the most interesting cases, revealing how differently models weigh ideology, scientific innovation, or cultural legacy.
Name reconciliation
Model outputs vary in spelling, honorifics, and transliteration. Names are normalized and mapped to canonical figure IDs via alias tables (for example: âSiddhartha Gautamaâ â âGautama Buddhaâ). Manual merges remove duplicates so each historical figure appears once.
Geography + metadata
Birthplaces, regions, and descriptions are drawn from Wikipedia and Wikidata. Regions are intentionally stable across eras to support cross-temporal comparisons and map-based views. Each figure has a birthplace coordinate for future globe visualizations.
Interpretation: history + model behavior
The list is not just a ranking; it is a lens on model reasoning. LLMs struggle with this task because "importance" is not a stable, objective quantity. By making the model explanations visible in the detail panel, HistoryRank treats the list as an interpretive argument rather than a scoreboard.
Over time, this allows comparative analysis: how do models diverge on religious figures, colonial leaders, or scientific innovators? Which traditions or regions are consistently underweighted?
The circularity problem
There is an obvious methodological concern: LLMs are trained on human texts. When we ask them to rank historical figures, are they doing anything more than reflecting back the existing historiographical consensus?
In one sense, yesâthat's exactly what they're doing. An LLM has no independent access to the past. It cannot evaluate Caesar's military campaigns or Confucius's teachings except through the lens of what humans have written about them.
But the circularity is less damning than it first appears. The training corpora for modern LLMs include texts from many cultures, time periods, and perspectivesâfar more than any individual human could synthesize. When Claude and GPT disagree about the relative importance of a figure, that disagreement reflects genuine tensions in the historical record, weighted differently by different training approaches.
We treat this not as a bug but as a feature. The consensus ranking represents what the accumulated text of human civilization, filtered through multiple model architectures, collectively "believes" about historical importance. The patterns of agreement and disagreement are themselves the data.
Model quality and exclusions
Not all models can complete this task reliably. The "rank 1,000 most influential people in history" challenge turns out to be a surprisingly effective test of frontier model capabilities. Only a handful of current models can maintain coherent global reasoning across 1,000 entries without falling into failure modes.
The most common failure is what we call autoregressive pattern collapse: the model loses track of the task constraint ("rank by historical importance") and instead starts optimizing for local sequence prediction ("what comes next in this pattern"). By rank 500â700, weaker models often fall into "local minima" where they generate long sequences of thematically similar entries that have no business appearing on a list of history's most important figures.
Case Study: GLM 4.7
Zhipu AI's GLM 4.7 produced lists that exemplify this failure mode. Around rank 615, the model encountered a legitimate entry (possibly Arvydas Sabonis, a notable figure in basketball history) and then generated over 20 consecutive entries of obscure Lithuanian basketball players:
{
"rank": 615,
"name": "Edgaras Ulanovas",
"primary_contribution": "Lithuanian basketball player; small forward."
},
{
"rank": 616,
"name": "Rokas Jokubaitis",
"primary_contribution": "Lithuanian basketball player; point guard."
},
{
"rank": 617,
"name": "Ignas VaitiekĹŤnas",
"primary_contribution": "Lithuanian basketball player; power forward."
},
{
"rank": 618,
"name": "Karolis LukoĹĄiĹŤnas",
"primary_contribution": "Lithuanian basketball player; center."
},
{
"rank": 619,
"name": "Paulius Sarpalis",
"primary_contribution": "Lithuanian basketball player; center."
},
{
"rank": 620,
"name": "Dovydas Giedvila",
"primary_contribution": "Lithuanian basketball player; shooting guard."
},
// ... continues for 15+ more entries, cycling through positions
{
"rank": 633,
"name": "Arvydas Sabonis",
"primary_contribution": "Lithuanian basketball player; center; one of the best international players ever."
}Notice that genuinely notable figures (Arvydas Sabonis, Ĺ arĹŤnas MarÄiulionis) appear afterobscure current playersâthe model is no longer ranking by importance but playing "what comes next." This represents a fundamental failure to maintain the task constraint across the generation window.
Failure Taxonomy
We identified four distinct failure modes during testing:
- Pattern Collapse: The model falls into "local minima," generating long sequences of thematically similar entries (e.g., 20+ consecutive basketball players) while losing track of the ranking criterion.
- Repetition: The same figures appear multiple times throughout the list. In severe cases, a single figure like Socrates might appear 20+ times across different ranks.
- Category Cycling: The model mechanically alternates through categories (scientist, artist, ruler, scientist, artist, ruler...) rather than producing an integrated ranking.
- Output Truncation: The model cannot generate 1,000 entries in a single pass due to output token limits, producing incomplete or malformed JSON.
Excluded Models
The following table summarizes models that were tested but excluded from the consensus rankings. Quality metrics are averages across all test lists for each model.
| Model | Developer | Failure Mode | Avg Duplicates | Max Pattern Seq | Lists Tested |
|---|---|---|---|---|---|
| Qwen 3 | Alibaba | Repetition | 404â920 | 12â17 | 6 |
| GLM 4.7 | Zhipu AI | Pattern Collapse | 225 | 20+ | 3 |
| Mistral Large 3 | Mistral AI | Pattern Collapse | 275 | 328 | 5 |
| Claude Haiku 4.5 | Anthropic | Category Cycling | 268 | 97 | 1 |
| GPT-5.2 Mini | OpenAI | Repetition (padding) | N/A | N/A | 1 |
| Llama 4 Maverick | Meta | Output Truncation | â | â | 3 attempts |
| Amazon Nova Pro | AWS | Output Truncation | â | â | 3 attempts |
Exclusion Criteria
A model was excluded from the consensus if it met any of the following criteria:
- Repetition threshold: More than 50 exact duplicate names per list on average (representing a 5%+ error rate).
- Pattern collapse threshold: More than 30 consecutive entries with similar primary_contribution text (indicating loss of ranking criterion).
- Structural failure: Inability to produce valid JSON with 1,000 sequential entries in a single generation pass.
These thresholds were chosen to exclude only severe failures while tolerating minor imperfections. Even well-performing models like Claude Opus 4.5 occasionally produce lists with 5â10 duplicates; such minor errors do not warrant exclusion. The goal is to distinguish between models that can meaningfully complete the task versus those that fundamentally cannot.
Implications
The pattern of failures reveals something interesting: the ability to complete this task is not uniformly distributed across model architectures or price points. Several observations stand out:
- Size alone is insufficient. Llama 4 Maverick (400B parameters) failed due to output truncation, while DeepSeek V3 (671B) succeeds. The difference appears to be output token limits and architecture rather than raw parameter count.
- Smaller models from the same family fail. Claude Haiku fails where Opus succeeds; GPT-5.2 Mini fails where GPT-5.2-Thinking succeeds. The task requires capabilities that don't survive model compression.
- Chinese models show mixed results. DeepSeek V3 performs adequately, but Qwen 3 and GLM 4.7 exhibit severe failures. This suggests the issues are model-specific rather than related to training data geography.
- European models struggled. Mistral Large 3 showed the worst pattern collapse of any model tested (328 consecutive similar entries on average). This may reflect architectural choices or training priorities that deprioritize sustained long-form generation.
We treat these failures not as defects to be worked around but as data about model capabilities. The "rank 1,000 figures" task functions as an implicit capability filter, and documenting which models pass or fail contributes to understanding the current landscape of frontier AI systems.
Limitations and bias
Every source here is partial. Wikipedia reflects modern attention. Pantheon reflects an academic framing. LLMs inherit their training data and may amplify dominant narratives. The project treats these biases as data: where they align, where they diverge, and where they are silent.
What We've Learned So Far
After collecting rankings from 10 models across 60 independent samples, several patterns have emerged:
- Scientists rise relative to conquerors. Compared to traditional "great figures" lists, LLMs consistently elevate Newton, Darwin, and Einstein relative to Alexander, Napoleon, and Genghis Khan.
- Religious founders remain central. Jesus, Muhammad, Buddha, and Confucius appear in every model's top tier, suggesting cross-cultural robustness in training data.
- Modern figures are volatile. 20th-century figures show the highest variance. Models disagree sharply about Mao, Churchill, Gandhi, and Einstein's relative positions.
- Chinese models differ measurably. DeepSeek and Qwen show statistically different rankings for Chinese historical figures compared to Western-developed models.
- Women remain underrepresented. Despite prompt language encouraging global balance, female figures rarely break the top 50 in any model's ranking. This likely reflects the historical record itself rather than model bias.
Roadmap
Completed
- ⢠Map and timeline views for geographic and temporal exploration
- ⢠Model comparison tools (radar charts, outlier detection, pairwise scatter)
- ⢠Domain and era bias visualization
- ⢠Figure detail panels with Wikipedia integration
- ⢠Media atlas linking figures to cultural artifacts
In Progress
- ⢠Expanding to 10+ lists per model for statistical stability
- ⢠Adding more Chinese-developed models for cross-cultural comparison
- ⢠Refining domain and era classifications
Planned
- ⢠Multilingual prompts (French, Mandarin, Arabic, Russian, Hindi)
- ⢠Prompt sensitivity analysis (varying definitions of "influence")
- ⢠Public API for researchers
- ⢠User voting layer to compare human vs. AI consensus
Future work
Our next phase extends the current benchmark in two directions: prompt sensitivity and cross-lingual comparison. We will run two prompt variants in parallel: the current prompt and a matched version that removes the global balance instruction. Each model will produce 10 independent lists under each prompt, letting us compare stability within a prompt and shifts between prompts.
We will also translate the prompt into multiple languages (Arabic, Farsi, Mandarin, Russian, French, Spanish, Hindi) while keeping the JSON keys in English. Each language will be sampled with the same number of lists per model to enable clean comparisons.
Planned analyses include rank correlations across prompts and languages, top-k overlap, and distribution shifts by era, region, and domain. These results will be reported alongside within-model stability metrics to clarify which differences reflect model priors versus prompt framing.
February 2026 update
We introduced a new âWeighted Avg v3â view that combines all three list pools (v1, v2, and v3) while adding robust weighting and quality filters.
- Weighted v3 aggregates lists from `data/raw`, `data/raw_v2`, and `data/raw_v3`.
- Model IDs are canonicalized (e.g., `gpt-5.2`/`gpt-5.2-thinking` and `gpt-5.3`/`gpt-5.3-thinking` are merged).
- Canonical model weights are derived from cross-model reliability analysis.
- Weights are coverage-aware: shorter lists contribute less via a â(coverage) penalty.
- Missing ranks are imputed as (list length + 1), so shorter lists do not inflate impact.
- Bayesian shrinkage pulls sparse-coverage figures toward a neutral prior.
- Alias + merge remapping collapses known duplicates before aggregation.
- Worst 10 lists (by combined quality + advanced name hygiene metrics) are excluded from v3 weighted:
- GLM 4.7 LIST 3 (January 14, 2026).txt
- Mistral Large 3 LIST 5 (January 18, 2026).txt
- Qwen3 235B A22B LIST 7 (January 14, 2026).txt
- GLM 4.7 LIST 2 (January 14, 2026).txt
- Grok 4 LIST 1 (January 14, 2026).txt
- Mistral Large 3 LIST 4 (January 17, 2026).txt
- Grok 4.1 Fast LIST 1 (January 14, 2026).txt
- Mistral Large 3 LIST 1 (January 15, 2026).txt
- Grok 4 LIST 3 (January 14, 2026).txt
- Claude Sonnet 4.5 LIST 3 (January 12, 2025).txt