← Analyses

Benchmark trust leaderboard

Every benchmark in the catalog ranked by a composite trust score derived from the integrity classifications already mined in benchmark integrity. Peer-reviewed mentions raise the score, independently-verified mentions raise it a little more, disputed mentions push it down, and an all-vendor-claimed benchmark with ≥5 citations takes an orphan penalty on top. This is derived data — not an opinion — and the per-benchmark drilldown shows you exactly which systems contributed to each bucket.

25 benchmarks ranked · formula in $lib/analyses/benchmark-trust.ts.

Most trusted (top 5)

highest composite scores
  1. 1 ALFWorld 100.0 High 9 peer-reviewed · 9 total
  2. 2 AppWorld 100.0 High 2 peer-reviewed · 2 total
  3. 3 BABILong 100.0 High 5 peer-reviewed · 5 total
  4. 4 BrowseComp 100.0 High 4 peer-reviewed · 4 total
  5. 5 HotpotQA 100.0 High 10 peer-reviewed · 10 total

Most gamed (bottom 5)

≥5 vendor-claimed mentions only
  1. 1 MMLU 17.6 Compromised 14 vendor-claimed · 0 disputed

Full leaderboard

Click any column header to sort. Click a row to expand its list of citing systems with each system's integrity classification.

ALFWorld mentions-only 100.0 9———9High
AppWorld mentions-only 100.0 2———2High
BABILong 2y 9mo100.0 5———5High
BrowseComp 2y 7mo100.0 4———4High
HotpotQA mentions-only 100.0 10———10High
ImplicitMemBench 7mo100.0 1———1High
LongBench 3y 4mo100.0 3———3High
Mind2Web 3y 7mo100.0 2———2High
MT-Bench mentions-only 100.0 3———3High
NaturalQuestions mentions-only 100.0 4———4High
NIAH 3y100.0 7———7High
PersonaBench mentions-only 100.0 1———1High
RULER 2y 7mo100.0 3———3High
ScienceWorld mentions-only 100.0 2———2High
TriviaQA mentions-only 100.0 2———2High
GAIA 78.6 11—3—14High
LoCoMo 1y 10mo54.5 2222531Medium
MemoryAgentBench 1y 5mo50.0 1—1—2Medium
WebArena 3y 4mo30.0 3—115Low
MMLU mentions-only 17.6 3—14—17Compromised
OSWorld 2y 7mo12.5 2—114Compromised
AIME mentions-only 0.0 2——68Compromised
ConvoMem mentions-only 0.0 ——112Compromised
LongMemEval 2y 1mo0.0 101—819Compromised
SWE-bench 3y 1mo0.0 313512Compromised
← Analyses hub Derived from integrity classifications in $lib/analyses/benchmark-integrity.ts. Score formula in $lib/analyses/benchmark-trust.ts.