AI Model Benchmark Comparison

Compare two models on common benchmark versions collected from original benchmark publishers.

Interactive Tool

Build a Scenario

Runs in your browser
Model A
Search by model, developer, or canonical ID.
Model B
Search by model, developer, or canonical ID.
ResultValueHow to read it
Common benchmark rows8Same benchmark, version, and metric for both models.
Model A published rows8Claude Fable 5
Model B published rows9Claude Fable 5.1
BenchmarkVersion and metricClaude Fable 5Claude Fable 5.1Publisher
ARC-AGI-1verified-v1-613c385b0c93verified_score · higher is better98.5 percent97.5 percentARC Prize Foundation
ARC-AGI-2verified-v2-be40992860f9verified_score · higher is better89.166667 percent90 percentARC Prize Foundation
LiveBench2026-06-25-90f8d44da965overall · higher is better86.550183 percent86.816836 percentLiveBench
LMArena Agent Arenaagent-2026-10-16-a64ca3b12b6eoutcome_score · higher is better8.181926 score14.032177 scoreLMArena
LMArena Document Arenadocument-2026-09-13-a64ca3b12b6earena_rating · higher is better1496.082236 rating1512.584319 ratingLMArena
LMArena Search Arenasearch-2026-10-13-a64ca3b12b6earena_rating · higher is better1229.139752 rating1245.845434 ratingLMArena
LMArena Vision Arenavision-2026-10-09-a64ca3b12b6earena_rating · higher is better1323.954428 rating1318.239621 ratingLMArena
ToneBench2026-10-17-10-task-e9c76358afb2overall_score · higher is better81.9 points83.41 pointsTowards AI

Rows come from original benchmark publishers. Open the source and protocol before treating a score difference as a general winner.

Inputs

What the Calculation Needs

1 input groups
InputHow it is used
Model A and BTwo catalog versions with published benchmark mappings.

Methodology

Rows are joined only when both models have results for the same benchmark slug, version, and metric. Directionality comes from the benchmark definition rather than an assumed higher-is-better rule.

How to Interpret the Result

Read the evaluation protocol and source artifact before calling a winner. A result can be publisher-verified without being an independent Model Markets measurement.

Boundaries

What the Result Does Not Prove

  1. No common rows means insufficient comparable evidence, not a tie.
  2. Scores across different benchmarks are not directly interchangeable.
  3. Sampling uncertainty and configuration differences can change apparent ordering.

Catalog values retain their source and freshness on the linked model, provider, benchmark, or comparison page. Editable scenario assumptions are not Model Markets measurements.

Continue the Analysis

Related Tools

All tools →
ToolNext question
Model SelectorTurn workload constraints into a short, inspectable model shortlist instead of a universal best-model claim.
Price vs PerformanceScreen for models that combine useful published performance with acceptable token economics.
Reasoning ModelsShortlist reasoning models while keeping output-token economics and evidence coverage visible.

Questions

Benchmark Comparison FAQs

What does the AI Model Benchmark Comparison calculate?+

Inspect like-for-like published results without blending incompatible metrics or versions. It returns common benchmark rows with version, metric, scores, direction, publisher, and source recency.

Does the AI Model Benchmark Comparison use current model data?+

Where the calculation needs model facts, it uses the current Model Markets catalog snapshot updated 2026-10-19. User-entered assumptions remain clearly editable, and unsupported values stay unknown rather than being inferred.

What should I verify before using the AI Model Benchmark Comparison result?+

No common rows means insufficient comparable evidence, not a tie. Scores across different benchmarks are not directly interchangeable. Sampling uncertainty and configuration differences can change apparent ordering. Open the linked canonical records and primary sources before making a production or purchasing decision.

Send Feedback