Benchmarks

Verified primary-publisher scores with explicit acquisition, mapping, and exclusion coverage.

Directory

Benchmark Types

View aggregate rankings →
Aider Polyglotpolyglot-225-5dc9490bb35fAidercoding6913105634.5%Mapped rows excluded56 source IDs need review
ARC-AGI-1verified-v1-613c385b0c93ARC Prize Foundationabstract-reasoning265224484117621.7%Mapped rows excluded41 source IDs need review
ARC-AGI-2verified-v2-be40992860f9ARC Prize Foundationabstract-reasoning265220484517221.7%Mapped rows excluded45 source IDs need review
Berkeley Function Calling Leaderboardv4-ede5081a24bcBerkeley Function Calling Leaderboardtool-use109281881108.1%Mapped rows excluded81 source IDs need review
LiveBench2026-06-25-90f8d44da965LiveBenchgeneral-language71585513324.9%Mapped rows excluded13 source IDs need review
LMArena Agent Arenaagent-2026-10-16-a64ca3b12b6eLMArenaagentic5218183408.1%Mapping incomplete34 source IDs need review
LMArena Document Arenadocument-2026-09-13-a64ca3b12b6eLMArenaknowledge-work4439335614.9%Mapped rows excluded5 source IDs need review
LMArena Search Arenasearch-2026-10-13-a64ca3b12b6eLMArenasearch42313011113.6%Mapped rows excluded11 source IDs need review
LMArena Text Arenatext-2026-10-15-a64ca3b12b6eLMArenageneral-language4169586321938.9%Mapped rows excluded321 source IDs need review
LMArena Vision Arenavision-2026-10-09-a64ca3b12b6eLMArenamultimodal165675898926.2%Mapped rows excluded98 source IDs need review
ToneBench2026-10-17-10-task-e9c76358afb2Towards AIwriting1349355413824.9%Mapped rows excluded41 source IDs need review

Select a benchmark to view its model leaderboard. Mapped rows have an exact catalog identity; unmapped source IDs remain quarantined.

Results

Model Benchmark Scores

GPT-5OpenAIAider Polyglotpolyglot-225-5dc9490bb35f88.00percent11,659.7225diff; aider 0.86.2.dev; reasoning hightotalRecomputedwinner eligibleThird-party benchmark
GPT-5OpenAIAider Polyglotpolyglot-225-5dc9490bb35f86.67percent6,528225diff; aider 0.86.2.dev; reasoning mediumtotalRecomputedwinner eligibleThird-party benchmark
GPT-5OpenAIAider Polyglotpolyglot-225-5dc9490bb35f81.33percent3,464.7225diff; aider 0.86.2.dev; reasoning lowtotalRecomputedwinner eligibleThird-party benchmark
Kimi K2 InstructMoonshot AIAider Polyglotpolyglot-225-5dc9490bb35f59.11percent1,617.1225diff; aider 0.85.3.devtotalRecomputedwinner eligibleThird-party benchmark
GPT-4.1OpenAIAider Polyglotpolyglot-225-5dc9490bb35f52.44percent—225diff; aider 0.81.4.devunknownRecomputedwinner eligibleThird-party benchmark
gpt-oss-120bOpenAIAider Polyglotpolyglot-225-5dc9490bb35f41.78percent3,806.6225diff; aider 0.85.3.devtotalRecomputedwinner eligibleThird-party benchmark
GPT-4.1 MiniOpenAIAider Polyglotpolyglot-225-5dc9490bb35f32.44percent—225diff; aider 0.81.4.devunknownRecomputedwinner eligibleThird-party benchmark
GPT-4oOpenAIAider Polyglotpolyglot-225-5dc9490bb35f23.11percent—225diff; aider 0.70.1.devunknownRecomputedwinner eligibleThird-party benchmark
Llama 4 Maverick 17B 128E InstructMetaAider Polyglotpolyglot-225-5dc9490bb35f15.56percent—225whole; aider 0.81.2.devunknownRecomputedwinner eligibleThird-party benchmark
Command ACohereAider Polyglotpolyglot-225-5dc9490bb35f12.00percent—225whole; aider 0.77.1.devunknownRecomputedwinner eligibleThird-party benchmark
GPT-4.1 NanoOpenAIAider Polyglotpolyglot-225-5dc9490bb35f8.89percent—225whole; aider 0.81.4.devunknownRecomputedwinner eligibleThird-party benchmark
GPT-4o MiniOpenAIAider Polyglotpolyglot-225-5dc9490bb35f3.56percent—225whole; aider 0.69.2.devunknownRecomputedwinner eligibleThird-party benchmark
Claude Fable 5AnthropicARC-AGI-1verified-v1-613c385b0c9398.50percent——Claude Fable 5 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5.5AnthropicARC-AGI-1verified-v1-613c385b0c9398.50percent——Claude Opus 5.5 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.8 FlashGoogle DeepMindARC-AGI-1verified-v1-613c385b0c9398.50percent——Gemini 3.8 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6.1 SolOpenAIARC-AGI-1verified-v1-613c385b0c9398.50percent——GPT-6.1 Sol (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 AstraOpenAIARC-AGI-1verified-v1-613c385b0c9398.50percent——GPT-6 Astra (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindARC-AGI-1verified-v1-613c385b0c9398.00percent——Gemini 3.1 Pro (Preview)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5.1AnthropicARC-AGI-1verified-v1-613c385b0c9397.50percent——Claude Fable 5.1 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5AnthropicARC-AGI-1verified-v1-613c385b0c9397.50percent——Claude Opus 5 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 SolOpenAIARC-AGI-1verified-v1-613c385b0c9397.50percent——GPT-5.6 Sol (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5 ProOpenAIARC-AGI-1verified-v1-613c385b0c9396.50percent——GPT-5.5 Pro (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 TerraOpenAIARC-AGI-1verified-v1-613c385b0c9396.50percent——GPT-5.6 Terra (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.7 FlashGoogle DeepMindARC-AGI-1verified-v1-613c385b0c9395.50percent——Gemini 3.7 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 SolOpenAIARC-AGI-1verified-v1-613c385b0c9395.50percent——GPT-6 Sol (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAIARC-AGI-1verified-v1-613c385b0c9395.00percent——GPT-5.5 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4.1 FlashDeepSeekARC-AGI-1verified-v1-613c385b0c9394.50percent——DeepSeek V4.1 Flash (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 ProOpenAIARC-AGI-1verified-v1-613c385b0c9394.50percent——GPT-5.4 Pro (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K3Moonshot AIARC-AGI-1verified-v1-613c385b0c9394.50percent——Kimi K3 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicARC-AGI-1verified-v1-613c385b0c9394.00percent——Claude Opus 4.6 (120K, High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAIARC-AGI-1verified-v1-613c385b0c9393.67percent——GPT-5.4 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicARC-AGI-1verified-v1-613c385b0c9393.50percent——Claude 4.7 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicARC-AGI-1verified-v1-613c385b0c9392.50percent——Claude Opus 4.8 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindARC-AGI-1verified-v1-613c385b0c9392.50percent——Gemini 3.5 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindARC-AGI-1verified-v1-613c385b0c9391.17percent——Gemini 3.6 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 LunaOpenAIARC-AGI-1verified-v1-613c385b0c9390.67percent——GPT-5.6 Luna 2026-07-30 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4 Pro 0813DeepSeekARC-AGI-1verified-v1-613c385b0c9390.50percent——DeepSeek V4 Pro 0813 (Low)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2 ProOpenAIARC-AGI-1verified-v1-613c385b0c9390.50percent——GPT-5.2 Pro (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.7xAIARC-AGI-1verified-v1-613c385b0c9390.17percent——Grok 4.7 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.20 Multi AgentxAIARC-AGI-1verified-v1-613c385b0c9389.50percent——Grok 4.20 (Reasoning)unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4 FlashDeepSeekARC-AGI-1verified-v1-613c385b0c9389.00percent——DeepSeek V4 Flash 0731 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.6xAIARC-AGI-1verified-v1-613c385b0c9387.50percent——Grok 4.6 (Medium)unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.8 27BQwenARC-AGI-1verified-v1-613c385b0c9387.50percent——Qwen3.8-27B (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.5xAIARC-AGI-1verified-v1-613c385b0c9387.17percent——Grok 4.5 (Medium)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 LunaOpenAIARC-AGI-1verified-v1-613c385b0c9386.67percent——GPT-6 Luna (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicARC-AGI-1verified-v1-613c385b0c9386.50percent——Claude Sonnet 4.6 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAIARC-AGI-1verified-v1-613c385b0c9386.17percent——GPT-5.2 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Inkling SmallThinking Machines LabARC-AGI-1verified-v1-613c385b0c9384.00percent——Inkling Small (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
InklingThinking Machines LabARC-AGI-1verified-v1-613c385b0c9379.50percent——InklingunknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAIARC-AGI-1verified-v1-613c385b0c9372.83percent——GPT-5.1 (Thinking, High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 ProOpenAIARC-AGI-1verified-v1-613c385b0c9370.17percent——GPT-5 ProunknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5OpenAIARC-AGI-1verified-v1-613c385b0c9365.67percent——GPT-5 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicARC-AGI-1verified-v1-613c385b0c9363.67percent——Claude Sonnet 4.5 (Thinking 32K)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 MiniOpenAIARC-AGI-1verified-v1-613c385b0c9363.67percent——GPT-5.4 Mini (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 MiniOpenAIARC-AGI-1verified-v1-613c385b0c9354.33percent——GPT-5 Mini (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 Flash LiteGoogle DeepMindARC-AGI-1verified-v1-613c385b0c9353.50percent——Gemini 3.5 Flash-Lite (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 NanoOpenAIARC-AGI-1verified-v1-613c385b0c9351.50percent——GPT-5.4 Nano (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Haiku 4.5AnthropicARC-AGI-1verified-v1-613c385b0c9347.67percent——Claude Haiku 4.5 (Thinking 32K)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 NanoOpenAIARC-AGI-1verified-v1-613c385b0c9320.71percent——GPT-5 Nano (Medium)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1OpenAIARC-AGI-1verified-v1-613c385b0c935.50percent——GPT-4.1unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 AstraOpenAIARC-AGI-2verified-v2-be40992860f995.00percent——GPT-6 Astra (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6.1 SolOpenAIARC-AGI-2verified-v2-be40992860f994.17percent——GPT-6.1 Sol (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5.5AnthropicARC-AGI-2verified-v2-be40992860f993.33percent——Claude Opus 5.5 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 SolOpenAIARC-AGI-2verified-v2-be40992860f992.50percent——GPT-5.6 Sol (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5AnthropicARC-AGI-2verified-v2-be40992860f990.42percent——Claude Opus 5 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5.1AnthropicARC-AGI-2verified-v2-be40992860f990.00percent——Claude Fable 5.1 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 SolOpenAIARC-AGI-2verified-v2-be40992860f989.58percent——GPT-6 Sol (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5AnthropicARC-AGI-2verified-v2-be40992860f989.17percent——Claude Fable 5 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.8 FlashGoogle DeepMindARC-AGI-2verified-v2-be40992860f989.17percent——Gemini 3.8 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAIARC-AGI-2verified-v2-be40992860f985.00percent——GPT-5.5 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.7 FlashGoogle DeepMindARC-AGI-2verified-v2-be40992860f984.58percent——Gemini 3.7 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5 ProOpenAIARC-AGI-2verified-v2-be40992860f984.58percent——GPT-5.5 Pro (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 TerraOpenAIARC-AGI-2verified-v2-be40992860f983.90percent——GPT-5.6 Terra (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 ProOpenAIARC-AGI-2verified-v2-be40992860f983.33percent——GPT-5.4 Pro (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindARC-AGI-2verified-v2-be40992860f977.08percent——Gemini 3.1 Pro (Preview)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicARC-AGI-2verified-v2-be40992860f975.83percent——Claude 4.7 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAIARC-AGI-2verified-v2-be40992860f973.95percent——GPT-5.4 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4.1 FlashDeepSeekARC-AGI-2verified-v2-be40992860f972.92percent——DeepSeek V4.1 Flash (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicARC-AGI-2verified-v2-be40992860f972.08percent——Claude Opus 4.8 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindARC-AGI-2verified-v2-be40992860f972.08percent——Gemini 3.5 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicARC-AGI-2verified-v2-be40992860f969.17percent——Claude Opus 4.6 (120K, High)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.6xAIARC-AGI-2verified-v2-be40992860f967.08percent——Grok 4.6 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.20 Multi AgentxAIARC-AGI-2verified-v2-be40992860f965.14percent——Grok 4.20 (Reasoning)unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4 FlashDeepSeekARC-AGI-2verified-v2-be40992860f961.39percent——DeepSeek V4 Flash 0731 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.7xAIARC-AGI-2verified-v2-be40992860f961.39percent——Grok 4.7 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4 Pro 0813DeepSeekARC-AGI-2verified-v2-be40992860f961.25percent——DeepSeek V4 Pro 0813 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicARC-AGI-2verified-v2-be40992860f960.42percent——Claude Sonnet 4.6 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindARC-AGI-2verified-v2-be40992860f960.42percent——Gemini 3.6 Flash (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K3Moonshot AIARC-AGI-2verified-v2-be40992860f960.42percent——Kimi K3 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 LunaOpenAIARC-AGI-2verified-v2-be40992860f959.58percent——GPT-5.6 Luna 2026-07-30 (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 LunaOpenAIARC-AGI-2verified-v2-be40992860f959.31percent——GPT-6 Luna (Max)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2 ProOpenAIARC-AGI-2verified-v2-be40992860f954.16percent——GPT-5.2 Pro (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAIARC-AGI-2verified-v2-be40992860f952.91percent——GPT-5.2 (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.5xAIARC-AGI-2verified-v2-be40992860f952.64percent——Grok 4.5 (Medium)unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.8 27BQwenARC-AGI-2verified-v2-be40992860f942.36percent——Qwen3.8-27B (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
Inkling SmallThinking Machines LabARC-AGI-2verified-v2-be40992860f940.14percent——Inkling Small (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
InklingThinking Machines LabARC-AGI-2verified-v2-be40992860f936.53percent——InklingunknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 MiniOpenAIARC-AGI-2verified-v2-be40992860f918.90percent——GPT-5.4 Mini (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 ProOpenAIARC-AGI-2verified-v2-be40992860f918.33percent——GPT-5 ProunknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAIARC-AGI-2verified-v2-be40992860f917.64percent——GPT-5.1 (Thinking, High)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicARC-AGI-2verified-v2-be40992860f913.61percent——Claude Sonnet 4.5 (Thinking 32K)unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 Flash LiteGoogle DeepMindARC-AGI-2verified-v2-be40992860f910.28percent——Gemini 3.5 Flash-Lite (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5OpenAIARC-AGI-2verified-v2-be40992860f99.86percent——GPT-5 (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 NanoOpenAIARC-AGI-2verified-v2-be40992860f95.69percent——GPT-5.4 Nano (XHigh)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 MiniOpenAIARC-AGI-2verified-v2-be40992860f94.44percent——GPT-5 Mini (High)unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Haiku 4.5AnthropicARC-AGI-2verified-v2-be40992860f94.03percent——Claude Haiku 4.5 (Thinking 32K)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 NanoOpenAIARC-AGI-2verified-v2-be40992860f92.61percent——GPT-5 Nano (High)unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1OpenAIARC-AGI-2verified-v2-be40992860f90.42percent——GPT-4.1unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.5AnthropicBerkeley Function Calling Leaderboardv4-ede5081a24bc77.47percent——Claude-Opus-4-5-20251101 (FC)unknownRecomputedwinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicBerkeley Function Calling Leaderboardv4-ede5081a24bc73.24percent——Claude-Sonnet-4-5-20250929 (FC)unknownRecomputedwinner eligibleThird-party benchmark
Kimi K2 InstructMoonshot AIBerkeley Function Calling Leaderboardv4-ede5081a24bc59.06percent——Moonshotai-Kimi-K2-Instruct (FC)unknownRecomputedwinner eligibleThird-party benchmark
Gemini 2.5 FlashGoogle DeepMindBerkeley Function Calling Leaderboardv4-ede5081a24bc56.24percent——Gemini-2.5-Flash (FC)unknownRecomputedwinner eligibleThird-party benchmark
GPT-5.2OpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc55.87percent——GPT-5.2-2025-12-11 (FC)unknownRecomputedwinner eligibleThird-party benchmark
GPT-5 MiniOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc55.46percent——GPT-5-mini-2025-08-07 (FC)unknownRecomputedwinner eligibleThird-party benchmark
GPT-4.1OpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc53.96percent——GPT-4.1-2025-04-14 (FC)unknownRecomputedwinner eligibleThird-party benchmark
GPT-5 NanoOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc51.45percent——GPT-5-nano-2025-08-07 (FC)unknownRecomputedwinner eligibleThird-party benchmark
Gemini 2.5 FlashGoogle DeepMindBerkeley Function Calling Leaderboardv4-ede5081a24bc50.90percent——Gemini-2.5-Flash (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
GPT-4.1 MiniOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc50.45percent——GPT-4.1-mini-2025-04-14 (FC)unknownRecomputedwinner eligibleThird-party benchmark
Command ACohereBerkeley Function Calling Leaderboardv4-ede5081a24bc46.49percent——Command A (FC)unknownRecomputedwinner eligibleThird-party benchmark
GPT-5.2OpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc45.27percent——GPT-5.2-2025-12-11 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
GPT-4.1OpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc39.38percent——GPT-4.1-2025-04-14 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
Gemini 2.5 Flash LiteGoogle DeepMindBerkeley Function Calling Leaderboardv4-ede5081a24bc36.87percent——Gemini-2.5-Flash-Lite (FC)unknownRecomputedwinner eligibleThird-party benchmark
Claude Opus 4.5AnthropicBerkeley Function Calling Leaderboardv4-ede5081a24bc33.47percent——Claude-Opus-4-5-20251101 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
GPT-4.1 NanoOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc33.05percent——GPT-4.1-nano-2025-04-14 (FC)unknownRecomputedwinner eligibleThird-party benchmark
Llama 3.3 70B InstructMetaBerkeley Function Calling Leaderboardv4-ede5081a24bc31.90percent——Llama-3.3-70B-Instruct (FC)unknownRecomputedwinner eligibleThird-party benchmark
GPT-4.1 MiniOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc29.73percent——GPT-4.1-mini-2025-04-14 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
phi-4MicrosoftBerkeley Function Calling Leaderboardv4-ede5081a24bc28.79percent——Phi-4 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
Llama 4 Scout 17B 16E InstructMetaBerkeley Function Calling Leaderboardv4-ede5081a24bc28.13percent——Llama-4-Scout-17B-16E-Instruct (FC)unknownRecomputedwinner eligibleThird-party benchmark
Gemini 2.5 Flash LiteGoogle DeepMindBerkeley Function Calling Leaderboardv4-ede5081a24bc28.03percent——Gemini-2.5-Flash-Lite (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
GPT-5 MiniOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc27.83percent——GPT-5-mini-2025-08-07 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
GPT-5 NanoOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc27.55percent——GPT-5-nano-2025-08-07 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
Nova 2 LiteAmazonBerkeley Function Calling Leaderboardv4-ede5081a24bc27.10percent——Amazon-Nova-2-Lite-v1:0 (FC)unknownRecomputedwinner eligibleThird-party benchmark
Llama 3.1 8B InstructMetaBerkeley Function Calling Leaderboardv4-ede5081a24bc25.83percent——Llama-3.1-8B-Instruct (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicBerkeley Function Calling Leaderboardv4-ede5081a24bc24.90percent——Claude-Sonnet-4-5-20250929 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
GPT-4.1 NanoOpenAIBerkeley Function Calling Leaderboardv4-ede5081a24bc24.88percent——GPT-4.1-nano-2025-04-14 (Prompt)unknownRecomputedwinner eligibleThird-party benchmark
Ministral 8B Instruct 2410Mistral AIBerkeley Function Calling Leaderboardv4-ede5081a24bc11.10percent——Ministral-8B-Instruct-2410 (FC)unknownRecomputedwinner eligibleThird-party benchmark
Claude Fable 5.1AnthropicLiveBench2026-06-25-90f8d44da96586.82percent16,4701,270claude-fable-5-1-max-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Fable 5AnthropicLiveBench2026-06-25-90f8d44da96586.55percent20,2551,270claude-fable-5-max-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-6 AstraOpenAILiveBench2026-06-25-90f8d44da96586.47percent10,4071,270gpt-6-astra-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-6.1 SolOpenAILiveBench2026-06-25-90f8d44da96586.14percent10,3751,270gpt-6.1-sol-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Opus 5.5AnthropicLiveBench2026-06-25-90f8d44da96585.94percent25,6101,270claude-opus-5-5-max-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
Muse Spark 1.3MetaLiveBench2026-06-25-90f8d44da96585.47percent28,2341,270muse-spark-1.3-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-6.1 SolOpenAILiveBench2026-06-25-90f8d44da96585.35percent6,5941,270gpt-6.1-sol-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Opus 5.5AnthropicLiveBench2026-06-25-90f8d44da96585.30percent7,5081,270claude-opus-5-5-xhigh-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.6 SolOpenAILiveBench2026-06-25-90f8d44da96585.26percent11,7291,270gpt-5.6-sol-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.5OpenAILiveBench2026-06-25-90f8d44da96584.54percent11,3551,270gpt-5.5-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-6 SolOpenAILiveBench2026-06-25-90f8d44da96583.83percent17,1311,270gpt-6-sol-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Opus 5AnthropicLiveBench2026-06-25-90f8d44da96583.44percent14,8261,271claude-opus-5-max-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
DeepSeek V4.1 FlashDeepSeekLiveBench2026-06-25-90f8d44da96583.20percent36,3551,270deepseek-v4.1-flash-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
Gemini 3.7 FlashGoogle DeepMindLiveBench2026-06-25-90f8d44da96583.15percent22,6101,270gemini-3.7-flash-highaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.4OpenAILiveBench2026-06-25-90f8d44da96582.38percent18,2731,270gpt-5.4-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.6 TerraOpenAILiveBench2026-06-25-90f8d44da96582.31percent22,1451,270gpt-5.6-terra-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
Grok 4.7xAILiveBench2026-06-25-90f8d44da96582.20percent56,7761,270grok-4.7-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
Grok 4.6xAILiveBench2026-06-25-90f8d44da96582.17percent16,1541,270grok-4.6average per caseRecomputedwinner eligibleThird-party benchmark
DeepSeek V4 Pro 0813DeepSeekLiveBench2026-06-25-90f8d44da96581.91percent36,3391,270deepseek-v4-pro-0813average per caseRecomputedwinner eligibleThird-party benchmark
Qwen3.8 MaxQwenLiveBench2026-06-25-90f8d44da96581.88percent21,6371,270qwen3.8-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
Muse Spark 1.2MetaLiveBench2026-06-25-90f8d44da96581.88percent18,7001,270muse-spark-1.2-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindLiveBench2026-06-25-90f8d44da96581.66percent13,3801,270gemini-3.1-pro-preview-highaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLiveBench2026-06-25-90f8d44da96581.18percent24,1711,270claude-opus-4-8-max-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
Kimi K3Moonshot AILiveBench2026-06-25-90f8d44da96581.02percent13,6471,270kimi-k3average per caseRecomputedwinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicLiveBench2026-06-25-90f8d44da96580.97percent11,4601,270claude-opus-4-7-xhigh-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
Gemini 3.8 FlashGoogle DeepMindLiveBench2026-06-25-90f8d44da96580.85percent42,7861,270gemini-3.8-flash-highaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Sonnet 5AnthropicLiveBench2026-06-25-90f8d44da96580.01percent19,4281,270claude-sonnet-5-xhigh-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
Grok 4.5xAILiveBench2026-06-25-90f8d44da96580.01percent10,5171,270grok-4.5average per caseRecomputedwinner eligibleThird-party benchmark
DeepSeek V4 Flash Vision ExpDeepSeekLiveBench2026-06-25-90f8d44da96579.67percent52,6441,270deepseek-v4-flash-vision-expaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.2OpenAILiveBench2026-06-25-90f8d44da96579.21percent11,5121,270gpt-5.2-2025-12-11-highaverage per caseRecomputedwinner eligibleThird-party benchmark
GLM 5.3Z.aiLiveBench2026-06-25-90f8d44da96579.15percent62,0901,270glm-5.3average per caseRecomputedwinner eligibleThird-party benchmark
Qwen3.8 FlashQwenLiveBench2026-06-25-90f8d44da96579.12percent54,4381,270qwen3.8-flash-nextaverage per caseRecomputedwinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindLiveBench2026-06-25-90f8d44da96578.84percent15,5221,270gemini-3.5-flash-highaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicLiveBench2026-06-25-90f8d44da96578.69percent9,6511,270claude-opus-4-6-thinking-auto-high-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
Muse Spark 1.1MetaLiveBench2026-06-25-90f8d44da96578.57percent13,6521,270muse-spark-1.1-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
DeepSeek V4 FlashDeepSeekLiveBench2026-06-25-90f8d44da96578.08percent21,0791,270deepseek-v4-flash-0731average per caseRecomputedwinner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindLiveBench2026-06-25-90f8d44da96578.05percent14,7461,270gemini-3.6-flash-highaverage per caseRecomputedwinner eligibleThird-party benchmark
Qwen3.8 27BQwenLiveBench2026-06-25-90f8d44da96578.02percent28,7401,270qwen3.8-27baverage per caseRecomputedwinner eligibleThird-party benchmark
Qwen3.7 MaxQwenLiveBench2026-06-25-90f8d44da96577.50percent12,9091,270qwen3.7-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Opus 4.5AnthropicLiveBench2026-06-25-90f8d44da96577.39percent15,2031,270claude-opus-4-5-20251101-thinking-64k-high-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicLiveBench2026-06-25-90f8d44da96577.11percent13,2261,270claude-sonnet-4-6-thinking-auto-medium-effortaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.6 LunaOpenAILiveBench2026-06-25-90f8d44da96577.05percent21,7991,270gpt-5.6-luna-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
GLM 5.2Z.aiLiveBench2026-06-25-90f8d44da96576.96percent23,4631,270glm-5.2average per caseRecomputedwinner eligibleThird-party benchmark
DeepSeek V4 ProDeepSeekLiveBench2026-06-25-90f8d44da96576.79percent35,0141,270deepseek-v4-proaverage per caseRecomputedwinner eligibleThird-party benchmark
Mistral Large 4Mistral AILiveBench2026-06-25-90f8d44da96576.67percent25,6991,270mistral-large-4-highaverage per caseRecomputedwinner eligibleThird-party benchmark
InklingThinking Machines LabLiveBench2026-06-25-90f8d44da96576.47percent22,2131,270inkling-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-6 LunaOpenAILiveBench2026-06-25-90f8d44da96575.84percent35,8691,270gpt-6-luna-maxaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.4 NanoOpenAILiveBench2026-06-25-90f8d44da96575.27percent46,1791,246gpt-5.4-nano-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
Kimi K2.6Moonshot AILiveBench2026-06-25-90f8d44da96574.18percent27,0011,270kimi-k2.6-thinkingaverage per caseRecomputedwinner eligibleThird-party benchmark
NVIDIA Nemotron 3 Ultra 550B A55B BF16NVIDIALiveBench2026-06-25-90f8d44da96573.49percent41,6541,270nemotron-3-ultra-550b-a55baverage per caseRecomputedwinner eligibleThird-party benchmark
GLM 5.3 FlashZ.aiLiveBench2026-06-25-90f8d44da96573.27percent34,7071,270glm-5.3-flashaverage per caseRecomputedwinner eligibleThird-party benchmark
Kimi K2.7 CodeMoonshot AILiveBench2026-06-25-90f8d44da96571.45percent13,0071,270kimi-k2.7-codeaverage per caseRecomputedwinner eligibleThird-party benchmark
Grok Build 0.1xAILiveBench2026-06-25-90f8d44da96571.09percent9801,270grok-build-0.1average per caseRecomputedwinner eligibleThird-party benchmark
MiniMax M3MiniMaxLiveBench2026-06-25-90f8d44da96570.26percent15,5301,270minimax-m3average per caseRecomputedwinner eligibleThird-party benchmark
DeepSeek V4 FlashDeepSeekLiveBench2026-06-25-90f8d44da96569.67percent34,4341,270deepseek-v4-flashaverage per caseRecomputedwinner eligibleThird-party benchmark
GPT-5.4 MiniOpenAILiveBench2026-06-25-90f8d44da96569.53percent47,4481,257gpt-5.4-mini-xhighaverage per caseRecomputedwinner eligibleThird-party benchmark
Grok 4.3xAILiveBench2026-06-25-90f8d44da96569.27percent11,1841,270grok-4.3average per caseRecomputedwinner eligibleThird-party benchmark
Gemini 3.5 Flash LiteGoogle DeepMindLiveBench2026-06-25-90f8d44da96566.35percent11,5261,270gemini-3.5-flash-lite-highaverage per caseRecomputedwinner eligibleThird-party benchmark
Claude Fable 5.1AnthropicLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e14.03score—16,374Claude Fable 5.1 (Max); 95% CI [12.03932907, 16.02502568]; sessions 16374; observations 1913479; rank 3unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5AnthropicLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e8.68score—23,770Claude Opus 5 (Max); 95% CI [6.99592257, 10.36856205]; sessions 23770; observations 3146528; rank 8unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5AnthropicLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e8.18score—42,608Claude Fable 5 (High); 95% CI [6.75735259, 9.60649884]; sessions 42608; observations 2530600; rank 9unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 5AnthropicLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e4.58score—33,276Claude Sonnet 5 (High); 95% CI [2.88280252, 6.28024714]; sessions 33276; observations 3570560; rank 12unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.3MetaLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e3.82score—73,912Muse Spark 1.3 (Max); 95% CI [2.98809934, 4.65329623]; sessions 73912; observations 7381209; rank 14unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.8 FlashGoogle DeepMindLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e3.75score—37,692Gemini 3.8 Flash (High); 95% CI [2.64957678, 4.84993702]; sessions 37692; observations 5316787; rank 15unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.7xAILMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e3.21score—15,127Grok 4.7 (xHigh); 95% CI [1.57579589, 4.84117305]; sessions 15127; observations 2475030; rank 16unknownOriginal sourcewinner eligibleThird-party benchmark
Hy4 previewTencentLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e2.68score—84,828Hy4 preview; 95% CI [2.00929922, 3.35139547]; sessions 84828; observations 8314177; rank 20unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K3Moonshot AILMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e1.93score—135,415Kimi K3 (Max); 95% CI [1.20183745, 2.66737332]; sessions 135415; observations 12343129; rank 23unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.6xAILMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e0.89score—28,868Grok 4.6 (xHigh); 95% CI [-0.22077562, 2.00905409]; sessions 28868; observations 3315294; rank 28unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.7 FlashGoogle DeepMindLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-0.72score—54,989Gemini 3.7 Flash (High); 95% CI [-1.64184585, 0.19418642]; sessions 54989; observations 4923541; rank 32unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-4.00score—87,236Gemini 3.1 Pro Preview; 95% CI [-5.35690873, -2.63856355]; sessions 87236; observations 2815597; rank 39unknownOriginal sourcewinner eligibleThird-party benchmark
Hy3TencentLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-6.00score—31,296Hy3; 95% CI [-7.50774599, -4.49280945]; sessions 31296; observations 1149668; rank 41unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.2MetaLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-6.41score—51,435Muse Spark 1.2 (xHigh); 95% CI [-7.24140950, -5.58489868]; sessions 51435; observations 3268541; rank 43unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.1MetaLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-6.43score—145,940Muse Spark 1.1; 95% CI [-7.08799618, -5.77544358]; sessions 145940; observations 7748331; rank 44unknownOriginal sourcewinner eligibleThird-party benchmark
Mistral Medium 3.5 128BMistral AILMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-11.72score—12,762Mistral Medium 3.5; 95% CI [-13.50841359, -9.93416425]; sessions 12762; observations 527876; rank 49unknownOriginal sourcewinner eligibleThird-party benchmark
InklingThinking Machines LabLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-14.35score—43,507Inkling; 95% CI [-15.81859883, -12.88168979]; sessions 43507; observations 1662352; rank 50unknownOriginal sourcewinner eligibleThird-party benchmark
Solar Pro 4UpstageLMArena Agent Arenaagent-2026-10-16-a64ca3b12b6e-20.06score—10,243Solar Pro 4; 95% CI [-22.42702213, -17.68944380]; sessions 10243; observations 452978; rank 52unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,516.27rating—8,794claude-opus-5-high; 95% CI [1509.24512533, 1523.28765667]; votes 8794; rank 1unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5.1AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,512.58rating—1,403claude-fable-5.1-max; 95% CI [1497.40364732, 1527.76498981]; votes 1403; rank 2unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,507.32rating—27,929claude-opus-4-6-high; 95% CI [1500.89502415, 1513.74254503]; votes 27929; rank 3unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,507.05rating—41,260claude-opus-4-6; 95% CI [1501.18336037, 1512.92390326]; votes 41260; rank 4unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,496.08rating—8,497claude-fable-5; 95% CI [1488.22135990, 1503.94311259]; votes 8497; rank 5unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,495.04rating—22,192claude-opus-4-7; 95% CI [1488.66496264, 1501.41313008]; votes 22192; rank 6unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,494.71rating—21,957claude-opus-4-7-high; 95% CI [1488.20710383, 1501.21879014]; votes 21957; rank 7unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,485.72rating—21,279gpt-5.5; 95% CI [1479.48245578, 1491.95617143]; votes 21279; rank 8unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,484.48rating—20,944gpt-5.5-high; 95% CI [1478.10008380, 1490.85597001]; votes 20944; rank 9unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 SolOpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,482.71rating—4,818gpt-5.6-sol-xhigh; 95% CI [1473.91086026, 1491.51379085]; votes 4818; rank 10unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,482.24rating—57,813claude-sonnet-4-6; 95% CI [1476.36427265, 1488.10617859]; votes 57813; rank 11unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,474.79rating—11,551claude-opus-4-8-high; 95% CI [1467.88529316, 1481.69160653]; votes 11551; rank 12unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 TerraOpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,471.58rating—5,787gpt-5.6-terra-xhigh; 95% CI [1463.31179298, 1479.85049651]; votes 5787; rank 13unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,471.00rating—33,331gpt-5.4; 95% CI [1464.96841782, 1477.04032901]; votes 33331; rank 14unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.3MetaLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,470.66rating—1,006muse-spark-1.3-max; 95% CI [1452.36505006, 1488.94793707]; votes 1006; rank 15unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 AstraOpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,467.52rating—1,621gpt-6-astra-max; 95% CI [1453.25995337, 1481.78626802]; votes 1621; rank 16unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 5AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,466.14rating—7,411claude-sonnet-5-high; 95% CI [1458.49407458, 1473.77896309]; votes 7411; rank 17unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.1MetaLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,464.70rating—4,885muse-spark-1.1; 95% CI [1455.86175356, 1473.53929177]; votes 4885; rank 18unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,464.07rating—12,128claude-opus-4-8; 95% CI [1457.10320334, 1471.03216030]; votes 12128; rank 19unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,463.27rating—6,500gemini-3.5-flash-medium; 95% CI [1455.40466041, 1471.14299590]; votes 6500; rank 20unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.5AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,462.20rating—7,981claude-opus-4-5-20251101; 95% CI [1451.78988580, 1472.60655272]; votes 7981; rank 21unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,461.40rating—4,061gemini-3.5-flash-high; 95% CI [1452.14297727, 1470.66464631]; votes 4061; rank 22unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 LunaOpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,456.92rating—5,766gpt-5.6-luna-xhigh; 95% CI [1448.72029252, 1465.11301394]; votes 5766; rank 23unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,456.06rating—2,975gemini-3.6-flash-high; 95% CI [1445.28023002, 1466.83474253]; votes 2975; rank 24unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.6xAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,452.33rating—2,258grok-4.6-high; 95% CI [1440.31399734, 1464.34557688]; votes 2258; rank 25unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.5xAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,451.96rating—4,965grok-4.5; 95% CI [1443.26182849, 1460.65626012]; votes 4965; rank 26unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K2.6Moonshot AILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,450.74rating—11,291kimi-k2.6; 95% CI [1443.10467262, 1458.37474735]; votes 11291; rank 27unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,449.81rating—31,455claude-sonnet-4-5-20250929; 95% CI [1443.68972646, 1455.92640287]; votes 31455; rank 28unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.7 PlusQwenLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,444.14rating—4,591qwen3.7-plus; 95% CI [1435.12302267, 1453.16578005]; votes 4591; rank 30unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,443.92rating—49,457gemini-3.1-pro-preview; 95% CI [1438.69417039, 1449.14324048]; votes 49457; rank 31unknownOriginal sourcewinner eligibleThird-party benchmark
MiniMax M3MiniMaxLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,434.79rating—6,314minimax-m3; 95% CI [1426.53255805, 1443.05504941]; votes 6314; rank 32unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K2.5Moonshot AILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,430.10rating—21,569kimi-k2.5-thinking; 95% CI [1423.37027866, 1436.81983378]; votes 21569; rank 34unknownOriginal sourcewinner eligibleThird-party benchmark
Gemma 4 31BGoogle DeepMindLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,424.51rating—12,326gemma-4-31b; 95% CI [1416.71159012, 1432.31286462]; votes 12326; rank 35unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 2.5 ProGoogle DeepMindLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,421.23rating—25,110gemini-2.5-pro; 95% CI [1414.98072895, 1427.48825137]; votes 25110; rank 36unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Haiku 4.5AnthropicLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,419.97rating—34,677claude-haiku-4-5-20251001; 95% CI [1414.09579972, 1425.83505080]; votes 34677; rank 37unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3 FlashGoogle DeepMindLMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,412.99rating—7,158gemini-3-flash; 95% CI [1403.58694998, 1422.40270038]; votes 7158; rank 40unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,404.59rating—7,108gpt-5.2-high; 95% CI [1395.08956216, 1414.09210801]; votes 7108; rank 41unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,403.17rating—8,244gpt-5.1; 95% CI [1393.82886201, 1412.50542979]; votes 8244; rank 42unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Document Arenadocument-2026-09-13-a64ca3b12b6e1,401.12rating—28,212gpt-5.2; 95% CI [1395.19508120, 1407.03614053]; votes 28212; rank 44unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 SolOpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,261.13rating—60,437gpt-5.6-sol-xhigh; 95% CI [1254.84060485, 1267.42091382]; votes 60437; rank 1unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.8 MaxQwenLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,261.08rating—1,870qwen3.8-max; 95% CI [1247.89214823, 1274.26022415]; votes 1870; rank 2unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,251.37rating—173,191claude-opus-4-6-search; 95% CI [1246.82915739, 1255.90736955]; votes 173191; rank 3unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,246.55rating—125,957gpt-5.5-search; 95% CI [1241.65410036, 1251.45490149]; votes 125957; rank 4unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5.1AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,245.85rating—12,782claude-fable-5.1-high; 95% CI [1238.79268797, 1252.89817971]; votes 12782; rank 5unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,241.57rating—13,285claude-opus-5-high; 95% CI [1234.69644002, 1248.43868868]; votes 13285; rank 6unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 AstraOpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,233.62rating—18,483gpt-6-astra-max; 95% CI [1225.77363708, 1241.45798456]; votes 18483; rank 7unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6.1 SolOpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,233.10rating—5,555gpt-6.1-sol-max; 95% CI [1224.24145466, 1241.96324521]; votes 5555; rank 8unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,230.15rating—127,506claude-opus-4-7; 95% CI [1225.28137992, 1235.01180806]; votes 127506; rank 9unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,229.14rating—73,596claude-fable-5-high; 95% CI [1222.63001070, 1235.64949261]; votes 73596; rank 10unknownOriginal sourcewinner eligibleThird-party benchmark
ERNIE 5.1BaiduLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,226.72rating—4,024ernie-5.1; 95% CI [1217.24341628, 1236.18668968]; votes 4024; rank 11unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,220.50rating—173,986claude-sonnet-4-6-search; 95% CI [1216.03052081, 1224.97904735]; votes 173986; rank 12unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.5xAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,215.94rating—76,458grok-4.5; 95% CI [1210.07957437, 1221.79459071]; votes 76458; rank 13unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5.5AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,212.75rating—10,842claude-opus-5.5-medium; 95% CI [1205.66309681, 1219.84195206]; votes 10842; rank 14unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,208.81rating—151,436gemini-3.1-pro-grounding; 95% CI [1204.12797055, 1213.48336905]; votes 151436; rank 15unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,207.24rating—55,634gpt-5.2-search; 95% CI [1201.69874997, 1212.78027063]; votes 55634; rank 16unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.20 Multi AgentxAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,204.80rating—126,238grok-4.20-multi-agent-beta-0309; 95% CI [1199.36322528, 1210.23649279]; votes 126238; rank 18unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,204.11rating—106,304claude-opus-4-8; 95% CI [1198.48669076, 1209.73163091]; votes 106304; rank 19unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,199.70rating—63,042gpt-5.1-search; 95% CI [1194.51255947, 1204.89089087]; votes 63042; rank 20unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,199.08rating—126,730gpt-5.4-search; 95% CI [1193.60193056, 1204.56536227]; votes 126730; rank 21unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3 FlashGoogle DeepMindLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,195.69rating—196,399gemini-3-flash-grounding; 95% CI [1191.39370466, 1199.99583788]; votes 196399; rank 22unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.5AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,179.58rating—65,047claude-opus-4-5-search; 95% CI [1173.98777416, 1185.18060388]; votes 65047; rank 25unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 SolOpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,174.91rating—11,313gpt-6-sol-max; 95% CI [1167.83636087, 1181.98711987]; votes 11313; rank 26unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,171.46rating—79,796gpt-5.2-search-non-reasoning; 95% CI [1165.94554809, 1176.98399625]; votes 79796; rank 27unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.3xAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,165.81rating—128,393grok-4.3; 95% CI [1161.07351221, 1170.53848666]; votes 128393; rank 30unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,160.27rating—144,153claude-sonnet-4-5-search; 95% CI [1155.14751166, 1165.38826265]; votes 144153; rank 31unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 LunaOpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,159.56rating—10,793gpt-6-luna-max; 95% CI [1152.33057533, 1166.78316335]; votes 10793; rank 32unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 2.5 ProGoogle DeepMindLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,142.80rating—86,689gemini-2.5-pro-grounding; 95% CI [1138.12227943, 1147.47015160]; votes 86689; rank 35unknownOriginal sourcewinner eligibleThird-party benchmark
Sonar Reasoning ProPerplexityLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,139.01rating—29,439ppl-sonar-reasoning-pro-high; 95% CI [1133.19180048, 1144.81939817]; votes 29439; rank 37unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5OpenAILMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,133.49rating—20,865gpt-5-search; 95% CI [1127.51131313, 1139.47049228]; votes 20865; rank 38unknownOriginal sourcewinner eligibleThird-party benchmark
Sonar ProPerplexityLMArena Search Arenasearch-2026-10-13-a64ca3b12b6e1,130.28rating—28,899ppl-sonar-pro-high; 95% CI [1124.47147876, 1136.08107434]; votes 28899; rank 39unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.8 MaxQwenLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,482.88rating—27,766qwen3.8-max; 95% CI [1477.92809424, 1487.82635626]; votes 27766; rank 17unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,482.02rating—48,486gemini-3.5-flash-high; 95% CI [1478.14855340, 1485.88478693]; votes 48486; rank 18unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,479.31rating—36,122gemini-3.6-flash-high; 95% CI [1474.91726787, 1483.70716010]; votes 36122; rank 21unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,477.42rating—47,292gemini-3.5-flash-medium; 95% CI [1473.29723956, 1481.53686131]; votes 47292; rank 23unknownOriginal sourcewinner eligibleThird-party benchmark
GLM 5.3Z.aiLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,471.46rating—22,543glm-5.3-max; 95% CI [1466.26042381, 1476.65163576]; votes 22543; rank 27unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,471.34rating—69,401gpt-5.5-high; 95% CI [1467.64988983, 1475.02964305]; votes 69401; rank 28unknownOriginal sourcewinner eligibleThird-party benchmark
GLM 5.3 FlashZ.aiLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,470.53rating—32,925glm-5.3-flash; 95% CI [1465.67476412, 1475.38456118]; votes 32925; rank 29unknownOriginal sourcewinner eligibleThird-party benchmark
GLM 5.2Z.aiLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,470.37rating—49,820glm-5.2-max; 95% CI [1466.22224854, 1474.51957977]; votes 49820; rank 31unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,468.97rating—64,776gpt-5.4-high; 95% CI [1465.23802304, 1472.70880445]; votes 64776; rank 33unknownOriginal sourcewinner eligibleThird-party benchmark
ERNIE 5.1BaiduLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,467.73rating—39,468ernie-5.1; 95% CI [1463.22136313, 1472.23707800]; votes 39468; rank 34unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,466.80rating—70,985gpt-5.5; 95% CI [1463.14500791, 1470.45729846]; votes 70985; rank 35unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3 FlashGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,465.71rating—31,325gemini-3-flash; 95% CI [1461.39670282, 1470.02720080]; votes 31325; rank 36unknownOriginal sourcewinner eligibleThird-party benchmark
GLM 5.1Z.aiLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,462.40rating—62,889glm-5.1; 95% CI [1458.83486169, 1465.97294166]; votes 62889; rank 39unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,461.08rating—64,100claude-opus-4-8-high; 95% CI [1457.20719685, 1464.94408250]; votes 64100; rank 40unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,457.87rating—70,931claude-sonnet-4-6; 95% CI [1454.37156748, 1461.36302648]; votes 70931; rank 41unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 2.5 ProGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,457.73rating—125,366gemini-2.5-pro; 95% CI [1455.29194111, 1460.15968303]; votes 125366; rank 42unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 SolOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,457.06rating—40,442gpt-5.6-sol-xhigh; 95% CI [1452.73485432, 1461.39117296]; votes 40442; rank 43unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K2.6Moonshot AILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,455.42rating—40,013kimi-k2.6; 95% CI [1451.01237282, 1459.83173802]; votes 40013; rank 44unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.7 PlusQwenLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,454.58rating—42,075qwen3.7-plus; 95% CI [1450.26283424, 1458.90144791]; votes 42075; rank 46unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,453.90rating—65,172claude-opus-4-8; 95% CI [1450.05936004, 1457.74353427]; votes 65172; rank 47unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,452.22rating—67,870gpt-5.4; 95% CI [1448.56177849, 1455.87949508]; votes 67870; rank 48unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4 ProDeepSeekLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,451.16rating—57,594deepseek-v4-pro; 95% CI [1447.27741116, 1455.03943137]; votes 57594; rank 49unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.5AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,450.88rating—72,899claude-opus-4-5-20251101; 95% CI [1447.77007872, 1453.98289133]; votes 72899; rank 50unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.20 Multi AgentxAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,450.27rating—64,946grok-4.20-multi-agent-beta-0309; 95% CI [1446.59423552, 1453.95404223]; votes 64946; rank 52unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.5AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,448.19rating—37,509claude-opus-4-5-20251101-high-32k; 95% CI [1444.36613918, 1452.02144591]; votes 37509; rank 54unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.5xAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,447.97rating—39,896grok-4.5; 95% CI [1443.63647354, 1452.30434473]; votes 39896; rank 56unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6.1 SolOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,447.67rating—6,320gpt-6.1-sol-max; 95% CI [1439.59979847, 1455.74908604]; votes 6320; rank 57unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 TerraOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,447.39rating—43,271gpt-5.6-terra-xhigh; 95% CI [1443.15823569, 1451.62460535]; votes 43271; rank 58unknownOriginal sourcewinner eligibleThird-party benchmark
GLM 5Z.aiLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,445.93rating—29,272glm-5; 95% CI [1441.71120059, 1450.14553038]; votes 29272; rank 60unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4 Pro 0813DeepSeekLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,445.55rating—9,800deepseek-v4-pro-high-20260813; 95% CI [1438.98161909, 1452.11869256]; votes 9800; rank 61unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K2.5Moonshot AILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,445.02rating—74,759kimi-k2.5-thinking; 95% CI [1441.75782956, 1448.27322629]; votes 74759; rank 62unknownOriginal sourcewinner eligibleThird-party benchmark
Gemma 4 31BGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,442.86rating—6,147gemma-4-31b; 95% CI [1435.47112822, 1450.25595360]; votes 6147; rank 67unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,442.74rating—41,651gpt-5.1-high; 95% CI [1439.06360530, 1446.41090056]; votes 41651; rank 68unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 AstraOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,442.69rating—12,163gpt-6-astra-max; 95% CI [1436.40189535, 1448.98654490]; votes 12163; rank 69unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3 FlashGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,442.38rating—91,039gemini-3-flash (thinking-minimal); 95% CI [1439.36658863, 1445.39123855]; votes 91039; rank 70unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 5AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,442.12rating—49,595claude-sonnet-5-high; 95% CI [1438.01344792, 1446.22951308]; votes 49595; rank 72unknownOriginal sourcewinner eligibleThird-party benchmark
InklingThinking Machines LabLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,441.38rating—40,648inkling; 95% CI [1437.08506747, 1445.68368363]; votes 40648; rank 74unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.8 27BQwenLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,440.55rating—23,294qwen3.8-27b; 95% CI [1435.47949951, 1445.61514077]; votes 23294; rank 75unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,438.42rating—82,688claude-sonnet-4-5-20250929; 95% CI [1435.57332334, 1441.27604162]; votes 82688; rank 79unknownOriginal sourcewinner eligibleThird-party benchmark
Hy3TencentLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,438.00rating—12,208hy3; 95% CI [1431.86907820, 1444.13361939]; votes 12208; rank 80unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.5 397B A17BQwenLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,437.72rating—93,567qwen3.5-397b-a17b; 95% CI [1434.65086689, 1440.78699055]; votes 93567; rank 81unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.5AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,434.58rating—83,940claude-sonnet-4-5-20250929-high-32k; 95% CI [1431.82164426, 1437.34230911]; votes 83940; rank 88unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 Flash LiteGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,434.52rating—35,851gemini-3.5-flash-lite; 95% CI [1430.05687105, 1438.97565121]; votes 35851; rank 89unknownOriginal sourcewinner eligibleThird-party benchmark
Gemma 4 26B A4BGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,434.12rating—6,094gemma-4-26b-a4b; 95% CI [1426.70039347, 1441.53160125]; votes 6094; rank 90unknownOriginal sourcewinner eligibleThird-party benchmark
MiniMax M3MiniMaxLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,433.33rating—63,973minimax-m3; 95% CI [1429.51159020, 1437.14164071]; votes 63973; rank 91unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V4 FlashDeepSeekLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,431.84rating—51,987deepseek-v4-flash; 95% CI [1427.81979734, 1435.85552908]; votes 51987; rank 92unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 LunaOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,430.66rating—41,109gpt-5.6-luna-xhigh; 95% CI [1426.38028671, 1434.93119450]; votes 41109; rank 93unknownOriginal sourcewinner eligibleThird-party benchmark
Mistral Large 3Mistral AILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,428.16rating—84,205mistral-large-3; 95% CI [1425.33671505, 1430.99053174]; votes 84205; rank 98unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.6xAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,427.77rating—28,965grok-4.6-high; 95% CI [1422.91144511, 1432.61896218]; votes 28965; rank 99unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V3.2DeepSeekLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,424.46rating—48,112deepseek-v3.2; 95% CI [1420.99052972, 1427.92299771]; votes 48112; rank 105unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,422.28rating—44,434gpt-5.1; 95% CI [1418.72432020, 1425.83291138]; votes 44434; rank 110unknownOriginal sourcewinner eligibleThird-party benchmark
Mistral Medium 3.5 128BMistral AILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,420.97rating—11,778mistral-medium-3.5; 95% CI [1414.59009121, 1427.34230551]; votes 11778; rank 112unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 2.5 FlashGoogle DeepMindLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,416.89rating—125,521gemini-2.5-flash; 95% CI [1414.48804539, 1419.29483183]; votes 125521; rank 127unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,416.24rating—49,655gpt-5.2-high; 95% CI [1412.72461401, 1419.75769766]; votes 49655; rank 129unknownOriginal sourcewinner eligibleThird-party benchmark
Inkling SmallThinking Machines LabLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,412.62rating—32,304Inkling Small; 95% CI [1407.97725962, 1417.26957820]; votes 32304; rank 135unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,412.14rating—83,855gpt-5.2; 95% CI [1408.99454704, 1415.29029705]; votes 83855; rank 136unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 MiniOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,411.45rating—63,449gpt-5.4-mini-high; 95% CI [1407.73358875, 1415.16901218]; votes 63449; rank 137unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,406.18rating—31,722gpt-5-high; 95% CI [1401.76102728, 1410.60028213]; votes 31722; rank 146unknownOriginal sourcewinner eligibleThird-party benchmark
MiniMax M2.7MiniMaxLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,404.83rating—84,977minimax-m2.7; 95% CI [1401.50702597, 1408.15721867]; votes 84977; rank 148unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 SolOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,398.02rating—12,466gpt-6-sol-max; 95% CI [1391.69518333, 1404.34476736]; votes 12466; rank 156unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.3xAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,396.92rating—71,347grok-4.3; 95% CI [1393.31445966, 1400.53298228]; votes 71347; rank 158unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Haiku 4.5AnthropicLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,396.64rating—149,199claude-haiku-4-5-20251001; 95% CI [1394.24930739, 1399.03971640]; votes 149199; rank 159unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.5 35B A3BQwenLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,394.73rating—30,457qwen3.5-35b-a3b; 95% CI [1390.52780278, 1398.93686884]; votes 30457; rank 161unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 LunaOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,391.63rating—49,617gpt-6-luna-max; 95% CI [1387.01005073, 1396.24774606]; votes 49617; rank 166unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Glimmer 30BMetaLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,388.91rating—3,897muse-glimmer; 95% CI [1379.26475817, 1398.55311930]; votes 3897; rank 167unknownOriginal sourcewinner eligibleThird-party benchmark
Solar Pro 4UpstageLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,386.72rating—21,281solar-pro4; 95% CI [1381.43817825, 1392.00326711]; votes 21281; rank 169unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1OpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,382.89rating—50,312gpt-4.1-2025-04-14; 95% CI [1379.19934172, 1386.58437112]; votes 50312; rank 172unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 MiniOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,373.28rating—26,804gpt-5-mini-high; 95% CI [1368.72762571, 1377.83899204]; votes 26804; rank 180unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek R1DeepSeekLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,372.65rating—18,524deepseek-r1; 95% CI [1367.80631687, 1377.49940563]; votes 18524; rank 181unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 NanoOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,372.01rating—62,396gpt-5.4-nano-high; 95% CI [1368.25704083, 1375.76986498]; votes 62396; rank 182unknownOriginal sourcewinner eligibleThird-party benchmark
gpt-oss-120bOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,365.51rating—30,206gpt-oss-120b; 95% CI [1361.16495776, 1369.85717870]; votes 30206; rank 192unknownOriginal sourcewinner eligibleThird-party benchmark
Nova 2 LiteAmazonLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,361.83rating—12,413nova-2-lite; 95% CI [1355.81915120, 1367.83207069]; votes 12413; rank 195unknownOriginal sourcewinner eligibleThird-party benchmark
Granite 4.2 30BIBMLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,361.41rating—3,401granite-4.2-30b; 95% CI [1350.97772869, 1371.83470317]; votes 3401; rank 196unknownOriginal sourcewinner eligibleThird-party benchmark
MiniMax M2.5MiniMaxLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,359.12rating—42,815minimax-m2.5; 95% CI [1355.25588729, 1362.99197980]; votes 42815; rank 198unknownOriginal sourcewinner eligibleThird-party benchmark
NVIDIA Nemotron 3 Nano 30B A3B BF16NVIDIALMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,347.82rating—15,770nvidia-nemotron-3-nano-30b-a3b-bf16; 95% CI [1342.43511795, 1353.20837526]; votes 15770; rank 209unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1 MiniOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,340.50rating—38,709gpt-4.1-mini-2025-04-14; 95% CI [1336.20142291, 1344.80800339]; votes 38709; rank 211unknownOriginal sourcewinner eligibleThird-party benchmark
DeepSeek V3DeepSeekLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,332.46rating—21,770deepseek-v3; 95% CI [1327.72698428, 1337.19353550]; votes 21770; rank 224unknownOriginal sourcewinner eligibleThird-party benchmark
Command ACohereLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,330.94rating—55,766command-a-03-2025; 95% CI [1327.49064818, 1334.38717569]; votes 55766; rank 225unknownOriginal sourcewinner eligibleThird-party benchmark
NVIDIA Nemotron 3.5 Lightning 30B A3BNVIDIALMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,328.88rating—19,938nvidia-nemotron-3.5-lightning-30b-a3b-nvfp4; 95% CI [1323.35291228, 1334.41299389]; votes 19938; rank 229unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 NanoOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,319.94rating—8,132gpt-5-nano-high; 95% CI [1313.09185399, 1326.78218151]; votes 8132; rank 232unknownOriginal sourcewinner eligibleThird-party benchmark
Granite 4.2 8BIBMLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,319.58rating—3,254granite-4.2-8b; 95% CI [1308.51127780, 1330.64584507]; votes 3254; rank 234unknownOriginal sourcewinner eligibleThird-party benchmark
Olmo 3.1 32B InstructAi2LMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,311.14rating—11,817olmo-3.1-32b-instruct; 95% CI [1305.04954142, 1317.22764633]; votes 11817; rank 242unknownOriginal sourcewinner eligibleThird-party benchmark
Olmo 3 32B ThinkAi2LMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,299.42rating—5,831olmo-3-32b-think; 95% CI [1291.17882644, 1307.65677276]; votes 5831; rank 248unknownOriginal sourcewinner eligibleThird-party benchmark
Granite 4.2 3BIBMLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,292.94rating—3,251granite-4.2-3b; 95% CI [1281.43969143, 1304.43063080]; votes 3251; rank 253unknownOriginal sourcewinner eligibleThird-party benchmark
Granite 4.1 8BIBMLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,290.69rating—4,180granite-4.1-8b; 95% CI [1280.76464094, 1300.60785998]; votes 4180; rank 256unknownOriginal sourcewinner eligibleThird-party benchmark
gpt-oss-20bOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,287.43rating—10,419gpt-oss-20b; 95% CI [1281.03637900, 1293.81371199]; votes 10419; rank 260unknownOriginal sourcewinner eligibleThird-party benchmark
Llama 4 Maverick 17B 128E InstructMetaLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,287.19rating—39,450llama-4-maverick-17b-128e-instruct; 95% CI [1282.93484207, 1291.44351277]; votes 39450; rank 261unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4o MiniOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,286.34rating—68,705gpt-4o-mini-2024-07-18; 95% CI [1282.82219462, 1289.86344250]; votes 68705; rank 263unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1 NanoOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,284.78rating—6,103gpt-4.1-nano-2025-04-14; 95% CI [1277.13551573, 1292.41837024]; votes 6103; rank 264unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4oOpenAILMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,282.50rating—45,499gpt-4o-2024-08-06; 95% CI [1278.31275237, 1286.69364786]; votes 45499; rank 267unknownOriginal sourcewinner eligibleThird-party benchmark
Llama 4 Scout 17B 16E InstructMetaLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,279.16rating—29,826llama-4-scout-17b-16e-instruct; 95% CI [1274.44779094, 1283.86814615]; votes 29826; rank 273unknownOriginal sourcewinner eligibleThird-party benchmark
Llama 3.3 70B InstructMetaLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,274.21rating—54,497llama-3.3-70b-instruct; 95% CI [1270.72459081, 1277.68627453]; votes 54497; rank 276unknownOriginal sourcewinner eligibleThird-party benchmark
Llama 3.1 70B InstructMetaLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,260.87rating—55,240llama-3.1-70b-instruct; 95% CI [1257.15696595, 1264.58148679]; votes 55240; rank 290unknownOriginal sourcewinner eligibleThird-party benchmark
phi-4MicrosoftLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,216.66rating—24,126phi-4; 95% CI [1212.07369450, 1221.23689100]; votes 24126; rank 314unknownOriginal sourcewinner eligibleThird-party benchmark
Llama 3.1 8B InstructMetaLMArena Text Arenatext-2026-10-15-a64ca3b12b6e1,186.54rating—49,605llama-3.1-8b-instruct; 95% CI [1182.43982822, 1190.63886318]; votes 49605; rank 327unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,323.95rating—14,175claude-fable-5-high; 95% CI [1316.82313713, 1331.08571856]; votes 14175; rank 1unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,319.22rating—16,665claude-opus-5-high; 95% CI [1312.47954379, 1325.95953993]; votes 16665; rank 3unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Fable 5.1AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,318.24rating—4,648claude-fable-5.1-max; 95% CI [1308.61778049, 1327.86146111]; votes 4648; rank 4unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,316.41rating—23,165claude-opus-4-7; 95% CI [1309.83870131, 1322.97989133]; votes 23165; rank 5unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.7 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,315.97rating—4,524gemini-3.7-flash-high; 95% CI [1306.20108292, 1325.73138242]; votes 4524; rank 6unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,315.64rating—22,304claude-opus-4-6-high; 95% CI [1309.23331588, 1322.04524655]; votes 22304; rank 7unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.8 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,314.08rating—3,792gemini-3.8-flash-high; 95% CI [1303.54395703, 1324.61562115]; votes 3792; rank 8unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.8 MaxQwenLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,313.60rating—10,017qwen3.8-max; 95% CI [1306.14335895, 1321.05468944]; votes 10017; rank 9unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.6AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,313.02rating—26,853claude-opus-4-6; 95% CI [1306.75407253, 1319.29550756]; votes 26853; rank 10unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.7AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,312.95rating—22,733claude-opus-4-7-high; 95% CI [1306.39165389, 1319.51248325]; votes 22733; rank 11unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,309.62rating—13,103gemini-3.5-flash-high; 95% CI [1302.66440457, 1316.57227728]; votes 13103; rank 12unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.3MetaLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,309.35rating—4,550muse-spark-1.3-max; 95% CI [1299.58784189, 1319.11184130]; votes 4550; rank 13unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,309.32rating—13,180gemini-3.5-flash-medium; 95% CI [1302.39764204, 1316.24123214]; votes 13180; rank 14unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.2MetaLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,304.55rating—1,954muse-spark-1.2 (xHigh); 95% CI [1290.22866830, 1318.87305829]; votes 1954; rank 17unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,303.15rating—29,881gpt-5.4-high; 95% CI [1297.39164127, 1308.90995855]; votes 29881; rank 18unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,297.66rating—8,127gemini-3.6-flash-high; 95% CI [1289.51471576, 1305.80526574]; votes 8127; rank 20unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,296.63rating—27,993gpt-5.5; 95% CI [1290.81697444, 1302.45204648]; votes 27993; rank 21unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,296.20rating—46,320gemini-3.1-pro-preview; 95% CI [1291.04958388, 1301.35691905]; votes 46320; rank 22unknownOriginal sourcewinner eligibleThird-party benchmark
GLM 5.3 FlashZ.aiLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,296.03rating—11,157glm-5.3-flash; 95% CI [1288.97978191, 1303.07121064]; votes 11157; rank 23unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,294.18rating—18,341claude-opus-4-8-high; 95% CI [1287.71437228, 1300.65034925]; votes 18341; rank 24unknownOriginal sourcewinner eligibleThird-party benchmark
Muse Spark 1.1MetaLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,292.70rating—11,994muse-spark-1.1; 95% CI [1285.66303358, 1299.73172684]; votes 11994; rank 25unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.5OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,292.31rating—26,281gpt-5.5-high; 95% CI [1286.39749993, 1298.21557690]; votes 26281; rank 26unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,292.11rating—22,832gpt-5.4; 95% CI [1285.63250026, 1298.59555072]; votes 22832; rank 27unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 4.8AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,288.52rating—18,852claude-opus-4-8; 95% CI [1282.01202676, 1295.03051235]; votes 18852; rank 29unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6.1 SolOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,288.19rating—1,813gpt-6.1-sol-max; 95% CI [1273.83724449, 1302.54208160]; votes 1813; rank 30unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.5xAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,288.17rating—11,764grok-4.5; 95% CI [1280.98331591, 1295.35286239]; votes 11764; rank 31unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,285.15rating—39,145gemini-3-flash; 95% CI [1279.92496783, 1290.36579718]; votes 39145; rank 32unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K2.6Moonshot AILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,282.78rating—16,379kimi-k2.6; 95% CI [1275.98531996, 1289.57750584]; votes 16379; rank 33unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,282.47rating—27,422claude-sonnet-4-6; 95% CI [1276.33534417, 1288.60341882]; votes 27422; rank 34unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 SolOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,281.39rating—10,907gpt-5.6-sol-xhigh; 95% CI [1273.98131322, 1288.80759068]; votes 10907; rank 35unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-6 AstraOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,281.35rating—3,590gpt-6-astra-max; 95% CI [1270.63592513, 1292.07239183]; votes 3590; rank 36unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.7 PlusQwenLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,279.07rating—13,636qwen3.7-plus; 95% CI [1272.29971328, 1285.84102976]; votes 13636; rank 37unknownOriginal sourcewinner eligibleThird-party benchmark
Gemma 4 31BGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,276.80rating—39,669gemma-4-31b; 95% CI [1271.07071523, 1282.52723839]; votes 39669; rank 38unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Sonnet 5AnthropicLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,273.92rating—13,503claude-sonnet-5-high; 95% CI [1267.02186706, 1280.81063637]; votes 13503; rank 41unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.8 27BQwenLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,271.39rating—7,013qwen3.8-27b; 95% CI [1262.99100972, 1279.79432635]; votes 7013; rank 42unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 TerraOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,271.07rating—11,020gpt-5.6-terra-xhigh; 95% CI [1263.65540928, 1278.48964371]; votes 11020; rank 43unknownOriginal sourcewinner eligibleThird-party benchmark
Kimi K2.5Moonshot AILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,268.77rating—28,297kimi-k2.5-thinking; 95% CI [1263.09963340, 1274.44784290]; votes 28297; rank 44unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3.5 Flash LiteGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,268.15rating—8,381gemini-3.5-flash-lite; 95% CI [1260.07450401, 1276.22711331]; votes 8381; rank 45unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 3 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,265.51rating—37,172gemini-3-flash (thinking-minimal); 95% CI [1260.17071513, 1270.84458597]; votes 37172; rank 48unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 2.5 ProGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,263.29rating—88,805gemini-2.5-pro; 95% CI [1258.74589708, 1267.83852907]; votes 88805; rank 51unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.6xAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,263.14rating—6,495grok-4.6-high; 95% CI [1254.48523007, 1271.79468461]; votes 6495; rank 52unknownOriginal sourcewinner eligibleThird-party benchmark
Qwen3.5 397B A17BQwenLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,262.52rating—32,058qwen3.5-397b-a17b; 95% CI [1257.19517602, 1267.83577721]; votes 32058; rank 54unknownOriginal sourcewinner eligibleThird-party benchmark
Gemma 4 26B A4BGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,259.70rating—23,943gemma-4-26b-a4b; 95% CI [1253.23971386, 1266.15382555]; votes 23943; rank 55unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.20 Multi AgentxAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,258.97rating—24,543grok-4.20-multi-agent-beta-0309; 95% CI [1252.84769478, 1265.09117861]; votes 24543; rank 57unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.6 LunaOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,258.24rating—11,086gpt-5.6-luna-xhigh; 95% CI [1250.82216689, 1265.66350676]; votes 11086; rank 58unknownOriginal sourcewinner eligibleThird-party benchmark
MiniMax M3MiniMaxLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,253.11rating—19,026minimax-m3; 95% CI [1246.68252453, 1259.53765792]; votes 19026; rank 60unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,249.84rating—9,861gpt-5.1-high; 95% CI [1242.04728848, 1257.64065919]; votes 9861; rank 63unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,245.81rating—19,041gpt-5.2-high; 95% CI [1239.74622137, 1251.87027714]; votes 19041; rank 67unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 MiniOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,245.01rating—25,733gpt-5.4-mini-high; 95% CI [1238.81649273, 1251.21275945]; votes 25733; rank 68unknownOriginal sourcewinner eligibleThird-party benchmark
Gemini 2.5 FlashGoogle DeepMindLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,235.45rating—60,112gemini-2.5-flash; 95% CI [1230.89884927, 1239.99599852]; votes 60112; rank 74unknownOriginal sourcewinner eligibleThird-party benchmark
Inkling SmallThinking Machines LabLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,235.32rating—7,472Inkling Small; 95% CI [1226.97211879, 1243.66134454]; votes 7472; rank 75unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.1OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,234.81rating—10,818gpt-5.1; 95% CI [1227.28917044, 1242.33289013]; votes 10818; rank 76unknownOriginal sourcewinner eligibleThird-party benchmark
Grok 4.3xAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,229.24rating—27,037grok-4.3; 95% CI [1223.34663531, 1235.13960477]; votes 27037; rank 78unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.2OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,229.01rating—20,127gpt-5.2; 95% CI [1223.02274809, 1235.00649862]; votes 20127; rank 79unknownOriginal sourcewinner eligibleThird-party benchmark
Mistral Medium 3.5 128BMistral AILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,223.08rating—5,375mistral-medium-3.5; 95% CI [1213.57754699, 1232.58266173]; votes 5375; rank 82unknownOriginal sourcewinner eligibleThird-party benchmark
Mistral Large 3Mistral AILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,220.76rating—8,643mistral-large-3; 95% CI [1212.81813492, 1228.69335345]; votes 8643; rank 83unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,210.62rating—41,017gpt-4.1-2025-04-14; 95% CI [1203.95207689, 1217.29091390]; votes 41017; rank 87unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5OpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,208.24rating—34,470gpt-5-high; 95% CI [1201.43993030, 1215.03686763]; votes 34470; rank 89unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 MiniOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,202.14rating—28,959gpt-5-mini-high; 95% CI [1194.33907236, 1209.93452091]; votes 28959; rank 91unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5.4 NanoOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,195.96rating—25,650gpt-5.4-nano-high; 95% CI [1189.64874058, 1202.27965668]; votes 25650; rank 94unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1 MiniOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,181.35rating—40,221gpt-4.1-mini-2025-04-14; 95% CI [1173.87762706, 1188.81616531]; votes 40221; rank 101unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-5 NanoOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,159.22rating—3,929gpt-5-nano-high; 95% CI [1148.16831669, 1170.26403282]; votes 3929; rank 113unknownOriginal sourcewinner eligibleThird-party benchmark
Llama 4 Maverick 17B 128E InstructMetaLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,141.63rating—6,922llama-4-maverick-17b-128e-instruct; 95% CI [1132.58229133, 1150.67926500]; votes 6922; rank 120unknownOriginal sourcewinner eligibleThird-party benchmark
Llama 4 Scout 17B 16E InstructMetaLMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,118.23rating—6,451llama-4-scout-17b-16e-instruct; 95% CI [1108.78959993, 1127.66568063]; votes 6451; rank 127unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4o MiniOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,065.60rating—17,341gpt-4o-mini-2024-07-18; 95% CI [1057.29887437, 1073.89816601]; votes 17341; rank 135unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4oOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,064.52rating—3,376gpt-4o-2024-08-06; 95% CI [1052.04133780, 1077.00060680]; votes 3376; rank 136unknownOriginal sourcewinner eligibleThird-party benchmark
GPT-4.1 NanoOpenAILMArena Vision Arenavision-2026-10-09-a64ca3b12b6e1,063.24rating—1,211gpt-4.1-nano-2025-04-14; 95% CI [1044.95158579, 1081.52393740]; votes 1211; rank 137unknownOriginal sourcewinner eligibleThird-party benchmark
Claude Opus 5.5AnthropicToneBench2026-10-17-10-task-e9c76358afb285.93points126,48550Claude Opus 5.5 (max effort)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 5.5AnthropicToneBench2026-10-17-10-task-e9c76358afb285.83points47,52450Claude Opus 5.5 (xhigh)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 5.5AnthropicToneBench2026-10-17-10-task-e9c76358afb284.61points13,77850Claude Opus 5.5 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Fable 5.1AnthropicToneBench2026-10-17-10-task-e9c76358afb284.53points68,65350Claude Fable 5.1 (max effort)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 5.5AnthropicToneBench2026-10-17-10-task-e9c76358afb284.49points12,86050Claude Opus 5.5 (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 5.5AnthropicToneBench2026-10-17-10-task-e9c76358afb284.28points9,50750Claude Opus 5.5 (low)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb283.52points10,00850GPT-6 Sol (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Fable 5.1AnthropicToneBench2026-10-17-10-task-e9c76358afb283.41points34,28450Claude Fable 5.1 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 5AnthropicToneBench2026-10-17-10-task-e9c76358afb283.25points26,82050Claude Opus 5 (max effort)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 5AnthropicToneBench2026-10-17-10-task-e9c76358afb282.57points16,22750Claude Opus 5 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb282.51points2,98350GPT-6 Sol (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6.1 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb282.44points21,22150GPT-6.1 Sol (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GLM 5.3Z.aiToneBench2026-10-17-10-task-e9c76358afb282.39points50,20850GLM-5.3 (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6.1 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb282.39points17,25950GPT-6.1 Sol (xhigh)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.6 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb282.35points15,71450GPT-5.6 Sol (ultra)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.6 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb282.35points2,98850GPT-5.6 Sol (low)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6 AstraOpenAIToneBench2026-10-17-10-task-e9c76358afb282.32points20,44950GPT-6 Astra (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Kimi K3Moonshot AIToneBench2026-10-17-10-task-e9c76358afb282.23points21,43850Kimi K3 (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Fable 5AnthropicToneBench2026-10-17-10-task-e9c76358afb281.90points24,07650Claude Fable 5 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GLM 5.3 FlashZ.aiToneBench2026-10-17-10-task-e9c76358afb281.82points40,30150GLM-5.3 Flash (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6.1 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb281.41points2,55850GPT-6.1 Sol (low)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.6 TerraOpenAIToneBench2026-10-17-10-task-e9c76358afb281.40points20,71850GPT-5.6 Terra (ultra)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6.1 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb281.12points6,80350GPT-6.1 Sol (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4.1 FlashDeepSeekToneBench2026-10-17-10-task-e9c76358afb281.03points25,01250DeepSeek V4.1 Flash (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6.1 SolOpenAIToneBench2026-10-17-10-task-e9c76358afb281.00points2,72250GPT-6.1 Sol (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 4.8AnthropicToneBench2026-10-17-10-task-e9c76358afb280.70points46,60150Claude Opus 4.8 (max effort)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6 AstraOpenAIToneBench2026-10-17-10-task-e9c76358afb280.67points2,61050GPT-6 Astra (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.6 TerraOpenAIToneBench2026-10-17-10-task-e9c76358afb280.66points2,95850GPT-5.6 Terra (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4.1 FlashDeepSeekToneBench2026-10-17-10-task-e9c76358afb280.35points16,66850DeepSeek V4.1 Flash (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Kimi K3Moonshot AIToneBench2026-10-17-10-task-e9c76358afb280.35points5,85150Kimi K3 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Grok 4.6xAIToneBench2026-10-17-10-task-e9c76358afb280.33points21,44050Grok 4.6 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4 Pro 0813DeepSeekToneBench2026-10-17-10-task-e9c76358afb280.12points34,47350DeepSeek V4 Pro 0813 (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Grok 4.7xAIToneBench2026-10-17-10-task-e9c76358afb279.60points31,03450Grok 4.7 (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Grok 4.7xAIToneBench2026-10-17-10-task-e9c76358afb279.58points45,96450Grok 4.7 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 4.8AnthropicToneBench2026-10-17-10-task-e9c76358afb279.30points5,09750Claude Opus 4.8 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4.1 FlashDeepSeekToneBench2026-10-17-10-task-e9c76358afb279.30points9,39450DeepSeek V4.1 Flash (low)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Sonnet 5AnthropicToneBench2026-10-17-10-task-e9c76358afb279.21points66,95350Claude Sonnet 5 (max effort)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Grok 4.7xAIToneBench2026-10-17-10-task-e9c76358afb278.95points5,89150Grok 4.7 (low)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.6 LunaOpenAIToneBench2026-10-17-10-task-e9c76358afb278.83points19,62150GPT-5.6 Luna (ultra)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 4.7AnthropicToneBench2026-10-17-10-task-e9c76358afb278.27points12,59050Claude Opus 4.7 (xhigh)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6 LunaOpenAIToneBench2026-10-17-10-task-e9c76358afb278.19points6,59550GPT-6 Luna (max)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Grok 4.5xAIToneBench2026-10-17-10-task-e9c76358afb277.82points2,77550Grok 4.5 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6 LunaOpenAIToneBench2026-10-17-10-task-e9c76358afb277.39points3,05050GPT-6 Luna (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-6 LunaOpenAIToneBench2026-10-17-10-task-e9c76358afb276.96points2,62050GPT-6 Luna (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Opus 4.6AnthropicToneBench2026-10-17-10-task-e9c76358afb276.91points28,42350Claude Opus 4.6 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Qwen3.8 MaxQwenToneBench2026-10-17-10-task-e9c76358afb276.83points29,83950Qwen3.8 Max (thinking on)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4.1 FlashDeepSeekToneBench2026-10-17-10-task-e9c76358afb276.81points2,84350DeepSeek V4.1 Flash (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.5OpenAIToneBench2026-10-17-10-task-e9c76358afb276.76points3,93950GPT-5.5 (xhigh)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GLM 5Z.aiToneBench2026-10-17-10-task-e9c76358afb276.68points32,05650GLM-5 (thinking on)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.6 LunaOpenAIToneBench2026-10-17-10-task-e9c76358afb276.66points3,24450GPT-5.6 Luna (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Sonnet 5AnthropicToneBench2026-10-17-10-task-e9c76358afb276.62points9,45350Claude Sonnet 5 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.5OpenAIToneBench2026-10-17-10-task-e9c76358afb276.41points3,89350GPT-5.5 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Claude Sonnet 4.6AnthropicToneBench2026-10-17-10-task-e9c76358afb275.99points41,61650Claude Sonnet 4.6 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.5OpenAIToneBench2026-10-17-10-task-e9c76358afb275.80points3,68250GPT-5.5 (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GLM 5.2Z.aiToneBench2026-10-17-10-task-e9c76358afb275.76points11,13850GLM-5.2 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Muse Spark 1.3MetaToneBench2026-10-17-10-task-e9c76358afb275.55points7,51150Muse Spark 1.3 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Muse Spark 1.3MetaToneBench2026-10-17-10-task-e9c76358afb275.44points4,99550Muse Spark 1.3 (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Qwen3.8 FlashQwenToneBench2026-10-17-10-task-e9c76358afb275.30points31,59050Qwen3.8 Flash (thinking on)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.5OpenAIToneBench2026-10-17-10-task-e9c76358afb275.15points3,60550GPT-5.5 (none)average per caseOriginal sourcenot winner eligibleThird-party benchmark
MiniMax M3MiniMaxToneBench2026-10-17-10-task-e9c76358afb274.79points31,77750MiniMax M3 (thinking on)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Kimi K2.6Moonshot AIToneBench2026-10-17-10-task-e9c76358afb274.36points22,64950Kimi K2.6 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4 ProDeepSeekToneBench2026-10-17-10-task-e9c76358afb273.62points6,35350DeepSeek V4 Pro (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4 ProDeepSeekToneBench2026-10-17-10-task-e9c76358afb273.07points17,92450DeepSeek V4 Pro (xhigh)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Qwen3.7 MaxQwenToneBench2026-10-17-10-task-e9c76358afb272.57points9,01950Qwen3.7 Max (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
DeepSeek V4 Pro 0813DeepSeekToneBench2026-10-17-10-task-e9c76358afb272.29points11,26250DeepSeek V4 Pro 0813 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-5.2OpenAIToneBench2026-10-17-10-task-e9c76358afb271.37points4,15550GPT-5.2 (no reasoning)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb270.99points10,02950Gemini 3.1 Pro (high thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 2.5 ProGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb270.96points4,93050Gemini 2.5 Pro (dynamic thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.8 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb270.22points20,36950Gemini 3.8 Flash (high thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.1 ProGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb270.14points6,45350Gemini 3.1 Pro (low thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.7 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb270.06points20,20850Gemini 3.7 Flash (high thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Llama 4 Maverick 17B 128E InstructMetaToneBench2026-10-17-10-task-e9c76358afb269.93points2,23250Llama 4 Maverick (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb269.55points12,76650Gemini 3.5 Flash (high thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.5 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb269.54points10,00050Gemini 3.5 Flash (medium thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.7 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb269.44points7,38450Gemini 3.7 Flash (medium thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb269.28points11,19150Gemini 3.6 Flash (medium thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.6 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb269.16points13,34650Gemini 3.6 Flash (high thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.8 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb269.13points6,79550Gemini 3.8 Flash (medium thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
InklingThinking Machines LabToneBench2026-10-17-10-task-e9c76358afb268.77points6,99850Inkling (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
NVIDIA Nemotron 3 Ultra 550B A55B BF16NVIDIAToneBench2026-10-17-10-task-e9c76358afb266.66points2,70550Nemotron 3 Ultra 550B (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Grok 4.3xAIToneBench2026-10-17-10-task-e9c76358afb265.80points7,56350Grok 4.3 (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 2.5 FlashGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb265.00points4,77650Gemini 2.5 Flash (dynamic thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 3.5 Flash LiteGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb265.00points2,03050Gemini 3.5 Flash-Lite (minimal thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Grok 4.3xAIToneBench2026-10-17-10-task-e9c76358afb262.45points1,83650Grok 4.3 (low)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Mistral Large 3Mistral AIToneBench2026-10-17-10-task-e9c76358afb261.78points2,03150Mistral Large 3 (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
gpt-oss-120bOpenAIToneBench2026-10-17-10-task-e9c76358afb261.29points8,84950gpt-oss 120B (high)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Gemini 2.5 Flash LiteGoogle DeepMindToneBench2026-10-17-10-task-e9c76358afb260.69points2,37450Gemini 2.5 Flash-Lite (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
gpt-oss-120bOpenAIToneBench2026-10-17-10-task-e9c76358afb260.13points2,72550gpt-oss 120B (medium)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Command A ReasoningCohereToneBench2026-10-17-10-task-e9c76358afb252.73points1,91650Cohere Command A Reasoning (thinking on)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Command ACohereToneBench2026-10-17-10-task-e9c76358afb249.68points1,17550Cohere Command A (03-2025) (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-4oOpenAIToneBench2026-10-17-10-task-e9c76358afb247.32points1,11550GPT-4o (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
GPT-4o MiniOpenAIToneBench2026-10-17-10-task-e9c76358afb246.95points1,33950GPT-4o mini (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark
Llama 4 Scout 17B 16E InstructMetaToneBench2026-10-17-10-task-e9c76358afb237.59points84750Llama 4 Scout (no thinking)average per caseOriginal sourcenot winner eligibleThird-party benchmark

Observed Oct 19, 2026. 119 of 221 text models have at least one current verified result. Score and output-token columns may cite different original artifacts.

Primary Evidence

Pinned Source Artifacts

Aider Polyglot polyglot-225-5dc9490bb35f score tableAider · observed Oct 8, 2026ARC-AGI-1 verified-v1-613c385b0c93 score tableARC Prize Foundation · observed Oct 15, 2026ARC-AGI-2 verified-v2-be40992860f9 score tableARC Prize Foundation · observed Oct 15, 2026Berkeley Function Calling Leaderboard v4-ede5081a24bc score tableBerkeley Function Calling Leaderboard · observed Oct 8, 2026LiveBench 2026-06-25-90f8d44da965 score tableLiveBench · observed Oct 15, 2026LiveBench 2026-06-25-90f8d44da965 token accountingLiveBench · observed Oct 15, 2026LMArena Agent Arena agent-2026-10-16-a64ca3b12b6e score tableLMArena · observed Oct 19, 2026LMArena Document Arena document-2026-09-13-a64ca3b12b6e score tableLMArena · observed Oct 19, 2026LMArena Search Arena search-2026-10-13-a64ca3b12b6e score tableLMArena · observed Oct 19, 2026LMArena Text Arena text-2026-10-15-a64ca3b12b6e score tableLMArena · observed Oct 19, 2026LMArena Vision Arena vision-2026-10-09-a64ca3b12b6e score tableLMArena · observed Oct 19, 2026ToneBench 2026-10-17-10-task-e9c76358afb2 score tableTowards AI · observed Oct 17, 2026LiveBench methodologyLiveBench · observed Oct 15, 2026Berkeley Function Calling Leaderboard methodologyBerkeley Function Calling Leaderboard · observed Oct 8, 2026Aider Polyglot methodologyAider · observed Oct 8, 2026ARC-AGI-1 methodologyARC Prize Foundation · observed Oct 15, 2026ARC-AGI-2 methodologyARC Prize Foundation · observed Oct 15, 2026LMArena Vision Arena methodologyLMArena · observed Oct 19, 2026ToneBench methodologyTowards AI · observed Oct 17, 2026

Questions

Benchmark Questions

Which benchmarks enter rankings?+

Only current-version results obtained from the original benchmark publisher. Scores are recomputed where the publisher exposes sufficient components; exact publisher artifacts are verified and pinned otherwise. Provider self-reports cannot enter the aggregate ranking.

How is the maximum-firepower run selected?+

For each model and benchmark, Model Markets selects the published configuration with the highest output-token spend per case. If the benchmark publishes no token accounting, the latest comparable run is used for performance only.

How are scores compared?+

A score is normalized using the benchmark’s declared range and direction. Direct comparisons require the same version, metric, protocol, and evidence class. An overall winner requires at least two verified common benchmarks and a majority.

Why keep score and token sources separate?+

A benchmark may publish scores and cost or token logs in different artifacts. Both artifacts are pinned independently so token efficiency is never inferred from a model card or marketing claim.

What happens when evidence is missing?+

It stays missing. Model Markets publishes coverage and excludes incomplete token data from efficiency rather than filling it with an estimate. Read the methodology →

Send Feedback