BlogLLM Benchmark Scores as Published, Side by Side
Claude Opus 4: Benchmark Scores as Published
Every result the catalog holds for Claude Opus 4: 34 tests in 8 areas, from 4 pages. 8 printed by Anthropic itself, the rest by the company named beside each number. Each number is as printed; nothing is ranked or rescored.
Developer AnthropicReleased 2025-05-22Data version 2026103001, as of 2026-10-30
Agentic Coding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| SWE-bench Verified | 79.4% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 2 more pages | Effort: none; Attempt budget: parallel test-time compute: multiple samples, the best selected by an internal scoring model |
| 72.5% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15 | Effort: none | |
| Terminal-Bench (version not stated) | 50% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 2 more pages | Effort: none; Attempt budget: parallel test-time compute: multiple samples, the best selected by an internal scoring model |
| 43.2% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15 | Effort: none | |
| 39.2% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15 | Effort: none; Harness: the same agent as the non-Claude models | |
| SWE-bench Verified (agentless, single patch without test) | 53% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking; Harness: agentless |
| SWE-bench Verified (multiple attempts) | 79.4% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking; Harness: agentic, multiple attempts |
Science and Math
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPQA Diamond | 83.3% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 2 more pages | Effort: extended thinking, up to 64K; Attempt budget: parallel test-time compute: multiple samples, the best selected by an internal scoring model |
| 74.9% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15 | Effort: none | |
| 79.6% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15 | Effort: extended thinking, up to 64K | |
| AIME 2025 | 90% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 2 more pages | Effort: extended thinking, up to 64K; Attempt budget: parallel test-time compute: multiple samples, the best selected by an internal scoring model |
| 75.5% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15 | Effort: extended thinking, up to 64K | |
| HMMT February 2025 | 15.9% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| AIME 2024 | 48.2% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| MATH-500 | 94.4% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| CNMO 2024 | 57.6% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| PolyMath (en) | 49.8% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
Multimodal Understanding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| MMMU (validation) | 76.5% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 1 more page | Effort: extended thinking, up to 64K |
General Knowledge and Reasoning
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Humanity's Last Exam (no tools) | 7.1% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| MMLU-Pro | 86.6% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| MMLU-Redux | 94.2% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| SuperGPQA | 56.5% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| MMLU | 92.9% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| SimpleQA | 22.8% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| AutoLogi | 86.1% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| LiveBench (2024-11-25) | 74.6% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| ZebraLogic | 59.3% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
Code Generation
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| LiveCodeBench v6 | 47.4% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| Aider polyglot | 70.7% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| MultiPL-E | 89.6% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| OJBench (language not stated) | 19.6% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
Tool Use and Workflows
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| τ²-bench Telecom | 57% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| τ²-bench Retail | 81.8% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| τ²-bench Airline | 60% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| τ-bench Airline | 59.6% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 1 more page | Effort: extended thinking, up to 64K |
| τ-bench Retail | 81.4% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 1 more page | Effort: extended thinking, up to 64K |
| AceBench | 75.6% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
Instruction Following
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| MultiChallenge | 49% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
| IFEval (prompt-level strict) | 87.4% | Moonshot AI, Kimi K2 release pagechecked 2026-10-15 | Effort: no extended thinking |
Multilingual
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| MMMLU | 88.8% | Anthropic, Claude Opus 4 and Claude Sonnet 4checked 2026-10-15; printed on 1 more page | Effort: extended thinking, up to 64K |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked.
| Price | Value | Printed by | Setup as printed |
|---|---|---|---|
| Input | $15 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Cached input | $1.5 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Cache write | $18.75 | Anthropic, Anthropic API pricingchecked 2026-10-15 | Cache: 5 minute cache |
| Cache write, 1 hour | $30 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Output | $75 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Input, batch | $7.5 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Output, batch | $37.5 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
More from Anthropic
- Claude Haiku 5.5
- Claude Sonnet 5.5
- Claude Opus 5.5
- Claude Fable 5.1
- Claude Mythos 5.1
- Claude Opus 5
- Claude Sonnet 5
- Claude Fable 5
- Claude Mythos 5
- Claude Opus 4.8
- Claude Opus 4.7
- Claude Mythos Preview
- Claude Sonnet 4.6
- Claude Opus 4.6
- Claude Opus 4.5
- Claude Haiku 4.5
- Claude Sonnet 4.5
- Claude Opus 4.1
- Claude Sonnet 4
- Claude 3.7 Sonnet
- Claude 3.5 Sonnet
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.