BlogLLM Benchmark Scores as Published, Side by Side
Claude Fable 5.1: Benchmark Scores as Published
Every result the catalog holds for Claude Fable 5.1: 137 tests in 16 areas, from 19 pages. 80 printed by Anthropic itself, the rest by the company named beside each number. Each number is as printed; nothing is ranked or rescored.
Developer AnthropicReleased 2026-09-01Context window 1MMax output 128KInput Text, imageOutput TextWeights ClosedData version 2026103001, as of 2026-10-30
Knowledge Work
Agentic Coding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| SWE-Bench Pro | 81.2% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | Effort: max |
| DeepSWE v1.1 | 67.4% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 5 more pages | - |
| SWE-bench Multilingual | 89.1% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | Effort: max |
| Terminal-Bench 4.0 | 55.8% | Anthropic, Claude Fable 5.1 and Mythos 5.1checked 2026-10-15; printed on 11 more pages | Model setup as reported: Release table; exact effort is unspecified here unless stated. See system card for full protocol. |
| 60.9% | Anthropic, Claude Fable 5.1 and Mythos 5.1checked 2026-10-15 | Model setup as reported: Second value printed in the Fable 5.1 cell as "60.9% (Mythos 5.1)": filed under the Fable 5.1 heading, the label names Claude Mythos 5.1. | |
| ProgramBench Almost@1 | 55.5% | Meta, Meta Muse Wonder model cardchecked 2026-10-19; printed on 1 more page | Effort: max; Harness: mini-swe-agent |
| SWE-Marathon | 45.6% | Meta, Meta Muse Wonder model cardchecked 2026-10-19; printed on 1 more page | Effort: max |
| ProgramBench | 87.6% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | - |
| FrontierCode v1.1 Main | 50.9% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 3 more pages | Effort: medium |
| FrontierSWE v2 | 57% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 5 more pages | - |
| FrontierCode v1.1 Extended | 63.6% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 2 more pages | Effort: medium |
| CursorBench 4.0 | 51.8% | Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 2 more pages | - |
| SWE-Bench Multimodal | 54.7% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | Effort: max |
| Kimi Code Bench 3.0 Long-horizon | 58.8% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Fallback: with fallback |
| CursorBench 3.2.0 | 73.4% | Anthropic, Claude Fable 5.1 and Mythos 5.1checked 2026-10-15; printed on 1 more page | - |
| SWE-sweep | 2.9% | Google, Gemini 4 Carbonchecked 2026-10-29 | - |
| Internal Database Migration Tasks | 57.8% | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
| Vibe Code Bench | 90.3% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
ML Engineering
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| PostTrainBench v1.1 | 40.2% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| PostTrainBench v1.2 | 44.6% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Dataset revision: v1.2; Fallback: with fallback |
Science and Math
Long Context
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GraphWalks BFS up to 128k (F1) | 91.4% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| GraphWalks BFS 256k to 1M (F1) | 65% | Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page | - |
| MemoryBench (Meta internal) | 79% | Meta, Meta Muse Wonder model cardchecked 2026-10-19 | Effort: max |
Computer Use
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| OSWorld 2.0 partial | 77.9% | Anthropic, Claude Fable 5.1 and Mythos 5.1checked 2026-10-15; printed on 2 more pages | - |
| OSWorld 2.1 partial | 80.7% | Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 2 more pages | - |
| OSWorld 2.1 offline subset | 76.8% | Google, Gemini 4 Carbonchecked 2026-10-29 | - |
| OSWorld 2.1 binary | 43.1% | Meta, Meta Muse Wonder model cardchecked 2026-10-19 | Effort: max |
| OSWorld 2.0 strict | 41.7% | Anthropic, Claude Fable 5.1 and Mythos 5.1checked 2026-10-15; printed on 2 more pages | - |
Multimodal Understanding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| CharXiv Reasoning (no tools) | 88.8% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
| MMMU-Pro | 86.3% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
| GDP.pdf | 27.6% | Meta, Meta Muse Wonder model cardchecked 2026-10-19; printed on 1 more page | Effort: max |
| CharXiv Reasoning (with tools) | 92.7% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: python; Fallback: with fallback |
| BabyVision (with tools) | 95.1% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: python; Fallback: with fallback |
| MMMU-Pro (with tools) | 88.4% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: python; Fallback: with fallback |
| LVBench | 79.7% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| Chartography (no tools) | 42.6% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 4 more pages | Effort: max; Tools: none |
| Chartography (with tools) | 86.2% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 4 more pages | Effort: max; Tools: enabled |
| ZeroBench (with tools, pass@5) | 59% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: python; Attempt budget: pass@5; Fallback: with fallback |
| PerceptionBench | 63% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
| ZeroBench (pass@5) | 35% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
| ZeroBench_main (avg@5) | 23% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
Cybersecurity
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| ExploitBench | 83% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Fallback: with fallback |
| ExploitGym | 30.4% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24; printed on 1 more page | Effort: max; Fallback: with fallback |
| CWE-bench v1 | 58% | Google, Gemini 4 Argonchecked 2026-10-29; printed on 2 more pages | - |
General Knowledge and Reasoning
Tool Use and Workflows
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Toolathlon Verified | 77.8% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 2 more pages | Effort: max |
| Toolathlon Verified Pass@3 | 81.5% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 2 more pages | Effort: max |
| Toolathlon Verified Pass^3 | 73.1% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 2 more pages | Effort: max |
| Toolathlon Verified average assistant turnslower is better | 23.7 | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | Effort: max |
Instruction Following
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| HANDBOOK.md | 38.8% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Harness: OpenHands; Fallback: with fallback |
Multilingual
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Global-MMLU | 94% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 3 more pages | Effort: max |
| MILU | 93% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 3 more pages | Effort: max |
Healthcare
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| HealthBench | 60 | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25 | - |
| HealthBench Professional (length-adjusted) | 62.1% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 3 more pages | Effort: max |
| HealthBench Professional | 74.2% | Anthropic, Claude Sonnet 5.5 System Cardchecked 2026-10-19; printed on 3 more pages | Effort: max |
| HealthBench (unadjusted) | 66.7 | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | Effort: max |
| HealthBench Professional (unadjusted) | 74.2% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | - |
| PhysicianBench | 61% | Anthropic, Claude Sonnet 5.5 System Cardchecked 2026-10-19 | Effort: max |
Safety and Alignment
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Gray Swan IPI (attack success rate after k attempts)attack success rate after k attempts, lower is better | 1% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 2 more pages | - |
| BBQ ambiguous accuracy | 99.97% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | - |
| BBQ disambiguated accuracy | 89.92% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | - |
| Benign request refusal rate (all languages)lower is better | 0.34% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.1.2.A, all tested languages, claude.ai |
| 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.1.2.A, all tested languages, API | |
| Child safety multi-turn appropriate response rate | 100% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.2.B, claude.ai |
| 84% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.B, API, without a system prompt | |
| Child safety single-turn harmless rate | 99.98% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.2.A, claude.ai |
| 99.9% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.A, API | |
| Child safety single-turn refusal ratelower is better | 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.2.A, API |
| 0.17% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.A, claude.ai | |
| Disordered eating single-turn harmless rate | 99.43% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.3.2.A, claude.ai |
| 95.69% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.2.A, API | |
| Disordered eating single-turn refusal ratelower is better | 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.3.2.A, API |
| 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.2.A, claude.ai | |
| Election integrity multi-turn appropriate response rate | 90% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, API |
| 88% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, claude.ai | |
| Election integrity single-turn harmless rate | 100% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai |
| 100% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API | |
| Election integrity single-turn refusal ratelower is better | 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API |
| 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai | |
| Harmful request harmless response rate (all languages) | 99.41% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.1.1.A, all tested languages, claude.ai |
| 94.71% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.1.1.A, all tested languages, API | |
| Pairwise even-handedness | 98.3% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API |
| 98.8% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai | |
| Pairwise opposing perspectives acknowledged | 25.9% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API |
| 80.5% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai | |
| Shade coding attack success rate (attempt level)lower is better | 8.7% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, with probes: H5.5 0/40, Sonnet 5.5 13/40, Opus 5.5 36/40, Fable 5.1 35/40, Haiku 4.5 40/40 |
| 51.93% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, no safeguards: H5.5 6/40, Sonnet 5.5 16/40, Opus 5.5 37/40, Fable 5.1 39/40, Haiku 4.5 40/40 | |
| Shade computer use attack success rate (attempt level)lower is better | 0.07% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, with probes: 1/14 for Haiku 5.5, Sonnet 5.5 and Fable 5.1; 1/14 for Opus 5.5; 10/14 for Haiku 4.5 |
| 0.07% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, no safeguards: 1/14 for Haiku 5.5, Sonnet 5.5, Opus 5.5 and Fable 5.1; 13/14 for Haiku 4.5 | |
| Suicide and self-harm multi-turn appropriate response rate | 60% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.3.1.B, API |
| 94% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.B, claude.ai | |
| Suicide and self-harm single-turn harmless rate | 100% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.3.1.A, claude.ai |
| 99.3% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.A, API | |
| Suicide and self-harm single-turn refusal ratelower is better | 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | Setup as reported: Table 4.3.1.A, API |
| 0.45% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.A, claude.ai | |
| Primary misbehavior judge score, overall (18 tasks)lower is better | 1.57 | Google, Gemini 4 Argon Safety and Security Reportchecked 2026-10-19 | - |
| Browser use red-teamer attack success rate (attempt level)lower is better | 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page | - |
| Internal computer use safety benchmarklower is better | 9.5% | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
| Multi-turn appropriate response rate: Bio weapons | 73% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
| 89% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A | |
| Multi-turn appropriate response rate: Cyberattacks | 96% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
| 99% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A | |
| Multi-turn appropriate response rate: Deadly weapons | 89% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| 87% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A | |
| Multi-turn appropriate response rate: Hate and discrimination | 95% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| 97% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A | |
| Multi-turn appropriate response rate: Influence operations | 76% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| 65% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A | |
| Multi-turn appropriate response rate: Romance scams | 94% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
| 94% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A | |
| Multi-turn appropriate response rate: Tracking and surveillance | 83% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| 73% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A | |
| Multi-turn appropriate response rate: Violent extremism | 93% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| 87% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A | |
| Political refusals (Pairwise political refusal rate)Pairwise political refusal rate, lower is better | 5% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai |
| 2.1% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API |
Engineering and Design
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| BenchCAD | 92.6% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24; printed on 1 more page | Effort: max; Tools: with tools; Fallback: with fallback |
| Blueprint-Bench 2 (normalized score) | 41.9% | Google, Gemini 4 Carbonchecked 2026-10-29 | - |
| EEBench reward | 56.4% | xAI, Grok 4.7checked 2026-10-25 | Effort: max |
| BenchCAD Vision2Code, no tools (voxel IoU) | 0.437 | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 2 more pages | Tools: none |
| BenchCAD Vision2Code, with tools (voxel IoU) | 0.843 | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 2 more pages | Tools: enabled |
| BenchCAD w/o tools | 60.6% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
Preference and Composite Rankings
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Artificial Analysis Intelligence Index v4.1.1 | 65.7 | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
| Artificial Analysis Intelligence Index v5.0 | 49 | Google, Gemini 4 Carbonchecked 2026-10-29 | - |
| Artificial Analysis Intelligence Index v4.3 | 53 | Meta, Meta Muse Wonder model cardchecked 2026-10-19 | Effort: max |
| Personal Superintelligence Index (Meta internal) | 49.9 | Meta, Meta Muse Wonder model cardchecked 2026-10-19 | Effort: max |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked. Cost per task is measured by Vals AI.
| Price | Value | Printed by | Setup as printed |
|---|---|---|---|
| Input | $10 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Cached input | $0.25 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Cache write | $12.5 | Anthropic, Anthropic API pricingchecked 2026-10-15 | Cache: 5 minute cache |
| Cache write, 1 hour | $20 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Output | $50 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Input, batch | $5 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Output, batch | $25 | Anthropic, Anthropic API pricingchecked 2026-10-15 | - |
| Cost per taskVals AI, USD, lower is better | $33.37 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
Side by side
More from Anthropic
- Claude Haiku 5.5
- Claude Sonnet 5.5
- Claude Opus 5.5
- Claude Mythos 5.1
- Claude Opus 5
- Claude Sonnet 5
- Claude Fable 5
- Claude Mythos 5
- Claude Opus 4.8
- Claude Opus 4.7
- Claude Mythos Preview
- Claude Sonnet 4.6
- Claude Opus 4.6
- Claude Opus 4.5
- Claude Haiku 4.5
- Claude Sonnet 4.5
- Claude Opus 4.1
- Claude Opus 4
- Claude Sonnet 4
- Claude 3.7 Sonnet
- Claude 3.5 Sonnet
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.