BlogLLM Benchmark Scores as Published, Side by Side
Claude Fable 5.1 vs Kimi K3.1 Pro: Benchmark Scores Side by Side
Every test both Claude Fable 5.1 by Anthropic and Kimi K3.1 Pro by Moonshot AI have a published number for: 41 tests in 10 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.
Models Claude Fable 5.1, Kimi K3.1 ProData version 2026103001, as of 2026-10-30
Model
What each developer prints on its own model page; a dash means it prints none.
Knowledge Work
Agentic Coding
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| DeepSWE v1.1 | 67.4%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 5 more pages | 75.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code; Dataset revision: v1.1 |
| Terminal-Bench 4.0 | 55.8%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 11 more pagesModel setup as reported: Release table; exact effort is unspecified here unless stated. See system card for full protocol. 60.9%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15Model setup as reported: Second value printed in the Fable 5.1 cell as "60.9% (Mythos 5.1)": filed under the Fable 5.1 heading, the label names Claude Mythos 5.1. | |
| ProgramBench Almost@1 | 55.5%Meta, Meta Muse Wonder model card, checked 2026-10-19; printed on 1 more pageEffort: max; Harness: mini-swe-agent | |
| SWE-Marathon | 51.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code; Dataset revision: v1.1 | |
| Kimi Code Bench 3.0 Long-horizon |
ML Engineering
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| PostTrainBench v1.2 | 44.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Dataset revision: v1.2; Fallback: with fallback | 36.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code; Dataset revision: v1.2 |
Science and Math
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| GPQA Diamond | 93.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24; printed on 1 more pageEffort: max; Fallback: with fallback | |
| Terminal-Bench Science 0.1 | 52.6%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 8 more pages | |
| BioMysteryBench |
Computer Use
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| OSWorld 2.1 partial | 80.7%Anthropic, Claude Opus 5.5, checked 2026-10-14; printed on 2 more pages |
Multimodal Understanding
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| CharXiv Reasoning (no tools) | 88.8%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | |
| MMMU-Pro | 86.3%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | |
| GDP.pdf | ||
| CharXiv Reasoning (with tools) | 92.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | |
| BabyVision (with tools) | 95.1%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | |
| MMMU-Pro (with tools) | 88.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | |
| Chartography (with tools) | 86.2%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 4 more pagesEffort: max; Tools: enabled | |
| ZeroBench (with tools, pass@5) | 59%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Attempt budget: pass@5; Fallback: with fallback | 63%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Attempt budget: pass@5 |
| PerceptionBench | 63%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | |
| ZeroBench (pass@5) | 35%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | |
| ZeroBench_main (avg@5) | 23%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
Cybersecurity
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| ExploitBench | 74.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: ExploitBench official harness; Attempt budget: 300 turns; pass@5 | |
| ExploitGym | 30.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24; printed on 1 more pageEffort: max; Fallback: with fallback | 20.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Kimi Code; Attempt budget: 6-hour wall-clock budget per task |
General Knowledge and Reasoning
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| Humanity's Last Exam (no tools) | 60.9%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 3 more pagesTools: none | |
| Humanity's Last Exam (with tools) | 65%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 5 more pagesTools: enabled; exact tools in source | |
| Humanity's Last Exam Diamond (no tools) | 55.1%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | |
| Kimi Hallu Bench Hard w/ tools (lower is better)lower is better | 23.3%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback | |
| Kimi Hallu Bench w/o tools (lower is better)lower is better | 11.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
Instruction Following
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| HANDBOOK.md | 38.8%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: OpenHands; Fallback: with fallback |
Engineering and Design
| Test | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| BenchCAD | 92.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24; printed on 1 more pageEffort: max; Tools: with tools; Fallback: with fallback | 92.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code; Tools: with tools |
| BenchCAD w/o tools | 60.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.
| Price | Claude Fable 5.1 | Kimi K3.1 Pro |
|---|---|---|
| Input | $10Anthropic, Anthropic API pricing, checked 2026-10-15 | $2Moonshot AI, Kimi API pricing (international platform), checked 2026-10-24 |
| Cached input | $0.25Anthropic, Anthropic API pricing, checked 2026-10-15 | $0.2Moonshot AI, Kimi API pricing (international platform), checked 2026-10-24 |
| Cache write | ||
| Cache write, 1 hour | $20Anthropic, Anthropic API pricing, checked 2026-10-15 | $4Moonshot AI, Kimi API pricing (international platform), checked 2026-10-24 |
| Output | $50Anthropic, Anthropic API pricing, checked 2026-10-15 | $10Moonshot AI, Kimi API pricing (international platform), checked 2026-10-24 |
| Input, batch | $5Anthropic, Anthropic API pricing, checked 2026-10-15 | - |
| Output, batch | $25Anthropic, Anthropic API pricing, checked 2026-10-15 | - |
| Cost per taskVals AI, USD, lower is better |
Claude Fable 5.1 has 96 more and Kimi K3.1 Pro has 10 more: tests only one of them has a number for, listed on its model page.
More side by side
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.