BlogLLM Benchmark Scores as Published, Side by Side

Claude Fable 5.2 vs Kimi K3.1 Pro: Benchmark Scores Side by Side

Every test both Claude Fable 5.2 by Anthropic and Kimi K3.1 Pro by Moonshot AI have a published number for: 15 tests in 5 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.

Models Claude Fable 5.2, Kimi K3.1 ProData version 2026111201, as of 2026-11-12

Model

What each developer prints on its own model page; a dash means it prints none. Runs on is the smallest device that holds the model at 4-bit: the developer's words where it prints them, otherwise our estimate from the size.

FactClaude Fable 5.2Kimi K3.1 Pro
Released2026-11-092026-10-23
Context window1M1M
Max output128K-
InputText, imageText, image
OutputTextText
WeightsClosedOpen (Kimi K3.1 Pro License)
Size-2.8T (104B active)
Runs on-8 × B300 (about 1.85 TB at 4-bit, estimate)

Knowledge Work

TestClaude Fable 5.2Kimi K3.1 Pro
AutomationBench
51.4%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page
73.3%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max
OfficeQA Pro
67.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code
GDPval-AA v2.1
1846Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max
AA-Briefcase v1.1
1785Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page
1678Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max

Agentic Coding

TestClaude Fable 5.2Kimi K3.1 Pro
DeepSWE v1.1
75.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code; Dataset revision: v1.1
Terminal-Bench 4.0
67.6%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Harness: Claude Code --bare; Fallback: safeguards on; the fallback answered 2.5% of requests, affecting 10% of trials
65.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code
Vibe Code Bench
93.77%Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-11-09Harness: OpenHands
84.89%Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-11-02Harness: OpenHands

Science and Math

TestClaude Fable 5.2Kimi K3.1 Pro
GPQA Diamond
93.9%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max
94.2%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max
Terminal-Bench Science 0.1
74.6%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page
38.1%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code
FrontierMath Tier 4 (v2)
100%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max
65.9%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max
FrontierMath Tier 1-3 (v2)
95.1%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max
78.2%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max

Multimodal Understanding

TestClaude Fable 5.2Kimi K3.1 Pro
Chartography (with tools)
90.2%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python

General Knowledge and Reasoning

TestClaude Fable 5.2Kimi K3.1 Pro
Humanity's Last Exam (no tools)
51.1%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none
Humanity's Last Exam (with tools)
74.2%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page
70%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: with tools
SimpleQA Verified
94%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max
62.2%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max

Price

API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.

PriceClaude Fable 5.2Kimi K3.1 Pro
Input
$8Anthropic, Anthropic API pricing, checked 2026-11-09
Cached input
$0.2Anthropic, Anthropic API pricing, checked 2026-11-09
Cache write
$10Anthropic, Anthropic API pricing, checked 2026-11-09Cache: 5 minute cache
$2Moonshot AI, Kimi API pricing (international platform), checked 2026-10-24Cache: 5 minute cache
Cache write, 1 hour
$16Anthropic, Anthropic API pricing, checked 2026-11-09
Output
$40Anthropic, Anthropic API pricing, checked 2026-11-09
Input, batch
$4Anthropic, Anthropic API pricing, checked 2026-11-09
-
Output, batch
$20Anthropic, Anthropic API pricing, checked 2026-11-09
-
Input, fast
$16Anthropic, Anthropic API pricing, checked 2026-11-09
-
Output, fast
$80Anthropic, Anthropic API pricing, checked 2026-11-09
-
Cost per taskVals AI, USD, lower is better
$22.13Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-11-09Harness: OpenHands
$7.49Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-10-27Harness: OpenHands

Claude Fable 5.2 has 31 more and Kimi K3.1 Pro has 40 more: tests only one of them has a number for, listed on its model page.

More side by side

Every number here is read from the same catalog file as the benchmark table, data version 2026111201. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.