BlogLLM Benchmark Scores as Published, Side by Side
Claude Fable 5.1 vs Qwen3.8-Max: Benchmark Scores Side by Side
Every test both Claude Fable 5.1 by Anthropic and Qwen3.8-Max by Alibaba have a published number for: 18 tests in 7 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.
Models Claude Fable 5.1, Qwen3.8-MaxData version 2026103001, as of 2026-10-30
Model
What each developer prints on its own model page; a dash means it prints none.
| Fact | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| Released | 2026-09-01 | 2026-08-03 |
| Context window | 1M | 1M |
| Max output | 128K | 131K |
| Input | Text, image | Text, image, video |
| Output | Text | Text |
| Weights | Closed | Closed |
Knowledge Work
| Test | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| AutomationBench | 31.4%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 9 more pages | 27.3%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 1 more page |
| GDPval-AA v2 | 1853Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 1 more page | 1739Z.ai, GLM-5.3 model card, checked 2026-10-15 |
| JobBench | 53.4Alibaba, Qwen3.8-Max comparison, checked 2026-10-14 | |
| Vals Finance Agent v2 | 58.9%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page | 50.6%Mistral AI, Mistral Large 4 (preview), checked 2026-10-15 |
| Harvey's Legal Agent Benchmark | 6.7%Google, Gemini 4 Argon, checked 2026-10-29; printed on 2 more pages | 10.4%Mistral AI, Mistral Large 4 (preview), checked 2026-10-15 |
Agentic Coding
| Test | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| SWE-Bench Pro | 81.2%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 1 more pageEffort: max | 67.7%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14 |
| DeepSWE v1.1 | 67.4%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 5 more pages | 56.6%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 2 more pages |
| Terminal-Bench 4.0 | 55.8%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 11 more pagesModel setup as reported: Release table; exact effort is unspecified here unless stated. See system card for full protocol. 60.9%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15Model setup as reported: Second value printed in the Fable 5.1 cell as "60.9% (Mythos 5.1)": filed under the Fable 5.1 heading, the label names Claude Mythos 5.1. | 17%Mistral AI, Mistral Large 4 (preview), checked 2026-10-15 |
| ProgramBench Almost@1 | 55.5%Meta, Meta Muse Wonder model card, checked 2026-10-19; printed on 1 more pageEffort: max; Harness: mini-swe-agent | 10.5%Z.ai, GLM-5.3 model card, checked 2026-10-15 |
Science and Math
| Test | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| GPQA Diamond | 93.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24; printed on 1 more pageEffort: max; Fallback: with fallback | 92.6%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14 |
| FrontierMath Tier 4 (v2) | 87.8%OpenAI, GPT-6 Astra, checked 2026-10-14 | |
| FrontierMath Tier 1-3 (v2) |
Cybersecurity
| Test | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| ExploitBench | 28.8%Z.ai, GLM-5.3 model card, checked 2026-10-15 |
General Knowledge and Reasoning
| Test | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| Humanity's Last Exam (no tools) | 60.9%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 3 more pagesTools: none | 43.6%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14 |
| Humanity's Last Exam (with tools) | 65%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 5 more pagesTools: enabled; exact tools in source | 56.2%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 1 more pageTools: enabled; exact tools in source |
| SimpleQA Verified |
Tool Use and Workflows
| Test | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| Toolathlon Verified | 77.8%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 2 more pagesEffort: max | 72.5%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 1 more page |
Healthcare
| Test | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| HealthBench | 60Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25 | 60.2Alibaba, Qwen3.8-Max comparison, checked 2026-10-14 |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.
| Price | Claude Fable 5.1 | Qwen3.8-Max |
|---|---|---|
| Input | $10Anthropic, Anthropic API pricing, checked 2026-10-15 | $1.65Alibaba, Alibaba Model Studio pricing, checked 2026-10-15 |
| Cached input | $0.25Anthropic, Anthropic API pricing, checked 2026-10-15 | - |
| Cache write | - | |
| Cache write, 1 hour | $20Anthropic, Anthropic API pricing, checked 2026-10-15 | - |
| Output | $50Anthropic, Anthropic API pricing, checked 2026-10-15 | $4.951Alibaba, Alibaba Model Studio pricing, checked 2026-10-15 |
| Input, batch | $5Anthropic, Anthropic API pricing, checked 2026-10-15 | - |
| Output, batch | $25Anthropic, Anthropic API pricing, checked 2026-10-15 | - |
| Cost per taskVals AI, USD, lower is better |
Claude Fable 5.1 has 119 more and Qwen3.8-Max has 27 more: tests only one of them has a number for, listed on its model page.
More side by side
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.