BlogLLM Benchmark Scores as Published, Side by Side
GPT-6 Astra vs Claude Fable 5.2: Benchmark Scores Side by Side
Every test both GPT-6 Astra by OpenAI and Claude Fable 5.2 by Anthropic have a published number for: 32 tests in 8 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.
Models GPT-6 Astra, Claude Fable 5.2Data version 2026111201, as of 2026-11-12
Model
What each developer prints on its own model page; a dash means it prints none.
| Fact | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| Released | 2026-09-03 | 2026-11-09 |
| Context window | 1.05M | 1M |
| Max output | 128K | 128K |
| Input | Text, image | Text, image |
| Output | Text | Text |
| Weights | Closed | Closed |
Knowledge Work
Agentic Coding
| Test | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| DeepSWE v1.1 | 74.1%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 3 more pages | |
| Terminal-Bench 4.0 | 57.9%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 8 more pages | 67.6%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Harness: Claude Code --bare; Fallback: safeguards on; the fallback answered 2.5% of requests, affecting 10% of trials |
| FrontierSWE v2 | 65.5%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 5 more pages | 69.9%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page |
| Vibe Code Bench | 89.6%Google, Gemini 4 Argon, checked 2026-10-29 | |
| FrontierCode 2.0 | 42.8%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page | 49.1%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more pageEffort: xhigh |
| FrontierCode 2.0 (average cost per task)lower is better | $6.68Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Harness: Codex CLI | $2.48Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: medium; Harness: Claude Code $44.7Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Harness: Claude Code $6.72Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: high; Harness: Claude Code $14.19Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: xhigh; Harness: Claude Code $2.1Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: low; Harness: Claude Code |
Science and Math
| Test | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| GPQA Diamond | 96%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 1 more page | |
| Terminal-Bench Science 0.1 | 64.6%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 9 more pages | 74.6%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page |
| FrontierMath Tier 4 (v2) | 97.6%OpenAI, GPT-6 Astra, checked 2026-10-14 | |
| FrontierMath Tier 1-3 (v2) |
Computer Use
| Test | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| OSWorld 2.1 offline subset | 79.5%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 2 more pages | 89.3%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page |
| OSWorld 2.1 binary | 54.6%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09 |
Multimodal Understanding
| Test | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| Chartography (no tools) | 71%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 3 more pages | 73.4%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page |
| Chartography (with tools) | 91%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback |
General Knowledge and Reasoning
| Test | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| Humanity's Last Exam (no tools) | 53.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | |
| Humanity's Last Exam (with tools) | 57.2%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 5 more pagesTools: enabled; exact tools in source | 74.2%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09; printed on 1 more page |
| SimpleQA Verified | ||
| ARC-AGI-3 | 99.9%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 1 more page | 79.26%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: high; Harness: Standard 65.66%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Harness: Standard |
| ARC-AGI-3 (Provider Adapter harness) | 98.6%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Harness: Provider Adapter | 97.72%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: high; Harness: Provider Adapter 94.9%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Harness: Provider Adapter |
Healthcare
| Test | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| HealthBench | 58.3OpenAI, GPT-6 Astra System Card, checked 2026-10-25; printed on 2 more pages | |
| HealthBench Professional (length-adjusted) | 63.4%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 5 more pages | |
| HealthBench (unadjusted) | 56.9OpenAI, GPT-6.1 Sol system card addendum, checked 2026-10-19; printed on 1 more page | |
| HealthBench Professional (unadjusted) | 68.2%OpenAI, GPT-6.1 Sol system card addendum, checked 2026-10-19; printed on 1 more page | |
| PhysicianBench | 55%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: high; Attempt budget: 1 attempt 48%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Attempt budget: 1 attempt | 64.4%Anthropic, System Card: Claude Fable 5.2 & Claude Mythos 5.2, checked 2026-11-09Effort: max; Attempt budget: 5 attempts |
Engineering and Design
| Test | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| RoboDojo Sim | 29.8%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09 | 64.9%Anthropic, Claude Fable 5.2 and Mythos 5.2, checked 2026-11-09 |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.
| Price | GPT-6 Astra | Claude Fable 5.2 |
|---|---|---|
| Input | $10OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $20 per 1M tokens above 272,000 tokens | $8Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Cached input | $1OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $2 per 1M tokens above 272,000 tokens | $0.2Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Cache write | $12.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $25 per 1M tokens above 272,000 tokens | |
| Cache write, 1 hour | - | $16Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Output | $50OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $75 per 1M tokens above 272,000 tokens | $40Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Input, batch | $5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens | $4Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Cached input, batch | $0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens | - |
| Cache write, batch | $6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens | - |
| Output, batch | $25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens | $20Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Input, flex | $5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens | - |
| Cached input, flex | $0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens | - |
| Cache write, flex | $6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens | - |
| Output, flex | $25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens | - |
| Input, fast | $20OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $40 per 1M tokens above 272,000 tokens | $16Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Cached input, fast | $2OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $4 per 1M tokens above 272,000 tokens | - |
| Cache write, fast | $25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $50 per 1M tokens above 272,000 tokens | - |
| Output, fast | $100OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens | $80Anthropic, Anthropic API pricing, checked 2026-11-09 |
| Input, ultrafast | $60OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $120 per 1M tokens above 272,000 tokens | - |
| Cached input, ultrafast | $6OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12 per 1M tokens above 272,000 tokens | - |
| Cache write, ultrafast | $75OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens | - |
| Output, ultrafast | $300OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $450 per 1M tokens above 272,000 tokens | - |
| Cost per taskVals AI, USD, lower is better |
GPT-6 Astra has 179 more and Claude Fable 5.2 has 14 more: tests only one of them has a number for, listed on its model page.
More side by side
- GPT-6 Astra vs Gemini 4 Carbon
- GPT-6 Astra vs Grok 4.7
- GPT-6 Astra vs DeepSeek-V4.1-Flash-1017
- GPT-6 Astra vs Qwen3.8-Max
- GPT-6 Astra vs Kimi K3.1 Pro
- GPT-6 Astra vs GLM-5.3
- GPT-6 Astra vs MiniMax-M3.1-Flash
- Claude Fable 5.2 vs Gemini 4 Carbon
- Claude Fable 5.2 vs Grok 4.7
- Claude Fable 5.2 vs DeepSeek-V4.1-Flash-1017
- Claude Fable 5.2 vs Qwen3.8-Max
- Claude Fable 5.2 vs Kimi K3.1 Pro
- Claude Fable 5.2 vs GLM-5.3
Every number here is read from the same catalog file as the benchmark table, data version 2026111201. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.