BlogLLM Benchmark Scores as Published, Side by Side
GPT-6 Astra vs Claude Fable 5.1: Benchmark Scores Side by Side
Every test both GPT-6 Astra by OpenAI and Claude Fable 5.1 by Anthropic have a published number for: 82 tests in 13 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.
Models GPT-6 Astra, Claude Fable 5.1Data version 2026103001, as of 2026-10-30
Model
What each developer prints on its own model page; a dash means it prints none.
| Fact | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| Released | 2026-09-03 | 2026-09-01 |
| Context window | 1.05M | 1M |
| Max output | 128K | 128K |
| Input | Text, image | Text, image |
| Output | Text | Text |
| Weights | Closed | Closed |
Knowledge Work
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| AutomationBench | 41.4%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 7 more pages | 31.4%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 9 more pages |
| APEX-Agents | ||
| JobBench | ||
| Vals Finance Agent v2 | 53.5%Google, Gemini 4 Argon, checked 2026-10-29; printed on 2 more pages | 58.9%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page |
| Harvey's Legal Agent Benchmark | 5.4%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page | 6.7%Google, Gemini 4 Argon, checked 2026-10-29; printed on 2 more pages |
| OfficeQA Pro | 66.2%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Codex; Fallback: with fallback | 69%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 2 more pages |
| GDPval-AA v2.1 | 1542Anthropic, Claude Opus 5.5, checked 2026-10-14; printed on 3 more pages | 1735Anthropic, Claude Opus 5.5, checked 2026-10-14; printed on 4 more pages |
| Vending-Bench 2 (final balance in USD) | $15515Google, Gemini 4 Carbon, checked 2026-10-29 | $5422Google, Gemini 4 Carbon, checked 2026-10-29 |
| AA-Briefcase v1.1 | 1569Anthropic, Claude Opus 5.5 System Card, checked 2026-10-25; printed on 1 more page | |
| GDP.pdf w/ python (mean rubric pass rate) | 85.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | 85.1%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 1 more pageTools: python |
| Harvey LAB-AA v1.1 (tasks meeting every criterion) | 16.7%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 1 more pageEffort: xhigh | |
| Business Operation (Internal) | ||
| FrontierFinance | 45%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Finance Agent v2; Fallback: with fallback | 60.8%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Finance Agent v2; Fallback: with fallback |
| OfficeQA Pro v2 | 54.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Codex; Fallback: with fallback | 54.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code; Fallback: with fallback |
| Vals Index | 63.1%Google, Gemini 4 Argon, checked 2026-10-29 | 65.8%Google, Gemini 4 Argon, checked 2026-10-29 |
Agentic Coding
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| DeepSWE v1.1 | 74.1%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 3 more pages | 67.4%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 5 more pages |
| Terminal-Bench 4.0 | 57.9%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 7 more pages | 55.8%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 11 more pagesModel setup as reported: Release table; exact effort is unspecified here unless stated. See system card for full protocol. 60.9%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15Model setup as reported: Second value printed in the Fable 5.1 cell as "60.9% (Mythos 5.1)": filed under the Fable 5.1 heading, the label names Claude Mythos 5.1. |
| ProgramBench Almost@1 | 52.5%Meta, Meta Muse Wonder model card, checked 2026-10-19; printed on 1 more pageEffort: max; Harness: mini-swe-agent | 55.5%Meta, Meta Muse Wonder model card, checked 2026-10-19; printed on 1 more pageEffort: max; Harness: mini-swe-agent |
| SWE-Marathon | ||
| FrontierCode v1.1 Main | 53.3%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 2 more pages | 50.9%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 3 more pagesEffort: medium |
| FrontierSWE v2 | 65.5%Anthropic, Claude Opus 5.5 System Card, checked 2026-10-25; printed on 3 more pages | 57%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 5 more pages |
| FrontierCode v1.1 Extended | 64.5%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 1 more page | 63.6%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 2 more pagesEffort: medium |
| Kimi Code Bench 3.0 Long-horizon | ||
| SWE-sweep | 9.5%Google, Gemini 4 Carbon, checked 2026-10-29 | 2.9%Google, Gemini 4 Carbon, checked 2026-10-29 |
| Internal Database Migration Tasks | 63.9%OpenAI, GPT-6 Astra, checked 2026-10-14 | 57.8%OpenAI, GPT-6 Astra, checked 2026-10-14 |
| Vibe Code Bench | 89.6%Google, Gemini 4 Argon, checked 2026-10-29 | 90.3%Google, Gemini 4 Argon, checked 2026-10-29 |
ML Engineering
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| PostTrainBench v1.1 | 44.3%Google, Gemini 4 Argon, checked 2026-10-29 | 40.2%Google, Gemini 4 Argon, checked 2026-10-29 |
| PostTrainBench v1.2 | 41.9%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Dataset revision: v1.2; Fallback: with fallback | 44.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Dataset revision: v1.2; Fallback: with fallback |
Science and Math
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| GPQA Diamond | 96%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 1 more page | 93.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24; printed on 1 more pageEffort: max; Fallback: with fallback |
| Terminal-Bench Science 0.1 | 64.6%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 7 more pages | 52.6%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 8 more pages |
| FrontierMath Tier 4 (v2) | 97.6%OpenAI, GPT-6 Astra, checked 2026-10-14 | 87.8%OpenAI, GPT-6 Astra, checked 2026-10-14 |
| FrontierMath Tier 1-3 (v2) | ||
| LAB-Bench 2 | 85.4%Google, Gemini 4 Argon, checked 2026-10-29 | 68.6%Google, Gemini 4 Argon, checked 2026-10-29 |
| Morphology-to-molecule matching | 22.8%Anthropic, Claude Opus 5.5 System Card, checked 2026-10-25 | |
| BioMysteryBench | 78.9%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Codex; Fallback: with fallback | |
| ArXivMath (August 2026), with tools | 92.1%Anthropic, Claude Opus 5.5 System Card, checked 2026-10-25; printed on 1 more pageEffort: max; Tools: enabled | |
| RiemannBench | 72%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page | 65.6%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page |
Long Context
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| GraphWalks BFS up to 128k (F1) | 98.7%Google, Gemini 4 Argon, checked 2026-10-29 | 91.4%Google, Gemini 4 Argon, checked 2026-10-29 |
| GraphWalks BFS 256k to 1M (F1) | 71.8%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page | 65%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page |
| MemoryBench (Meta internal) |
Computer Use
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| OSWorld 2.1 partial | 80.7%Anthropic, Claude Opus 5.5, checked 2026-10-14; printed on 2 more pages | |
| OSWorld 2.1 offline subset | 80.9%Google, Gemini 4 Carbon, checked 2026-10-29 | 76.8%Google, Gemini 4 Carbon, checked 2026-10-29 |
| OSWorld 2.1 binary |
Multimodal Understanding
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| CharXiv Reasoning (no tools) | 90%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 88.8%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
| MMMU-Pro | 86.9%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 86.3%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
| GDP.pdf | ||
| CharXiv Reasoning (with tools) | 92.8%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | 92.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback |
| BabyVision (with tools) | 96.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | 95.1%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback |
| MMMU-Pro (with tools) | 87.8%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | 88.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback |
| LVBench | 87.5%Google, Gemini 4 Argon, checked 2026-10-29 | 79.7%Google, Gemini 4 Argon, checked 2026-10-29 |
| Chartography (no tools) | 42.6%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 4 more pagesEffort: max; Tools: none | |
| Chartography (with tools) | 91%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback | 86.2%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 4 more pagesEffort: max; Tools: enabled |
| ZeroBench (with tools, pass@5) | 58%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Attempt budget: pass@5; Fallback: with fallback | 59%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Attempt budget: pass@5; Fallback: with fallback |
| PerceptionBench | 77.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 63%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
| ZeroBench (pass@5) | 52%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 35%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
| ZeroBench_main (avg@5) | 43.2%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 23%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
Cybersecurity
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| ExploitBench | 100%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 2 more pages | |
| ExploitGym | 42.4%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 4 more pages | 30.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24; printed on 1 more pageEffort: max; Fallback: with fallback |
| CWE-bench v1 | 68%Google, Gemini 4 Argon, checked 2026-10-29; printed on 2 more pages | 58%Google, Gemini 4 Argon, checked 2026-10-29; printed on 2 more pages |
General Knowledge and Reasoning
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| Humanity's Last Exam (no tools) | 53.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 60.9%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 3 more pagesTools: none |
| Humanity's Last Exam (with tools) | 57.2%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 3 more pagesTools: enabled; exact tools in source | 65%Anthropic, Claude Fable 5.1 and Mythos 5.1, checked 2026-10-15; printed on 5 more pagesTools: enabled; exact tools in source |
| SimpleQA Verified | ||
| ARC-AGI-2 | 95%OpenAI, GPT-6 Astra, checked 2026-10-14 | 90%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 1 more pageEffort: max |
| ARC-AGI-1 | 98.5%OpenAI, GPT-6 Astra, checked 2026-10-14 | 97.5%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 1 more pageEffort: max |
| Humanity's Last Exam Diamond (no tools) | 65.8%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 55.1%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
| Kimi Hallu Bench Hard w/ tools (lower is better)lower is better | 5.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback | 23.3%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback |
| Kimi Hallu Bench w/o tools (lower is better)lower is better | 4.2%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback | 11.4%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback |
Healthcare
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| HealthBench | 58.3OpenAI, GPT-6 Astra System Card, checked 2026-10-25; printed on 1 more page | 60Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25 |
| HealthBench Professional (length-adjusted) | 63.4%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 4 more pages | 62.1%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 3 more pagesEffort: max |
| HealthBench Professional | 74.2%Anthropic, Claude Sonnet 5.5 System Card, checked 2026-10-19; printed on 3 more pagesEffort: max | |
| HealthBench (unadjusted) | 56.9OpenAI, GPT-6.1 Sol system card addendum, checked 2026-10-19 | 66.7Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 1 more pageEffort: max |
| HealthBench Professional (unadjusted) | 68.2%OpenAI, GPT-6.1 Sol system card addendum, checked 2026-10-19 | 74.2%Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1, checked 2026-10-25; printed on 1 more page |
Safety and Alignment
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| Gray Swan IPI (attack success rate after k attempts)attack success rate after k attempts, lower is better | 8.5%Anthropic, Claude Haiku 5.5 System Card, checked 2026-10-19; printed on 2 more pages | 1%Anthropic, Claude Haiku 5.5 System Card, checked 2026-10-19; printed on 2 more pages |
| Primary misbehavior judge score, overall (18 tasks)lower is better | 0.28Google, Gemini 4 Argon Safety and Security Report, checked 2026-10-19 | 1.57Google, Gemini 4 Argon Safety and Security Report, checked 2026-10-19 |
| Internal computer use safety benchmarklower is better | 2.4%OpenAI, GPT-6 Astra, checked 2026-10-14 | 9.5%OpenAI, GPT-6 Astra, checked 2026-10-14 |
Engineering and Design
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| BenchCAD | 95.9%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 1 more page | 92.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24; printed on 1 more pageEffort: max; Tools: with tools; Fallback: with fallback |
| Blueprint-Bench 2 (normalized score) | 49.7%Google, Gemini 4 Carbon, checked 2026-10-29 | 41.9%Google, Gemini 4 Carbon, checked 2026-10-29 |
| EEBench reward |
Preference and Composite Rankings
| Test | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| Artificial Analysis Intelligence Index v4.1.1 | 61.2OpenAI, GPT-6 Astra, checked 2026-10-14 | 65.7OpenAI, GPT-6 Astra, checked 2026-10-14 |
| Artificial Analysis Intelligence Index v5.0 | 57Google, Gemini 4 Carbon, checked 2026-10-29 | 49Google, Gemini 4 Carbon, checked 2026-10-29 |
| Artificial Analysis Intelligence Index v4.3 | ||
| Personal Superintelligence Index (Meta internal) |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.
| Price | GPT-6 Astra | Claude Fable 5.1 |
|---|---|---|
| Input | $10OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $20 per 1M tokens above 272,000 tokens | $10Anthropic, Anthropic API pricing, checked 2026-10-15 |
| Cached input | $1OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $2 per 1M tokens above 272,000 tokens | $0.25Anthropic, Anthropic API pricing, checked 2026-10-15 |
| Cache write | $12.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $25 per 1M tokens above 272,000 tokens | |
| Cache write, 1 hour | - | $20Anthropic, Anthropic API pricing, checked 2026-10-15 |
| Output | $50OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $75 per 1M tokens above 272,000 tokens | $50Anthropic, Anthropic API pricing, checked 2026-10-15 |
| Input, batch | $5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens | $5Anthropic, Anthropic API pricing, checked 2026-10-15 |
| Cached input, batch | $0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens | - |
| Cache write, batch | $6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens | - |
| Output, batch | $25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens | $25Anthropic, Anthropic API pricing, checked 2026-10-15 |
| Input, flex | $5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens | - |
| Cached input, flex | $0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens | - |
| Cache write, flex | $6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens | - |
| Output, flex | $25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens | - |
| Input, fast | $20OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $40 per 1M tokens above 272,000 tokens | - |
| Cached input, fast | $2OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $4 per 1M tokens above 272,000 tokens | - |
| Cache write, fast | $25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $50 per 1M tokens above 272,000 tokens | - |
| Output, fast | $100OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens | - |
| Input, ultrafast | $60OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $120 per 1M tokens above 272,000 tokens | - |
| Cached input, ultrafast | $6OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12 per 1M tokens above 272,000 tokens | - |
| Cache write, ultrafast | $75OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens | - |
| Output, ultrafast | $300OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $450 per 1M tokens above 272,000 tokens | - |
| Cost per taskVals AI, USD, lower is better |
GPT-6 Astra has 120 more and Claude Fable 5.1 has 55 more: tests only one of them has a number for, listed on its model page.
More side by side
- GPT-6 Astra vs Gemini 4 Carbon
- GPT-6 Astra vs Grok 4.7
- GPT-6 Astra vs DeepSeek-V4.1-Flash-1017
- GPT-6 Astra vs Qwen3.8-Max
- GPT-6 Astra vs Kimi K3.1 Pro
- GPT-6 Astra vs GLM-5.3
- Claude Fable 5.1 vs Gemini 4 Carbon
- Claude Fable 5.1 vs Grok 4.7
- Claude Fable 5.1 vs DeepSeek-V4.1-Flash-1017
- Claude Fable 5.1 vs Qwen3.8-Max
- Claude Fable 5.1 vs Kimi K3.1 Pro
- Claude Fable 5.1 vs GLM-5.3
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.