sugra.blog

BlogLLM Benchmark Scores as Published, Side by Side

GPT-6 Astra vs Grok 4.7: Benchmark Scores Side by Side

Every test both GPT-6 Astra by OpenAI and Grok 4.7 by xAI have a published number for: 18 tests in 8 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.

Models GPT-6 Astra, Grok 4.7Data version 2026103001, as of 2026-10-30

Compare in the table

Model

What each developer prints on its own model page; a dash means it prints none.

FactGPT-6 AstraGrok 4.7
Released2026-09-032026-09-21
Context window1.05M500K
Max output128K-
InputText, imageText, image
OutputTextText
WeightsClosedClosed

Knowledge Work

TestGPT-6 AstraGrok 4.7
Harvey's Legal Agent Benchmark
5.4%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page
19.6%xAI, Grok 4.7, checked 2026-10-25; printed on 1 more pageEffort: xhigh
GDPval-AA v2.1
1542Anthropic, Claude Opus 5.5, checked 2026-10-14; printed on 3 more pages
1695xAI, Grok 4.7, checked 2026-10-25Effort: xhigh
AA-Briefcase v1.1
1569Anthropic, Claude Opus 5.5 System Card, checked 2026-10-25; printed on 1 more page
1657xAI, Grok 4.7, checked 2026-10-25Effort: xhigh

Agentic Coding

TestGPT-6 AstraGrok 4.7
DeepSWE v1.1
74.1%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 3 more pages
71%xAI, Grok 4.7, checked 2026-10-25; printed on 1 more pageEffort: high
Terminal-Bench 4.0
57.9%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 7 more pages
37.6%xAI, Grok 4.7, checked 2026-10-25; printed on 1 more pageEffort: xhigh
FrontierSWE v2
65.5%Anthropic, Claude Opus 5.5 System Card, checked 2026-10-25; printed on 3 more pages
29%xAI, Grok 4.7 model card, checked 2026-10-14Effort: xhigh

Science and Math

TestGPT-6 AstraGrok 4.7
GPQA Diamond
96%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 1 more page
92.7%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: xhigh
FrontierMath Tier 4 (v2)
97.6%OpenAI, GPT-6 Astra, checked 2026-10-14
17.1%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: xhigh
FrontierMath Tier 1-3 (v2)
93.7%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: max
53%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: xhigh
ProtocolQA (open-ended)
45.37%OpenAI, GPT-6.1 Sol system card addendum, checked 2026-10-19
70.4%xAI, Grok 4.7 model card, checked 2026-10-14Effort: high
LatchBio Capabilities v1.0 (overall score)
47.4%xAI, Grok 4.7 model card, checked 2026-10-14Effort: max
44.5%xAI, Grok 4.7 model card, checked 2026-10-14Effort: xhigh

Cybersecurity

TestGPT-6 AstraGrok 4.7
CWE-bench v1
68%Google, Gemini 4 Argon, checked 2026-10-29; printed on 2 more pages
68%Google, Gemini 4 Carbon: our next frontier model, checked 2026-10-29Harness: opencode

General Knowledge and Reasoning

TestGPT-6 AstraGrok 4.7
SimpleQA Verified
75.6%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: max
56%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: xhigh

Healthcare

TestGPT-6 AstraGrok 4.7
HealthBench Professional
74%Anthropic, Claude Sonnet 5.5 System Card, checked 2026-10-19; printed on 2 more pagesEffort: max
56.7%xAI, Grok 4.7, checked 2026-10-25; printed on 1 more pageEffort: xhigh

Biosecurity

TestGPT-6 AstraGrok 4.7
BioSecBench Function
46%xAI, Grok 4.7 model card, checked 2026-10-14Effort: max
43.3%xAI, Grok 4.7 model card, checked 2026-10-14Effort: xhigh
BioSecBench Refusal
25.5%xAI, Grok 4.7 model card, checked 2026-10-14Effort: max
62.4%xAI, Grok 4.7 model card, checked 2026-10-14Effort: xhigh
BioSecBench Surveillance
35.2%xAI, Grok 4.7 model card, checked 2026-10-14Effort: max
48%xAI, Grok 4.7 model card, checked 2026-10-14Effort: xhigh

Engineering and Design

TestGPT-6 AstraGrok 4.7
EEBench reward
69.3%xAI, Grok 4.7 model card, checked 2026-10-14Effort: max
64%xAI, Grok 4.7, checked 2026-10-25; printed on 1 more pageEffort: xhigh

Price

API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.

PriceGPT-6 AstraGrok 4.7
Input
$10OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $20 per 1M tokens above 272,000 tokens
$2xAI, xAI API pricing, checked 2026-10-15Context: up to 200,000 tokens; Long context: $4 per 1M tokens above 200,000 tokens
Cached input
$1OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $2 per 1M tokens above 272,000 tokens
$0.5xAI, xAI API pricing, checked 2026-10-15Context: up to 200,000 tokens; Long context: $1 per 1M tokens above 200,000 tokens
Cache write
$12.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $25 per 1M tokens above 272,000 tokens
-
Output
$50OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $75 per 1M tokens above 272,000 tokens
$6xAI, xAI API pricing, checked 2026-10-15Context: up to 200,000 tokens; Long context: $12 per 1M tokens above 200,000 tokens
Input, batch
$5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens
-
Cached input, batch
$0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens
-
Cache write, batch
$6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens
-
Output, batch
$25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens
-
Input, flex
$5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens
-
Cached input, flex
$0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens
-
Cache write, flex
$6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens
-
Output, flex
$25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens
-
Input, fast
$20OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $40 per 1M tokens above 272,000 tokens
$4xAI, xAI API pricing, checked 2026-10-15Context: up to 200,000 tokens; Long context: $6 per 1M tokens above 200,000 tokens
Cached input, fast
$2OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $4 per 1M tokens above 272,000 tokens
$1xAI, xAI API pricing, checked 2026-10-15Context: up to 200,000 tokens; Long context: $1.5 per 1M tokens above 200,000 tokens
Cache write, fast
$25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $50 per 1M tokens above 272,000 tokens
-
Output, fast
$100OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens
$12xAI, xAI API pricing, checked 2026-10-15Context: up to 200,000 tokens; Long context: $18 per 1M tokens above 200,000 tokens
Input, ultrafast
$60OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $120 per 1M tokens above 272,000 tokens
-
Cached input, ultrafast
$6OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12 per 1M tokens above 272,000 tokens
-
Cache write, ultrafast
$75OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens
-
Output, ultrafast
$300OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $450 per 1M tokens above 272,000 tokens
-
Cost per taskVals AI, USD, lower is better
$38.51Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-10-27Harness: OpenHands
$15.83Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-10-27Harness: OpenHands

GPT-6 Astra has 184 more and Grok 4.7 has 29 more: tests only one of them has a number for, listed on its model page.

More side by side

Every number here is read from the same catalog file as the benchmark table, data version 2026103001. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.