BlogLLM Benchmark Scores as Published, Side by Side

GPT-6 Astra vs MiniMax-M3.1-Flash: Benchmark Scores Side by Side

Every test both GPT-6 Astra by OpenAI and MiniMax-M3.1-Flash by MiniMax have a published number for: 10 tests in 6 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.

Models GPT-6 Astra, MiniMax-M3.1-FlashData version 2026111201, as of 2026-11-12

Model

What each developer prints on its own model page; a dash means it prints none. Runs on is the smallest device that holds the model at 4-bit: the developer's words where it prints them, otherwise our estimate from the size.

FactGPT-6 AstraMiniMax-M3.1-Flash
Released2026-09-032026-10-19
Context window1.05M1M
Max output128K-
InputText, imageText, image, video
OutputTextText
WeightsClosedOpen
Size-428B (23B active)
Runs on-DGX Spark × 3 (about 284 GB at 4-bit, estimate)

Knowledge Work

TestGPT-6 AstraMiniMax-M3.1-Flash
AutomationBench
41.4%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 9 more pages
62.8%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25Dataset revision: v1.0.6

Agentic Coding

TestGPT-6 AstraMiniMax-M3.1-Flash
DeepSWE v1.1
74.1%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 3 more pages
73.7%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25; printed on 1 more pageHarness: mini-SWE-agent 2.4.5; Dataset revision: v1.1
Terminal-Bench 4.0
57.9%OpenAI, GPT-6 Astra, checked 2026-10-14; printed on 8 more pages
38.1%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25Harness: Codex 0.149.1
Vibe Code Bench
89.6%Google, Gemini 4 Argon, checked 2026-10-29
73.94%Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-11-02Harness: OpenHands

ML Engineering

TestGPT-6 AstraMiniMax-M3.1-Flash
PostTrainBench v1.1
44.3%Google, Gemini 4 Argon, checked 2026-10-29
39.3%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25Harness: Claude Code 2.1.251; Dataset revision: v1.1

Multimodal Understanding

TestGPT-6 AstraMiniMax-M3.1-Flash
CharXiv Reasoning (no tools)
90%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
82.5%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25Tools: none
GDP.pdf
34.2%Meta, Meta Muse Wonder model card, checked 2026-10-19; printed on 1 more pageEffort: max
BabyVision (with tools)
96.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: python; Fallback: with fallback
91%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25Harness: Claude Code 2.1.285; Tools: enabled

General Knowledge and Reasoning

TestGPT-6 AstraMiniMax-M3.1-Flash
Humanity's Last Exam (no tools)
53.6%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
43.4%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25Tools: none; Dataset revision: text-only subset (2,158 questions)

Tool Use and Workflows

TestGPT-6 AstraMiniMax-M3.1-Flash
Agents' Last Exam (pass rate)
34.2%Google, Gemini 4 Argon, checked 2026-10-29; printed on 1 more page
29.6%MiniMax, MiniMax-M3.1-Flash model card, checked 2026-10-25; printed on 1 more page

Price

API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.

PriceGPT-6 AstraMiniMax-M3.1-Flash
Input
$10OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $20 per 1M tokens above 272,000 tokens
$0.15MiniMax, MiniMax API pricing, checked 2026-10-19
Cached input
$1OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $2 per 1M tokens above 272,000 tokens
$0.015MiniMax, MiniMax API pricing, checked 2026-10-19
Cache write
$12.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $25 per 1M tokens above 272,000 tokens
-
Output
$50OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $75 per 1M tokens above 272,000 tokens
$0.6MiniMax, MiniMax API pricing, checked 2026-10-19
Input, batch
$5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens
-
Cached input, batch
$0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens
-
Cache write, batch
$6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens
-
Output, batch
$25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens
-
Input, flex
$5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $10 per 1M tokens above 272,000 tokens
-
Cached input, flex
$0.5OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $1 per 1M tokens above 272,000 tokens
-
Cache write, flex
$6.25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12.5 per 1M tokens above 272,000 tokens
-
Output, flex
$25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $37.5 per 1M tokens above 272,000 tokens
-
Input, fast
$20OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $40 per 1M tokens above 272,000 tokens
-
Cached input, fast
$2OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $4 per 1M tokens above 272,000 tokens
-
Cache write, fast
$25OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $50 per 1M tokens above 272,000 tokens
-
Output, fast
$100OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens
-
Input, ultrafast
$60OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $120 per 1M tokens above 272,000 tokens
-
Cached input, ultrafast
$6OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $12 per 1M tokens above 272,000 tokens
-
Cache write, ultrafast
$75OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $150 per 1M tokens above 272,000 tokens
-
Output, ultrafast
$300OpenAI, OpenAI API pricing, checked 2026-10-15Context: up to 272,000 tokens; Long context: $450 per 1M tokens above 272,000 tokens
-
Cost per taskVals AI, USD, lower is better
$38.51Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-10-27Harness: OpenHands
$1.15Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-10-27Harness: OpenHands

GPT-6 Astra has 201 more and MiniMax-M3.1-Flash has 6 more: tests only one of them has a number for, listed on its model page.

More side by side

Every number here is read from the same catalog file as the benchmark table, data version 2026111201. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.