BlogLLM Benchmark Scores as Published, Side by Side

GPT-5: Benchmark Scores as Published

Every result the catalog holds for GPT-5: 55 tests in 14 areas, from 9 pages. 28 printed by OpenAI itself, the rest by the company named beside each number. Each number is as printed; nothing is ranked or rescored.

Developer OpenAIReleased 2025-08-07Context window 400KMax output 128KInput Text, imageOutput TextWeights ClosedData version 2026103001, as of 2026-10-30

Knowledge Work

Agentic Coding

TestValuePrinted bySetup as printed
SWE-bench Verified52.8%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 6 more pagesEffort: none
74.9%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
SWE-bench Multilingual55.3%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15; printed on 1 more pageEffort: high; Harness: in-house harness derived from SWE-agent; Tools: enabled; bash and edit tools
Terminal-Bench 2.035.2%DeepSeek, DeepSeek-V3.2 model cardchecked 2026-10-15; printed on 1 more pageEffort: high
Terminal-Bench (version not stated)43.8%Anthropic, Claude Haiku 4.5checked 2026-10-15; printed on 2 more pages-
Terminal-Bench Hard30.5%Z.ai, GLM-4.7 model cardchecked 2026-10-15Effort: high
Multi-SWE-bench39.3%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15Effort: high; Harness: in-house harness derived from SWE-agent; Tools: enabled; bash and edit tools

Science and Math

TestValuePrinted bySetup as printed
GPQA Diamond77.8%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 5 more pagesEffort: none; Tools: no tools
87.3%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high; Tools: python
85.7%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high; Tools: no tools
AIME 202561.9%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 6 more pagesEffort: none; Tools: no tools
94.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high; Tools: no tools
71%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none; Tools: python
99.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high; Tools: python
SciCode42.9%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15Effort: high; Tools: none
HMMT February 202593.3%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 3 more pagesEffort: high; Tools: no tools
96.7%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high; Tools: python
IMO-AnswerBench76%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15; printed on 1 more pageEffort: high; Tools: none
HMMT November 202589.2%Z.ai, GLM-4.7 model cardchecked 2026-10-15Effort: high
FrontierMath Tier 1-326.3%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 1 more pageEffort: high; Tools: python
13.5%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high; Tools: no tools

Long Context

TestValuePrinted bySetup as printed
BrowseComp Long Context 128k90%OpenAI, Introducing GPT-5.1 for developerschecked 2026-10-15Effort: high; Context: 128k

Multimodal Understanding

TestValuePrinted bySetup as printed
CharXiv Reasoning (no tools)81.1%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
57.8%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
MMMU-Pro78.4%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
62.7%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
MMMU (validation)84.2%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 3 more pagesEffort: high
74.4%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
Video-MMMU84.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
61.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
ERQA65.7%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
42%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none

General Knowledge and Reasoning

TestValuePrinted bySetup as printed
Humanity's Last Exam (no tools)6.3%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 3 more pagesEffort: none; Tools: no tools
24.8%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high; Tools: no tools
MMLU-Pro87.1%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15; printed on 1 more pageEffort: high; Tools: none
Humanity's Last Exam (with tools)35.2%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 2 more pagesEffort: high; Tools: python + search with blocklist
MMLU-Redux95.3%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15Effort: high; Tools: none
FActScore (hallucination rate)lower is better1%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
LongFact-Concepts (hallucination rate)lower is better0.7%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
LongFact-Objects (hallucination rate)lower is better0.8%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high

Code Generation

TestValuePrinted bySetup as printed
LiveCodeBench v687%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15; printed on 1 more pageEffort: high; Tools: none
Codeforces rating2537DeepSeek, DeepSeek-V3.2 model cardchecked 2026-10-15Effort: high
Aider polyglot26.7%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
88%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
OJBench (C++)56.2%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15Effort: high; Tools: none

Tool Use and Workflows

TestValuePrinted bySetup as printed
Toolathlon29%DeepSeek, DeepSeek-V3.2 model cardchecked 2026-10-15Effort: high
τ²-bench Telecom38.6%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 3 more pagesEffort: none
96.7%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
τ²-bench Retail72.8%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 3 more pagesEffort: none
81.1%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
τ²-bench Airline62.6%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 3 more pagesEffort: high
55%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
τ²-bench (domain not stated)80.2%DeepSeek, DeepSeek-V3.2 model cardchecked 2026-10-15; printed on 1 more pageEffort: high

Web Search and Research

TestValuePrinted bySetup as printed
BrowseComp54.9%OpenAI, Introducing GPT-5checked 2026-10-15; printed on 2 more pagesEffort: high
BrowseComp-ZH63%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15; printed on 1 more pageEffort: high; Tools: enabled; search, code interpreter, web browsing; Context: 256000
Seal-051.4%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15Effort: high; Tools: enabled; search, code interpreter, web browsing; Context: 256000
FRAMES86%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15; printed on 1 more pageEffort: high; Tools: enabled; search, code interpreter, web browsing; Context: 256000
FinSearchComp T348.5%Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15Effort: high; Tools: enabled; search, code interpreter, web browsing; Context: 256000
Research-Eval (Reka)45.5xAI, Grok 4.1 Fast and Agent Tools APIchecked 2026-10-15Tools: agentic search (web search, X search, code execution); exact tools per row not stated
X Browse24.2xAI, Grok 4.1 Fast and Agent Tools APIchecked 2026-10-15Tools: agentic search (web search, X search, code execution); exact tools per row not stated
FRAMES (average cost per task)lower is better$0.058xAI, Grok 4.1 Fast and Agent Tools APIchecked 2026-10-15Tools: agentic search (web search, X search, code execution); exact tools per row not stated
Research-Eval (Reka, average cost per task)lower is better$0.107xAI, Grok 4.1 Fast and Agent Tools APIchecked 2026-10-15Tools: agentic search (web search, X search, code execution); exact tools per row not stated
X Browse (average cost per task)lower is better$0.198xAI, Grok 4.1 Fast and Agent Tools APIchecked 2026-10-15Tools: agentic search (web search, X search, code execution); exact tools per row not stated

Instruction Following

TestValuePrinted bySetup as printed
MultiChallenge54.9%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
69.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
COLLIE99%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
70.5%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none

Multilingual

TestValuePrinted bySetup as printed
MMMLU89.4%Anthropic, Claude Haiku 4.5checked 2026-10-15; printed on 1 more page-

Writing and Conversation

TestValuePrinted bySetup as printed
Longform Writing71.4Moonshot AI, Kimi K2 Thinking release pagechecked 2026-10-15Effort: high; Tools: none

Healthcare

TestValuePrinted bySetup as printed
HealthBench54.3OpenAI, Introducing GPT-5checked 2026-10-15; printed on 1 more pageEffort: none
67.2OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
HealthBench Hard46.2OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
25.5OpenAI, Introducing GPT-5checked 2026-10-15Effort: none
HealthBench Hard (hallucination rate)lower is better1.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
3.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none

Safety and Alignment

TestValuePrinted bySetup as printed
OpenAI deception evals (deception rate)lower is better4.8%OpenAI, Introducing GPT-5checked 2026-10-15Effort: high
11.6%OpenAI, Introducing GPT-5checked 2026-10-15Effort: none

Price

API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked.

PriceValuePrinted bySetup as printed
Input$1.25OpenAI, OpenAI API pricingchecked 2026-10-15-
Cached input$0.125OpenAI, OpenAI API pricingchecked 2026-10-15-
Output$10OpenAI, OpenAI API pricingchecked 2026-10-15-
Input, batch$0.625OpenAI, OpenAI API pricingchecked 2026-10-15-
Cached input, batch$0.0625OpenAI, OpenAI API pricingchecked 2026-10-15-
Output, batch$5OpenAI, OpenAI API pricingchecked 2026-10-15-
Input, flex$0.625OpenAI, OpenAI API pricingchecked 2026-10-15-
Cached input, flex$0.0625OpenAI, OpenAI API pricingchecked 2026-10-15-
Output, flex$5OpenAI, OpenAI API pricingchecked 2026-10-15-
Input, fast$2.5OpenAI, OpenAI API pricingchecked 2026-10-15-
Cached input, fast$0.25OpenAI, OpenAI API pricingchecked 2026-10-15-
Output, fast$20OpenAI, OpenAI API pricingchecked 2026-10-15-

More from OpenAI

Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.