BlogLLM Benchmark Scores as Published, Side by Side
DeepSeek-R1-0528: Benchmark Scores as Published
Every result the catalog holds for DeepSeek-R1-0528: 17 tests in 6 areas, from 1 page. All were printed by DeepSeek itself. Each number is as printed; nothing is ranked or rescored.
Developer DeepSeekReleased 2025-05-28Input TextOutput TextWeights Open (MIT)Data version 2026103001, as of 2026-10-30
Agentic Coding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| SWE-bench Verified | 57.6% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | Harness: Agentless |
Science and Math
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPQA Diamond | 81% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| AIME 2025 | 87.5% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| HMMT February 2025 | 79.4% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| AIME 2024 | 91.4% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| CNMO 2024 | 86.9% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
General Knowledge and Reasoning
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Humanity's Last Exam (no tools) | 17.7% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | Tools: none |
| MMLU-Pro | 85% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| MMLU-Redux | 93.4% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| SimpleQA | 27.8% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | Tools: none |
Code Generation
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| LiveCodeBench v6 | 73.3% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| Aider polyglot | 71.6% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
| Codeforces Div1 rating | 1930 | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
Tool Use and Workflows
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| τ-bench Airline | 53.5% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | Harness: GPT-4.1 as the simulated user (card note) |
| τ-bench Retail | 63.9% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | Harness: GPT-4.1 as the simulated user (card note) |
| BFCL v3 multi-turn | 37% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
Web Search and Research
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| FRAMES | 83% | DeepSeek, DeepSeek-R1-0528 model cardchecked 2026-10-15 | - |
More from DeepSeek
- DeepSeek-V4.1-Flash-1017
- DeepSeek-V4.1-Flash
- DeepSeek-V4-Flash (Preview)
- DeepSeek-V4-Flash-Base
- DeepSeek-V4-Pro (Preview)
- DeepSeek-V4-Pro-Base
- DeepSeek-V3.2
- DeepSeek-V3.2-Base
- DeepSeek-V3.2-Speciale
- DeepSeek-V3.2-Exp
- DeepSeek-V3.1-Terminus
- DeepSeek-V3.1
- DeepSeek-R1-0528-Qwen3-8B
- DeepSeek-V3-0324
- DeepSeek-R1
- DeepSeek-R1-Distill-Llama-70B
- DeepSeek-R1-Distill-Llama-8B
- DeepSeek-R1-Distill-Qwen-1.5B
- DeepSeek-R1-Distill-Qwen-14B
- DeepSeek-R1-Distill-Qwen-32B
- DeepSeek-R1-Distill-Qwen-7B
- DeepSeek-V3
- DeepSeek-V4-Flash-0731
- DeepSeek-V4-Pro-0813
- DeepSeek-V4-Vision-Exp
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.