BlogLLM Benchmark Scores as Published, Side by Side
Mistral Small 4: Benchmark Scores as Published
Every result the catalog holds for Mistral Small 4: 15 tests in 9 areas, from 3 pages. All were printed by Mistral AI itself. Each number is as printed; nothing is ranked or rescored.
Developer Mistral AIReleased 2026-03-16Context window 256KInput Text, imageOutput TextWeights Open (Apache 2.0)Data version 2026103001, as of 2026-10-30
Science and Math
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPQA Diamond | 71.2% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
| 59.1% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none | |
| AIME 2025 | 84% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high; Harness: Score vs. Output Length chart (Mistral comparison run) |
| 83.8% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high | |
| 36% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none; Harness: Score vs. Output Length chart (Mistral comparison run) |
Long Context
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| AA-LCR | 71.2% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
| LCR (Mistral custom implementation of AA LCR) | 44 | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none; Harness: Score vs. Output Length chart (Mistral comparison run) |
| 72 | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high; Harness: Score vs. Output Length chart (Mistral comparison run) |
Multimodal Understanding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| MMMU-Pro | 46.3% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none |
| 60% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
General Knowledge and Reasoning
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| MMLU-Pro | 73.5% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none |
| 78% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
Code Generation
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| LiveCodeBench (version not stated) | 32% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none; Harness: Score vs. Output Length chart (Mistral comparison run) |
| 64% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high; Harness: Score vs. Output Length chart (Mistral comparison run) | |
| 63.6% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
Tool Use and Workflows
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| τ³-bench Banking | 7% | Mistral AI, Mistral Medium 3.5 model cardchecked 2026-10-15 | Effort: max; Harness: gpt-5.2 user simulator (low), 4 trials; terminal- or embedding-based agentic search retrieval, highest score |
| τ³-bench Airline | 38.5% | Mistral AI, Mistral Medium 3.5 model cardchecked 2026-10-15 | Effort: max; Harness: gpt-5.2 user simulator (low), 4 trials; Sierra-reported for Claude Sonnet 4.5 and Qwen3.5 |
| τ³-bench Retail | 67.8% | Mistral AI, Mistral Medium 3.5 model cardchecked 2026-10-15 | Effort: max; Harness: gpt-5.2 user simulator (low), 4 trials; Sierra-reported for Claude Sonnet 4.5 and Qwen3.5 |
| τ³-bench Telecom | 47.1% | Mistral AI, Mistral Medium 3.5 model cardchecked 2026-10-15 | Effort: max; Harness: gpt-5.2 user simulator (low), 4 trials; Sierra-reported for Claude Sonnet 4.5 and Qwen3.5 |
Web Search and Research
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| BrowseComp | 21.3% | Mistral AI, Mistral Medium 3.5 model cardchecked 2026-10-15 | Effort: max; Harness: context management, discard-all at 100k tokens (Mistral) |
Instruction Following
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| IFBench | 48 | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
| 35.7 | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none | |
| COLLIE | 62.9% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
Preference and Composite Rankings
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Arena-Hard win rate (GPT-4-1106 judge) | 55.8% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: none |
| 58.3% | Mistral AI, Mistral Small 4 model cardchecked 2026-10-15 | Effort: high |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked.
| Price | Value | Printed by | Setup as printed |
|---|---|---|---|
| Input | $0.15 | Mistral AI, Mistral API pricingchecked 2026-10-15 | - |
| Cached input | $0.015 | Mistral AI, Mistral API pricingchecked 2026-10-19 | - |
| Output | $0.6 | Mistral AI, Mistral API pricingchecked 2026-10-15 | - |
More from Mistral AI
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.