BlogLLM Benchmark Scores as Published, Side by Side
FrontierSWE: Results as Published
Every result the catalog holds for FrontierSWE: 23 models from 8 developers, read from 11 pages. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area Agentic CodingMaintainer Proximal Labs (Proximal-Labs on GitHub)Introduced 2026Data version 2026103001, as of 2026-10-30
FrontierSWE tests coding agents on very long engineering and research jobs: reimplementing complex systems, speeding up existing code without breaking its correctness, and designing and training machine learning models on held-out data. Version 2 has 34 tasks, each with up to a 20-hour budget per trial. Results are averaged over five trials per task (mean at 5).
FrontierSWE v2
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6 SolOpenAI, released 2026-09-22 | 32.2% | Anthropic, Claude Sonnet 5.5 System Cardchecked 2026-10-19 | Effort: max; Harness: Proximal agent harness |
| GPT-6 AstraOpenAI, released 2026-09-03 | 65.5% | Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 3 more pages | - |
| GPT-5.6 SolOpenAI, released 2026-07-09 | 32% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 3 more pages | - |
| Claude Haiku 5.5Anthropic, released 2026-10-07 | 43.8% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Sonnet 5.5Anthropic, released 2026-09-28 | 61.9% | Anthropic, Claude Sonnet 5.5 System Cardchecked 2026-10-19 | Effort: max; Harness: Proximal agent harness |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 62.3% | Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 3 more pages | - |
| Claude Fable 5.1Anthropic, released 2026-09-01 | 57% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 5 more pages | - |
| Claude Opus 5Anthropic, released 2026-07-24 | 52% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25 | - |
| Claude Fable 5Anthropic, released 2026-06-09 | 48% | Anthropic, System Card: Claude Fable 5.1 & Claude Mythos 5.1checked 2026-10-25; printed on 1 more page | - |
| Gemini 4 CarbonGoogle, released 2026-10-28 | 61.2% | Google, Gemini 4 Carbonchecked 2026-10-29 | - |
| Gemini 4 ArgonGoogle, released 2026-09-30 | 55% | Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page | - |
| Grok 4.7xAI, released 2026-09-21 | 29% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: xhigh |
| Grok 4.6xAI, released 2026-08-12 | 25.3% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: xhigh |
| Kimi K3Moonshot AI, released 2026-07-16 | 25.9% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: max |
FrontierSWE (dominance score)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.6 SolOpenAI, released 2026-07-09 | 71.3 | Moonshot AI, Kimi K3 model cardchecked 2026-10-15 | Effort: max; Harness: Codex |
| GPT-5.5OpenAI, released 2026-04-23 | 64.9 | Moonshot AI, Kimi K3 model cardchecked 2026-10-15; printed on 1 more page | Effort: xhigh |
| Claude Fable 5Anthropic, released 2026-06-09 | 88.8 | Alibaba, Qwen3.8-Max comparisonchecked 2026-10-14; printed on 2 more pages | - |
| Claude Opus 4.8Anthropic, released 2026-05-28 | 70 | Alibaba, Qwen3.8-Max comparisonchecked 2026-10-14; printed on 3 more pages | - |
| Gemini 3.1 Pro PreviewGoogle, released 2026-02-19 | 39.6 | Z.ai, GLM-5.2 model cardchecked 2026-10-15 | Context: 1000000 |
| DeepSeek-V4-Pro (Preview)DeepSeek, released 2026-04-24 | 29 | Z.ai, GLM-5.2 model cardchecked 2026-10-15 | Context: 1000000 |
| Qwen3.8-MaxAlibaba, released 2026-08-03 | 73.5 | Alibaba, Qwen3.8-Max comparisonchecked 2026-10-14 | - |
| Qwen3.7-MaxAlibaba | 40.7 | Alibaba, Qwen3.8-Max comparisonchecked 2026-10-14 | - |
| Kimi K3Moonshot AI, released 2026-07-16 | 81.2 | Moonshot AI, Kimi K3 model cardchecked 2026-10-15 | Effort: max; Harness: Kimi Code |
| GLM-5.3Z.ai, released 2026-08-18 | 78.1 | Z.ai, GLM-5.3 model cardchecked 2026-10-15 | Effort: max; Context: 1000000 |
| GLM-5.2Z.ai, released 2026-06-16 | 74.4 | Z.ai, GLM-5.2 model cardchecked 2026-10-15; printed on 2 more pages | Context: 1000000 |
| GLM-5.1Z.ai, released 2026-04-07 | 30.5 | Z.ai, GLM-5.2 model cardchecked 2026-10-15 | Context: 1000000 |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.