BlogLLM Benchmark Scores as Published, Side by Side
Artificial Analysis Coding Agent Index: Results as Published
Every result the catalog holds for Artificial Analysis Coding Agent Index: 11 models from 4 developers, read from 3 pages. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area Agentic CodingMaintainer Artificial AnalysisIntroduced 2026Data version 2026103001, as of 2026-10-30
The Coding Agent Index is a single score from Artificial Analysis for coding agents, meaning full tool setups such as Claude Code or Codex rather than models alone. It is an equal-weight average of benchmark components, which at v1.4 were DeepSWE, Terminal-Bench 2.1 and SWE-Atlas-QnA, a test of answering questions by tracing a code repository. Each component is scored as pass@1 averaged over three attempts per task, and reward-hacked or time-limited attempts score zero.
Artificial Analysis Coding Agent Index v1.1
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.6 LunaOpenAI, released 2026-07-09 | 74.6 | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | - |
| GPT-5.6 SolOpenAI, released 2026-07-09 | 80 | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | - |
| GPT-5.6 TerraOpenAI, released 2026-07-09 | 77.4 | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | - |
| GPT-5.5OpenAI, released 2026-04-23 | 76.4 | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | - |
| Claude Fable 5Anthropic, released 2026-06-09 | 77.2 | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | - |
| Claude Opus 4.8Anthropic, released 2026-05-28 | 72.5 | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | - |
| Gemini 3.1 Pro PreviewGoogle, released 2026-02-19 | 42.7 | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | - |
Artificial Analysis Coding Agent Index v1.4
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6 AstraOpenAI, released 2026-09-03 | 67 | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
| GPT-5.6 SolOpenAI, released 2026-07-09 | 65.1 | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
| Claude Opus 5Anthropic, released 2026-07-24 | 68.1 | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
| Claude Fable 5Anthropic, released 2026-06-09 | 67.2 | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
| Gemini 3.8 FlashGoogle, released 2026-09-02 | 61.2 | OpenAI, GPT-6 Astrachecked 2026-10-14 | - |
Artificial Analysis Coding Agent Index (version not stated)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Mistral Large 4 (preview)Mistral AI, released 2026-10-06 | 49.8 | Mistral AI, Mistral Large 4 (preview)checked 2026-10-15 | - |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.