BlogLLM Benchmark Scores as Published, Side by Side
GraphWalks: Results as Published
Every result the catalog holds for GraphWalks: 30 models from 10 developers, read from 10 pages. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area Long ContextMaintainer OpenAIIntroduced 2025Data version 2026103001, as of 2026-10-30
GraphWalks gives a model a directed graph as a long edge list and asks one graph question in a single answer, with no tools. The two task types are a breadth-first search from a start node to a given depth, which returns only the nodes at exactly that depth, and a parents query, which returns the nodes with an edge pointing into a given node. The public dataset has 1,150 examples, split into inputs of 128k and shorter and inputs from 256k to 1M. Each answer ends with a 'Final Answer:' line of node IDs and is scored by recall, precision and F1 against the true set.
GraphWalks BFS 1M (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.6 LunaOpenAI, released 2026-07-09 | 51.2% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 1M |
| GPT-5.6 SolOpenAI, released 2026-07-09 | 77.1% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 1M |
| GPT-5.6 TerraOpenAI, released 2026-07-09 | 71.2% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 1M |
| GPT-5.5OpenAI, released 2026-04-23 | 45.4% | OpenAI, Introducing GPT-5.5checked 2026-10-15; printed on 1 more page | Effort: xhigh; Context: 1M |
| GPT-5.4OpenAI, released 2026-03-05 | 9.4% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Effort: xhigh; Context: 1M |
| Claude Mythos 5Anthropic, released 2026-06-09 | 79.4% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 1M |
| Claude Opus 4.8Anthropic, released 2026-05-28 | 68.1% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 1M |
| Claude Opus 4.7Anthropic, released 2026-04-16 | 41.2% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Context: 1M |
| Claude Mythos PreviewAnthropic, released 2026-04-07 | 74.3% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 1M |
| MiMo-V2.5-ProXiaomi, released 2026-04-27 | 37% | Xiaomi, Xiaomi MiMo-V2.5-Pro model cardchecked 2026-10-15 | Context: 1048576 |
| MiMo-V2-ProXiaomi, released 2026-03-18 | 0% | Xiaomi, Xiaomi MiMo-V2.5-Pro model cardchecked 2026-10-15 | Context: 1048576 |
GraphWalks BFS up to 128k (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6 AstraOpenAI, released 2026-09-03 | 98.7% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| GPT-5.4 miniOpenAI, released 2026-03-17 | 76.3% | OpenAI, Introducing GPT-5.4 mini and nanochecked 2026-10-15 | Effort: xhigh; Context: 0K-128K |
| GPT-5.4 nanoOpenAI, released 2026-03-17 | 73.4% | OpenAI, Introducing GPT-5.4 mini and nanochecked 2026-10-15 | Effort: xhigh; Context: 0K-128K |
| GPT-5.4OpenAI, released 2026-03-05 | 93% | OpenAI, Introducing GPT-5.4checked 2026-10-15; printed on 1 more page | Effort: xhigh; Context: 0K-128K |
| GPT-5.2OpenAI, released 2025-12-11 | 94% | OpenAI, Introducing GPT-5.2checked 2026-10-15; printed on 1 more page | Effort: xhigh; Context: <128k |
| GPT-5.1OpenAI, released 2025-11-12 | 76.8% | OpenAI, Introducing GPT-5.2checked 2026-10-15 | Effort: high; Context: <128k |
| GPT-5 miniOpenAI, released 2025-08-07 | 73.4% | OpenAI, Introducing GPT-5.4 mini and nanochecked 2026-10-15 | Effort: high; Context: 0K-128K |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 90.6% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| Claude Fable 5.1Anthropic, released 2026-09-01 | 91.4% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| Gemini 4 ArgonGoogle, released 2026-09-30 | 99.7% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
GraphWalks BFS 256k (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.6 LunaOpenAI, released 2026-07-09 | 81.3% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 256k |
| GPT-5.6 SolOpenAI, released 2026-07-09 | 90.7% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 256k |
| GPT-5.6 TerraOpenAI, released 2026-07-09 | 76.9% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 256k |
| GPT-5.5OpenAI, released 2026-04-23 | 73.7% | OpenAI, Introducing GPT-5.5checked 2026-10-15; printed on 1 more page | Effort: xhigh; Context: 256k |
| GPT-5.4OpenAI, released 2026-03-05 | 62.5% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Effort: xhigh; Context: 256k |
| Claude Mythos 5Anthropic, released 2026-06-09 | 91.1% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 256k |
| Claude Opus 4.8Anthropic, released 2026-05-28 | 85.9% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 256k |
| Claude Opus 4.7Anthropic, released 2026-04-16 | 76.9% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Context: 256k |
| Claude Mythos PreviewAnthropic, released 2026-04-07 | 85.7% | OpenAI, GPT-5.6: Frontier intelligence that scales with your ambitionchecked 2026-10-15 | Context: 256k |
GraphWalks (variant not stated)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| DeepSeek-V4-Flash-0731DeepSeek | 65.4% | NVIDIA, NVIDIA Nemotron 3.5 Super VL 120B-A12B model cardchecked 2026-10-19 | - |
| Qwen3.5-122B-A10BAlibaba, released 2026-02-24 | 86.1% | NVIDIA, NVIDIA Nemotron 3.5 Super VL 120B-A12B model cardchecked 2026-10-19 | - |
| Qwen3.8-Flash-NextAlibaba | 76.1% | NVIDIA, NVIDIA Nemotron 3.5 Super VL 120B-A12B model cardchecked 2026-10-19 | - |
| GLM-5.3-FlashZ.ai, released 2026-08-26 | 88.4% | NVIDIA, NVIDIA Nemotron 3.5 Super VL 120B-A12B model cardchecked 2026-10-19 | - |
| Nemotron 3.5 Super VL 120B-A12BNVIDIA, released 2026-10-15 | 89.71% | NVIDIA, NVIDIA Nemotron 3.5 Super VL 120B-A12B model cardchecked 2026-10-19 | - |
| Nemotron 3 UltraNVIDIA, released 2026-06-04 | 63.3% | NVIDIA, NVIDIA Nemotron 3.5 Super VL 120B-A12B model cardchecked 2026-10-19 | - |
| Inkling-SmallThinking Machines | 55.7% | NVIDIA, NVIDIA Nemotron 3.5 Super VL 120B-A12B model cardchecked 2026-10-19 | - |
GraphWalks BFS 256k to 1M (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6 AstraOpenAI, released 2026-09-03 | 71.8% | Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page | - |
| GPT-5.4OpenAI, released 2026-03-05 | 21.4% | OpenAI, Introducing GPT-5.4checked 2026-10-15 | Effort: xhigh; Context: 256K-1M |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 66.8% | Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page | - |
| Claude Fable 5.1Anthropic, released 2026-09-01 | 65% | Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page | - |
| Gemini 4 CarbonGoogle, released 2026-10-28 | 96.2% | Google, Gemini 4 Carbonchecked 2026-10-29 | - |
| Gemini 4 ArgonGoogle, released 2026-09-30 | 84.2% | Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page | - |
GraphWalks parents up to 128k (accuracy)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.4 miniOpenAI, released 2026-03-17 | 71.5% | OpenAI, Introducing GPT-5.4 mini and nanochecked 2026-10-15 | Effort: xhigh; Context: 0-128K |
| GPT-5.4 nanoOpenAI, released 2026-03-17 | 50.8% | OpenAI, Introducing GPT-5.4 mini and nanochecked 2026-10-15 | Effort: xhigh; Context: 0-128K |
| GPT-5.4OpenAI, released 2026-03-05 | 89.8% | OpenAI, Introducing GPT-5.4checked 2026-10-15; printed on 1 more page | Effort: xhigh; Context: 0-128K |
| GPT-5.2OpenAI, released 2025-12-11 | 89% | OpenAI, Introducing GPT-5.2checked 2026-10-15; printed on 1 more page | Effort: xhigh; Context: <128k |
| GPT-5.1OpenAI, released 2025-11-12 | 71.5% | OpenAI, Introducing GPT-5.2checked 2026-10-15 | Effort: high; Context: <128k |
| GPT-5 miniOpenAI, released 2025-08-07 | 64.3% | OpenAI, Introducing GPT-5.4 mini and nanochecked 2026-10-15 | Effort: high; Context: 0-128K |
GraphWalks parents 1M (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.5OpenAI, released 2026-04-23 | 58.5% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Effort: xhigh; Context: 1M |
| GPT-5.4OpenAI, released 2026-03-05 | 44.4% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Effort: xhigh; Context: 1M |
| Claude Opus 4.7Anthropic, released 2026-04-16 | 72% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Context: 1M |
| MiMo-V2.5-ProXiaomi, released 2026-04-27 | 62% | Xiaomi, Xiaomi MiMo-V2.5-Pro model cardchecked 2026-10-15 | Context: 1048576 |
| MiMo-V2-ProXiaomi, released 2026-03-18 | 0% | Xiaomi, Xiaomi MiMo-V2.5-Pro model cardchecked 2026-10-15 | Context: 1048576 |
GraphWalks parents 256k (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.5OpenAI, released 2026-04-23 | 90.1% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Effort: xhigh; Context: 256k |
| GPT-5.4OpenAI, released 2026-03-05 | 82.8% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Effort: xhigh; Context: 256k |
| Claude Opus 4.7Anthropic, released 2026-04-16 | 93.6% | OpenAI, Introducing GPT-5.5checked 2026-10-15 | Context: 256k |
GraphWalks up to 128k (overall F1) (GraphWalks overall F1, up to 128k)
GraphWalks overall F1, up to 128k
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Claude Sonnet 4.6Anthropic, released 2026-02-17 | 96% | Microsoft, Microsoft AI: MAI-Thinking-1 technical reportchecked 2026-10-19 | Effort: max |
| MAI-Thinking-1Microsoft, released 2026-08-12 | 90% | Microsoft, Microsoft AI: MAI-Thinking-1 technical reportchecked 2026-10-19 | - |
GraphWalks BFS 512k (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| MiMo-V2.5-ProXiaomi, released 2026-04-27 | 56% | Xiaomi, Xiaomi MiMo-V2.5-Pro model cardchecked 2026-10-15 | Context: 524288 |
GraphWalks parents 256k to 1M (accuracy)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.4OpenAI, released 2026-03-05 | 32.4% | OpenAI, Introducing GPT-5.4checked 2026-10-15 | Effort: xhigh; Context: 256K-1M |
GraphWalks parents 512k (F1)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| MiMo-V2.5-ProXiaomi, released 2026-04-27 | 92% | Xiaomi, Xiaomi MiMo-V2.5-Pro model cardchecked 2026-10-15 | Context: 524288 |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.