BlogLLM Benchmark Scores as Published, Side by Side
Vibe Code Bench: Results as Published
Every result the catalog holds for Vibe Code Bench: 68 models from 13 developers, read from 4 pages. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area Agentic CodingMaintainer Vals AIIntroduced 2026Data version 2026103001, as of 2026-10-30
Vibe Code Bench tests whether an AI model can build a complete, working web application from a written description, starting from nothing. The benchmark has 100 app specifications split into validation and held-out test sets. An automated browser agent then checks each deployed app against 964 multi-step user workflows, and the score is the accuracy across their 10,131 steps.
VIBE-Pro
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Claude Sonnet 4.6Anthropic, released 2026-02-17 | 56.1% | MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15 | - |
| Claude Opus 4.6Anthropic, released 2026-02-05 | 55.6% | MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15 | - |
| Gemini 3.1 Pro PreviewGoogle, released 2026-02-19 | 41% | MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15 | - |
| MiniMax M2.7MiniMax, released 2026-03-18 | 55.6% | MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15 | - |
| MiniMax M2.5MiniMax, released 2026-02-12 | 54.2% | MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15 | - |
VIBE-V2 (MiniMax internal)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-5.5OpenAI, released 2026-04-23 | 50.5% | MiniMax, MiniMax M3checked 2026-10-15 | Harness: Claude Code |
| Claude Opus 4.7Anthropic, released 2026-04-16 | 55.87% | MiniMax, MiniMax M3checked 2026-10-15 | Harness: Claude Code |
| Gemini 3.1 Pro PreviewGoogle, released 2026-02-19 | 28% | MiniMax, MiniMax M3checked 2026-10-15 | Harness: Claude Code |
| MiniMax M3MiniMax, released 2026-06-01 | 50.12% | MiniMax, MiniMax M3checked 2026-10-15 | Harness: Claude Code |
| MiniMax M2.7MiniMax, released 2026-03-18 | 37.89% | MiniMax, MiniMax M3checked 2026-10-15 | Harness: Claude Code |
Vibe Code Bench
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6 AstraOpenAI, released 2026-09-03 | 89.6% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 90.3% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| Claude Fable 5.1Anthropic, released 2026-09-01 | 90.3% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
| Gemini 4 ArgonGoogle, released 2026-09-30 | 91.9% | Google, Gemini 4 Argonchecked 2026-10-29 | - |
Cost per task, Vibe Code Bench v1.1
Vals AI, USD, lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6.1 TerraOpenAI, released 2026-10-26 | $6 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-6.1 SolOpenAI, released 2026-09-29 | $6.23 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-6 LunaOpenAI, released 2026-09-22 | $1.35 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-6 SolOpenAI, released 2026-09-22 | $26.36 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-6 AstraOpenAI, released 2026-09-03 | $38.51 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-5.6 LunaOpenAI, released 2026-07-09 | $0.73 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-5.6 SolOpenAI, released 2026-07-09 | $33.4 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-5.6 TerraOpenAI, released 2026-07-09 | $7.89 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-5.5OpenAI, released 2026-04-23 | $16.66 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-5.3-CodexOpenAI, released 2026-02-05 | $11.91 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-5.2-CodexOpenAI, released 2025-12-18 | $4.15 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GPT-5.1-Codex-MaxOpenAI, released 2025-11-19 | $7.32 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Haiku 5.5Anthropic, released 2026-10-07 | $6.07 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Sonnet 5.5Anthropic, released 2026-09-28 | $31.25 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Opus 5.5Anthropic, released 2026-09-22 | $57.92 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Fable 5.1Anthropic, released 2026-09-01 | $33.37 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Opus 5Anthropic, released 2026-07-24 | $33.88 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Sonnet 5Anthropic, released 2026-06-30 | $25.39 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Fable 5Anthropic, released 2026-06-09 | $41.71 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Opus 4.8Anthropic, released 2026-05-28 | $26.88 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Opus 4.7Anthropic, released 2026-04-16 | $21.41 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Sonnet 4.6Anthropic, released 2026-02-17 | $5.91 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Claude Opus 4.6Anthropic, released 2026-02-05 | $8.69 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 4 ArgonGoogle, released 2026-09-30 | $8.11 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 3.8 FlashGoogle, released 2026-09-02 | $6.87 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 3.7 FlashGoogle, released 2026-08-13 | $4.83 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 3.5 Flash-LiteGoogle, released 2026-07-21 | $0.83 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 3.6 FlashGoogle, released 2026-07-21 | $3.04 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 3.5 FlashGoogle, released 2026-05-19 | $2.54 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 3.1 Pro PreviewGoogle, released 2026-02-19 | $3.83 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Gemini 2.5 ProGoogle, released 2025-03-25 | $1.22 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Grok 4.7xAI, released 2026-09-21 | $15.83 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Grok 4.6xAI, released 2026-08-12 | $4.88 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Grok 4.5xAI, released 2026-07-16 | $4.1 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Muse Spark OpenMeta, released 2026-10-15 | $1.66 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Muse WonderMeta, released 2026-10-12 | $1.8 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Muse Wonder FullMeta, released 2026-10-12 | $2.29 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| DeepSeek-V4.1-Flash-1017DeepSeek, released 2026-10-17 | $0.58 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| DeepSeek-V4.1-FlashDeepSeek, released 2026-09-10 | $0.41 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| DeepSeek-V4-Pro (Preview)DeepSeek, released 2026-04-24 | $2.21 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| DeepSeek-V4-Flash-0731DeepSeek | $0.91 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| DeepSeek-V4-Pro-0813DeepSeek | $0.36 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Qwen3.8-MaxAlibaba, released 2026-08-03 | $8.24 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Qwen3.7-PlusAlibaba, released 2026-06-01 | $1.08 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Qwen3.6-27BAlibaba, released 2026-04-22 | $4.66 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Qwen3.6-PlusAlibaba, released 2026-04-02 | $5.45 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Qwen3.7-MaxAlibaba | $11.4 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Qwen3.8-27BAlibaba | $23.46 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Kimi K3.1 ProMoonshot AI, released 2026-10-23 | $7.49 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Kimi K3Moonshot AI, released 2026-07-16 | $10.01 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Kimi K2.7 CodeMoonshot AI, released 2026-06-11 | $3.84 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Kimi K2.6Moonshot AI, released 2026-04-20 | $1.93 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GLM-5.3-FlashZ.ai, released 2026-08-26 | $2.35 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GLM-5.3Z.ai, released 2026-08-18 | $12.45 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GLM-5.2Z.ai, released 2026-06-16 | $8.49 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GLM-5.1Z.ai, released 2026-04-07 | $2.89 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| GLM-4.6Z.ai, released 2025-09-30 | $10.85 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Mistral Large 4 (preview)Mistral AI, released 2026-10-06 | $39.46 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Mistral Medium 3.5Mistral AI, released 2026-05-22 | $16.74 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| MiniMax-M3.1-FlashMiniMax, released 2026-10-19 | $1.15 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| MiniMax M3MiniMax, released 2026-06-01 | $6.45 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| MiniMax M2.7MiniMax, released 2026-03-18 | $2.82 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| MiniMax M2.5MiniMax, released 2026-02-12 | $2.2 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| MiMo-V2.6-FlashXiaomi, released 2026-09-21 | $0.56 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| MiMo-V2.6-ProXiaomi, released 2026-09-21 | $1.04 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| MiMo-V2.5-ProXiaomi, released 2026-04-27 | $0.17 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| InklingThinking Machines, released 2026-07-14 | $1.61 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
| Inkling-SmallThinking Machines | $0.43 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.