BlogLLM Benchmark Scores as Published, Side by Side

Vibe Code Bench: Results as Published

Every result the catalog holds for Vibe Code Bench: 68 models from 13 developers, read from 4 pages. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.

Area Agentic CodingMaintainer Vals AIIntroduced 2026Data version 2026103001, as of 2026-10-30

Vibe Code Bench tests whether an AI model can build a complete, working web application from a written description, starting from nothing. The benchmark has 100 app specifications split into validation and held-out test sets. An automated browser agent then checks each deployed app against 964 multi-step user workflows, and the score is the accuracy across their 10,131 steps.

VIBE-Pro

ModelValuePrinted bySetup as printed
Claude Sonnet 4.6Anthropic, released 2026-02-1756.1%MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15-
Claude Opus 4.6Anthropic, released 2026-02-0555.6%MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15-
Gemini 3.1 Pro PreviewGoogle, released 2026-02-1941%MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15-
MiniMax M2.7MiniMax, released 2026-03-1855.6%MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15-
MiniMax M2.5MiniMax, released 2026-02-1254.2%MiniMax, MiniMax-M2.7 model cardchecked 2026-10-15-

VIBE-V2 (MiniMax internal)

ModelValuePrinted bySetup as printed
GPT-5.5OpenAI, released 2026-04-2350.5%MiniMax, MiniMax M3checked 2026-10-15Harness: Claude Code
Claude Opus 4.7Anthropic, released 2026-04-1655.87%MiniMax, MiniMax M3checked 2026-10-15Harness: Claude Code
Gemini 3.1 Pro PreviewGoogle, released 2026-02-1928%MiniMax, MiniMax M3checked 2026-10-15Harness: Claude Code
MiniMax M3MiniMax, released 2026-06-0150.12%MiniMax, MiniMax M3checked 2026-10-15Harness: Claude Code
MiniMax M2.7MiniMax, released 2026-03-1837.89%MiniMax, MiniMax M3checked 2026-10-15Harness: Claude Code

Vibe Code Bench

ModelValuePrinted bySetup as printed
GPT-6 AstraOpenAI, released 2026-09-0389.6%Google, Gemini 4 Argonchecked 2026-10-29-
Claude Opus 5.5Anthropic, released 2026-09-2290.3%Google, Gemini 4 Argonchecked 2026-10-29-
Claude Fable 5.1Anthropic, released 2026-09-0190.3%Google, Gemini 4 Argonchecked 2026-10-29-
Gemini 4 ArgonGoogle, released 2026-09-3091.9%Google, Gemini 4 Argonchecked 2026-10-29-

Cost per task, Vibe Code Bench v1.1

Vals AI, USD, lower is better

ModelValuePrinted bySetup as printed
GPT-6.1 TerraOpenAI, released 2026-10-26$6Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-6.1 SolOpenAI, released 2026-09-29$6.23Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-6 LunaOpenAI, released 2026-09-22$1.35Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-6 SolOpenAI, released 2026-09-22$26.36Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-6 AstraOpenAI, released 2026-09-03$38.51Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-5.6 LunaOpenAI, released 2026-07-09$0.73Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-5.6 SolOpenAI, released 2026-07-09$33.4Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-5.6 TerraOpenAI, released 2026-07-09$7.89Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-5.5OpenAI, released 2026-04-23$16.66Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-5.3-CodexOpenAI, released 2026-02-05$11.91Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-5.2-CodexOpenAI, released 2025-12-18$4.15Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GPT-5.1-Codex-MaxOpenAI, released 2025-11-19$7.32Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Haiku 5.5Anthropic, released 2026-10-07$6.07Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Sonnet 5.5Anthropic, released 2026-09-28$31.25Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Opus 5.5Anthropic, released 2026-09-22$57.92Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Fable 5.1Anthropic, released 2026-09-01$33.37Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Opus 5Anthropic, released 2026-07-24$33.88Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Sonnet 5Anthropic, released 2026-06-30$25.39Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Fable 5Anthropic, released 2026-06-09$41.71Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Opus 4.8Anthropic, released 2026-05-28$26.88Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Opus 4.7Anthropic, released 2026-04-16$21.41Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Sonnet 4.6Anthropic, released 2026-02-17$5.91Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Claude Opus 4.6Anthropic, released 2026-02-05$8.69Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 4 ArgonGoogle, released 2026-09-30$8.11Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 3.8 FlashGoogle, released 2026-09-02$6.87Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 3.7 FlashGoogle, released 2026-08-13$4.83Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 3.5 Flash-LiteGoogle, released 2026-07-21$0.83Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 3.6 FlashGoogle, released 2026-07-21$3.04Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 3.5 FlashGoogle, released 2026-05-19$2.54Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 3.1 Pro PreviewGoogle, released 2026-02-19$3.83Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Gemini 2.5 ProGoogle, released 2025-03-25$1.22Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Grok 4.7xAI, released 2026-09-21$15.83Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Grok 4.6xAI, released 2026-08-12$4.88Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Grok 4.5xAI, released 2026-07-16$4.1Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Muse Spark OpenMeta, released 2026-10-15$1.66Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Muse WonderMeta, released 2026-10-12$1.8Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Muse Wonder FullMeta, released 2026-10-12$2.29Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
DeepSeek-V4.1-Flash-1017DeepSeek, released 2026-10-17$0.58Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
DeepSeek-V4.1-FlashDeepSeek, released 2026-09-10$0.41Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
DeepSeek-V4-Pro (Preview)DeepSeek, released 2026-04-24$2.21Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
DeepSeek-V4-Flash-0731DeepSeek$0.91Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
DeepSeek-V4-Pro-0813DeepSeek$0.36Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Qwen3.8-MaxAlibaba, released 2026-08-03$8.24Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Qwen3.7-PlusAlibaba, released 2026-06-01$1.08Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Qwen3.6-27BAlibaba, released 2026-04-22$4.66Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Qwen3.6-PlusAlibaba, released 2026-04-02$5.45Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Qwen3.7-MaxAlibaba$11.4Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Qwen3.8-27BAlibaba$23.46Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Kimi K3.1 ProMoonshot AI, released 2026-10-23$7.49Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Kimi K3Moonshot AI, released 2026-07-16$10.01Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Kimi K2.7 CodeMoonshot AI, released 2026-06-11$3.84Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Kimi K2.6Moonshot AI, released 2026-04-20$1.93Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GLM-5.3-FlashZ.ai, released 2026-08-26$2.35Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GLM-5.3Z.ai, released 2026-08-18$12.45Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GLM-5.2Z.ai, released 2026-06-16$8.49Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GLM-5.1Z.ai, released 2026-04-07$2.89Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
GLM-4.6Z.ai, released 2025-09-30$10.85Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Mistral Large 4 (preview)Mistral AI, released 2026-10-06$39.46Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Mistral Medium 3.5Mistral AI, released 2026-05-22$16.74Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
MiniMax-M3.1-FlashMiniMax, released 2026-10-19$1.15Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
MiniMax M3MiniMax, released 2026-06-01$6.45Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
MiniMax M2.7MiniMax, released 2026-03-18$2.82Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
MiniMax M2.5MiniMax, released 2026-02-12$2.2Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
MiMo-V2.6-FlashXiaomi, released 2026-09-21$0.56Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
MiMo-V2.6-ProXiaomi, released 2026-09-21$1.04Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
MiMo-V2.5-ProXiaomi, released 2026-04-27$0.17Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
InklingThinking Machines, released 2026-07-14$1.61Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands
Inkling-SmallThinking Machines$0.43Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.