BlogLLM Benchmark Scores as Published, Side by Side

Claude Haiku 5.5: Benchmark Scores as Published

Every result the catalog holds for Claude Haiku 5.5: 114 tests in 11 areas, from 4 pages. All were printed by Anthropic itself. Each number is as printed; nothing is ranked or rescored.

Developer AnthropicReleased 2026-10-07Context window 1MMax output 128KInput Text, imageOutput TextWeights ClosedData version 2026103001, as of 2026-10-30

Knowledge Work

TestValuePrinted bySetup as printed
OfficeQA Pro60.3%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
GDPval-AA v2.11620Anthropic, Claude Haiku 5.5checked 2026-10-15; printed on 1 more page-
AA-Briefcase v1.11578Anthropic, Claude Haiku 5.5checked 2026-10-15; printed on 1 more page-
OfficeQA73.5%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-

Agentic Coding

Science and Math

TestValuePrinted bySetup as printed
Terminal-Bench Science 0.120.6%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-

Computer Use

TestValuePrinted bySetup as printed
OSWorld 2.1 offline subset72.4%Anthropic, Claude Haiku 5.5checked 2026-10-15; printed on 1 more page-
OSWorld 2.1 binary37.1%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-

Multimodal Understanding

TestValuePrinted bySetup as printed
Chartography (no tools)46.4%Anthropic, Claude Haiku 5.5checked 2026-10-15; printed on 1 more pageTools: none
Chartography (with tools)86.2%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Tools: enabled

Cybersecurity

TestValuePrinted bySetup as printed
ExploitBench38%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: ExploitBench, static uniform harness, all cyber safeguards off, escape classifiers on (Figure 3.3.1.A); plain arm
49%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: ExploitBench, static uniform harness, all cyber safeguards off, escape classifiers on (Figure 3.3.1.A); AutoNudge arm
Binary Exploitation (control-flow hijacks)3Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
CyScenarioBench3.3%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Dangerous actions while oblivious to a possibly real settinglower is better1.076Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Motivated reasoning (cyber)lower is better2.32Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Unsanctioned sandbox escape attemptlower is better1.34Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
ExploitBench full arbitrary code execution1%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
ExploitBench mean capability flags5.15Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: ExploitBench, static uniform harness, all cyber safeguards off, escape classifiers on (Figure 3.3.1.A); plain arm
6.56Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: ExploitBench, static uniform harness, all cyber safeguards off, escape classifiers on (Figure 3.3.1.A); AutoNudge arm

General Knowledge and Reasoning

TestValuePrinted bySetup as printed
Humanity's Last Exam (no tools)45.9%Anthropic, Claude Haiku 5.5checked 2026-10-15; printed on 1 more pageTools: none
Humanity's Last Exam (with tools)57.4%Anthropic, Claude Haiku 5.5checked 2026-10-15; printed on 1 more pageTools: enabled; exact tools in source

Multilingual

TestValuePrinted bySetup as printed
Global-MMLU87.8%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: max
MILU87.6%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: max

Healthcare

TestValuePrinted bySetup as printed
HealthBench59.9Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: low
61.6Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: max
60.2Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: medium
60.3Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: high
61.1Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: xhigh
HealthBench Professional (length-adjusted)61.3%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: high
64.8%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: max
64.8%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
59.9%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: medium
57.9%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: low
61%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: xhigh
PhysicianBench43%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: max
17.8%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: low
25.2%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: medium
35.8%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: xhigh
31.6%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Effort: high

Safety and Alignment

TestValuePrinted bySetup as printed
Gray Swan IPI (attack success rate after k attempts)attack success rate after k attempts, lower is better4%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Gray Swan indirect prompt injection, k=15 attempts (Figure 5.2.1.A); tool use
0.2%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Gray Swan indirect prompt injection, k=15 attempts (Figure 5.2.1.A); coding
24.4%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Gray Swan indirect prompt injection, k=15 attempts (Figure 5.2.1.A); GUI
7.1%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Gray Swan indirect prompt injection, k=15 attempts (Figure 5.2.1.A)
Self-preference bias, Claude-identity system prompt (0-9 scale)lower is better0.23Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Self-preference bias, no system prompt (0-9 scale)lower is better0.15Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
BBQ ambiguous accuracy99.65%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
BBQ disambiguated accuracy55.56%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Benign request refusal rate (all languages)lower is better0.82%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.1.2.A, all tested languages, claude.ai
0.17%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.1.2.A, all tested languages, API
Child safety multi-turn appropriate response rate99%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.B, claude.ai
96%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.B, API, without a system prompt
Child safety single-turn harmless rate99.29%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.A, API
99.9%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.A, claude.ai
Child safety single-turn refusal ratelower is better0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.A, claude.ai
0.04%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.A, API
Claude Code dual-use and benign success rate98.9%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Claude Code malicious request refusal rate84.3%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Disordered eating single-turn harmless rate99.83%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.2.A, claude.ai
97.43%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.2.A, API
Disordered eating single-turn refusal ratelower is better0.03%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.2.A, API
0.11%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.2.A, claude.ai
Election integrity multi-turn appropriate response rate99%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, API
98%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, claude.ai
Election integrity single-turn harmless rate100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai
100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API
Election integrity single-turn refusal ratelower is better0.33%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai
0.33%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API
Harmful request harmless response rate (all languages)99.71%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.1.1.A, all tested languages, claude.ai
98.39%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.1.1.A, all tested languages, API
Malicious computer use refusal rate (without mitigations)82.59%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Pairwise even-handedness99.1%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai
97.7%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API
Pairwise opposing perspectives acknowledged35.9%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API
67.8%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai
Shade coding attack success rate (attempt level)lower is better0.08%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, no safeguards: H5.5 6/40, Sonnet 5.5 16/40, Opus 5.5 37/40, Fable 5.1 39/40, Haiku 4.5 40/40
0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, with probes: H5.5 0/40, Sonnet 5.5 13/40, Opus 5.5 36/40, Fable 5.1 35/40, Haiku 4.5 40/40
Shade computer use attack success rate (attempt level)lower is better0.07%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, no safeguards: 1/14 for Haiku 5.5, Sonnet 5.5, Opus 5.5 and Fable 5.1; 13/14 for Haiku 4.5
0.07%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, with probes: 1/14 for Haiku 5.5, Sonnet 5.5 and Fable 5.1; 1/14 for Opus 5.5; 10/14 for Haiku 4.5
Suicide and self-harm multi-turn appropriate response rate70%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.B, API
90%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.B, claude.ai
Suicide and self-harm single-turn harmless rate99.61%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.A, API
100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.A, claude.ai
Suicide and self-harm single-turn refusal ratelower is better0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.A, API
0.41%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.A, claude.ai
Browser use red-teamer attack success rate (attempt level)lower is better0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Accepting unverifiable authorizationlower is better2.69Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Admirable behavior6.45Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Behavior consistency6.22Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Biological weapons upliftlower is better1.017Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Causal decision theory adherencelower is better4.54Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Character driftlower is better1.082Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Chemical weapons upliftlower is better1.028Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Circumventing constraints or controlslower is better1.65Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Coherence between actions and views6.12Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Complying with prompt injectionslower is better1.56Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Condescension toward the userlower is better1.58Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Controlled substance synthesis upliftlower is better1.047Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Creative mastery6.45Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Disallowed cyberoffenselower is better1.099Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Encouragement of user delusionlower is better1.038Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Evasiveness on controversial topicslower is better1.34Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Explosive weapons upliftlower is better1.017Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Failure to disclose bad or lazy behaviorlower is better1.73Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: False completion claimslower is better1.89Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Fraudlower is better1.125Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Fun or funny behavior2.49Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Good for the user6.74Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Harmful sexual contentlower is better1.054Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Ignoring explicit constraintslower is better2.06Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Illegible thinkinglower is better2.58Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Important omissionslower is better2.04Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Input hallucinationlower is better1.88Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Intellectual depth7.39Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Military-grade weaponslower is better1.061Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Overrefusallower is better2.203Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Proposes a security shortcut in the name of expediencelower is better2.09Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Radiological or nuclear weapons upliftlower is better1.004Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Reckless tool uselower is better2.36Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Supporting user autonomy7.01Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Sycophancylower is better1.77Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Undermining liberal democracylower is better1.22Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Unfaithful thinkinglower is better1.85Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: User deceptionlower is better1.36Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Verbalized evaluation awarenesslower is better1.92Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Warmth5.94Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Wet blanketlower is better2.089Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Multi-turn appropriate response rate: Bio weapons94%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
89%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Cyberattacks100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
98%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Deadly weapons78%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
78%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Hate and discrimination99%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
98%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Influence operations87%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
88%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Romance scams94%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
96%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Tracking and surveillance98%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
95%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Violent extremism90%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
90%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Political refusals (Pairwise political refusal rate)Pairwise political refusal rate, lower is better3.3%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API
5%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai
Rate of reaching outside the sandboxlower is better30%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Sandbox escape attempted crossings, all severitieslower is better8.7%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Sandbox escape attempted crossings, low severitylower is better6.6%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Sandbox escape attempted crossings, moderate severity and abovelower is better2%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Rate of using credentials or files outside the sandboxlower is better4%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-

Engineering and Design

TestValuePrinted bySetup as printed
BenchCAD Vision2Code voxel IoU0.67Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Tools: none
0.87Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Tools: enabled

Price

API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked. Cost per task is measured by Vals AI.

PriceValuePrinted bySetup as printed
Input$0.1Anthropic, Anthropic API pricingchecked 2026-10-15Context: up to 100,000 tokens; Long context: $0.5 per 1M tokens above 100,000 tokens
Cached input$0.01Anthropic, Anthropic API pricingchecked 2026-10-15Context: up to 100,000 tokens; Long context: $0.05 per 1M tokens above 100,000 tokens
Cache write$0.125Anthropic, Anthropic API pricingchecked 2026-10-15Context: up to 100,000 tokens; Long context: $0.625 per 1M tokens above 100,000 tokens; Cache: 5 minute cache
Cache write, 1 hour$0.2Anthropic, Anthropic API pricingchecked 2026-10-15Context: up to 100,000 tokens; Long context: $1 per 1M tokens above 100,000 tokens
Output$0.5Anthropic, Anthropic API pricingchecked 2026-10-15Context: up to 100,000 tokens; Long context: $2.5 per 1M tokens above 100,000 tokens
Input, batch$0.05Anthropic, Anthropic API pricingchecked 2026-10-15Context: up to 100,000 tokens; Long context: $0.25 per 1M tokens above 100,000 tokens
Output, batch$0.25Anthropic, Anthropic API pricingchecked 2026-10-15Context: up to 100,000 tokens; Long context: $1.25 per 1M tokens above 100,000 tokens
Cost per taskVals AI, USD, lower is better$6.07Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands

More from Anthropic

Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.