BlogLLM Benchmark Scores as Published, Side by Side

Claude Opus 5.5: Benchmark Scores as Published

Every result the catalog holds for Claude Opus 5.5: 199 tests in 17 areas, from 15 pages. 142 printed by Anthropic itself, the rest by the company named beside each number. Each number is as printed; nothing is ranked or rescored.

Developer AnthropicReleased 2026-09-22Context window 1MMax output 128KInput Text, imageOutput TextWeights ClosedData version 2026103001, as of 2026-10-30

Knowledge Work

TestValuePrinted bySetup as printed
AutomationBench40%Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 6 more pages-
APEX-Agents73.5%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Fallback: with fallback
JobBench75.4Meta, Meta Muse Wonder model cardchecked 2026-10-19Effort: max
Vals Finance Agent v258.6%Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page-
Harvey's Legal Agent Benchmark3.8%Google, Gemini 4 Argonchecked 2026-10-29-
OfficeQA Pro67.7%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
GDPval-AA v2.11846Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 4 more pages-
Vending-Bench 2 (final balance in USD)$9235Google, Gemini 4 Carbonchecked 2026-10-29-
AA-Briefcase v1.11705Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 3 more pagesEffort: high
1822Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max
1780Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: xhigh
Harvey's Legal Agent Benchmark (criterion pass rate)91.2%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max; Dataset revision: held-out set
OfficeQA78.9%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
GDP.pdf w/ python (mean rubric pass rate)83.9%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: python; Fallback: with fallback
Harvey LAB-AA v1.1 (tasks meeting every criterion)8.3%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
FrontierFinance56.7%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Harness: Finance Agent v2; Fallback: with fallback
OfficeQA Pro v262.2%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Harness: Claude Code; Fallback: with fallback
DECK-Arena (Internal, Elo)1253Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Fallback: with fallback
Vals Index67%Google, Gemini 4 Argonchecked 2026-10-29-
Vals Index v2.270.2%Google, Gemini 4 Carbonchecked 2026-10-29-

Agentic Coding

TestValuePrinted bySetup as printed
SWE-Bench Pro89.9%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
DeepSWE v1.174.2%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 3 more pages-
SWE-bench Multilingual93.9%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
Terminal-Bench 4.066.4%Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 8 more pages-
ProgramBench Almost@170.5%Meta, Meta Muse Wonder model cardchecked 2026-10-19; printed on 1 more pageEffort: max; Harness: mini-swe-agent
SWE-Marathon46.3%Meta, Meta Muse Wonder model cardchecked 2026-10-19; printed on 1 more pageEffort: max
ProgramBench91.2%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 2 more pages-
FrontierCode v1.1 Main54.6%Anthropic, Claude Opus 5.5checked 2026-10-25; printed on 3 more pagesEffort: medium
54.4%Anthropic, Claude Opus 5.5checked 2026-10-14-
FrontierSWE v262.3%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 3 more pages-
FrontierCode v1.1 Extended63.6%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max
65.3%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: medium
CursorBench 4.052.5%Anthropic, Claude Opus 5.5checked 2026-10-25; printed on 2 more pagesEffort: medium
57.8%Anthropic, Claude Opus 5.5checked 2026-10-14-
SWE-Bench Multimodal61.4%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
Kimi Code Bench 3.0 Long-horizon58.5%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Fallback: with fallback
SWE-sweep3.6%Google, Gemini 4 Carbonchecked 2026-10-29-
Vibe Code Bench90.3%Google, Gemini 4 Argonchecked 2026-10-29-

ML Engineering

TestValuePrinted bySetup as printed
PostTrainBench v1.149.3%Google, Gemini 4 Argonchecked 2026-10-29-
PostTrainBench v1.243.8%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Dataset revision: v1.2; Fallback: with fallback

Science and Math

TestValuePrinted bySetup as printed
GPQA Diamond93.9%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Fallback: with fallback
BioMysteryBench Human Difficult50%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
Terminal-Bench Science 0.158.7%Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 6 more pages-
BioMysteryBench Human Solvable89.3%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
LAB-Bench 273.1%Google, Gemini 4 Argonchecked 2026-10-29-
Protocol Understanding (V2)69%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
Protocols Troubleshooting73.7%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
Morphology-to-molecule matching34%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
LatchBio SingleCellBench61.2%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more page-
LatchBio SpatialBench Verified72%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more page-
Protein sequence generation60.2%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
ADME medicinal chemistry (504 questions)63.5%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more page-
Biomedical image analysis71.4%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more page-
BioMysteryBench81.9%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Fallback: with fallback
ArXivMath (August 2026), with tools96.9%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max; Tools: enabled
De novo binder design82.6%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more page-
Protein library ranking56%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
RiemannBench69.6%Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page-
ArXivMath (August 2026), no tools91.2%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max; Tools: none
Terminal-Bench Science 0.1 (average cost per task)lower is better$23.21OpenAI, GPT-6.1 Solchecked 2026-10-14-

Long Context

TestValuePrinted bySetup as printed
GraphWalks BFS up to 128k (F1)90.6%Google, Gemini 4 Argonchecked 2026-10-29-
GraphWalks BFS 256k to 1M (F1)66.8%Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page-
MemoryBench (Meta internal)81.5%Meta, Meta Muse Wonder model cardchecked 2026-10-19Effort: max

Computer Use

TestValuePrinted bySetup as printed
OSWorld 2.0 partial81.8%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max
OSWorld 2.1 partial81.8%Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 4 more pages-
OSWorld 2.1 offline subset87.2%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
OSWorld 2.1 binary53.2%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
OSWorld 2.0 strict48.7%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max

Multimodal Understanding

TestValuePrinted bySetup as printed
CharXiv Reasoning (no tools)92.1%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
MMMU-Pro87.7%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
GDP.pdf30.6%Meta, Meta Muse Wonder model cardchecked 2026-10-19; printed on 1 more pageEffort: max
CharXiv Reasoning (with tools)93.8%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: python; Fallback: with fallback
BabyVision (with tools)97.7%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: python; Fallback: with fallback
MMMU-Pro (with tools)89.8%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: python; Fallback: with fallback
LVBench83.7%Google, Gemini 4 Argonchecked 2026-10-29-
Chartography (no tools)64.4%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 4 more pagesEffort: max; Tools: none
Chartography (with tools)89%Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 3 more pagesTools: enabled; exact tools in source
ZeroBench (with tools, pass@5)61%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: python; Attempt budget: pass@5; Fallback: with fallback
PerceptionBench72.1%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
ZeroBench (pass@5)43%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
ZeroBench_main (avg@5)35%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback

Cybersecurity

General Knowledge and Reasoning

TestValuePrinted bySetup as printed
Humanity's Last Exam (no tools)64.4%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 2 more pagesEffort: max
Humanity's Last Exam (with tools)67.7%Anthropic, Claude Opus 5.5checked 2026-10-14; printed on 4 more pagesTools: enabled; exact tools in source
Humanity's Last Exam Diamond (no tools)60.9%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
Kimi Hallu Bench Hard w/ tools (lower is better)lower is better15%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback
Kimi Hallu Bench w/o tools (lower is better)lower is better6.8%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback

Tool Use and Workflows

TestValuePrinted bySetup as printed
Agents' Last Exam (pass rate)38.2%Google, Gemini 4 Argonchecked 2026-10-29; printed on 1 more page-
Toolathlon Verified77.8%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
Toolathlon Verified Pass@382.4%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
Toolathlon Verified Pass^372.2%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
Toolathlon Verified average assistant turnslower is better26.9Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max
Agents' Last Exam (CLI)40.7%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Dataset revision: v1.1; Fallback: with fallback
Agents' Last Exam v1.1 (score)71.6%Google, Gemini 4 Carbonchecked 2026-10-29-

Web Search and Research

TestValuePrinted bySetup as printed
BrowseComp90.8%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Fallback: with fallback

Instruction Following

TestValuePrinted bySetup as printed
HANDBOOK.md41.5%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Harness: OpenHands; Fallback: with fallback

Multilingual

TestValuePrinted bySetup as printed
Global-MMLU94.3%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 2 more pagesEffort: max
MILU93.1%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 2 more pagesEffort: max

Healthcare

TestValuePrinted bySetup as printed
HealthBench60.6Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25-
HealthBench Professional (length-adjusted)65.6%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageEffort: max
HealthBench Professional77.1%Anthropic, Claude Sonnet 5.5 System Cardchecked 2026-10-19; printed on 1 more pageEffort: max
HealthBench (unadjusted)68.1Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max
HealthBench Professional (unadjusted)77.1%Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25Effort: max
PhysicianBench68.4%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-

Safety and Alignment

TestValuePrinted bySetup as printed
Gray Swan IPI (attack success rate after k attempts)attack success rate after k attempts, lower is better1%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 2 more pages-
Self-preference bias, Claude-identity system prompt (0-9 scale)lower is better0.07Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Self-preference bias, no system prompt (0-9 scale)lower is better0.01Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
BBQ ambiguous accuracy99.99%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
BBQ disambiguated accuracy89.65%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
Benign request refusal rate (all languages)lower is better0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.1.2.A, all tested languages, API
0.33%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.1.2.A, all tested languages, claude.ai
Child safety multi-turn appropriate response rate99%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.2.B, claude.ai
84%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.B, API, without a system prompt
Child safety single-turn harmless rate99.81%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.2.A, claude.ai
99.14%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.A, API
Child safety single-turn refusal ratelower is better0.05%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.2.A, claude.ai
0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.2.A, API
Claude Code dual-use and benign success rate100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
Claude Code malicious request refusal rate81%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
Disordered eating single-turn harmless rate99.26%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.3.2.A, claude.ai
95.64%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.2.A, API
Disordered eating single-turn refusal ratelower is better0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.3.2.A, API
0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.2.A, claude.ai
Election integrity multi-turn appropriate response rate87%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, API
85%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, claude.ai
Election integrity single-turn harmless rate100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai
100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API
Election integrity single-turn refusal ratelower is better0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai
0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API
Harmful request harmless response rate (all languages)99.36%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.1.1.A, all tested languages, claude.ai
94.28%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.1.1.A, all tested languages, API
Malicious computer use refusal rate (without mitigations)79.46%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
Pairwise even-handedness99.4%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API
99.5%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai
Pairwise opposing perspectives acknowledged26.9%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API
71.3%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai
Shade coding attack success rate (attempt level)lower is better11.13%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, with probes: H5.5 0/40, Sonnet 5.5 13/40, Opus 5.5 36/40, Fable 5.1 35/40, Haiku 4.5 40/40
54.61%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, no safeguards: H5.5 6/40, Sonnet 5.5 16/40, Opus 5.5 37/40, Fable 5.1 39/40, Haiku 4.5 40/40
Shade computer use attack success rate (attempt level)lower is better0.07%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, no safeguards: 1/14 for Haiku 5.5, Sonnet 5.5, Opus 5.5 and Fable 5.1; 13/14 for Haiku 4.5
0.04%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, with probes: 1/14 for Haiku 5.5, Sonnet 5.5 and Fable 5.1; 1/14 for Opus 5.5; 10/14 for Haiku 4.5
Suicide and self-harm multi-turn appropriate response rate94%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.3.1.B, claude.ai
66%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.B, API
Suicide and self-harm single-turn harmless rate99.16%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.3.1.A, API
99.95%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.A, claude.ai
Suicide and self-harm single-turn refusal ratelower is better0.39%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more pageSetup as reported: Table 4.3.1.A, claude.ai
0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Table 4.3.1.A, API
Primary misbehavior judge score, overall (18 tasks)lower is better2.18Google, Gemini 4 Argon Safety and Security Reportchecked 2026-10-19-
Browser use red-teamer attack success rate (attempt level)lower is better0%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19; printed on 1 more page-
Behavioral audit: Accepting unverifiable authorizationlower is better2.59Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Admirable behavior7.03Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Behavior consistency6.97Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Biological weapons upliftlower is better1.013Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Causal decision theory adherencelower is better3.17Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Character driftlower is better1.067Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Chemical weapons upliftlower is better1.022Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Circumventing constraints or controlslower is better1.64Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Coherence between actions and views6.98Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Complying with prompt injectionslower is better1.51Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Condescension toward the userlower is better1.41Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Controlled substance synthesis upliftlower is better1.055Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Creative mastery7.06Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Disallowed cyberoffenselower is better1.099Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Encouragement of user delusionlower is better1.03Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Evasiveness on controversial topicslower is better1.18Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Explosive weapons upliftlower is better1.019Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Failure to disclose bad or lazy behaviorlower is better1.45Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: False completion claimslower is better1.48Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Fraudlower is better1.096Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Fun or funny behavior2.98Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Good for the user7.31Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Harmful sexual contentlower is better1.054Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Ignoring explicit constraintslower is better1.88Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Illegible thinkinglower is better2.32Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Important omissionslower is better1.73Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Input hallucinationlower is better1.32Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Intellectual depth7.83Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Military-grade weaponslower is better1.038Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Overrefusallower is better1.706Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Proposes a security shortcut in the name of expediencelower is better1.94Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Radiological or nuclear weapons upliftlower is better1.003Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Reckless tool uselower is better2.1Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Supporting user autonomy7.46Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Sycophancylower is better1.76Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Undermining liberal democracylower is better1.17Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Unfaithful thinkinglower is better1.62Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: User deceptionlower is better1.19Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Verbalized evaluation awarenesslower is better2.11Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Warmth6.66Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Behavioral audit: Wet blanketlower is better1.825Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Multi-turn appropriate response rate: Bio weapons89%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
94%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Cyberattacks95%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
100%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Deadly weapons93%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
82%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Hate and discrimination96%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
88%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Influence operations63%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
62%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Romance scams94%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
94%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Tracking and surveillance65%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
69%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Multi-turn appropriate response rate: Violent extremism95%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A
98%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A
Political refusals (Pairwise political refusal rate)Pairwise political refusal rate, lower is better2.3%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API
4.5%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai
Rate of reaching outside the sandboxlower is better21%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Sandbox escape attempted crossings, all severitieslower is better7.4%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Sandbox escape attempted crossings, low severitylower is better4.8%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Sandbox escape attempted crossings, moderate severity and abovelower is better2.6%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-
Rate of using credentials or files outside the sandboxlower is better3.4%Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19-

Engineering and Design

TestValuePrinted bySetup as printed
BenchCAD96.2%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback
Blueprint-Bench 2 (normalized score)51.2%Google, Gemini 4 Carbonchecked 2026-10-29-
BenchCAD Vision2Code, no tools (voxel IoU)0.73Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageTools: none
BenchCAD Vision2Code, with tools (voxel IoU)0.962Anthropic, Claude Opus 5.5 System Cardchecked 2026-10-25; printed on 1 more pageTools: enabled
Design Bench (Internal, Elo)927Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Fallback: with fallback
BenchCAD w/o tools73%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback

Preference and Composite Rankings

Price

API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked. Cost per task is measured by Vals AI.

PriceValuePrinted bySetup as printed
Input$4Anthropic, Anthropic API pricingchecked 2026-10-15-
Cached input$0.2Anthropic, Anthropic API pricingchecked 2026-10-15-
Cache write$5Anthropic, Anthropic API pricingchecked 2026-10-15Cache: 5 minute cache
Cache write, 1 hour$8Anthropic, Anthropic API pricingchecked 2026-10-15-
Output$20Anthropic, Anthropic API pricingchecked 2026-10-15-
Input, batch$2Anthropic, Anthropic API pricingchecked 2026-10-15-
Output, batch$10Anthropic, Anthropic API pricingchecked 2026-10-15-
Input, fast$8Anthropic, Anthropic API pricingchecked 2026-10-15-
Output, fast$40Anthropic, Anthropic API pricingchecked 2026-10-15-
Cost per taskVals AI, USD, lower is better$57.92Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27Harness: OpenHands

More from Anthropic

Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.