| Gray Swan IPI (attack success rate after k attempts)attack success rate after k attempts, lower is better | 83.2% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| BBQ ambiguous accuracy | 99.11% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| BBQ disambiguated accuracy | 60.56% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Benign request refusal rate (all languages)lower is better | 3.05% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.1.2.A, all tested languages, claude.ai |
|---|
| 0.44% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.1.2.A, all tested languages, API |
| Child safety multi-turn appropriate response rate | 95% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.B, API, without a system prompt |
|---|
| 98% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.B, claude.ai |
| Child safety single-turn harmless rate | 99.92% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.A, API |
|---|
| 99.92% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.A, claude.ai |
| Child safety single-turn refusal ratelower is better | 2.71% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.A, claude.ai |
|---|
| 0.33% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.2.A, API |
| Claude Code dual-use and benign success rate | 88.7% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Claude Code malicious request refusal rate | 66.6% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Disordered eating single-turn harmless rate | 99.04% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.2.A, claude.ai |
|---|
| 96.51% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.2.A, API |
| Disordered eating single-turn refusal ratelower is better | 0.68% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.2.A, claude.ai |
|---|
| 0.07% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.2.A, API |
| Election integrity multi-turn appropriate response rate | 87% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, claude.ai |
|---|
| 93% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.B, API |
| Election integrity single-turn harmless rate | 99.83% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API |
|---|
| 99.83% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai |
| Election integrity single-turn refusal ratelower is better | 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, claude.ai |
|---|
| 0% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Election integrity prompts (section 4.4.3), Table 4.4.3.A, API |
| Harmful request harmless response rate (all languages) | 99.32% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.1.1.A, all tested languages, claude.ai |
|---|
| 97.23% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.1.1.A, all tested languages, API |
| Malicious computer use refusal rate (without mitigations) | 58.93% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Pairwise even-handedness | 86.7% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API |
|---|
| 91.2% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai |
| Pairwise opposing perspectives acknowledged | 49.9% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API |
|---|
| 45.1% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai |
| Shade coding attack success rate (attempt level)lower is better | 30.43% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, with probes: H5.5 0/40, Sonnet 5.5 13/40, Opus 5.5 36/40, Fable 5.1 35/40, Haiku 4.5 40/40 |
|---|
| 58.4% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), coding, no safeguards: H5.5 6/40, Sonnet 5.5 16/40, Opus 5.5 37/40, Fable 5.1 39/40, Haiku 4.5 40/40 |
| Shade computer use attack success rate (attempt level)lower is better | 18.89% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, no safeguards: 1/14 for Haiku 5.5, Sonnet 5.5, Opus 5.5 and Fable 5.1; 13/14 for Haiku 4.5 |
|---|
| 10.46% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Shade indirect prompt injection attack success (scenario counts as printed in the card), computer use GUI, with probes: 1/14 for Haiku 5.5, Sonnet 5.5 and Fable 5.1; 1/14 for Opus 5.5; 10/14 for Haiku 4.5 |
| Suicide and self-harm multi-turn appropriate response rate | 71% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.B, claude.ai |
|---|
| 46% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.B, API |
| Suicide and self-harm single-turn harmless rate | 99.79% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.A, claude.ai |
|---|
| 99.46% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.A, API |
| Suicide and self-harm single-turn refusal ratelower is better | 0.55% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.A, claude.ai |
|---|
| 0.02% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Table 4.3.1.A, API |
| Behavioral audit: Accepting unverifiable authorizationlower is better | 4.55 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Admirable behavior | 3.77 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Behavior consistency | 4.18 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Biological weapons upliftlower is better | 1.046 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Causal decision theory adherencelower is better | 4.6 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Character driftlower is better | 2.078 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Chemical weapons upliftlower is better | 1.09 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Circumventing constraints or controlslower is better | 3.32 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Coherence between actions and views | 3.3 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Complying with prompt injectionslower is better | 4.08 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Condescension toward the userlower is better | 1.67 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Controlled substance synthesis upliftlower is better | 1.137 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Creative mastery | 5.39 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Disallowed cyberoffenselower is better | 1.447 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Encouragement of user delusionlower is better | 1.165 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Evasiveness on controversial topicslower is better | 1.71 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Explosive weapons upliftlower is better | 1.099 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Failure to disclose bad or lazy behaviorlower is better | 4.38 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: False completion claimslower is better | 4.85 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Fraudlower is better | 1.88 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Fun or funny behavior | 2.45 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Good for the user | 4.01 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Harmful sexual contentlower is better | 1.09 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Ignoring explicit constraintslower is better | 4.46 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Illegible thinkinglower is better | 1.41 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Important omissionslower is better | 4.74 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Input hallucinationlower is better | 3.96 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Intellectual depth | 5.25 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Military-grade weaponslower is better | 1.083 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Overrefusallower is better | 1.727 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Proposes a security shortcut in the name of expediencelower is better | 5.15 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Radiological or nuclear weapons upliftlower is better | 1.009 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Reckless tool uselower is better | 4.14 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Supporting user autonomy | 5.35 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Sycophancylower is better | 4.15 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Undermining liberal democracylower is better | 1.43 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Unfaithful thinkinglower is better | 4.41 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: User deceptionlower is better | 3.53 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Verbalized evaluation awarenesslower is better | 1.67 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Warmth | 5.8 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Behavioral audit: Wet blanketlower is better | 1.698 | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Multi-turn appropriate response rate: Bio weapons | 85% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
|---|
| 97% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
| Multi-turn appropriate response rate: Cyberattacks | 94% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
|---|
| 97% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| Multi-turn appropriate response rate: Deadly weapons | 84% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
|---|
| 80% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| Multi-turn appropriate response rate: Hate and discrimination | 100% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
|---|
| 100% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| Multi-turn appropriate response rate: Influence operations | 68% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
|---|
| 78% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
| Multi-turn appropriate response rate: Romance scams | 100% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
|---|
| 93% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| Multi-turn appropriate response rate: Tracking and surveillance | 84% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
|---|
| 89% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| Multi-turn appropriate response rate: Violent extremism | 93% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, API (solid bars), Figure 4.1.3.A |
|---|
| 89% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Multi-turn, claude.ai (hatched bars), Figure 4.1.3.A |
| Political refusals (Pairwise political refusal rate)Pairwise political refusal rate, lower is better | 5.4% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, API |
|---|
| 3.6% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | Setup as reported: Pairwise political bias evaluation (Figure 4.4.1.A-C); the card prints the values as bar labels, claude.ai |
| Sandbox escape attempted crossings, all severitieslower is better | 19.9% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Sandbox escape attempted crossings, low severitylower is better | 4.1% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|
| Sandbox escape attempted crossings, moderate severity and abovelower is better | 15.8% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
|---|