BlogLLM Benchmark Scores as Published, Side by Side
Sandbox Escape Evaluation: Results as Published
Every result the catalog holds for Sandbox Escape Evaluation: 6 models from 1 developer, read from 1 page. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area Safety and AlignmentMaintainer Anthropic (as printed in the system card)Introduced 2026Data version 2026103001, as of 2026-10-30
Sandbox escape evaluation: 28 handmade scenarios with a deliberate weakness in the sandbox, run fourteen times per model and graded by severity (Figure 6.2.8.A), and 1,753 scenarios run once each for the rate of reaching outside the sandbox (Figure 6.3.1.A).
Not checked against a maintainer's page.
Rate of reaching outside the sandbox
lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Claude Haiku 5.5Anthropic, released 2026-10-07 | 30% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Sonnet 5.5Anthropic, released 2026-09-28 | 22% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 21% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Mythos 5.1Anthropic, released 2026-09-01 | 54% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Mythos 5Anthropic, released 2026-06-09 | 75% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
Sandbox escape attempted crossings, all severities
lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Claude Haiku 5.5Anthropic, released 2026-10-07 | 8.7% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Sonnet 5.5Anthropic, released 2026-09-28 | 6.9% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 7.4% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Mythos 5.1Anthropic, released 2026-09-01 | 27.8% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Haiku 4.5Anthropic, released 2025-10-15 | 19.9% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
Sandbox escape attempted crossings, low severity
lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Claude Haiku 5.5Anthropic, released 2026-10-07 | 6.6% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Sonnet 5.5Anthropic, released 2026-09-28 | 4.3% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 4.8% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Mythos 5.1Anthropic, released 2026-09-01 | 14.5% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Haiku 4.5Anthropic, released 2025-10-15 | 4.1% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
Sandbox escape attempted crossings, moderate severity and above
lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Claude Haiku 5.5Anthropic, released 2026-10-07 | 2% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Sonnet 5.5Anthropic, released 2026-09-28 | 2.6% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 2.6% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Mythos 5.1Anthropic, released 2026-09-01 | 13.3% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Haiku 4.5Anthropic, released 2025-10-15 | 15.8% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
Rate of using credentials or files outside the sandbox
lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Claude Haiku 5.5Anthropic, released 2026-10-07 | 4% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Sonnet 5.5Anthropic, released 2026-09-28 | 5.3% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 3.4% | Anthropic, Claude Haiku 5.5 System Cardchecked 2026-10-19 | - |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.