BlogLLM Benchmark Scores as Published, Side by Side

xAI Jailbreak Evaluation: Results as Published

Every result the catalog holds for xAI Jailbreak Evaluation: 3 models from 1 developer, read from 1 page. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.

Area Safety and AlignmentMaintainer xAI (internal evaluation)Data version 2026103001, as of 2026-10-30

xAI's Grok 4.7 model card (section 8.1, Jailbreaks) reports how often the model complies with attacks that should be refused. It has three parts: a battery of standard jailbreaks, both published and internally discovered; StrongReject, the StrongREJECT suite; and long-horizon multi-turn jailbreaks, including Crescendo attacks. Each part is reported as compliance, the share of should-refuse attacks answered with disallowed help, and lower is better.

Standard jailbreaks compliance

lower is better

ModelValuePrinted bySetup as printed
Grok 4.7xAI, released 2026-09-210.01%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.6xAI, released 2026-08-120.04%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.5xAI, released 2026-07-160.73%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high

StrongReject compliance

lower is better

ModelValuePrinted bySetup as printed
Grok 4.7xAI, released 2026-09-212%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.6xAI, released 2026-08-123.9%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.5xAI, released 2026-07-161.5%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high

Long-horizon jailbreaks compliance

lower is better

ModelValuePrinted bySetup as printed
Grok 4.7xAI, released 2026-09-210.65%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.6xAI, released 2026-08-121%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.