BlogLLM Benchmark Scores as Published, Side by Side
xAI CBRN Weapons Refusals: Results as Published
Every result the catalog holds for xAI CBRN Weapons Refusals: 3 models from 1 developer, read from 1 page. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area Safety and AlignmentMaintainer xAI (internal evaluation)Data version 2026103001, as of 2026-10-30
xAI's Grok 4.7 model card (section 9.3, CBRN / weapons refusals) reports how often the model refuses requests about chemical, biological, radiological and nuclear weapons. The bio and chem parts use xAI's internal Autointent-Bio and Autointent-Chem suites of dangerous and benign CBRN queries, and the radiological and nuclear part uses FORTRESS-RN, a variant of the FORTRESS family of safeguard tests. The results are reported as refusal recall and refusal accuracy figures, and the card does not state the number of queries.
CBRN bio refusal recall
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Grok 4.7xAI, released 2026-09-21 | 100% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
| Grok 4.6xAI, released 2026-08-12 | 100% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
| Grok 4.5xAI, released 2026-07-16 | 97.9% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
CBRN chem refusal recall
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Grok 4.7xAI, released 2026-09-21 | 99.9% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
| Grok 4.6xAI, released 2026-08-12 | 100% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
| Grok 4.5xAI, released 2026-07-16 | 96.7% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
FORTRESS-RN refusal accuracy
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Grok 4.7xAI, released 2026-09-21 | 97.9% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
| Grok 4.6xAI, released 2026-08-12 | 97.9% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
| Grok 4.5xAI, released 2026-07-16 | 97.9% | xAI, Grok 4.7 model cardchecked 2026-10-14 | Effort: high |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.