BlogLLM Benchmark Scores as Published, Side by Side

xAI CBRN Weapons Refusals: Results as Published

Every result the catalog holds for xAI CBRN Weapons Refusals: 3 models from 1 developer, read from 1 page. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.

Area Safety and AlignmentMaintainer xAI (internal evaluation)Data version 2026103001, as of 2026-10-30

xAI's Grok 4.7 model card (section 9.3, CBRN / weapons refusals) reports how often the model refuses requests about chemical, biological, radiological and nuclear weapons. The bio and chem parts use xAI's internal Autointent-Bio and Autointent-Chem suites of dangerous and benign CBRN queries, and the radiological and nuclear part uses FORTRESS-RN, a variant of the FORTRESS family of safeguard tests. The results are reported as refusal recall and refusal accuracy figures, and the card does not state the number of queries.

CBRN bio refusal recall

ModelValuePrinted bySetup as printed
Grok 4.7xAI, released 2026-09-21100%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.6xAI, released 2026-08-12100%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.5xAI, released 2026-07-1697.9%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high

CBRN chem refusal recall

ModelValuePrinted bySetup as printed
Grok 4.7xAI, released 2026-09-2199.9%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.6xAI, released 2026-08-12100%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.5xAI, released 2026-07-1696.7%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high

FORTRESS-RN refusal accuracy

ModelValuePrinted bySetup as printed
Grok 4.7xAI, released 2026-09-2197.9%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.6xAI, released 2026-08-1297.9%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.5xAI, released 2026-07-1697.9%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.