BlogLLM Benchmark Scores as Published, Side by Side

xAI Sycophancy: Results as Published

Every result the catalog holds for xAI Sycophancy: 3 models from 1 developer, read from 1 page. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.

Area Safety and AlignmentMaintainer xAI (internal evaluation)Data version 2026103001, as of 2026-10-30

xAI's Grok 4.7 model card (section 11.2, Sycophancy) describes an internal evaluation of whether the model abandons a correct answer when a user confidently states a wrong one. The items are factual questions in science, history and other general-knowledge topics, each paired with misleading user-supplied context. A grader compares the answer with the true answer, and the sycophancy rate is the share of items where the model follows the user instead of the correct answer, where lower is better.

Sycophancy rate

lower is better

ModelValuePrinted bySetup as printed
Grok 4.7xAI, released 2026-09-210.03%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.6xAI, released 2026-08-120.04%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high
Grok 4.5xAI, released 2026-07-160.01%xAI, Grok 4.7 model cardchecked 2026-10-14Effort: high

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.