BlogLLM Benchmark Scores as Published, Side by Side
Kimi Hallu Bench: Results as Published
Every result the catalog holds for Kimi Hallu Bench: 7 models from 5 developers, read from 1 page. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area General Knowledge and ReasoningMaintainer Moonshot AIIntroduced 2026Data version 2026103001, as of 2026-10-30
Kimi Hallu Bench is an in-house factual-accuracy test of Moonshot AI. The prompts are challenging, de-identified requests drawn from practical work tasks, and fact-checking agents check every factual claim in the answer. The score is the claim-level hallucination rate, the share of claims that contain an error, so lower is better. A Hard split with tools is built from examples crafted to probe situations where models are prone to errors.
Kimi Hallu Bench Hard w/ tools (lower is better)
lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6 AstraOpenAI, released 2026-09-03 | 5.5% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: with tools; Fallback: with fallback |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 15% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: with tools; Fallback: with fallback |
| Claude Fable 5.1Anthropic, released 2026-09-01 | 23.3% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: with tools; Fallback: with fallback |
| DeepSeek-V4.1-Flash-1017DeepSeek, released 2026-10-17 | 23.3% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: with tools |
| Kimi K3.1 ProMoonshot AI, released 2026-10-23 | 8.3% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: with tools |
| Kimi K3Moonshot AI, released 2026-07-16 | 23.4% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Tools: with tools |
| GLM-5.3Z.ai, released 2026-08-18 | 22.6% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: with tools |
Kimi Hallu Bench w/o tools (lower is better)
lower is better
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPT-6 AstraOpenAI, released 2026-09-03 | 4.2% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
| Claude Opus 5.5Anthropic, released 2026-09-22 | 6.8% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
| Claude Fable 5.1Anthropic, released 2026-09-01 | 11.4% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none; Fallback: with fallback |
| DeepSeek-V4.1-Flash-1017DeepSeek, released 2026-10-17 | 13.1% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none |
| Kimi K3.1 ProMoonshot AI, released 2026-10-23 | 5.4% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none |
| GLM-5.3Z.ai, released 2026-08-18 | 14.8% | Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24 | Effort: max; Tools: none |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.