BlogLLM Benchmark Scores as Published, Side by Side

Kimi Hallu Bench: Results as Published

Every result the catalog holds for Kimi Hallu Bench: 7 models from 5 developers, read from 1 page. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.

Area General Knowledge and ReasoningMaintainer Moonshot AIIntroduced 2026Data version 2026103001, as of 2026-10-30

Kimi Hallu Bench is an in-house factual-accuracy test of Moonshot AI. The prompts are challenging, de-identified requests drawn from practical work tasks, and fact-checking agents check every factual claim in the answer. The score is the claim-level hallucination rate, the share of claims that contain an error, so lower is better. A Hard split with tools is built from examples crafted to probe situations where models are prone to errors.

Kimi Hallu Bench Hard w/ tools (lower is better)

lower is better

ModelValuePrinted bySetup as printed
GPT-6 AstraOpenAI, released 2026-09-035.5%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback
Claude Opus 5.5Anthropic, released 2026-09-2215%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback
Claude Fable 5.1Anthropic, released 2026-09-0123.3%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools; Fallback: with fallback
DeepSeek-V4.1-Flash-1017DeepSeek, released 2026-10-1723.3%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools
Kimi K3.1 ProMoonshot AI, released 2026-10-238.3%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools
Kimi K3Moonshot AI, released 2026-07-1623.4%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Tools: with tools
GLM-5.3Z.ai, released 2026-08-1822.6%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: with tools

Kimi Hallu Bench w/o tools (lower is better)

lower is better

ModelValuePrinted bySetup as printed
GPT-6 AstraOpenAI, released 2026-09-034.2%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
Claude Opus 5.5Anthropic, released 2026-09-226.8%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
Claude Fable 5.1Anthropic, released 2026-09-0111.4%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none; Fallback: with fallback
DeepSeek-V4.1-Flash-1017DeepSeek, released 2026-10-1713.1%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none
Kimi K3.1 ProMoonshot AI, released 2026-10-235.4%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none
GLM-5.3Z.ai, released 2026-08-1814.8%Moonshot AI, Introducing Kimi K3.1 Prochecked 2026-10-24Effort: max; Tools: none

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.