BlogLLM Benchmark Scores as Published, Side by Side

Kimi-VL-A3B-Thinking: Benchmark Scores as Published

Every result the catalog holds for Kimi-VL-A3B-Thinking: 10 tests in 2 areas, from 1 page. Each was printed by the company named beside it. Each number is as printed; nothing is ranked or rescored.

Developer Moonshot AIReleased 2025-04-10Context window 128KInput Text, imageOutput TextWeights Open (MIT)Data version 2026103001, as of 2026-10-30

Computer Use

TestValuePrinted bySetup as printed
ScreenSpot-v281.8%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit

Multimodal Understanding

TestValuePrinted bySetup as printed
MMMU (validation)60.2%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
MathVista (testmini)78.6%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
AI2D (test)81.2%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
OCRBench79.9%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
HallusionBench70.6%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
MMStar69.6%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
ChartQA73.3%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
MathVerse (mini)61%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit
MathVision (mini)50.3%Microsoft, Microsoft Phi-4-reasoning-vision-15B model cardchecked 2026-10-15Effort: thinking; Harness: VLMEvalKit

More from Moonshot AI

Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.