BlogLLM Benchmark Scores as Published, Side by Side

Qwen3.8-Max vs Kimi K3.1 Pro: Benchmark Scores Side by Side

Every test both Qwen3.8-Max by Alibaba and Kimi K3.1 Pro by Moonshot AI have a published number for: 13 tests in 6 areas. Each number is as printed, with the page it comes from and the setup it was run under; nothing is ranked or rescored, and two numbers under different setups are two results, not one comparison.

Models Qwen3.8-Max, Kimi K3.1 ProData version 2026111201, as of 2026-11-12

Model

What each developer prints on its own model page; a dash means it prints none. Runs on is the smallest device that holds the model at 4-bit: the developer's words where it prints them, otherwise our estimate from the size.

FactQwen3.8-MaxKimi K3.1 Pro
Released2026-08-032026-10-23
Context window1M1M
Max output131K-
InputText, image, videoText, image
OutputTextText
WeightsClosedOpen (Kimi K3.1 Pro License)
Size-2.8T (104B active)
Runs on-8 × B300 (about 1.85 TB at 4-bit, estimate)

Knowledge Work

TestQwen3.8-MaxKimi K3.1 Pro
AutomationBench
27.3%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 1 more page
73.3%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max

Agentic Coding

TestQwen3.8-MaxKimi K3.1 Pro
DeepSWE v1.1
56.6%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 2 more pages
75.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code; Dataset revision: v1.1
Terminal-Bench 4.0
65.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code
ProgramBench Almost@1
10.5%Z.ai, GLM-5.3 model card, checked 2026-10-15
31.5%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Claude Code
Vibe Code Bench
64.7%Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-11-02Harness: OpenHands
84.89%Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-11-02Harness: OpenHands

Science and Math

TestQwen3.8-MaxKimi K3.1 Pro
GPQA Diamond
92.6%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14
94.2%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max
FrontierMath Tier 4 (v2)
46.3%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: xhigh
65.9%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max
FrontierMath Tier 1-3 (v2)
74.7%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: xhigh
78.2%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max

Cybersecurity

TestQwen3.8-MaxKimi K3.1 Pro
ExploitBench
28.8%Z.ai, GLM-5.3 model card, checked 2026-10-15
74.7%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: ExploitBench official harness; Attempt budget: 300 turns; pass@5

General Knowledge and Reasoning

TestQwen3.8-MaxKimi K3.1 Pro
Humanity's Last Exam (no tools)
43.6%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14
51.1%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: none
Humanity's Last Exam (with tools)
56.2%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 1 more pageTools: enabled; exact tools in source
70%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Tools: with tools
SimpleQA Verified
45.8%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-10-30Effort: xhigh
62.2%Epoch AI, Epoch AI Benchmarking Hub, checked 2026-11-10Effort: max

Tool Use and Workflows

TestQwen3.8-MaxKimi K3.1 Pro
Agents' Last Exam (pass rate)
27%Alibaba, Qwen3.8-Max comparison, checked 2026-10-14; printed on 1 more page
43.2%Moonshot AI, Introducing Kimi K3.1 Pro, checked 2026-10-24Effort: max; Harness: Kimi Code; Dataset revision: v1.1

Price

API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked; a dash means the developer lists that price in another unit or not at all. Cost per task is measured by Vals AI.

PriceQwen3.8-MaxKimi K3.1 Pro
Input
$1.65Alibaba, Alibaba Model Studio pricing, checked 2026-10-15
Cached input-
Cache write-
$2Moonshot AI, Kimi API pricing (international platform), checked 2026-10-24Cache: 5 minute cache
Cache write, 1 hour-
Output
$4.951Alibaba, Alibaba Model Studio pricing, checked 2026-10-15
Cost per taskVals AI, USD, lower is better
$8.24Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-10-27Harness: OpenHands
$7.49Vals AI, Vibe Code Bench v1.1 leaderboard, checked 2026-10-27Harness: OpenHands

Qwen3.8-Max has 33 more and Kimi K3.1 Pro has 42 more: tests only one of them has a number for, listed on its model page.

More side by side

Every number here is read from the same catalog file as the benchmark table, data version 2026111201. A pair has a page when both models are their developers' flagships and both have a number for at least 10 of the same tests. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.