BlogLLM Benchmark Scores as Published, Side by Side
Nemotron 3.5 Lightning 30B-A3B: Benchmark Scores as Published
Every result the catalog holds for Nemotron 3.5 Lightning 30B-A3B: 17 tests in 8 areas, from 2 pages. All were printed by NVIDIA itself. Each number is as printed; nothing is ranked or rescored.
Developer NVIDIAReleased 2026-08-11Context window 1MInput TextOutput TextWeights Open (OpenMDW License Agreement, version 1.1)Data version 2026103001, as of 2026-10-30
Knowledge Work
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GDPval-AA v2 | 832 | NVIDIA, NVIDIA Nemotron 3.5 Lightning 30B-A3B model cardchecked 2026-10-19 | - |
| GDPval-AA v2 (printed as a percentage) | 18.26% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19 | - |
Agentic Coding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| SWE-bench Verified | 51.56% | NVIDIA, NVIDIA Nemotron 3.5 Lightning 30B-A3B model cardchecked 2026-10-19 | - |
| Terminal-Bench 2.1 | 23.46% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
| SWE-bench Multilingual | 39.33% | NVIDIA, NVIDIA Nemotron 3.5 Lightning 30B-A3B model cardchecked 2026-10-19 | - |
Science and Math
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPQA Diamond | 75.57% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
| SciCode | 31.38% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
Long Context
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| AA-LCR | 49.19% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
General Knowledge and Reasoning
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Humanity's Last Exam (no tools) | 10.47% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | Tools: none |
| MMLU-Pro | 81.94% | NVIDIA, NVIDIA Nemotron 3.5 Lightning 30B-A3B model cardchecked 2026-10-19 | - |
| AA-Omniscience Accuracy | 16.63% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
| AA-Omniscience Non-Hallucination | 68.81% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19 | - |
Tool Use and Workflows
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| τ³-bench Banking | 9.48% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
| MCP Atlas (public set) | 46.4% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19 | - |
| PinchBench | 83.43% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
Web Search and Research
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| BrowseComp | 36.81% | NVIDIA, NVIDIA Nemotron 3.5 Bolt 74B-A9B model cardchecked 2026-10-19; printed on 1 more page | - |
Instruction Following
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| IFBench | 71.88 | NVIDIA, NVIDIA Nemotron 3.5 Lightning 30B-A3B model cardchecked 2026-10-19 | - |
More from NVIDIA
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.