BlogLLM Benchmark Scores as Published, Side by Side
Muse Spark Open: Benchmark Scores as Published
Every result the catalog holds for Muse Spark Open: 23 tests in 9 areas, from 2 pages. All were printed by Meta itself. Each number is as printed; nothing is ranked or rescored.
Developer MetaReleased 2026-10-15Context window 1MInput Text, image, video, audioOutput TextWeights Open (Muse Model License)Data version 2026103001, as of 2026-10-30
Knowledge Work
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GDPval-AA v2 | 1401 | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
| JobBench | 61.8 | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
Agentic Coding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Terminal-Bench 2.1 | 76.4% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Harness: Terminus 2 |
| DeepSWE v1.1 | 60% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Harness: preferred harness of each model |
| SWE-Atlas-QnA (setting not stated) | 58% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Harness: preferred harness of each model |
Science and Math
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| GPQA Diamond | 89% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
| SciCode | 58.5% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
Computer Use
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| OSWorld-Verified | 80.4% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
Multimodal Understanding
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| BabyVision (with tools) | 80.2% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Tools: with tools |
| SimpleVQA | 73.6% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Tools: with tools |
| WorldVQA (mode not stated) | 49.4% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Tools: with tools |
| ZeroBench (with tools, metric not stated) | 50% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Tools: with tools |
| Video-MME v2 | 61.5% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
| IntPhys 2 | 68.3% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
General Knowledge and Reasoning
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Humanity's Last Exam (with tools) | 61% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Tools: with tools |
| AA-Omniscience Index | 25 | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
| Humanity's Last Exam Diamond (no tools) | 26.1% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh; Tools: none |
Tool Use and Workflows
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Toolathlon Verified | 72.8% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
| MCP Atlas | 89.2% | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
Safety and Alignment
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| FORTRESS adversarial (static), ARSlower is better | 5.8 | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
| FORTRESS adversarial (static), ORSlower is better | 17.4 | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
| StrongREJECT v2 (adaptive)lower is better | 0.5 | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
Preference and Composite Rankings
| Test | Value | Printed by | Setup as printed |
|---|---|---|---|
| Artificial Analysis Intelligence Index | 39 | Meta, Meta Muse Spark Open 816B-A42B model cardchecked 2026-10-19 | Effort: xhigh |
Price
API list prices in US dollars per one million tokens, as printed on the developer's pricing page on the day checked. Cost per task is measured by Vals AI.
| Price | Value | Printed by | Setup as printed |
|---|---|---|---|
| Cost per taskVals AI, USD, lower is better | $1.66 | Vals AI, Vibe Code Bench v1.1 leaderboardchecked 2026-10-27 | Harness: OpenHands |
More from Meta
Every number here is read from the same catalog file as the benchmark table, data version 2026103001. Where one page printed the model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.