BlogLLM Benchmark Scores as Published, Side by Side
RefCOCO: Results as Published
Every result the catalog holds for RefCOCO: 9 models from 3 developers, read from 4 pages. Each number is as printed by the company named beside it; nothing is ranked or rescored. Models are listed by developer, newest first.
Area Multimodal UnderstandingMaintainer Licheng Yu and co-authors (UNC); RefCOCO and RefCOCO+ are the UNC ReferItGame collectionsIntroduced 2014Data version 2026103001, as of 2026-10-30
RefCOCO, RefCOCO+, and RefCOCOg test referring expressions on COCO images: given a phrase, the model should localize that object. RefCOCO and RefCOCO+ were collected in a two-player game, RefCOCO+ forbids location words, and RefCOCOg was written separately without that game. The paper counts 142,209 expressions for 50,000 objects in 19,994 images for RefCOCO, and 141,564 expressions for 49,856 objects in 19,992 images for RefCOCO+. For comprehension, a predicted box counts when its intersection-over-union with the reference box is above 0.5, and that rate is averaged over images.
RefCOCO (average)
| Model | Value | Printed by | Setup as printed |
|---|---|---|---|
| Gemini 3 ProGoogle, released 2025-11-18 | 84.1% | Alibaba, Qwen3.5-397B-A17B model cardchecked 2026-10-15 | - |
| Qwen3.6-27BAlibaba, released 2026-04-22 | 92.5% | Alibaba, Qwen3.6-27B model cardchecked 2026-10-15 | - |
| Qwen3.6-35B-A3BAlibaba, released 2026-04-16 | 92% | Alibaba, Qwen3.6-35B-A3B model cardchecked 2026-10-15; printed on 1 more page | - |
| Qwen3.5-122B-A10BAlibaba, released 2026-02-24 | 91.3% | Alibaba, Qwen3.5-122B-A10B model cardchecked 2026-10-15 | - |
| Qwen3.5-27BAlibaba, released 2026-02-24 | 90.9% | Alibaba, Qwen3.5-122B-A10B model cardchecked 2026-10-15; printed on 2 more pages | - |
| Qwen3.5-35B-A3BAlibaba, released 2026-02-24 | 89.2% | Alibaba, Qwen3.5-122B-A10B model cardchecked 2026-10-15; printed on 1 more page | - |
| Qwen3.5-397B-A17BAlibaba, released 2026-02-16 | 92.3% | Alibaba, Qwen3.5-397B-A17B model cardchecked 2026-10-15; printed on 1 more page | - |
| Qwen3-VL-235B-A22BAlibaba, released 2025-09-23 | 91.1% | Alibaba, Qwen3.5-122B-A10B model cardchecked 2026-10-15; printed on 1 more page | - |
| Kimi K2.5Moonshot AI, released 2026-01-27 | 87.8% | Alibaba, Qwen3.5-397B-A17B model cardchecked 2026-10-15 | - |
Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.