RealWorldQA: Results as Published

RealWorldQA tests basic real-world spatial understanding in multimodal models. The test split has 765 rows, each pairing one image with one question and a short answer; the initial release has over 700 images, some taken from vehicles and others from real-world photos. Questions cover items such as traffic lights, lane layout, object counts, relative position and size. Most questions are multiple choice and the rest are open-ended, with a single word or number as the answer; the dataset card does not describe how answers are scored.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.