Blueprint-Bench: Results as Published

Blueprint-Bench tests spatial reasoning by asking a model to turn photographs of an apartment into a two-dimensional floor plan. The plan is scored against the true one by comparing which rooms connect and how their sizes rank. Blueprint-Bench 2 is the agent-only version: an agent works through 50 apartments in sequence and keeps a notepad between them, and its score is normalized so that a random plan scores 0 and a perfect one scores 1.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.