AI2D: Results as Published

AI2D, AI2 Diagrams, is a set of grade-school science diagrams with multiple-choice questions about what the diagram shows. The paper counts more than 5,000 diagrams and more than 15,000 questions, collected from topics in grade 1 to 6 science textbooks, and each question has four choices. The images are split into 4,000 for training and 1,000 for a blind test. Question answering is scored by accuracy on that test set.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.