CharXiv Reasoning: Results as Published

CharXiv tests whether a multimodal model can read real scientific charts. The set holds 2,323 charts taken from arXiv papers, each with descriptive questions about basic chart elements and reasoning questions that need information synthesized across the chart. All charts and questions were hand-picked and verified by human experts. The reasoning split, the one model cards report, is scored as accuracy on the reasoning questions.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.