AA-Briefcase: Results as Published

AA-Briefcase tests AI agents on long, multi-week business projects in fields such as data science, product management and corporate strategy. The material is four multi-week projects with thousands of input files and 91 tasks in total, and each task asks for a professional deliverable such as a spreadsheet, presentation or memo. Each deliverable is graded on pass-or-fail rubric checks plus pairwise comparisons for analytical quality and presentation, and these are combined into an Elo score. The evaluation is private and run by Artificial Analysis.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.