AceBench: Results as Published

ACEBench tests tool use, meaning function calls, in three settings called Normal, Special, and Agent. Normal checks a call against ground truth by parsing the call, Special checks whether the model spots missing, wrong, or mismatched instructions, and Agent checks multi-turn tool use with a simulated user. The set has 2,000 entries in parallel Chinese and English versions. Normal and Special use accuracy, Agent reports end-to-end accuracy and process accuracy, and an overall accuracy is a weighted sum of the three.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.