BenchCAD: Results as Published

BenchCAD is a benchmark of 17,900 industrial CAD programs written in CadQuery, each checked by running it, across 106 part families such as gears, springs and drill bits. Models answer questions about drawings and code, turn an image into code, and edit code according to an instruction. The authors report that current models often capture the rough outer shape of a part but struggle to build faithful parametric programs.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.