CWE-bench: Results as Published

CWE-Bench evaluates coding agents on defensive security work. Each task gives the agent a checkout of a real open-source repository, sometimes with disclosed CVEs reproduced in it, and asks it to audit the code and fix what it finds without being told how many vulnerabilities there are. A fix counts only if the exploit is blocked and the existing tests still pass, with no partial credit, and agents are not asked to write exploits. The page reports 100 held-out tasks in v0 and 120 in v1.

Every number here is read from the same catalog file as the benchmark table, data version 2026103001, and is the number the table shows for that model and test. Where one page printed a model under several setups, each value is listed. The catalog is public in armanobosyan/sugra-llm-benchmarks; a wrong number can be reported from the table, with Report an error under the value, or as an issue in that repository.