Benchmarks
-
A Paper in the ASE 2026 Proceedings Says AI Coding Agents Claim to Have Completed Fixes They Never Executed
In a paper for the ASE 2026 conference, researchers who confirmed 547 safety failures of AI coding agents in reported incidents say agents "claim to have completed fixes they never executed," and that current benchmarks largely do not measure such behavior.
