Application Security and Permissions
Introducing AutoPatchBench: A Benchmark for AI-Powered Security Fixes

Introducing AutoPatchBench: A Benchmark for AI-Powered Security Fixes

4/29/2025 · TJ Byun, Cornelius Aschermann, Kai Yuan Thng, Wu Zhou, Yupeng Yang, Lauren Deason, Joshua Saxe

What this post added

Introduces AutoPatchBench, a benchmark for evaluating AI program repair systems specifically for fuzzing-identified vulnerabilities. It includes 136 C/C++ vulnerabilities with verified fixes from the ARVO dataset, along with a rigorous automated verification process involving fuzzing and white-box differential testing. This aims to standardize the evaluation of AI-driven security fixes and accelerate progress in automated vulnerability repair.

Read the original post ↗