Revolutionizing software testing: Introducing LLM-powered bug catchers
2/5/2025 · Christopher Foster, Abhishek Gulati, Mark Harman, Inna Harper, Ke Mao, Jillian Ritchey, Hervé Robert, Shubho Sengupta
What this post added
This post introduces the Automated Compliance Hardening (ACH) tool, a novel system that leverages Large Language Models (LLMs) for mutation-guided test generation. ACH automatically generates realistic faults (mutants) in source code and then creates tests specifically designed to catch these faults. This approach moves beyond traditional code coverage-focused testing by targeting specific bugs, with verifiable assurances that the generated tests will indeed catch the intended faults. ACH has been applied to critical platforms like Facebook Feed, Instagram, Messenger, and WhatsApp, demonstrating its potential to harden codebases against regressions and optimize the testing process.