LLMs Are the Key to Mutation Testing and Better Compliance
Sep 30, 2025Mark Harman

Summary
This post details the development and application of Meta's Automated Compliance Hardening (ACH) tool, which uses Large Language Models (LLMs) to revolutionize software testing and compliance. It explains how LLMs overcome the traditional barriers to mutation testing, enabling scalable, realistic mutant generation and the detection of equivalent mutants. The post highlights ACH's success in generating privacy-relevant tests and its deployment across various Meta platforms, emphasizing the acceleration of developer velocity and the creation of a safer online ecosystem.
More from the AI Research and Development trail
- An Organizational Second Brain: Building an AI That Learns From Experts
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model
- Exploring Hierarchical Interest Representation For Meta Ads Deep Funnel Optimization
- Meta’s AI Storage Blueprint at Scale