Petri: An open-source auditing tool to accelerate AI safety research
Oct 6, 2025

Summary
Introduced Petri, an open-source auditing tool that deploys automated agents to test target AI systems through diverse multi-turn conversations. Petri simulates realistic environments, conducts conversations with target models, and uses LLM judges to score behavior across safety-relevant dimensions, surfacing concerning transcripts for human review. This enables rapid hypothesis testing and systematic exploration of model behaviors, complementing manual auditing and providing quantitative metrics for behaviors like deception, sycophancy, and self-preservation.
More from the AI-Resistant Technical Evaluation Design trail
- An alignment assessment of recent cybersecurity incidents
- Discovering cryptographic weaknesses with Claude
- Evaluating Claude’s bioinformatics research capabilities with BioMysteryBench
- A “diff” tool for AI: Finding behavioral differences in new models
- Eval awareness in Claude Opus 4.6’s BrowseComp performance