Anthropic

Petri: An open-source auditing tool to accelerate AI safety research

Oct 6, 2025
Petri: An open-source auditing tool to accelerate AI safety research
SummaryAI, from the source post

Introduced Petri, an open-source auditing tool that deploys automated agents to test target AI systems through diverse multi-turn conversations. Petri simulates realistic environments, conducts conversations with target models, and uses LLM judges to score behavior across safety-relevant dimensions, surfacing concerning transcripts for human review. This enables rapid hypothesis testing and systematic exploration of model behaviors, complementing manual auditing and providing quantitative metrics for behaviors like deception, sycophancy, and self-preservation.

More from the AI-Resistant Technical Evaluation Design trail