
11/7/2025 · Dima Melnyk, Sita Lakshmi Sangameswaran
What this post added
Introduced User Simulation as a new feature within the Agent Development Kit (ADK) evaluation framework. This feature utilizes an LLM to dynamically generate multi-turn conversations based on high-level goals and conversation plans, moving away from brittle, scripted tests. It allows for configuration of the simulation model, its behavior, and turn limits, and provides detailed invocation and metric breakdowns for evaluation. The goal is to significantly reduce test creation time, improve test resilience, and establish a reliable regression suite for AI agents.