Environment-free Synthetic Data Generation for API-Calling Agents
Feb 5, 2025

Summary
This post proposes an environment-free synthetic data generation approach for training API-calling LLM agents. It leverages LLMs as on-the-fly digital world models to generate diverse tasks, simulate coherent API responses, and filter trajectories, overcoming the bottleneck of requiring fully implemented environments. This method demonstrates significant performance gains on benchmarks like AppWorld and OfficeBench when fine-tuning models on the generated synthetic data.
More from the Agentic Data Cataloging trail
- Self-Compacting Language Model Agents
- RISED: Rubrics for Agentic Multi-Environment Selection and Self-Distillation
- SCLATE: A Substrate for Continual-Learning Agent Training and Evaluation
- Glyph: A Multi-Strategy Agentic System for Column Description and Sensitivity-Ontology Tagging of Enterprise Data Catalogs