Claude Managed Agents Q&A: Evals, CI/CD and Multi-Tenancy (Part 4 of 4) — Anthropic

This Q&A session from Anthropic's Claude Managed Agents workshop details practical engineering challenges and solutions for deploying and managing AI agents in production. Key contributions include: versioning agent configurations using YAML and syncing them via CI/CD with the ant CLI; strategies for tenant isolation using workspace, org, or session metadata; utilizing self-hosted sandboxes for custom compute, GPUs, and increased memory; and implementing a coordinator pattern to keep the main agent responsive while subagents handle custom tools. The discussion also touches on handling messages during custom tool waits, Anthropic's eval practices, resource sharing across organizations, code review agents, and modeling multiplayer Slack agents for long-running sessions.