AI Agents Don't Read Your Policy Docs. They Hit Your APIs — Gravitee

This talk demonstrates the critical need for infrastructure-level governance of AI agents, arguing that policies should be enforced at the gateway rather than within agent prompts. It showcases five live scenarios using a hotel-booking agent on the Gravitee Gateway with a Databricks backend, Sonnet, and Groq. Key demonstrations include blocking destructive tool calls (e.g., 'delete all bookings'), preventing data exfiltration, rate-limiting runaway requests, utilizing semantic caching for repeated queries, and rejecting oversized prompts before they reach the LLM. The talk also touches upon telemetry, vendor decoupling, and trimming Multi-Cloud Platform (MCP) tool lists, highlighting the limitations of relying solely on agent instructions for governance and the importance of infrastructure-based controls for cost management and security.