The AI engineering stack we built internally — on the platform we ship

This post details the internal engineering stack built on Cloudflare's AI products (AI Gateway, Workers AI, Cloudflare Access, Dynamic Workers, Workflows, Agents SDK) to power AI coding tools for Cloudflare employees. It describes the architecture for authentication, routing, inference, and agent execution, including the use of a proxy Worker for centralized control and the integration of Backstage for knowledge graphs. Key technical contributions include the design of a single discovery endpoint for automatic configuration, the use of JWTs and D1 for anonymous user tracking and cost attribution, and the implementation of a CI integration for AI code review. The post quantifies the internal adoption and impact of these AI tools on developer velocity.