AI Gateway now gives you access to your favorite AI models, dynamic routing and more — through just one endpoint

This post introduces several new features for Cloudflare AI Gateway: unified billing across multiple AI providers (Anthropic, Google, Groq, OpenAI, xAI) via Cloudflare credits, secure storage and distribution of provider API keys using Cloudflare Secrets Store with granular RBAC and audit logging, an automatic translation layer for unified request/response handling between providers, dynamic routing capabilities for AI traffic based on request attributes (e.g., rate limiting, A/B testing, model chaining), and integrated Data Loss Prevention (DLP) scanning within the AI Gateway Firewall for enhanced security. The post also details the integration with Secrets Store for managing BYO Provider Keys and the use of the 'AI Gateway' scope for secrets.