Atlassian’s AI Gateway: Best in Class Model Garden

This post introduces Atlassian's AI Gateway, a new internal platform designed to abstract and manage access to a diverse range of LLMs and AI models from multiple providers. Key technical contributions include a unified API contract for integration flexibility, automated fallback mechanisms for LLM unreliability, centralized enforcement of security, privacy, and compliance controls, and robust quota and cost management. The gateway also provides shared tooling for developers, integrates with Atlassian's AI Evaluation suite and ML Studio for synthetic data generation and testing, and supports rapid iteration through integration with Atlassian's Prompt Registry. It enables Atlassian developers to easily switch models, perform A/B tests, and deploy AI features with production-ready capacity and compliance.