Inference Infrastructure for AI Labs | Baseten
May 6, 2026

Summary
Introduced the Baseten Frontier Gateway, a managed API gateway built on top of Baseten Dedicated Inference. This gateway provides a production-grade, multi-tenant inference API for model labs, handling authentication, authorization, federated API key management, per-user rate and usage limits, and billing/metering. It is co-located with inference infrastructure to minimize latency and integration overhead, allowing labs to serve models under their own domain.
More from the Baseten AI Model Deployment and Serving Platform trail
- LangChain trains custom models for LangSmith Engine with Baseten Loops
- DeepSeek-V4.1-Flash: more efficient prefill for coding agents
- Blaxel is joining Baseten to build the future of agentic infrastructure
- How Baseten makes pyannote’s diarization models 9.6x faster
- Optimizing delta weight syncs for managed rollouts