Rolling deployments for zero-downtime model updates
Jun 12, 2026
Summary
Introduced rolling deployments for zero-downtime model updates. Implemented two provisioning modes: `max_surge` (temporarily exceeds steady-state capacity) and `max_unavailable` (stays within original resource footprint). Developed a durable workflow orchestration for stateful deployments, including automatic retries and pause/resume semantics. Integrated autoscaling coordination to manage load spikes during rollouts. Added mid-deploy controls (pause, resume, cancel, force cancel, force roll forward) and a configurable stabilization period.
More from the Baseten AI Model Deployment and Serving Platform trail
- LangChain trains custom models for LangSmith Engine with Baseten Loops
- DeepSeek-V4.1-Flash: more efficient prefill for coding agents
- Blaxel is joining Baseten to build the future of agentic infrastructure
- How Baseten makes pyannote’s diarization models 9.6x faster
- Optimizing delta weight syncs for managed rollouts