TechPrufer
Get started
Baseten
Baseten logoBaseten · Feature trail

Canary Deployments

1 post · Oct 2024

What this trail covers

Baseten introduces canary deployments, a feature that allows for gradual traffic shifting to new model deployments over a customizable time window. This enables early detection of issues and seamless rollback, improving reliability and developer experience during rollouts. The system ramps up traffic in 10 equal steps over a specified timeframe, allowing new deployments to scale appropriately and minimizing risk to end-users.

All Baseten trails
  1. Introducing canary deployments on BasetenThis post introduces canary deployments as a new capability on Baseten. It details how traffic is gradually shifted to new deployments in 10 steps over a configurable time window, with an option for one-click rollback. The post contrasts this with manual workarounds, highlighting benefits like decreased latency, easier development loops, and a better end-user experience. It also mentions configuration via UI or REST API.