Introducing Baseten Self-hosted

This post introduces Baseten Self-hosted, a new deployment option that allows AI model inference to run within a customer's own cloud environment (VPC). This offering provides enhanced control over data locality, security, compliance, and the utilization of existing cloud credits and custom hardware. It leverages Truss for packaging and deploying models, ensuring that data and compute remain within the customer's infrastructure. Baseten continues to manage application and infrastructure updates, including zero-downtime deployments and no-disruption updates, for these self-hosted instances. This expands the MCM system's capabilities to include in-VPC deployments, complementing Baseten Cloud and Hybrid modes.