Multi-Region Deployment and Routing

The multi-region deployment capability allows users to run workloads across geographies with a single endpoint, optimizing for low latency, resilience, and operational ease. This system dynamically maps requests across the broadest possible eligible capacity pool while respecting accelerator types, quota, reliability tiers, compliance boundaries, and data residency constraints. The architecture has been rewired to allow a single deployment to draw compatible capacity from multiple regions, moving global scheduling off the inference hot path.