The production platform for open-weight AI inference

This post details significant updates to Together AI's inference platform, focusing on production-grade deployment features for open-weight and licensed models. New capabilities include canary, blue-green, and rolling updates with auto-rollback, A/B and shadow testing against real traffic, and advanced autoscaling based on various inference-native metrics. It also introduces a closed beta for custom training (full-weight and LoRA RL, supervised fine-tuning) with direct deployment of checkpoints. The platform now offers faster model startup times (4x improvement) due to rebuilt model caching and distribution, and exposes a Prometheus endpoint for organization-level observability.