Baseten Chains is now GA for production compound AI systems

This post announces the general availability of Baseten Chains, an SDK for deploying compound AI systems. It details how Chains addresses challenges in model orchestration, latency, reliability, and cost for multi-model workflows. The core concept is 'Chainlets' which are individual subtasks that can run on custom hardware with independent autoscaling. Chainlets call each other directly, reducing latency. New features since beta include output streaming, binary IO support (NumPy arrays, raw bytes), subclassing for Chainlet reuse, Chains Watch for live code patching, a linter, improved logging, and UI enhancements for environment management.