Introducing Baseten Chains
Jun 27, 2024

Summary
Introduced 'Chains', a new framework and SDK for building high-performance workflows with multiple models and components. Chains allows for modular workflow composition via 'Chainlets', which can be models or business logic. Each Chainlet can have independent GPU and CPU resource optimization and auto-scaling policies. The framework provides a better developer experience with features like auto-complete, static type-checking, and a simulated local execution environment. This has resulted in halved processing times and 6x improved GPU utilization in use cases like text-to-speech.