Baseten

Introducing Baseten Chains

Jun 27, 2024
Introducing Baseten Chains
SummaryAI, from the source post

Introduced 'Chains', a new framework and SDK for building high-performance workflows with multiple models and components. Chains allows for modular workflow composition via 'Chainlets', which can be models or business logic. Each Chainlet can have independent GPU and CPU resource optimization and auto-scaling policies. The framework provides a better developer experience with features like auto-complete, static type-checking, and a simulated local execution environment. This has resulted in halved processing times and 6x improved GPU utilization in use cases like text-to-speech.

More from the Agentic Code Transformation and Model Orchestration trail