Introducing the Baseten Delivery Network: Fast cold starts for big models

Introduced the Baseten Delivery Network (BDN) to significantly reduce cold start times for large models. BDN employs a three-tier caching strategy (local node, peer, and mirrored origin) and single-flight downloads to mitigate the 'thundering herd' problem during rapid scaling. This architecture ensures faster and more consistent model weight downloads, improving the overall inference loop by accelerating the distribution of all deployment artifacts.