Eliminating Cold Starts 2: shard and conquer

This post introduces and details the "Worker sharding" technique, which uses a consistent hash ring to route requests to existing Worker instances within a data center. It explains the problem of increased cold start times due to relaxed limits on script size and startup CPU, and how coalescing requests onto a single instance improves warm request rates and memory efficiency. The post elaborates on the implementation using a consistent hash ring, analogous to HTTP cache sharding, to manage Worker placement across servers and minimize cold starts when servers are added or removed.