Durable Objects aren't just durable, they're fast: a 10x speedup for Cloudflare Queues

What this post added

Introduced a v2 architecture for Cloudflare Queues that horizontally scales across multiple Durable Objects to implement each high-performance Queue. This involves distributing Storage Shard Durable Objects in all available regions for lower latency and using multiple shards within each region to scale throughput. A new Consumer Shard Durable Object class was created to scale horizontally, enabling more concurrent invocations of user's `queue()` handlers. A Coordinator Durable Object was introduced as the 'Control Plane' to manage the individual Durable Objects in the system and maintain a Shard Map in Workers KV.