Observability Platform
Improving Worker Tail scalability

Improving Worker Tail scalability

9/1/2023 · Joshua Johnson, Adam Murray

What this post added

The Workers Tail feature has been significantly scaled to support Workers of any size. This was achieved by moving log filtering logic from the Durable Object to the message producer, preventing unnecessary load. A sampling mechanism was introduced to keep Durable Object RPS below a target of 100, with a visual indicator for users. A failsafe mechanism was also added to periodically stop forwarding messages if the Durable Object becomes overloaded.

Read the original post ↗