Cloudflare

Improving Worker Tail scalability

Sep 1, 2023Joshua Johnson, Adam Murray
Improving Worker Tail scalability
SummaryAI, from the source post

Improved Workers Tail scalability by moving log filtering out of Durable Objects to the message producer, reducing load on the Durable Object. Introduced a sampling mechanism to keep Durable Object RPS below 100 when filters are insufficient. Added a failsafe to stop forwarding messages if the Durable Object becomes overloaded.

More from the Observability Platform trail