Cloudflare

How Workers powers our internal maintenance scheduling pipeline

Dec 22, 2025Kevin Deems, Michael Hoffmann
How Workers powers our internal maintenance scheduling pipeline
SummaryAI, from the source post

This post details the development of a maintenance scheduling pipeline using Cloudflare Workers. Key technical contributions include: 1. Designing a graph processing interface inspired by Facebook's TAO to model objects (e.g., routers) and associations (e.g., Aegis pools) for maintenance constraints. 2. Implementing a fetch pipeline middleware layer for Workers to handle subrequest limits, including request deduplication (inspired by Go's singleflight), LRU caching, CDN caching, and backoff retries. 3. Demonstrating a 100x reduction in response sizes and achieving ~99% cache hit rate through targeted data fetching and the fetch pipeline.

More from the Edge Computing with Cloudflare Workers trail