“You get Instant Purge, and you get Instant Purge!” — all purge methods now available to all customers

This post details the engineering effort behind making all cache purge methods available to all customers. It describes the technical challenges of propagating purge requests globally, the limitations of previous lazy-purge mechanisms, and the adoption of RocksDB for "CacheDB" to enable active purging. The new architecture reduces storage needs by 10x, improves cache hit ratios, and allows for significantly higher purge throughput. It also outlines the new rate limits and the token bucket system used for managing purge requests.