Cloudflare

Explaining Cloudflare's ABR Analytics

Sep 29, 2020Jamie Herre
Explaining Cloudflare's ABR Analytics
SummaryAI, from the source post

This post introduces Adaptive Bit Rate (ABR) analytics as a technique to improve the quality and responsiveness of Cloudflare's analytics products. ABR is applied to data stored in ClickHouse, where data is written at multiple resolutions (covering seven orders of magnitude) into separate tables. This approach enables consistent response times and a better user experience by calculating analytics at a resolution matching the query's needs, thus saving resources and allowing for ad hoc queries on reduced resolution tables. The post also discusses aggregations and rollups, and how ABR handles 'topK' and 'count-distinct' aggregations, improving resilience and scalability by adapting to system conditions and providing appropriate answers reliably within predictable timeframes.

More from the Data Infrastructure & Analytics trail