Scaling out PostgreSQL for CloudFlare Analytics using CitusDB

This post details the scaling of Cloudflare's analytics database from a single PostgreSQL instance to a cluster using CitusDB. It outlines the log processing pipeline, including the use of Cap'n Proto, Go, Kafka, and CitusDB. The post explains the rationale behind choosing Go, Kafka, and PostgreSQL, and elaborates on the criteria for scaling PostgreSQL (performance, PostgreSQL compatibility, scaling, high availability, and business intelligence queries). It also describes the CitusDB architecture and the benefits of PostgreSQL extensions like HyperLogLog and Hstore on CitusDB.