Announcing the Cloudflare Data Platform: ingest, store, and query your data directly on Cloudflare

This post announces the launch of the Cloudflare Data Platform, comprising Cloudflare Pipelines, R2 Data Catalog with compaction, and R2 SQL. Cloudflare Pipelines, built on Arroyo, ingests and transforms events using SQL, sinking them to R2 or R2 Data Catalog with exactly-once guarantees. R2 Data Catalog now includes automatic compaction for small files to improve query performance. R2 SQL is an in-house distributed SQL engine for querying data in R2 at petabyte scale. The platform emphasizes open standards, zero egress fees, and usage-based pricing.