Introducing Cloudflare Basin: an open, serverless data platform, now generally available

This post announces the general availability of Cloudflare Basin, formerly the Cloudflare Data Platform. It details the three core components: Basin Pipelines (formerly Cloudflare Pipelines) for event ingestion and transformation using SQL into Apache Iceberg tables or R2 files; Basin Catalog (formerly R2 Data Catalog) for managing Iceberg metadata and performing automatic maintenance like compaction and snapshot expiration; and Basin SQL (formerly R2 SQL) as a serverless query engine for Iceberg tables. Key improvements since beta include increased ingestion scalability for Pipelines (up to 3GB/s), Logpush integration, schema-aware Worker bindings, data quality error visibility, Terraform support for IaC, and new features for Catalog like per-table compaction policies and unreferenced data-file cleanup. Future plans for Pipelines include custom partitioning, schema migrations, and stateful processing. Future plans for Catalog include improved compaction sorting/clustering, granular auth controls, and jurisdiction support.