Confluent

Tableflow is now generally available

Mar 19, 2025Marc Selwan
Tableflow is now generally available
SummaryAI, from the source post

This post announces the general availability of Tableflow, a new product that allows users to materialize Apache Kafka topics as Apache Iceberg™ or Delta Lake tables. It details the challenges of traditional Kafka-to-data-lake pipelines, highlighting fragility, cost, and complexity. Tableflow solves these issues by automatically converting Kafka segments and schemas (Avro, JSON, Protobuf) into Iceberg/Delta-compatible schemas and Parquet files, leveraging Confluent's Schema Registry. It handles schema evolution, catalog syncing with partners (AWS Glue, Databricks Unity Catalog, Snowflake Open Catalog), and table maintenance like compaction and snapshot expiration. The post also emphasizes the synergy with Apache Flink® for real-time data transformation before landing in tables, and lists various partner integrations and analytical tools that support Tableflow's output.

More from the Real-time Enterprise RAG trail