
10/29/2025 · Rohit Bakhshi
What this post added
Introduces General Availability for Delta Lake and Databricks Unity Catalog integration in Confluent Tableflow, enabling automated materialization of Kafka topics into Delta Lake tables with BYOS. Adds upsert materialization for CDC, allowing for "merge on read" tables using user-defined primary keys and handling updates/deletes. Enhances error handling with three strategies: Suspend, Skip, and Log to a Dead Letter Queue (DLQ) with standardized Avro schema for reprocessing and analysis. Implements Bring Your Own Key (BYOK) encryption for Delta Lake and Iceberg tables on AWS Dedicated clusters, supporting both Confluent-managed and customer-managed object storage with key permission checks for operational reliability. Expands Tableflow availability to Azure, allowing materialization into ADLS Gen2 and integration with Unity Catalog, Snowflake Open Catalog, and Apache Polaris.