Confluent

Confluent Tableflow + Databricks Unity Catalog | Real-Time Data to AI-Ready Tables

Oct 29, 2025Kasun Indrasiri
Confluent Tableflow + Databricks Unity Catalog | Real-Time Data to AI-Ready Tables
SummaryAI, from the source post

Introduces Confluent Tableflow, a new capability that bridges Kafka streaming data to Databricks Unity Catalog by transforming Kafka topics into Delta Lake tables. It details the under-the-hood implementation using Kora and the Delta Kernel, including metadata fetching, reading from tiered storage, conversion to Parquet, committing metadata to Delta/Iceberg catalogs, and table maintenance. Highlights new features like schema evolution for Delta Lake, upserts for Delta tables, multi-format control, and multiple catalog integrations.

More from the Confluent Connectors Portfolio trail