Delta Lake & Unity Catalog Now Integrate With Tableflow

What this post added

This post announces the integration of Confluent Tableflow with Delta Lake (Open Preview) and Databricks Unity Catalog (Open Preview). It details how Tableflow materializes Kafka topics into Delta Lake tables, handling data conversion, schema evolution, catalog syncing (including Databricks Unity Catalog), and table maintenance. The integration with Unity Catalog provides centralized data discovery, access control, end-to-end lineage, and unified governance for streaming data within the Databricks Lakehouse Platform. The architecture involves configuring Tableflow to write to an S3 bucket as Delta Lake tables and then integrating with Unity Catalog by registering the S3 location as an External Location in Databricks and providing Databricks workspace details and service principal credentials to Tableflow.