
12/5/2024 · Kasun Indrasiri
What this post added
Introduces integration of Confluent Tableflow with Amazon SageMaker Lakehouse, enabling materialization of Kafka topics into Apache Iceberg tables stored in S3. Leverages AWS Glue Data Catalog for Iceberg table metadata management, allowing consumption by AWS analytics engines like Amazon Athena, Amazon Redshift, and Amazon EMR, as well as other compatible tools like Apache Spark. Demonstrates a use case for capturing CDC streams from PostgreSQL into Kafka and materializing them as Iceberg tables for downstream analytics.