Sync Databases and Remove Data Silos with CDC & Apache Kafka

What this post added

This post details the advantages and disadvantages of using JDBC source connectors versus Change Data Capture (CDC) for moving data from databases to Apache Kafka. It highlights CDC's ability to capture all events, including inserts, updates, and deletes, with lower database load and richer payload information. The post also presents a real-world use case of a legacy bank synchronizing two databases (PostgreSQL and SQL Server) using Debezium CDC connectors and Kafka Connect, and demonstrates how to prevent infinite loops using Single Message Transformations (SMTs) for filtering.