KSQL in Action: Enriching CSV Events with Data from RDBMS into AWS

This post details how to enrich CSV events in real-time by joining them with customer data from a MySQL RDBMS using Kafka Connect and ksqlDB. It covers setting up customer data in MySQL, using Mockaroo for data generation, and configuring Kafka Connect to ingest data from MySQL into a Kafka topic. The post then demonstrates how ksqlDB can be used to perform a stream-table join between the order events (CSV) and customer data (from MySQL) to enrich the order events with customer attributes. The resulting enriched stream is then sent to AWS S3 for analysis.