OpenSearch Ingestion Integration
KSQL in Action: Enriching CSV Events with Data from RDBMS into AWS

KSQL in Action: Enriching CSV Events with Data from RDBMS into AWS

3/22/2018 · Robin Moffatt

What this post added

This post details how to enrich CSV events in real-time by joining them with customer data from a MySQL RDBMS using Kafka Connect and ksqlDB. It covers setting up customer data in MySQL, using Mockaroo for data generation, and configuring Kafka Connect to ingest data from MySQL into a Kafka topic. The post then demonstrates how ksqlDB can be used to perform a stream-table join between the order events (CSV) and customer data (from MySQL) to enrich the order events with customer attributes. The resulting enriched stream is then sent to AWS S3 for analysis.

Read the original post ↗