Stream Processing Fundamentals
Deploying Kafka Streams and KSQL with Gradle – Part 1: Overview and Motivation | Confluent

Deploying Kafka Streams and KSQL with Gradle – Part 1: Overview and Motivation | Confluent

5/15/2019 · Stewart Bryson

What this post added

This post details the integration of Oracle WMS Cloud with on-premises systems using Apache Kafka and Confluent Platform. It describes using Oracle GoldenGate for Big Data to deliver relational data change events to Kafka and MuleSoft to produce payloads from other APIs to Kafka. For data egress, the Kafka Connect JDBC Sink connector is used to deliver data back into legacy systems, and MuleSoft consumes topics for API calls. The post highlights the use of KSQL for data stream curation and Kafka Streams for final payload packaging, specifically addressing the need for nested messages for Oracle WMS Cloud and leveraging Kafka Streams' built-in state store.

Read the original post ↗