Real-Time Data Streams in the Cloud, On-Prem, or Both with Confluent
Jun 22, 2021Jeff Bean
Summary
This post introduces a tutorial demonstrating an end-to-end data pipeline using Confluent Cloud and Confluent Platform. It covers setting up Confluent Cloud and MongoDB Atlas, using the Datagen connector to stream sample data into Kafka, joining data sets into a combined stream using ksqlDB, and streaming the results into MongoDB Atlas. It also shows the same pipeline in a self-managed deployment using Confluent Platform and MongoDB Server, and uses Confluent Replicator to bridge the two environments.
More from the Real-time Enterprise RAG trail
- Building an Agentic SOC on a Stream
- Hemut: Building the Internet of Freight on Real-Time Data
- New in Confluent Intelligence and AI Tools: Making Agents Native to the Stream, Expanded Model Support, New Agent Skills, and Copilot
- Customer Intelligence Hub for Real-Time GTM Insights
- RAG and GenAI for Customer 360 Architecture