Modernize Legacy Data for Real-Time AI with Oracle & MongoDB
Aug 5, 2025Sean Falconer
Summary
This post details building a real-time personalization engine by ingesting data from Oracle databases to Kafka using the Oracle XStream CDC Source Connector, enriching it with Flink and LLMs (GPT-4 for descriptions, OpenAI for embeddings), and sinking embeddings to MongoDB for semantic search. It demonstrates how to use Kafka and Flink for real-time data pipelines to power AI applications, specifically for product recommendations based on semantic similarity. The post includes Flink SQL examples for model creation and data processing.
More from the Real-time Enterprise RAG trail
- Building an Agentic SOC on a Stream
- Hemut: Building the Internet of Freight on Real-Time Data
- New in Confluent Intelligence and AI Tools: Making Agents Native to the Stream, Expanded Model Support, New Agent Skills, and Copilot
- Customer Intelligence Hub for Real-Time GTM Insights
- RAG and GenAI for Customer 360 Architecture