We ❤️ syslogs: Real-time syslog processing with Apache Kafka and KSQL – Part 3: Enriching events with external data
Jun 27, 2018Robin Moffatt
Summary
This post details enriching syslog data with external reference data from MongoDB using KSQL and Debezium. It covers streaming Ubiquiti device and user metadata from MongoDB into Kafka topics using Debezium, and then joining this reference data with the syslog stream in KSQL to enrich events with device names and IP addresses. The enriched data is then used for real-time analytics in Elasticsearch/Kibana and for triggering push notifications.
More from the Real-time Enterprise RAG trail
- Building an Agentic SOC on a Stream
- Hemut: Building the Internet of Freight on Real-Time Data
- New in Confluent Intelligence and AI Tools: Making Agents Native to the Stream, Expanded Model Support, New Agent Skills, and Copilot
- Customer Intelligence Hub for Real-Time GTM Insights
- RAG and GenAI for Customer 360 Architecture