Stream Processing Fundamentals
How PushOwl Uses ksqlDB to Scale Analytics and Reporting Use Cases

How PushOwl Uses ksqlDB to Scale Analytics and Reporting Use Cases

7/27/2020 · Abhishek Kumar

What this post added

This post details how PushOwl uses ksqlDB to scale analytics and reporting use cases by migrating from a traditional PostgreSQL database approach to an event streaming platform. It covers the challenges of slow query execution and database scaling due to high volumes of push notification data. The solution involves publishing dispatch and ping events to Kafka, aggregating these events using ksqlDB for real-time reporting, and sinking the aggregated data back to PostgreSQL for dashboard access. The post also details the use of Kafka Connect JDBC sink and S3 sink connectors, and provides Python code examples for producing Avro-formatted messages to Kafka.

Read the original post ↗