Confluent

How Real-Time Materialized Views Work with ksqlDB

Oct 13, 2020Michael Drogalis
How Real-Time Materialized Views Work with ksqlDB
SummaryAI, from the source post

This post details how ksqlDB builds real-time materialized views using stateful stream processing, leveraging RocksDB for local storage and Kafka changelog topics for durability and recovery. It explains automatic repartitioning for GROUP BY operations and the role of changelog compaction. The post also introduces the LATEST_BY_OFFSET aggregation for retaining the last value per key.

More from the Stream Processing Fundamentals trail