Stream Processing Fundamentals
Data Reprocessing with the Streams API in Kafka: Resetting a Streams Application | Confluent

Data Reprocessing with the Streams API in Kafka: Resetting a Streams Application | Confluent

8/15/2016 · Matthias J. Sax

What this post added

This post details how to reprocess input data from scratch in Kafka Streams applications. It introduces an application reset tool that handles global resets by clearing internal topics and state stores, and requires a local cleanup call within the application code. The post also dives into the internal mechanics of Kafka Streams, including intermediate topics, internal changelog topics, and committed offsets, to explain the complexities of manual resets and the benefits of the new tool.

Read the original post ↗