Confluent

Data Reprocessing with the Streams API in Kafka: Resetting a Streams Application | Confluent

Aug 15, 2016Matthias J. Sax
Data Reprocessing with the Streams API in Kafka: Resetting a Streams Application | Confluent
SummaryAI, from the source post

This post introduces a new application reset tool for Kafka Streams, simplifying the process of reprocessing input data from scratch. It also provides a deep dive into the internal mechanisms of Kafka Streams, including internal topics, operator state, and offset commits, to explain how manual resets can be performed. The post highlights the importance of stopping all application instances before using the reset tool and warns about potential data inconsistencies if not used carefully.

More from the Stream Processing Fundamentals trail