Confluent

Hands-Free Kafka Replication: A Lesson in Operational Simplicity | Confluent

Jul 1, 2015Neha Narkhede
Hands-Free Kafka Replication: A Lesson in Operational Simplicity | Confluent
SummaryAI, from the source post

Introduces a change to Kafka's replica lag detection mechanism, replacing `replica.lag.max.messages` with a time-based approach (`replica.lag.time.max.ms`). This aims to simplify configuration, reduce operational overhead, and prevent false alerts caused by temporary spikes in producer traffic or GC pauses on follower replicas. The new model ensures that replicas are only removed from the ISR if they consistently lag behind the leader for a defined period, improving the stability of replication.

More from the Kafka Broker and Streams Enhancements trail