Kafka Broker and Streams Enhancements
Get Automatic, Self-Balancing Kafka Clusters in Confluent Platform 6.0

Get Automatic, Self-Balancing Kafka Clusters in Confluent Platform 6.0

10/6/2020 · Steve Rodrigues

What this post added

Introduces Confluent Platform's Self-Balancing Clusters (SBC) feature, which automates Kafka cluster scaling and load balancing. SBC monitors partition layout and broker load, automatically reassigning partitions to balance replica counts, leader counts, disk usage, and network usage. It handles broker additions, removals, and failures, respecting rack awareness and capacity limits. Rebalancing is throttled to minimize impact on ongoing traffic.

Read the original post ↗