Migrate from ZooKeeper to KRaft with Confluent for Kubernetes
Oct 14, 2024Chase Thomas
Summary
This post details Confluent's experience migrating thousands of Kafka clusters to KRaft in Confluent Cloud without downtime, highlighting the technical challenges of scale and multi-tenancy. It emphasizes KRaft's benefits in enhanced scalability (millions of partitions) and improved operational stability due to the removal of ZooKeeper. The post also outlines migration strategies for users, including manual steps (dual-write mode, rolling restarts) and automated approaches using Confluent for Kubernetes (CFK) and Ansible Playbooks.
More from the Kafka KRaft Migration trail
- Announcing Confluent Platform 8.3: Powerful Apache Flink® SQL operations, Easier KRaft Migrations, Expanded Monitoring and more
- Apache Kafka 4.3 released: 25 KIPs, Kafka Streams, Share Group Controls, Broker Isolation, and more
- Introducing Confluent Platform 8.2: Queues for Kafka & Flink SQL
- Migrate From Hosted Kafka to Confluent Cloud in the KRaft Era
- Apache Kafka 4.1 Release: New Features & Upgrade Guide