Kafka Connect Improvements in Apache Kafka 2.3 | Confluent

What this post added

Details the implementation and benefits of Incremental Cooperative Rebalancing (KIP-415) in Kafka Connect starting from Apache Kafka 2.3, which replaces the previous 'stop-the-world' rebalancing with a more efficient, incremental approach. It also introduces logging improvements via Mapped Diagnostic Context (MDC) for better log context, consolidated REST API endpoints for connector status and information, distinct client.id per task for improved diagnostics, and the ability to override producer/consumer configurations at the connector level (KIP-458). Includes practical examples and test results demonstrating the reduction in downtime during rebalances.