Top 5 Things Every Apache Kafka Developer Should Know
Oct 16, 2020Bill Bejeck

Summary
This post introduces the sticky partitioner for Kafka producers, which improves batching efficiency by assigning records to the same partition until the batch is full or a timeout occurs, leading to fewer produce requests and reduced latency. It also explains the cooperative rebalancing protocol for consumer groups, which minimizes downtime during rebalances by shifting coordination logic to the broker-side group coordinator. Additionally, it details message delivery and durability guarantees configurable via the `acks` setting and `min.insync.replicas`, and highlights the utility of record headers for passing metadata and debugging information.
More from the Kafka Producer and Consumer API Enhancements trail
- How a Tier‑1 Bank Tuned Apache Kafka® for p99 Latency for Trading
- Kafka Producer Internals: The Producer Request Lifecycle
- Inside the Kafka Black Box—How Producers Prepare Event Data for Brokers
- Apache Kafka Message Compression
- How to Make Apache Kafka Clients Go Fast(er) on Confluent Cloud | Confluent How to Make Apache Kafka Even Faster