Log Compaction | Highlights in the Apache Kafka and Stream Processing Community | October 2016 | Confluent

This post details several Kafka Improvement Proposals (KIPs) relevant to broker and client behavior. KIP-74 introduces a fetch response size limit to control consumer memory usage and allow progress even with large messages. KIP-79 adds timestamp search methods to the new consumer. KIP-82 proposes adding headers to Kafka messages, a significant change to message structure. KIP-83 allows multiple SASL-authenticated Java clients in a single JVM, aiding MirrorMaker. KIP-85 enables dynamic JAAS configuration for clients, beneficial for containerized microservices.