Log Compaction | Highlights in the Apache Kafka and Stream Processing Community | November 2016 | Confluent

This post details the rationale for KIP-72 (limiting memory for incoming requests) and KIP-81 (bounding fetch memory usage in consumers), both addressing broker and consumer memory exhaustion. It also discusses KIP-84 (SASL/SCRAM mechanisms) for improved authentication and KIP-85 (dynamic JAAS configuration) for client security in containerized environments. Additionally, KIP-87 (Compaction Tombstone Flag) is introduced as a more robust way to delete keys in compacted topics compared to null values.