Log Compaction | Highlights in the Kafka and Stream Processing Community | October 2015 | Confluent

What this post added

This post details community discussions and upcoming features for Apache Kafka 0.10.1.0, including KIPs related to fetch response size limits, timestamp searching in the new consumer, adding record headers, supporting multiple SASL authenticated Java clients in a single JVM, and dynamic JAAS configuration for Kafka clients. It also mentions Google's use of Kafka in GCP, Strata announcements, O'Reilly's insights on streams architecture, a customer 360 architecture tutorial, testing Kafka. Specifically, it highlights KIP-31 (Move to relative offsets in compressed message sets), KIP-32 (Add CreateTime and LogAppendTime to Kafka messages), and KIP-33 (Add time-based log index), which together enable time-based message lookup. It also notes that authorization patches for topic-level authorization have been merged into trunk for Kafka 0.9.0.0.