Kafka Infinite Storage
Handling GDPR with Apache Kafka: How does a log forget? | Confluent

Handling GDPR with Apache Kafka: How does a log forget? | Confluent

12/8/2017 · Ben Stopford

What this post added

Introduces the use of Kafka's compacted topics as a mechanism for implementing GDPR's 'right to be forgotten'. Explains that messages can be marked for deletion by sending a new message with the same key and a null value. Discusses strategies for mapping data to keys, handling composite keys, and an alternative approach using per-user encryption keys. Also covers propagating deletes from originating databases via Kafka Connectors and provides tuning configurations for the log cleaner to control compaction timing and I/O.

Read the original post ↗