Kafka Infinite Storage
Infinite Storage in Kafka: Unlimited Retention in Confluent Cloud

Infinite Storage in Kafka: Unlimited Retention in Confluent Cloud

7/1/2020 · Jun Rao

What this post added

This post introduces the concept of 'infinite storage' for Apache Kafka in Confluent Cloud, decoupling storage from compute and allowing for unlimited data retention without additional charges or pre-provisioning. It explains the technical benefits for use cases like system of record, regulatory compliance, and rebuilding ksqlDB state. The underlying technology is based on Tiered Storage, with performance optimizations in Confluent Cloud to ensure cost-effectiveness, ease of use, and performance isolation between real-time and historical data consumers.

Read the original post ↗