Kafka Storage That’s 10x More Scalable and Elastic with Confluent

This post introduces and details Confluent Cloud's 'Infinite Storage' engine, which separates compute and storage by offloading data to cloud object storage. It addresses operational pain points of traditional Kafka storage, such as throttling, capacity balancing, and retention negotiation. The post highlights the benefits of this architecture, including automatic storage growth, cost savings through pay-as-you-go, and enabling new use cases like using Kafka as a source of truth and powering real-time/historical analytics. It also explains performance improvements achieved through resource isolation between real-time and historical consumers.