Kafka Infinite Storage
Making Confluent Cloud 10x More Elastic Than Apache Kafka | Confluent Making Confluent Cloud 10x More Elastic Than Apache Kafka

Making Confluent Cloud 10x More Elastic Than Apache Kafka | Confluent Making Confluent Cloud 10x More Elastic Than Apache Kafka

5/31/2022 · Addison Huddy

What this post added

This post introduces Confluent Cloud Intelligent Storage as the core technology enabling 10x elasticity compared to Apache Kafka. It details how Intelligent Storage utilizes tiered cloud storage (object storage and local disks) to minimize data rebalancing during scaling operations. The post quantifies the performance improvements, showing up to 30x faster scaling than vanilla Kafka and an average reduction of 69% in cluster expansion times with Intelligent Storage enabled. It also highlights how this elasticity improves resiliency by enabling faster recovery from broker failures and more efficient fleet-wide upgrades. The post contrasts the scaling process of Apache Kafka with Confluent Cloud, emphasizing the reduction in operational burden and capacity planning.

Read the original post ↗