Why Confluent? The Largest Kafka Service in the World

This post details Confluent's engineering capabilities in reliability, durability, scalability, and security for their Kafka service. It provides statistics on managed clusters (30,000+), daily messages (3 trillion), uptime SLA (99.99%), monitoring (7,700+ monitors), multi-zone availability, self-healing automation, Cluster Linking, and Schema Linking for disaster recovery. Durability is enhanced with checks on over 80 trillion Kafka messages per day, exceeding Apache Kafka standards through proactive design reviews, real-time auditing, and at-scale data integrity repair. Scalability is highlighted with 10x elasticity over Apache Kafka, 2,500+ cluster expansions/contractions annually, and support for up to 100 CKUs. Security features include private networking, BYOK, SSO, OAuth, RBAC (2 billion checks daily), and audit logging.