Building Confluent Cloud – Here’s What We Learned

What this post added

This post details the architecture of Confluent Cloud, breaking it down into the control plane (mothership and satellites managing physical clusters via Kubernetes custom resources and Confluent Operator) and the data plane (network architecture with load balancers for broker abstraction and dynamic scaling). It also highlights improvements made to Apache Kafka, including TLS certificate renewals without restarts, multi-tenant Kafka with quotas, and client-side DNS re-resolution for improved fault tolerance and infrastructure flexibility.