Building Confluent Cloud – Here’s What We Learned

This post details the current architecture of Confluent Cloud, focusing on the data plane network architecture with Layer 4 load balancers for broker abstraction and the control plane's mothership/satellite components managing physical clusters via Kubernetes custom resources. It also outlines improvements made to Apache Kafka based on Confluent Cloud learnings, including TLS certificate renewals without broker restarts, multi-tenant Kafka, and client DNS re-resolution.