Exposing a Kafka Cluster via a VPC Endpoint Service

This post details the implementation of a VPC Endpoint Service to expose an Apache Kafka cluster from Grab's main VPC to the GrabKios VPC. It describes the architecture involving a Network Load Balancer (NLB) with dedicated listeners for each broker and AZ-specific CNAME records to optimize data transfer across Availability Zones. The setup ensures deterministic connections to Kafka brokers while enhancing security by avoiding VPC peering. Future improvements focus on scalability and multi-cloud compatibility.