Securing and Managing Multi-cloud Presto Clusters with Grab’s DataGateway

This post details the evolution of Grab's DataGateway, highlighting its role in managing multi-cloud Presto clusters. Key contributions include: 1. Enhancing access control to schema, table, and field levels beyond S3 bucket/file control. 2. Providing a seamless user experience during EMR migrations by acting as a central proxy, abstracting cluster changes from users. 3. Enabling multi-cloud data lake maintenance by acting as a gateway between AWS and Azure Presto clusters, allowing users to switch between them on the fly without endpoint changes. The post also elaborates on the DataGateway's key components (API Service, SQL Parser, Auth Framework, Admin UI) and its deployment on Kubernetes for high availability and scalability.