TechPrufer
Get started
Grab
Grab logoGrab · Feature trail

Data Access Gateway for Presto

1 post · Aug 2020

What this trail covers

Grab's DataGateway has evolved to manage user access and cluster selections for its Presto ecosystem, providing a single endpoint for interactive querying and ETL jobs. It enforces schema, table, and field-level access control, seamlessly handles cluster scaling and migrations across multi-cloud environments (AWS and Azure), and captures audit trails of user activities. The system is deployed on Kubernetes for high availability and scalability, and includes an administration UI for managing clusters and user access.

All Grab trails
  1. Securing and Managing Multi-cloud Presto Clusters with Grab’s DataGatewayThis post details the evolution of Grab's DataGateway, highlighting its role in managing multi-cloud Presto clusters. Key contributions include: 1. Enhancing access control to schema, table, and field levels beyond S3 bucket/file control. 2. Providing a seamless user experience during EMR migrations by acting as a central proxy, abstracting cluster changes from users. 3. Enabling multi-cloud data lake maintenance by acting as a gateway between AWS and Azure Presto clusters, allowing users to switch between them on the fly without endpoint changes. The post also elaborates on the DataGateway's key components (API Service, SQL Parser, Auth Framework, Admin UI) and its deployment on Kubernetes for high availability and scalability.