Designing MCP Gateway Uber's MCP Management Platform

This post details the design and implementation of the MCP Gateway, a foundational microservice that standardizes how AI agents interact with Uber's backend systems. It acts as an orchestration and routing layer, translating MCP protocol calls into HTTP, gRPC, or TChannel requests and vice-versa. Key components include the MCP Registry for discovery and control, and the Proxy Gateway for runtime execution. AutoCrawler automates the discovery and registration of MCP servers and tools from IDL definitions and native MCP servers. The system enforces security through access control and data redaction, and leverages Muttley, Uber's service mesh sidecar, for downstream request execution. The MCP Gateway currently hosts over 800 MCP servers and 5000 tools, enabling scalable and consistent agentic workflows.