Accelerating Search and Ingestion with High-Performance gRPC™ in OpenSearch™

Introduced native gRPC endpoints to OpenSearch, enabling direct communication with gRPC/Protobuf clients for search and ingestion workloads. Designed a gRPC server module that coexists with the existing REST transport, publishing an SPI for plugin extensibility. Developed an automated pipeline for converting OpenAPI specifications to Protobuf, ensuring API parity and backward compatibility. Integrated gRPC APIs into Uber's OpenSearch Gateway, removing an internal translation layer and reducing latency. Achieved significant performance gains, including a ~60% p99 write latency reduction for M3 metrics and a 20-35% reduction in max indexing delay for the M3 Indexer.