Streamlining Grab's Segmentation Platform with faster creation and lower latency

This post details the evolution of Grab's Segmentation Platform to address challenges with long segment creation times and high read latency. The core technical contributions include: 1. Adoption of Roaring Bitmaps for efficient storage of user IDs within segments, significantly reducing storage size and improving compression for sparse data. 2. Development of an SDK that handles segment retrieval, decoding, caching (with LRU eviction), and watching for updates, enabling low-latency membership checks (<1ms p99) for downstream services. This SDK allows for set operations on segments on the fly and has enabled new use cases like controlling communication frequency and lifting segment size restrictions in experimentation.