CacheLib, Facebook’s open source caching engine for web-scale services
Sep 2, 2021Sathya Gunasekar, Snehal Khandkar, Dmitry Vinnik, Michael Cheng
Summary
This post announces the open-sourcing of CacheLib, a pluggable in-process C++ caching engine designed for building and scaling high-performance services. It details CacheLib's API for creating customizable, scalable, and concurrent caches, and highlights its adoption in over 70 large-scale systems at Facebook. The post also introduces CacheBench, a benchmarking tool for evaluating caching performance on diverse production workloads. It emphasizes the potential for CacheLib and CacheBench to become industry standards, citing collaborations with Twitter, Pinterest, and academic institutions, as well as contributions to the Open Compute Project (OCP) NVMe Cloud SSD Specification.
More from the Scalability and Large-Scale Systems Engineering trail
- Open-Sourcing Rebalancer: A Generic, High-Performance Library for Solving Assignment Problems
- ZGateway: Learnings from Putting a Proxy in Front of ZippyDB
- MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model