Kangaroo: A new flash cache optimized for tiny objects
Oct 26, 2021Sathya Gunasekar, Jimmy Lu

Summary
Introduced Kangaroo, a novel flash cache design optimized for tiny objects (~100 bytes or less). Kangaroo combines log-structured (KLog) and set-associative (KSet) cache components to reduce both DRAM overhead and write amplification. It employs a threshold admission policy to amortize writes to KSet over multiple objects and a new eviction policy to minimize cache misses. Evaluated using production social graph caching workloads from Facebook and Twitter, demonstrating a 29% reduction in misses under realistic constraints compared to prior designs.
More from the Scalability and Large-Scale Systems Engineering trail
- Open-Sourcing Rebalancer: A Generic, High-Performance Library for Solving Assignment Problems
- ZGateway: Learnings from Putting a Proxy in Front of ZippyDB
- MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model