Superpack: Pushing the limits of compression in Facebook’s mobile apps
Sep 13, 2021Sapan Bhatia
Summary
Introduced Superpack, a novel compression technique that combines compiler analysis with data compression to reduce the size of mobile applications. Superpack achieves over 20% savings compared to default Android Zip compression by applying advanced LZ parsing and entropy coding techniques informed by compiler analysis of code structure (ASTs, opcodes). It also transforms unstructured data into programs for compression. Superpack is applied to Dex bytecode, ARM machine code, and Hermes bytecode.
More from the Scalability and Large-Scale Systems Engineering trail
- Open-Sourcing Rebalancer: A Generic, High-Performance Library for Solving Assignment Problems
- ZGateway: Learnings from Putting a Proxy in Front of ZippyDB
- MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model