DotSlash: Simplified executable deployment
Feb 6, 2024Michael Bolin, Andres Suarez
Summary
Introduced DotSlash, a tool for simplified executable deployment that replaces large executables with lightweight descriptor files. DotSlash handles transparent fetching, decompression, and verification of platform-specific remote artifacts, reducing repository size and improving clone times. The post details the internal use cases at Meta, including managing first-party and third-party command-line tools within a monorepo and for core developer tools like Buck2 and Sapling. It also describes the DotSlash file format, its execution workflow, caching mechanisms, and the automated generation of DotSlash files via CI pipelines and GitHub Actions.
More from the Scalability and Large-Scale Systems Engineering trail
- Open-Sourcing Rebalancer: A Generic, High-Performance Library for Solving Assignment Problems
- ZGateway: Learnings from Putting a Proxy in Front of ZippyDB
- MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model