Building data science teams to have an impact at scale
Jun 12, 2018Rajiv Krishnamurthy

Summary
This post details the integration of data science teams with infrastructure engineering teams at Meta to tackle large-scale challenges. It highlights specific contributions in: 1. CDN cache efficiency through ML models predicting future content requests. 2. Performance regression detection tools for both client-side and server-side applications, using custom algorithms to account for trends, seasonality, and noise. 3. Data center demand forecasting using custom Bayesian time series and deep learning models, and predicting the impact of infrequent events on infrastructure.
More from the Scalability and Large-Scale Systems Engineering trail
- Open-Sourcing Rebalancer: A Generic, High-Performance Library for Solving Assignment Problems
- ZGateway: Learnings from Putting a Proxy in Front of ZippyDB
- MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model