Asicmon: A platform agnostic observability system for AI accelerators
Jun 28, 2021Brian Coutinho, Hao Wang, David Carrillo-Cisneros, Cynthia Liu, Parth Malani
Summary
Introduced Asicmon, a scalable observability framework for AI accelerators that abstracts custom interfaces and provides a standard interface to internal tools, facilitating load balancing, performance monitoring, and automated health checks. Developed Asimov, a custom specification language to simplify the development and rapid prototyping of new accelerators by generating efficient C++ monitoring modules. Introduced Atrace, an accelerator tracing solution for remote trace collection and detailed inspection of accelerator systems.
More from the AI Research and Development trail
- An Organizational Second Brain: Building an AI That Learns From Experts
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model
- Exploring Hierarchical Interest Representation For Meta Ads Deep Funnel Optimization
- Meta’s AI Storage Blueprint at Scale