Using Chakra execution traces for benchmarking and network performance optimization
Sep 7, 2023Louis Feng, Shengbao Zheng, Zhaodong Wang, Wenyin Fu, James Hongyi Zeng

Summary
Introduced Chakra execution traces, an open graph-based representation of AI/ML workload execution, to address limitations in traditional AI benchmarking (forecasting, cost, adaptability). Chakra captures compute, memory, and communication operations, dependencies, timing, and metadata. Developed tools for trace collection, analysis, generation, and simulation. Leveraged Chakra traces for benchmarking (Mystique, PARAM) and performance optimization (visualizing collective message sizes). Future plans include enhancing benchmarking with pre-execution traces and using generative AI to create representative traces for optimization and IP-protected sharing. Collaborating with MLCommons to drive industry adoption.