Distributed AI training

3 posts · 3 sources

CoreweaveBlog30 Jul

Reference Architecture for AI Training

DeepMindBlog23 Apr

Decoupled DiLoCo: Resilient, Distributed AI Training at Scale

MetaBlog5 Aug

RoCE networks for distributed AI training at scale