Optimization story: Bloom inference
Mar 24, 2023
Summary
This post details the technology behind BLOOM's training, including the distributed training infrastructure, hardware, and software stack required for such a massive model.
This post details the technology behind BLOOM's training, including the distributed training infrastructure, hardware, and software stack required for such a massive model.