The next step in Facebook’s AI hardware infrastructure

What this post added

Introduced Big Basin v2, an upgraded AI hardware system featuring NVIDIA Tesla V100 GPU accelerators, an upgraded head-node (Tioga Pass) for increased CPU performance, doubled PCIe bandwidth between CPUs and GPUs, and an upgraded OCP network card for enhanced network bandwidth for distributed training. This resulted in a 66% increase in single-GPU performance and near-linear performance improvement in large-scale distributed GPU training. The post also details how Big Basin v2 integrates with the FBLearner platform (Feature Store, Flow, Predictor) and other custom hardware like Bryce Canyon and Twin Lakes.