MLPerf Training v6.0: Lambda delivers fastest LLM training on NVIDIA GB300 NVL72 and fastest MoE training on NVIDIA HGX B200

MLPerf Training v6.0 results are presented, showing Lambda's fastest LLM training on NVIDIA GB300 NVL72 (18.7% improvement over v5.1 for Llama 3.1 8B) and fastest MoE training on NVIDIA HGX B200 (GPT-OSS-20B). The post details system specifications for both GB300 NVL72 and HGX B200, and discusses the impact of hardware innovations (Blackwell Ultra) and software optimizations (tuned NeMo stack) on training speed and efficiency, particularly for MoE architectures.