BlogsLambdaMLPerf Training Benchmark Performance

MLPerf Training Benchmark Performance

MLPerf Training Benchmark Performance

1
posts
2026

This post details Lambda's performance in MLPerf Training v6.0, showcasing the fastest LLM training on NVIDIA GB300 NVL72 and fastest MoE training on NVIDIA HGX B200. It highlights improvements in training speed for Llama 3.1 8B on GB300 NVL72 due to software optimizations and presents results for GPT-OSS-20B, an MoE model, demonstrating competitive performance on both GB300 NVL72 and HGX B200 systems. The post emphasizes the impact of hardware innovations like NVIDIA Blackwell Ultra and software stack tuning on convergence times and efficiency for various AI model architectures.

2026

MLPerf Training v6.0: Lambda delivers fastest LLM training on NVIDIA GB300 NVL72 and fastest MoE training on NVIDIA HGX B200

6/16/2026

This post reports Lambda's specific results for MLPerf Training v6.0, detailing the fastest LLM training times on NVIDIA GB300 NVL72 and the fastest MoE training times on NVIDIA HGX B200. It quantifies the 18.7% improvement in training speed for Llama 3.1 8B on GB300 NVL72 due to software optimizations and provides convergence times for GPT-OSS-20B on both GB300 NVL72 and HGX B200 systems. It also lists system specifications for the tested configurations and compares Lambda's performance against other submissions.