To Infinity and Beyond: ThunderKittens Now on NVIDIA Vera Rubin NVL72!

This post details the integration of the ThunderKittens GEMM kernel with the NVIDIA Vera Rubin NVL72 platform. It highlights new features such as doubled K-step instructions for tensor cores, increased tensor memory (576 columns), oversized shared memory (328 KiB), B-side collector functionality for operand reuse, and early A-release commit signals. The authors demonstrate how these features are leveraged to optimize the kernel, achieving over 22 PFLOPS in NVFP4 GEMMs by addressing bottlenecks in data supply to the tensor cores and improving data reuse.