NVIDIA NVLink Fusion Brings NVHBM to Next-Generation AI Infrastructure | NVIDIA Technical Blog

This post introduces NVIDIA NVLink Fusion, a connective technology and IP that enables hyperscalers and AI-native companies to deploy custom XPUs and CPUs into the NVIDIA AI infrastructure platform using the MGX rack-scale architecture. It details NVHBM, a custom HBM base-die technology that offers up to 30% more memory bandwidth, up to 67% reduction in PHY and support area (leading to up to 30% more main-die silicon for compute), and up to 15% lower HBM power usage compared to standard HBM4e. The combination of NVLink Fusion and NVHBM is shown to deliver a 30% overall end-to-end performance increase per XPU at rack scale by compounding bandwidth, area, and power improvements.