Deploying NVIDIA H200 Tensor Core GPUs | CoreWeave

This post announces the first deployment of NVIDIA H200 Tensor Core GPUs by CoreWeave, detailing their technical specifications (4.8 TB/s memory bandwidth, 141 GB HBM3e memory) and performance advantages over H100s for generative AI workloads. It outlines the instance configuration, including Intel fifth-generation Xeon CPUs, NVIDIA BlueField-3 DPUs, and 3200Gbps NVIDIA Quantum-2 InfiniBand networking, and mentions cluster sizes up to 42,000 GPUs. The post also reiterates the role of CoreWeave Mission Control for cluster reliability and resiliency, the benefits of CKS for bare-metal performance, and the integrated SUNK for job scheduling. Observability services are presented as a key component for identifying and resolving system faults.