NVIDIA H100 GPUs are here
May 16, 2025

Summary
This post announces the availability of NVIDIA H100 GPUs and expanded multi-GPU configurations (2x, 4x, 8x) for A100 and L40S GPUs for regular models and training runs, in addition to existing deployments. It provides pricing details for these new hardware options and includes cURL examples for creating new models with H100 GPUs and listing available hardware via the API. It also guides users on updating their existing deployments to utilize the new hardware.