Cloud Function Platform
Introducing: H100s on Modal

Introducing: H100s on Modal

2/6/2024

What this post added

Introduces support for NVIDIA H100 GPUs on Modal, enabling users to leverage these high-performance accelerators for machine learning tasks. The post highlights the speedups H100s offer for training and inference compared to A100s, details their technical specifications (80GB DRAM, NVLink), pricing ($7.65/hour/GPU), and how to enable them via the `@app.function(gpu='H100')` decorator. It emphasizes Modal's autoscaling capabilities for cost-effective utilization of these powerful GPUs.

Read the original post ↗