Modal

Introducing: H100s on Modal

Feb 6, 2024
Introducing: H100s on Modal
SummaryAI, from the source post

Introduces support for NVIDIA H100 GPUs on Modal, enabling users to leverage these high-performance accelerators for machine learning tasks. The post highlights the speedups H100s offer for training and inference compared to A100s, details their technical specifications (80GB DRAM, NVLink), pricing ($7.65/hour/GPU), and how to enable them via the `@app.function(gpu='H100')` decorator. It emphasizes Modal's autoscaling capabilities for cost-effective utilization of these powerful GPUs.

More from the Cloud Function Platform trail