Modal

Introducing: L40S GPUs on Modal

Dec 19, 2024
Introducing: L40S GPUs on Modal
SummaryAI, from the source post

Introduces support for NVIDIA L40S GPUs, which offer 48GB of VRAM (double the A10) and improved performance for inference workloads. The post details performance benefits for larger models and compute-bound jobs, including a 20% speedup in a basic load test without tuning. It also provides a comparative spec table and instructions for using the L40S with the Modal Python SDK.

More from the Serverless GPU Inference trail