Introducing: L40S GPUs on Modal
Dec 19, 2024

Summary
Introduces support for NVIDIA L40S GPUs, which offer 48GB of VRAM (double the A10) and improved performance for inference workloads. The post details performance benefits for larger models and compute-bound jobs, including a 20% speedup in a basic load test without tuning. It also provides a comparative spec table and instructions for using the L40S with the Modal Python SDK.