TechPrufer
Get started
Replicate
Replicate logoReplicate · Feature trail

GPU Hardware Support and Migration

3 posts · Nov 2024 – May 2025

What this trail covers

Replicate has introduced support for NVIDIA L40S GPUs, offering significant performance improvements over A40 GPUs. This includes a migration plan for existing models and deployments from A40s to L40S, with updated pricing considerations. Users are advised to adjust minimum instance counts for deployments to account for the increased performance per dollar. Support for A40 GPUs will be phased out.

All Replicate trails
  1. NVIDIA H100 GPUs are hereThis post announces the availability of NVIDIA H100 GPUs and expanded multi-GPU configurations (2x, 4x, 8x) for A100 and L40S GPUs for regular models and training runs, in addition to existing deployments. It provides pricing details for these new hardware options and includes cURL examples for creating new models with H100 GPUs and listing available hardware via the API. It also guides users on updating their existing deployments to utilize the new hardware.
  2. NVIDIA L40S GPUs are hereThis post announces the addition of NVIDIA L40S GPUs to Replicate's supported hardware, detailing their performance (~40% faster than A40s) and cost implications. It outlines a migration timeline for public and private models/deployments from A40 to L40S GPUs, and provides guidance on updating deployment configurations to maintain cost-effectiveness. Benchmarking methodology and results are linked.