NVIDIA L40S GPUs are here

This post announces the addition of NVIDIA L40S GPUs to Replicate's supported hardware, detailing their performance (~40% faster than A40s) and cost implications. It outlines a migration timeline for public and private models/deployments from A40 to L40S GPUs, and provides guidance on updating deployment configurations to maintain cost-effectiveness. Benchmarking methodology and results are linked.