Introducing: B200s and H200s on Modal

This post announces the availability of NVIDIA B200 and H200 GPUs on Modal, detailing their specifications and performance benefits over H100s. It highlights increased GPU RAM (180GB for B200), higher memory bandwidth (8 TB/s for B200), and new FP4 Tensor Core arithmetic capabilities on the B200. Benchmarks show a 2.5x faster median time-to-first-token and 1.7x higher queries-per-second for DeepSeek V3 Large on 8xB200s vs 8xH200s using vLLM. The post emphasizes Modal's ability to provide these powerful GPUs with no reservations, fast spin-up times, and pay-as-you-go pricing.