Run Step 3.7 Flash on NVIDIA GPUs with Enterprise-Ready Multimodal AI | NVIDIA Technical Blog

This post details the deployment of Step 3.7 Flash, a 198B-parameter Mixture-of-Experts vision-language model, on NVIDIA-accelerated infrastructure. It covers deployment options using open-source frameworks (SGLang, TensorRT-LLM, vLLM), production-ready deployment via NVIDIA NIM as containerized inference microservices with standardized APIs, and Day 0 fine-tuning with the NVIDIA NeMo framework (including Automodel and Megatron-Bridge recipes). The post also mentions the use of NVFP4-quantized checkpoints for boosted inference and the availability of GPU-accelerated endpoints for prototyping and evaluation.