Run Step 3.7 Flash on NVIDIA GPUs with Enterprise-Ready Multimodal AI | NVIDIA Technical Blog

What this post added

This post details the deployment and fine-tuning of the Step 3.7 Flash multimodal AI model on NVIDIA GPUs. It highlights the model's architecture (198B parameters, MoE, 11B active parameters, 256k context window, native image/video input) and its suitability for agentic workflows. The post outlines deployment options using SGLang, TensorRT-LLM, and vLLM, and emphasizes production-ready deployment via NVIDIA NIM microservices with OpenAI-compatible APIs. It also describes Day 0 fine-tuning using the NVIDIA NeMo framework, including Automodel for SFT and LoRA, and NeMo Megatron-Bridge for large-scale training, demonstrating efficient fine-tuning on Hopper GPUs.