NVIDIA Nemotron 3.5 Lightning Delivers Fast, Accurate Specialized Task Execution for Long-Running Agents | NVIDIA Technical Blog

This post introduces NVIDIA Nemotron 3.5 Lightning, a 30B parameter open Mixture-of-Experts (MoE) model with 3B active parameters, optimized for high-volume, low-latency execution in always-on AI agents and agentic workflows. It details innovations in inference and training, including speculative decoding, harness-optimized training, and quantization (NVFP4 and BF16 checkpoints), delivering up to 4x output speed compared to similar-sized models. The post also introduces NVIDIA NeMo Switchyard, a library for intelligent model routing, allowing Nemotron 3.5 Lightning to be deployed alongside other models for optimal task allocation. The open release includes permissive licensing, weights, data, and recipes for customization.