Introducing NVIDIA Nemotron 3.5 Lightning

This post introduces NVIDIA Nemotron 3.5 Lightning, a 30B MoE model with 3B active parameters, distilled for agentic use cases. It highlights the model's ability to achieve 4x higher throughput and 30% lower time to task completion compared to other open models. The post details the fine-tuning process of Nemotron 3.5 Lightning by CodeRabbit using Baseten Training, including supervised fine-tuning (SFT) and reinforcement learning with verifiable rewards. The fine-tuned adapter, loaded as a rank-16 LoRA, demonstrates improved accuracy, reduced cost, and fewer output tokens on Baseten Dedicated Inference.