NVIDIA Nemotron 3 Ultra Powers Faster, More Efficient Reasoning for Long-Running Agents | NVIDIA Technical Blog

Introduces NVIDIA Nemotron 3 Ultra, a 550B-parameter Mixture-of-Experts model designed for frontier reasoning and orchestration in long-running agent workflows. Key technical contributions include: hybrid Mamba-Transformer layers for efficient long-context handling, NVFP4 quantization for cross-architecture GPU deployment with up to 5x higher throughput, LatentMoE for efficient expert routing, and multi-token prediction for improved generative speed. The model also incorporates Multi-Teacher On-Policy Distillation (MOPD) for continuous improvement and domain specialization, trained on a large dataset with open recipes and weights. Performance benchmarks show Nemotron 3 Ultra delivering leading accuracy with higher throughput and lower cost compared to other open models.