NVIDIA Nemotron 3 Super for agentic AI in financial services

This post introduces day-0 support for NVIDIA Nemotron 3 Super, a 120B hybrid mixture-of-experts model, on the Baseten Inference Stack. It details the model's architecture, including latent MoE and multi-token prediction (MTP), and its performance benefits (over 50% faster token generation) for agentic workloads. The post highlights the model's suitability for financial services due to its open nature and strong benchmark performance across reasoning and coding tasks. It also contrasts Nemotron 3 Super with Nano and Ultra variants, outlining use cases in financial services like loan processing, fraud detection, and cybersecurity. The post emphasizes Baseten's role in providing flexible deployment options (Baseten Cloud, single-tenant, self-hosted) for sensitive financial applications.