Baseten AI Model Deployment and Serving Platform
NVIDIA Nemotron 3 Ultra | Model library

NVIDIA Nemotron 3 Ultra | Model library

8/11/2026

What this post added

This post details the deployment of the NVIDIA Nemotron 3 Ultra model on the Baseten platform. It highlights the model's architecture (550B hybrid Mamba-Transformer MoE with 55B active params, latent MoE routing, multi-token prediction, and 1M token context) and provides example usage for OpenAI-compatible chat completion, including Python code snippets and JSON output structure. It also mentions recommended parameters like temperature=1.0 and top_p=0.95, and the ability to toggle reasoning via chat_template_kwargs.enable_thinking.

Read the original post ↗