8/11/2026
What this post added
This post details the deployment of the NVIDIA Nemotron 3 Ultra model on the Baseten platform. It highlights the model's architecture (550B hybrid Mamba-Transformer MoE with 55B active params, latent MoE routing, multi-token prediction, and 1M token context) and provides example usage for OpenAI-compatible chat completion, including Python code snippets and JSON output structure. It also mentions recommended parameters like temperature=1.0 and top_p=0.95, and the ability to toggle reasoning via chat_template_kwargs.enable_thinking.