Develop Physical AI Reasoning, World, and Action Models with NVIDIA Cosmos 3 | NVIDIA Technical Blog

This post introduces NVIDIA Cosmos 3, a frontier foundation model for physical AI that unifies physical reasoning, world generation, and action generation. It features a Mixture-of-Transformers (MoT) architecture with a Reasoner tower (VLM) and a Generator tower (diffusion-based). Cosmos 3 supports multimodal inputs and outputs (text, image, video, action) and is available in Nano (16B) and Super (64B) parameter sizes. The release includes open-source models, training scripts, deployment tools (Cosmos NIM microservices), and synthetic datasets for robotics, autonomous driving, and warehouse environments.