Pretrained to Imagine, Fine-Tuned to Act: The Rise of World-Action Models | NVIDIA Technical Blog

This post analyzes the recent shift in robot foundation models from Vision-Language-Action (VLA) models to World-Action Models (WAMs). It hypothesizes that WAMs, by leveraging pretrained video or world-model backbones that already model scene dynamics, can better address the language-to-action grounding gap compared to VLM-based VLAs. The post categorizes modern WAMs based on what they predict (inverse dynamics, joint prediction, representation-only) and how actions are integrated (default action tokens, action as image, latent actions). It also discusses architectural considerations and the reasons for the recent popularity of WAMs, suggesting they will become a major recipe for robot foundation models, likely in hybrid forms.