Building AI Agents for AR Glasses and XR Devices with NVIDIA XR AI | NVIDIA Technical Blog

This post introduces NVIDIA XR AI, an open-source library for building intelligent agents for AR glasses and XR devices. It details the modular architecture, which separates media transport, model services (NVIDIA Cosmos, Nemotron), enterprise connectivity (MCP), and agent orchestration (NeMo Agent Toolkit). The post provides a step-by-step guide to building a first agent, including starting AI services, running a sensor-first agent, connecting enterprise data via MCP, and adding agent orchestration.