Runway Feature Trails

Runway introduces Data Augmentation for its General World Model (GWM-1) in robotics. This feature allows engineers to generate photorealistic variations of existing robot trajectories, including new environments, lighting, camera angles, and object placements. This enables scaling training data without additional collection by transforming existing trajectory videos into new conditions or generating full trajectory videos from a single frame and text prompt. This complements Offline Policy Evaluation by providing a richer and more diverse dataset for training and testing robot policies.

Runway is actively researching and developing advanced diffusion models for various AI applications, including vision-language tasks, image generation, 3D rendering, and video synthesis. Recent work focuses on improving efficiency, controllability, interpretability, and mitigating biases in these models.