Genie 3: A new frontier for world models

Genie 3 represents a significant leap in world model capabilities by enabling real-time, interactive environment generation. Key technical breakthroughs include managing auto-regressive generation over time to maintain consistency for several minutes (visual memory up to one minute) and responding to user inputs multiple times per second. The introduction of 'promptable world events' allows for dynamic changes to the generated world, enhancing interactivity and enabling 'what if' scenarios for agent training. The post also details the integration and testing of Genie 3 with the SIMA agent, demonstrating its utility for complex goal achievement in simulated environments.