AI Video Editing

Netflix is exploring the application of AI in video editing to streamline complex manual tasks for content creators. This involves developing models that allow for precise control over edits, preserve the integrity of original footage, and ensure natural visual continuity. Initial research focuses on layered editing (Vera) and physically plausible object removal (VOID), aiming to empower artists while maintaining creative intent. Vera, a layered video diffusion model, generates edits as separate layers, preserving original footage outside the edited regions. VOID performs physically plausible inpainting for object and interaction deletion, reconstructing the scene as if the object was never there. Both Vera and VOID are research prototypes, with papers and code released to encourage further research.