D4RT: Unified, Fast 4D Scene Reconstruction & Tracking

Introduced D4RT, a unified AI model for 4D scene reconstruction and tracking across space and time. D4RT uses a unified encoder-decoder Transformer architecture with a novel query mechanism to reconstruct dynamic scenes from 2D video. It achieves up to 300x greater efficiency than previous methods, enabling real-time applications. Capabilities include point tracking (predicting 3D trajectories even when points are not visible in all frames), point cloud reconstruction (generating 3D structure without separate camera estimation), and camera pose estimation (recovering camera trajectory by aligning 3D snapshots).