VGGT-Ω
Training faster, cheaper 3D scene reconstruction models at 15 times larger scale
A new model called VGGT-Ω reconstructs 3D scenes from video more accurately than previous approaches while using 70% less GPU memory during training. By cutting computational costs and creating a pipeline to label dynamic video scenes, the researchers trained on 15 times more data than prior work, achieving 77% better camera tracking on standard benchmarks and unlocking the ability to learn from unlabeled video.
3D scene reconstruction from video underpins AR applications, robotics, and autonomous systems that need to understand their surroundings. Making this technology faster and cheaper to train means more organizations can build and deploy these systems. The model's learned patterns also transfer to other vision tasks—including helping AI systems align what they see with language descriptions—suggesting reconstruction is a foundational skill worth scaling up.