Quantitative Video World Model Evaluation for Geometric-Consistency
Measuring whether AI-generated videos obey real physics and geometry
Researchers created PDI-Bench, a system that automatically checks whether videos generated by AI actually respect the laws of physics—measuring whether objects maintain consistent size, move realistically in 3D space, and hold their shape. When tested on state-of-the-art video generators, it found specific geometric failures that popular quality metrics completely miss.
Video-generating AI models are increasingly used to simulate physical environments, from robotics training to visual effects. If these videos contain hidden geometry errors—objects that shrink or deform impossibly—systems trained on them will learn incorrect physics and make poor real-world decisions. PDI-Bench catches these failures automatically, letting developers identify and fix the blind spots in their models before deploying them.