NeuROK: Generative 4D Neural Object Kinematics
Teaching AI to predict how objects bend and move under pressure
Researchers created a system called NeuROK that learns to generate realistic 4D animations—showing how objects deform and move over time—without needing hand-coded physics rules for each object type. The approach works across many different kinds of objects by learning a compressed mathematical representation of all possible shapes an object can take, then predicting how that shape changes moment by moment.
Current methods for simulating object deformation require scientists to manually specify physics equations for each category of thing they want to simulate, limiting them to small datasets and specific objects. NeuROK instead learns from large 4D video datasets, meaning it can simulate deformations of any object type—rubber, cloth, metal, food—without rebuilding the physics from scratch. This directly enables better 3D video games, digital twins for manufacturing, and AI systems that understand how the physical world actually works.