Pose-to-Biomechanics: Bridging 3D Human Pose Estimation and Biomechanical Attribute Prediction
Turning pose videos into measurements of body stress and muscle work
Researchers created BioModule, a lightweight add-on that converts standard 3D pose estimates from videos into biomechanical measurements—like joint forces, muscle activation, and movement efficiency—that matter for injury prevention and rehabilitation. The system works with any existing pose estimator without modifications, and the team built the first large-scale dataset pairing video recordings with precise biomechanical labels to train and test it.
Physical therapists, sports coaches, and ergonomists currently need expensive motion-capture labs with markers placed on patients' bodies to measure how joints load during movement. This work enables those same biomechanical insights from ordinary video, making detailed movement analysis accessible in clinics, gyms, and workplaces where cameras already exist. It could expand screening for injury risk and personalized rehabilitation to millions more people who can't afford specialized labs.