Key Features

Evaluates human video generation using structured 3D physical motion rewards.
Recovers SMPL body meshes from generated videos for 3D motion analysis.
Retargets recovered motion onto a humanoid in the MuJoCo physics simulator.
Scores kinematic plausibility, contact and balance, and dynamic feasibility.
Provides interpretable reward components for diagnosing motion failures.
Supports reinforcement-learning based post-training of human video generators.
Correlates generated motion quality with physical feasibility rather than only 2D appearance.
Targets realistic human movement in generated videos and embodied simulations.

The method recovers SMPL body meshes from generated videos, retargets them onto a humanoid inside the MuJoCo physics simulator, and scores the motion along interpretable axes. These include kinematic plausibility, contact and balance consistency, and dynamic feasibility. Because each component is continuous and tied to a specific physical property, the reward can diagnose which part of the motion is wrong instead of returning only a vague visual score.


PhyMotion is useful for researchers using reinforcement learning or post-training to improve human video models. It can help align generated motion with human judgment, reduce physical artifacts, and guide models toward more believable full-body action. The project is best understood as a reward and evaluation framework for video generation, not a general consumer animation editor.

Get more likes & reach the top of search results by adding this button on your site!

Embed button preview - Light theme
Embed button preview - Dark theme
TurboType Banner
Zero to AI Engineer Program

Zero to AI Engineer

Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.

Subscribe to the AI Search Newsletter

Get top updates in AI to your inbox every weekend. It's free!