✦
Summary
PhyMotion is a structured 3D motion reward for improving and evaluating physics-grounded human video generation. It targets a major weakness in video generation: models can produce visually attractive human videos that still contain floating bodies, broken balance, bad contacts, or physically implausible movement. PhyMotion provides a reward signal that looks beyond 2D perceptual quality and evaluates whether the generated human motion could plausibly exist in 3D.
Key Features
Evaluates human video generation using structured 3D physical motion rewards.
Recovers SMPL body meshes from generated videos for 3D motion analysis.
Retargets recovered motion onto a humanoid in the MuJoCo physics simulator.
Scores kinematic plausibility, contact and balance, and dynamic feasibility.
Provides interpretable reward components for diagnosing motion failures.
Supports reinforcement-learning based post-training of human video generators.
Correlates generated motion quality with physical feasibility rather than only 2D appearance.
Targets realistic human movement in generated videos and embodied simulations.
About PhyMotion
The method recovers SMPL body meshes from generated videos, retargets them onto a humanoid inside the MuJoCo physics simulator, and scores the motion along interpretable axes. These include kinematic plausibility, contact and balance consistency, and dynamic feasibility. Because each component is continuous and tied to a specific physical property, the reward can diagnose which part of the motion is wrong instead of returning only a vague visual score.
PhyMotion is useful for researchers using reinforcement learning or post-training to improve human video models. It can help align generated motion with human judgment, reduce physical artifacts, and guide models toward more believable full-body action. The project is best understood as a reward and evaluation framework for video generation, not a general consumer animation editor.