Perceptive Behavior Foundation Model

NEW

Key Features

One policy for adapting many human-motion references.
Uses robot-centric terrain perception for foot placement.
Creates terrain-conformal supervision with the TCRS synthesizer.
Uses an identity-gated vision student for terrain corrections.
Adds zero-initialized residual pathways only where needed.
Supports acrobatics, expressive motion, locomotion, and recovery.
Runs an interactive browser demo with MuJoCo WASM and ONNX Runtime.
Demonstrates motion adaptation on a Unitree G1 robot.

The training pipeline uses TCRS supervision, an offline synthesizer that combines raw motion clips with sampled height fields to create terrain-conformal references. At deployment, an identity-gated vision student preserves the raw command and adds terrain corrections through zero-initialized residual pathways only where the terrain requires them, avoiding per-skill tuning at test time.


Perceptive BFM is useful for humanoid locomotion, motion imitation, terrain adaptation, fall recovery, and robot demonstrations. The project includes a browser demo powered by MuJoCo WASM and ONNX Runtime plus a Unitree G1 gallery covering backflips, cartwheels, stair walking, expressive motion, obstacles, outdoor surfaces, and recovery behaviors.

Get more likes & reach the top of search results by adding this button on your site!

Embed button preview - Light theme
Embed button preview - Dark theme
TurboType Banner
Zero to AI Engineer Program

Zero to AI Engineer

Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.

Subscribe to the AI Search Newsletter

Get top updates in AI to your inbox every weekend. It's free!