Matrix-Game: Interactive World Foundation Model
Yifan Zhang, Chunli Peng, Boyang Wang, Puyi Wang, Qingcheng Zhu, Fei Kang, Biao Jiang, Zedong Gao, Eric Li, Yang Liu, Yahui Zhou
2025-06-25
Summary
This paper talks about Matrix-Game, a new AI model that creates Minecraft game worlds in video form that players can control, producing realistic and consistent results.
What's the problem?
The problem is that previous models struggled to generate complex game worlds that players could interact with while keeping the world realistic and following physical rules.
What's the solution?
The researchers trained Matrix-Game in two stages to learn how to generate high-quality videos of game worlds where actions can control what happens, ensuring the worlds stay physically consistent and believable.
Why it matters?
This matters because it can enhance video game design and experiences by making AI that can create interactive and realistic game environments, which can also be used for testing and simulating virtual worlds.
Abstract
Matrix-Game, a controllable game world generation model trained in a two-stage process, outperforms existing models by producing high-quality, action-controllable, and physically consistent Minecraft world videos.