Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory

NEW

Key Features

Generates interactive world-model outputs in real time and in streaming mode.
Supports 720p long-form video generation.
Uses long-horizon memory to improve temporal consistency.
Improves data, model, and inference components together.
Builds on an upgraded data engine with synthetic and real-world sources.
Includes Video-Pose-Action-Prompt quadruplet training data.
Leverages Unreal Engine and AAA-game collection for richer supervision.
Targets practical interactive scenarios where coherence and latency both matter.

The project page emphasizes improvements across data, model design, and inference, including an upgraded data engine that combines Unreal Engine synthetic data, large-scale automated collection from AAA games, and real-world video augmentation. That pipeline feeds Video-Pose-Action-Prompt quadruplet data into the training process, showing that the system is built around structured interactive supervision instead of simple prompt-to-video generation.


Matrix-Game 3.0 aims to improve temporal consistency and real-time responsiveness at the same time. By combining memory-augmented modeling with streaming generation, it targets longer, more coherent interactions and positions itself as a practical world-model foundation for dynamic video generation and interactive environments.

Get more likes & reach the top of search results by adding this button on your site!

Embed button preview - Light theme
Embed button preview - Dark theme
TurboType Banner
Zero to AI Engineer Program

Zero to AI Engineer

Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.

Subscribe to the AI Search Newsletter

Get top updates in AI to your inbox every weekend. It's free!