The technical leap centers on long-term memory. Previous models struggled with object persistence, failing to track items when camera angles shifted. Skywork AI’s Matrix-Game 3.5 addresses this by moving from frame-based storage to spatial mapping. By breaking frames into patches tagged with three-dimensional coordinates, the model remembers what exists at a specific location rather than just how a scene looks. This shift allows a 5B-parameter model to maintain 20 FPS at 720P resolution on a single GPU, creating a consistent, interactive experience that functions as a living environment.
This architectural shift favors ingenuity over brute force. Rather than stacking parameters, the team implemented modular systems like PRoPE geometric encoding as pluggable components. This design allows the model to retain its native generative capabilities while adding interactive logic, effectively positioning it as a foundational layer for the industry. Academic breakthroughs, such as those from Nanjing University’s Zhou Zhihua, further support this transition by introducing "learnware"—a framework for assembling heterogeneous models into a cohesive, growable ecosystem.

Comments (0)
No comments yet. Be the first!