作为世界模型的视频生成:一种关于状态与动态的机制性视角 / A Mechanistic View on Video Generation as World Models: State and Dynamics
1️⃣ 一句话总结
这篇论文提出了一种新的分类框架,将视频生成模型视为潜在的世界模型,并主张通过关注模型如何构建内部“状态”以及如何模拟动态变化来提升其物理连贯性和因果推理能力,从而推动该领域从生成逼真视频迈向构建通用的世界模拟器。
Large-scale video generation models have demonstrated emergent physical coherence, positioning them as potential world models. However, a gap remains between contemporary "stateless" video architectures and classic state-centric world model theories. This work bridges this gap by proposing a novel taxonomy centered on two pillars: State Construction and Dynamics Modeling. We categorize state construction into implicit paradigms (context management) and explicit paradigms (latent compression), while dynamics modeling is analyzed through knowledge integration and architectural reformulation. Furthermore, we advocate for a transition in evaluation from visual fidelity to functional benchmarks, testing physical persistence and causal reasoning. We conclude by identifying two critical frontiers: enhancing persistence via data-driven memory and compressed fidelity, and advancing causality through latent factor decoupling and reasoning-prior integration. By addressing these challenges, the field can evolve from generating visually plausible videos to building robust, general-purpose world simulators.
作为世界模型的视频生成:一种关于状态与动态的机制性视角 / A Mechanistic View on Video Generation as World Models: State and Dynamics
这篇论文提出了一种新的分类框架,将视频生成模型视为潜在的世界模型,并主张通过关注模型如何构建内部“状态”以及如何模拟动态变化来提升其物理连贯性和因果推理能力,从而推动该领域从生成逼真视频迈向构建通用的世界模拟器。
源自 arXiv: 2601.17067