菜单

🤖 系统
📄 Abstract - What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewards

Recent video diffusion models can synthesize visually compelling clips, yet often violate basic physical laws-objects float, accelerations drift, and collisions behave inconsistently-revealing a persistent gap between visual realism and physical realism. We propose $\texttt{NewtonRewards}$, the first physics-grounded post-training framework for video generation based on $\textit{verifiable rewards}$. Instead of relying on human or VLM feedback, $\texttt{NewtonRewards}$ extracts $\textit{measurable proxies}$ from generated videos using frozen utility models: optical flow serves as a proxy for velocity, while high-level appearance features serve as a proxy for mass. These proxies enable explicit enforcement of Newtonian structure through two complementary rewards: a Newtonian kinematic constraint enforcing constant-acceleration dynamics, and a mass conservation reward preventing trivial, degenerate solutions. We evaluate $\texttt{NewtonRewards}$ on five Newtonian Motion Primitives (free fall, horizontal/parabolic throw, and ramp sliding down/up) using our newly constructed large-scale benchmark, $\texttt{NewtonBench-60K}$. Across all primitives in visual and physics metrics, $\texttt{NewtonRewards}$ consistently improves physical plausibility, motion smoothness, and temporal coherence over prior post-training methods. It further maintains strong performance under out-of-distribution shifts in height, speed, and friction. Our results show that physics-grounded verifiable rewards offer a scalable path toward physics-aware video generation.

顶级标签: video generation model training aigc
详细标签: physics-aware generation post-training verifiable rewards physical realism video diffusion models 或 搜索:

视频生成中的重力问题?利用可验证奖励的后训练牛顿定律 / What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewards


1️⃣ 一句话总结

这篇论文提出了一个名为NewtonRewards的后训练框架,通过从生成的视频中提取速度和质量的代理指标,并利用牛顿运动学约束和质量守恒奖励,显著提升了视频生成模型在物理规律上的合理性,使生成的物体运动更符合真实世界的重力、加速度和碰撞效果。


📄 打开原文 PDF