ReViSE:基于自我反思学习的统一模型中面向推理感知的视频编辑 / ReViSE: Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning
1️⃣ 一句话总结
这篇论文提出了一个名为ReViSE的新框架,它通过让模型在编辑视频时进行自我评估和反思,成功地将高级推理能力与视频编辑任务结合起来,从而显著提升了编辑结果在逻辑合理性和视觉质量上的表现。
Video unified models exhibit strong capabilities in understanding and generation, yet they struggle with reason-informed visual editing even when equipped with powerful internal vision-language models (VLMs). We attribute this gap to two factors: 1) existing datasets are inadequate for training and evaluating reasoning-aware video editing, and 2) an inherent disconnect between the models' reasoning and editing capabilities, which prevents the rich understanding from effectively instructing the editing process. Bridging this gap requires an integrated framework that connects reasoning with visual transformation. To address this gap, we introduce the Reason-Informed Video Editing (RVE) task, which requires reasoning about physical plausibility and causal dynamics during editing. To support systematic evaluation, we construct RVE-Bench, a comprehensive benchmark with two complementary subsets: Reasoning-Informed Video Editing and In-Context Video Generation. These subsets cover diverse reasoning dimensions and real-world editing scenarios. Building upon this foundation, we propose the ReViSE, a Self-Reflective Reasoning (SRF) framework that unifies generation and evaluation within a single architecture. The model's internal VLM provides intrinsic feedback by assessing whether the edited video logically satisfies the given instruction. The differential feedback that refines the generator's reasoning behavior during training. Extensive experiments on RVE-Bench demonstrate that ReViSE significantly enhances editing accuracy and visual fidelity, achieving a 32% improvement of the Overall score in the reasoning-informed video editing subset over state-of-the-art methods.
ReViSE:基于自我反思学习的统一模型中面向推理感知的视频编辑 / ReViSE: Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning
这篇论文提出了一个名为ReViSE的新框架,它通过让模型在编辑视频时进行自我评估和反思,成功地将高级推理能力与视频编辑任务结合起来,从而显著提升了编辑结果在逻辑合理性和视觉质量上的表现。
源自 arXiv: 2512.09924