菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-08
📄 Abstract - Temporal-Aware Reasoning Optimization for Video Temporal Grounding

Multi-modal Large Language Models (MLLMs) have achieved remarkable progress in video temporal grounding with reinforcement learning for generating reasoning paths. However, existing models often produce superficial reasoning, which offers limited guidance for precise temporal localization. This limitation stems from (1) inefficient random exploration and (2) reward functions that focus solely on the answer correctness while ignoring reasoning quality. To address these issues, we propose TaRO (Temporal-Aware Reasoning Optimization), a framework that explicitly enhances the model's ability of thinking with time. First, we introduce a Constructive Reasoning Exploration that leverages pre-generated dense captions to construct reasoning paths grounded in explicit visual cues and timestamps, enabling efficient exploration of high-quality time-aware reasoning. Second, to evaluate reasoning quality, we design a Temporal-Sensitivity Reward. High-quality reasoning should be anchored to specific events and timestamps. If the event boundary under thinking is disrupted, such reasoning should become invalid, leading to a drop in the logit of the reasoning path. We utilize this drop as a critique of reasoning quality. Finally, TaRO follows a progressive curriculum, which starts by utilizing this reward to select better constructed reasoning paths, and evolves to a free exploration phase where the model autonomously generates effective reasoning. Experiments demonstrate that TaRO achieves state-of-the-art performance on VTG benchmarks. Code is available at this https URL.

顶级标签: multi-modal reinforcement learning video
详细标签: video temporal grounding reasoning optimization reward design temporal awareness curriculum learning 或 搜索:

时序感知推理优化用于视频时序定位 / Temporal-Aware Reasoning Optimization for Video Temporal Grounding


1️⃣ 一句话总结

该论文提出了一种名为TaRO的框架,通过构建基于视觉线索和时间戳的高质量推理路径,并设计一种能评估推理过程是否真正关注时间事件的奖励机制,显著提升了多模态大模型在视频中精准定位特定事件片段的能力。

源自 arXiv: 2606.09248