基于声明级评分规则的视频字幕强化学习奖励机制 / Claim-Level Rubric Rewards for Video Caption Reinforcement Learning
1️⃣ 一句话总结
本文提出了一种名为CuRe的新奖励机制,通过将视频字幕分解为细粒度的、按类别划分的原子声明,并逐一验证其正确性,从而解决了强化学习在视频字幕生成中因传统整体评分或依赖参考文本对齐而导致的准确性不足和多样性受限的问题。
In this paper, we introduce Claim-Level Rubric Rewards (CuRe), a structured reward framework designed to address the reward-design bottleneck in reinforcement learning for dense video captioning. Existing reward designs generally fall into two categories: holistic response-level judgment across heterogeneous criteria, or alignment-based evaluation against reference captions. However, both paradigms suffer from fundamental limitations. Holistic rewards struggle to ensure factual accuracy and are prone to stylistic reward hacking, while reference-based rewards overly rely on rigid textual alignment, failing to preserve the completeness and diversity inherent to open-ended generation tasks. To address these challenges, CuRe reformulates reward modeling as fine-grained claim-level verification. Specifically, CuRe decomposes captions into category-aware atomic claims through a structured rubric, converting holistic evaluation into simpler and more reliable claim-level verification.
基于声明级评分规则的视频字幕强化学习奖励机制 / Claim-Level Rubric Rewards for Video Caption Reinforcement Learning
本文提出了一种名为CuRe的新奖励机制,通过将视频字幕分解为细粒度的、按类别划分的原子声明,并逐一验证其正确性,从而解决了强化学习在视频字幕生成中因传统整体评分或依赖参考文本对齐而导致的准确性不足和多样性受限的问题。
源自 arXiv: 2607.05150