菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-26
📄 Abstract - MovieTeller: Tool-augmented Movie Synopsis with ID Consistent Progressive Abstraction

With the explosive growth of digital entertainment, automated video summarization has become indispensable for applications such as content indexing, personalized recommendation, and efficient media archiving. Automatic synopsis generation for long-form videos, such as movies and TV series, presents a significant challenge for existing Vision-Language Models (VLMs). While proficient at single-image captioning, these general-purpose models often exhibit critical failures in long-duration contexts, primarily a lack of ID-consistent character identification and a fractured narrative coherence. To overcome these limitations, we propose MovieTeller, a novel framework for generating movie synopses via tool-augmented progressive abstraction. Our core contribution is a training-free, tool-augmented, fact-grounded generation process. Instead of requiring costly model fine-tuning, our framework directly leverages off-the-shelf models in a plug-and-play manner. We first invoke a specialized face recognition model as an external "tool" to establish Factual Groundings--precise character identities and their corresponding bounding boxes. These groundings are then injected into the prompt to steer the VLM's reasoning, ensuring the generated scene descriptions are anchored to verifiable facts. Furthermore, our progressive abstraction pipeline decomposes the summarization of a full-length movie into a multi-stage process, effectively mitigating the context length limitations of current VLMs. Experiments demonstrate that our approach yields significant improvements in factual accuracy, character consistency, and overall narrative coherence compared to end-to-end baselines.

顶级标签: multi-modal video model evaluation
详细标签: video summarization vision-language models tool-augmented generation character identification progressive abstraction 或 搜索:

MovieTeller:基于工具增强与身份一致渐进式抽象的电影梗概生成 / MovieTeller: Tool-augmented Movie Synopsis with ID Consistent Progressive Abstraction


1️⃣ 一句话总结

这篇论文提出了一个名为MovieTeller的新框架,它通过结合现成的人脸识别工具和分阶段抽象的方法,解决了现有视觉语言模型在生成长视频(如电影)梗概时角色身份混乱和叙事不连贯的问题,从而生成了更准确、更连贯的电影摘要。

源自 arXiv: 2602.23228