菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-19
📄 Abstract - EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs

The rapid development of Multimodal Large Language Models (MLLMs) has led to growing interest in egocentric video understanding, specifically the ability for MLLMs to recognize fine-grained hand-object interactions, track object state changes over time, and reason about manipulative processes in dynamic environments from a first-person perspective. However, existing egocentric video benchmarks suffer from \textbf{limited grounded rationale evaluation}, offering limited support for fine-grained operation-centric reasoning and rarely examining whether model rationales are grounded in explicit spatio-temporal evidence. To address this gap, we introduce \textbf{EgoCoT-Bench}, a fine-grained egocentric benchmark for grounded and verifiable operation-centric reasoning with explicit step-by-step rationale annotations. Overall, EgoCoT-Bench comprises 3,172 verifiable QA pairs over 351 egocentric videos separated into four task groups for a total of 12 sub-task groups, encompassing perception and retrospection, anticipation, and high-level reasoning. The benchmark is constructed through a spatio-temporal scene graphs (STSG) guided generation framework and is further refined by human annotators to ensure correctness, egocentric relevance and fine-grained quality. Experimental results show continuing difficulties with egocentric fine-grained reasoning and further reveal that many multimodal models produce explanations that are answer-correct, but have evidence that is inconsistent with the answer. We hope EgoCoT-Bench can serve as a useful testbed for grounded and verifiable reasoning in egocentric video understanding. Project page and supplementary materials are available at: this https URL.

顶级标签: multi-modal benchmark video
详细标签: egocentric video chain of thought reasoning operation-centric reasoning multi-modal llm evaluation spatio-temporal reasoning 或 搜索:

EgoCoT-Bench:面向多模态大语言模型的、基于事实且可验证的操作中心链式推理基准 / EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs


1️⃣ 一句话总结

针对当前多模态模型在处理第一人称视频时缺乏细粒度操作推理和可验证推理过程的问题,本文提出了一个新基准EgoCoT-Bench,它通过时空场景图自动生成高质量的问答对,并由人工精修,能够系统评估模型在感知、回顾、预测和高层推理上的表现,实验发现很多模型虽然答案正确,但解释中引用的证据与答案矛盾。

源自 arXiv: 2605.19559