菜单

🤖 系统
📄 Abstract - VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models

Video anomaly understanding (VAU) aims to provide detailed interpretation and semantic comprehension of anomalous events within videos, addressing limitations of traditional methods that focus solely on detecting and localizing anomalies. However, existing approaches often neglect the deeper causal relationships and interactions between objects, which are critical for understanding anomalous behaviors. In this paper, we propose VADER, an LLM-driven framework for Video Anomaly unDErstanding, which integrates keyframe object Relation features with visual cues to enhance anomaly comprehension from video. Specifically, VADER first applies an Anomaly Scorer to assign per-frame anomaly scores, followed by a Context-AwarE Sampling (CAES) strategy to capture the causal context of each anomalous event. A Relation Feature Extractor and a COntrastive Relation Encoder (CORE) jointly model dynamic object interactions, producing compact relational representations for downstream reasoning. These visual and relational cues are integrated with LLMs to generate detailed, causally grounded descriptions and support robust anomaly-related question answering. Experiments on multiple real-world VAU benchmarks demonstrate that VADER achieves strong results across anomaly description, explanation, and causal reasoning tasks, advancing the frontier of explainable video anomaly analysis.

顶级标签: computer vision llm multi-modal
详细标签: video anomaly understanding causal reasoning relation extraction object interactions explainable ai 或 搜索:

📄 论文总结

VADER:利用关系感知大语言模型实现因果视频异常理解 / VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models


1️⃣ 一句话总结

这项研究提出了一个名为VADER的智能框架,通过结合大语言模型与视频中物体间的动态关系分析,不仅能识别异常行为,还能深入解释异常事件的因果缘由,显著提升了视频异常理解的准确性和可解释性。


📄 打开原文 PDF