菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-17
📄 Abstract - Follow the Clues, Frame the Truth: Hybrid-evidential Deductive Reasoning in Open-Vocabulary Multimodal Emotion Recognition

Open-Vocabulary Multimodal Emotion Recognition (OV-MER) is inherently challenging due to the ambiguity of equivocal multimodal cues, which often stem from distinct unobserved situational dynamics. While Multimodal Large Language Models (MLLMs) offer extensive semantic coverage, their performance is often bottlenecked by premature commitment to dominant data priors, resulting in suboptimal heuristics that overlook crucial, complementary affective cues across modalities. We argue that effective affective reasoning requires more than surface-level association; it necessitates reconstructing nuanced emotional states by synthesizing multiple evidence-grounded rationales that reconcile these observations from diverse latent perspectives. We introduce HyDRA, a Hybrid-evidential Deductive Reasoning Architecture that formalizes inference as a Propose-Verify-Decide protocol. To internalize this abductive process, we employ reinforcement learning with hierarchical reward shaping, aligning the reasoning trajectories with final task performance to ensure they best reconcile the observed multimodal cues. Systematic evaluations validate our design choices, with HyDRA consistently outperforming strong baselines--especially in ambiguous or conflicting scenarios--while providing interpretable, diagnostic evidence traces.

顶级标签: multi-modal natural language processing model training
详细标签: emotion recognition multimodal reasoning reinforcement learning evidence synthesis open-vocabulary 或 搜索:

循迹求真:开放词汇多模态情感识别中的混合证据演绎推理 / Follow the Clues, Frame the Truth: Hybrid-evidential Deductive Reasoning in Open-Vocabulary Multimodal Emotion Recognition


1️⃣ 一句话总结

这篇论文提出了一种名为HyDRA的新方法,它通过一个‘提出-验证-决策’的推理框架,结合强化学习来整合多模态线索,从而更准确、可解释地识别开放词汇下的复杂情感,尤其在信息模糊或冲突的场景中表现突出。

源自 arXiv: 2603.16463