菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-22
📄 Abstract - Dual Causal Inference: Integrating Backdoor Adjustment and Instrumental Variable Learning for Medical VQA

Medical Visual Question Answering (MedVQA) aims to generate clinically reliable answers conditioned on complex medical images and questions. However, existing methods often overfit to superficial cross-modal correlations, neglecting the intrinsic biases embedded in multimodal medical data. Consequently, models become vulnerable to cross-modal confounding effects, severely hindering their ability to provide trustworthy diagnostic reasoning. To address this limitation, we propose a novel Dual Causal Inference (DCI) framework for MedVQA. To the best of our knowledge, DCI is the first unified architecture that integrates Backdoor Adjustment (BDA) and Instrumental Variable (IV) learning to jointly tackle both observable and unobserved confounders. Specifically, we formulate a Structural Causal Model (SCM) where observable cross-modal biases (e.g., frequent visual and textual co-occurrences) are mitigated via BDA, while unobserved confounders are compensated using an IV learned from a shared latent space. To guarantee the validity of the IV, we design mutual information constraints that maximize its dependence on the fused multimodal representations while minimizing its associations with the unobserved confounders and target answers. Through this dual mechanism, DCI extracts deconfounded representations that capture genuine causal relationships. Extensive experiments on four benchmark datasets, SLAKE, SLAKE-CP, VQA-RAD, and PathVQA, demonstrate that our method consistently outperforms existing approaches, particularly in out-of-distribution (OOD) generalization. Furthermore, qualitative analyses confirm that DCI significantly enhances the interpretability and robustness of cross-modal reasoning by explicitly disentangling true causal effects from spurious cross-modal shortcuts.

顶级标签: medical multi-modal causal inference
详细标签: medical vqa backdoor adjustment instrumental variable confounding bias out-of-distribution generalization 或 搜索:

双重因果推断:整合后门调整与工具变量学习的医学视觉问答 / Dual Causal Inference: Integrating Backdoor Adjustment and Instrumental Variable Learning for Medical VQA


1️⃣ 一句话总结

该论文提出了一种名为DCI的因果推理框架,通过结合后门调整和工具变量学习,有效消除了医学视觉问答中由数据混淆产生的虚假相关性,从而提升了模型在跨模态推理中的准确性和鲁棒性,尤其擅长处理分布外数据。

源自 arXiv: 2604.20306