菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-22
📄 Abstract - E-MRL: Cross-view Aligned Evidence-driven Multimodal Reinforcement Learning for Reliable 3D Tumor Analysis

While Vision-Language Models (VLMs) show great promise in volumetric medical report generation, they frequently suffer from visual hallucinations and a lack of grounding in 3D CT data. Current Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) strategies typically optimize text fidelity alone, essentially rewarding correct diagnoses derived from language priors rather than genuine visual perception. To address this, we propose cross-view aligned Evidence-driven Multimodal Reinforcement Learning (Evidence-MRL, noted as E-MRL), a reliable RL reasoning framework that formulates the generation process as a Markov Decision Process of "diagnosis-localization-verification". Unlike standard approaches, our model is explicitly trained to identify a "key evidence slice" alongside the global diagnostic report, grounding its findings in verifiable visual evidence. Crucially, we introduce a novel cross-view consistency reward, which validates the semantic alignment between the golden-standard report and a local visual re-query of the selected key slice, providing additional rewards for correctly-localized reasoning. Experiments on large-scale 3D CT tumor datasets demonstrate that E-MRL significantly reduces hallucinations and improves diagnostic accuracy compared to SFT and RL baselines, offering a clinically interpretable solution for visually-grounded and tumor analysis.

顶级标签: medical reinforcement learning multi-modal
详细标签: 3d ct analysis vision-language model hallucination reduction tumor diagnosis 或 搜索:

E-MRL:基于跨视角对齐的证据驱动多模态强化学习,实现可靠的3D肿瘤分析 / E-MRL: Cross-view Aligned Evidence-driven Multimodal Reinforcement Learning for Reliable 3D Tumor Analysis


1️⃣ 一句话总结

本文提出一种名为E-MRL的强化学习框架,通过让AI模型在生成诊断报告时同时找出并验证关键的CT切片证据,而不是仅依赖语言模式或文本准确性,从而显著减少视觉幻觉,提升3D肿瘤分析的可靠性和临床可解释性。

源自 arXiv: 2606.23888