菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-10
📄 Abstract - CLoE: Expert Consistency Learning for Missing Modality Segmentation

Multimodal medical image segmentation often faces missing modalities at inference, which induces disagreement among modality experts and makes fusion unstable, particularly on small foreground structures. We propose Consistency Learning of Experts (CLoE), a consistency-driven framework for missing-modality segmentation that preserves strong performance when all modalities are available. CLoE formulates robustness as decision-level expert consistency control and introduces a dual-branch Expert Consistency Learning objective. Modality Expert Consistency enforces global agreement among expert predictions to reduce case-wise drift under partial inputs, while Region Expert Consistency emphasizes agreement on clinically critical foreground regions to avoid background-dominated regularization. We further map consistency scores to modality reliability weights using a lightweight gating network, enabling reliability-aware feature recalibration before fusion. Extensive experiments on BraTS 2020 and MSD Prostate demonstrate that CLoE outperforms state-of-the-art methods in incomplete multimodal segmentation, while exhibiting strong cross-dataset generalization and improving robustness on clinically critical structures.

顶级标签: medical multi-modal model training
详细标签: medical image segmentation missing modalities consistency learning multimodal fusion robustness 或 搜索:

CLoE:面向缺失模态分割的专家一致性学习 / CLoE: Expert Consistency Learning for Missing Modality Segmentation


1️⃣ 一句话总结

这篇论文提出了一种名为CLoE的新方法,通过强制不同医学影像模态的‘专家’模型在决策层面保持高度一致,解决了多模态分割中某些影像数据缺失时性能下降的问题,尤其提升了在关键小病灶区域上的分割鲁棒性。

源自 arXiv: 2603.09316