PRIME:面向缺失模态的癌症预后原型驱动多模态预训练 / PRIME: Prototype-Driven Multimodal Pretraining for Cancer Prognosis with Missing Modalities
1️⃣ 一句话总结
这篇论文提出了一个名为PRIME的智能预训练框架,它能够有效利用现实中经常缺失部分数据(如病理图像、基因报告)的临床癌症患者信息,通过原型学习和一致性训练,构建出对癌症生存期、复发等预后任务具有强大且稳健预测能力的通用模型。
Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete inputs. In practice, clinical cohorts are fragmented and often miss one or more modalities, limiting both supervised fusion and scalable multimodal pretraining. We propose PRIME, a missing-aware multimodal self-supervised pretraining framework that learns robust and transferable representations from partially observed cohorts. PRIME maps heterogeneous modality embeddings into a unified token space and introduces a shared prototype memory bank for latent-space semantic imputation via patient-level consensus retrieval, producing structurally aligned tokens without reconstructing raw signals. Two complementary pretraining objectives: inter-modality alignment and post-fusion consistency under structured missingness augmentation, jointly learn representations that remain predictive under arbitrary modality subsets. We evaluate PRIME on The Cancer Genome Atlas with label-free pretraining on 32 cancer types and downstream 5-fold evaluation on five cohorts across overall survival prediction, 3-year mortality classification, and 3-year recurrence classification. PRIME achieves the best macro-average performance among all compared methods, reaching 0.653 C-index, 0.689 AUROC, and 0.637 AUROC on the three tasks, respectively, while improving robustness under test-time missingness and supporting parameter-efficient and label-efficient adaptation. These results support missing-aware multimodal pretraining as a practical strategy for prognosis modeling in fragmented clinical data settings.
PRIME:面向缺失模态的癌症预后原型驱动多模态预训练 / PRIME: Prototype-Driven Multimodal Pretraining for Cancer Prognosis with Missing Modalities
这篇论文提出了一个名为PRIME的智能预训练框架,它能够有效利用现实中经常缺失部分数据(如病理图像、基因报告)的临床癌症患者信息,通过原型学习和一致性训练,构建出对癌症生存期、复发等预后任务具有强大且稳健预测能力的通用模型。
源自 arXiv: 2604.04999