📄
Abstract - AURORA: Contextual Orthogonalization for Geometric Representation Learning in Healthcare Foundation Models
Recent healthcare foundation models have achieved strong predictive performance through large scale self supervised learning, yet their latent representations frequently entangle physiologic severity, intervention intensity, observational structure, and institutional workflow into shared embedding directions. While effective for downstream prediction, such representations remain semantically opaque and unstable under contextual shift. We introduce AURORA, Adaptive Uncertainty aware Representations through Orthogonalized Relational Alignment, a new framework for healthcare representation learning based on contextual latent geometry. Rather than optimizing a single unified embedding manifold, AURORA decomposes representations into orthogonal semantic subspaces corresponding to distinct contextual factors and learns relational consistency objectives within each subspace. This induces latent spaces that are both semantically disentangled and geometrically interpretable. Across multiple clinical prediction and retrieval tasks, AURORA consistently outperforms reconstruction, contrastive, and self distillation baselines while substantially improving contextual disentanglement, neighborhood purity, and robustness under institutional distribution shift. Our results suggest that latent geometry itself constitutes an important axis of healthcare foundation model design and that explicitly structuring representation space according to contextual semantics provides a complementary direction beyond conventional predictive compression objectives.
AURORA:面向医疗基础模型几何表征学习的情境正交化方法 /
AURORA: Contextual Orthogonalization for Geometric Representation Learning in Healthcare Foundation Models
1️⃣ 一句话总结
本文提出一种名为AURORA的新框架,通过将医疗数据的潜在表示分解为对应于不同情境因素的正交语义子空间,使得模型在保持高预测性能的同时,其内部表征更加清晰、可解释,并且在不同医疗机构的分布变化下表现得更稳定。