菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-19
📄 Abstract - FPED: A Functional-Network Prior-Guided Mixture-of-Experts Framework for Interpretable Brain Decoding

Visual image reconstruction from functional Magnetic Resonance Imaging (fMRI) is a fundamental task in brain decoding, providing a crucial pathway for understanding human perceptual mechanisms and developing advanced brain-computer interfaces (BCIs). However, most current methods simply flatten fMRI signals from localized visual cortices into one-dimensional (1D) vectors, mapping them directly into latent spaces such as that of Contrastive Language-Image Pre-training (CLIP). This paradigm not only disrupts the inherent network topology of the brain-leading to limited neuroscientific interpretability-but also overlooks the synergistic contributions of other distributed functional networks in processing high-level visual semantics. To address these limitations, we propose FPED, a Functional-Network Prior-Guided Mixture of Experts (MoE) framework for interpretable brain decoding. FPED explicitly models different functional brain networks as specialized experts and employs adaptive routing to capture their complementary contributions to visual semantic understanding. Unlike conventional homogeneous decoding paradigms, our framework incorporates neurobiologically grounded priors to enable structured and interpretable network-level representation learning. Experimental results demonstrate that FPED achieves highly competitive semantic reconstruction performance with only 0.68B parameters. The learned routing dynamics reveal biologically meaningful correspondence between functional brain networks and modality-specific semantic processing, providing transparent neuroscientific interpretability. This suggests that brain network-aware expert modeling is a promising direction for bridging neural decoding and biologically inspired artificial intelligence.

顶级标签: machine learning multi-modal medical
详细标签: brain decoding fmri mixture-of-experts interpretability semantic reconstruction 或 搜索:

FPED:一种功能网络先验引导的混合专家框架,用于可解释的脑解码 / FPED: A Functional-Network Prior-Guided Mixture-of-Experts Framework for Interpretable Brain Decoding


1️⃣ 一句话总结

本文提出了一种名为FPED的新型脑解码框架,它通过将大脑的不同功能网络视为专门的“专家”并利用自适应路由机制,来从fMRI信号中更准确且可解释地重建视觉图像,解决了传统方法忽略大脑网络拓扑结构的问题。

源自 arXiv: 2605.19279