设备护照:让时空预训练模型在不同输入布局下实现泛化 / Device Passport: Enabling Spatio-Temporal Pretrained Models to Generalize Across Input Layouts
1️⃣ 一句话总结
这篇论文提出了一种名为“设备护照”的新型通道嵌入技术,通过混合利用每个通道的功能活动信息和元数据来训练专家模型,有效解决了生物信号预训练模型在面对新设备不同电极布局时性能下降的问题,从而提升了模型在跨布局场景下的泛化能力。
New device layouts pose a challenging modeling problem due to the lack of large datasets for each specific layout. Biosignal foundation models offer a plausible solution if they are able to generalize to new layouts effectively. To improve cross-layout transfer, we study how different channel embedding techniques behave when pretraining layouts differ substantially from the downstream decoding layout. We propose Device Passport, a new channel embedding technique that learns experts and mixture models that take each channel's functional activity and metadata as input. This contrasts with prior embedding methods, which typically use only functional information or only metadata to look up learned or fixed positional embeddings. Across controlled subset-transfer experiments and realistic transfer to ear-EEG, Device Passport is competitive overall and improves over the strongest learned baseline in the layout-transfer regimes that motivate this work. These results suggest that channel embedding design is a key consideration when reusing large-scale pretrained biosignal models on new devices.
设备护照:让时空预训练模型在不同输入布局下实现泛化 / Device Passport: Enabling Spatio-Temporal Pretrained Models to Generalize Across Input Layouts
这篇论文提出了一种名为“设备护照”的新型通道嵌入技术,通过混合利用每个通道的功能活动信息和元数据来训练专家模型,有效解决了生物信号预训练模型在面对新设备不同电极布局时性能下降的问题,从而提升了模型在跨布局场景下的泛化能力。
源自 arXiv: 2607.00249