PanLUNA:一种面向边缘生物信号智能的高效、鲁棒的查询统一多模态模型 / PanLUNA: An Efficient and Robust Query-Unified Multimodal Model for Edge Biosignal Intelligence
1️⃣ 一句话总结
这篇论文提出了一种名为PanLUNA的小型多模态基础模型,它能同时高效处理脑电图、心电图和光电容积脉搏波三种生物信号,在性能媲美甚至超越大模型的同时,非常适合部署在资源受限的可穿戴设备上。
Physiological foundation models (FMs) have shown promise for biosignal representation learning, yet most remain confined to a single modality such as EEG, ECG, or PPG, largely because paired multimodal datasets are scarce. In this paper, we present PanLUNA, a compact 5.4M-parameter pan-modal FM that jointly processes EEG, ECG, and PPG within a single shared encoder. Extending LUNA's channel-unification module, PanLUNA treats multimodal channels as entries in a unified query set augmented with sensor-type embeddings, enabling efficient cross-modal early fusion while remaining inherently robust to missing modalities at inference time. Despite its small footprint, PanLUNA matches or exceeds models up to 57$\times$ larger: 81.21% balanced accuracy on TUAB abnormal EEG detection and state-of-the-art 0.7416 balanced accuracy on HMC multimodal sleep staging. Quantization-aware training with INT8 weights recovers $\geq$96% of full-precision performance, and deployment on the GAP9 ultra-low-power RISC-V microcontroller for wearables achieves 325.6 ms latency and 18.8 mJ per 10-second, 12-lead ECG inference, and 1.206 s latency at 68.65 mJ for multimodal 5-channel sleep staging over 30-second epochs.
PanLUNA:一种面向边缘生物信号智能的高效、鲁棒的查询统一多模态模型 / PanLUNA: An Efficient and Robust Query-Unified Multimodal Model for Edge Biosignal Intelligence
这篇论文提出了一种名为PanLUNA的小型多模态基础模型,它能同时高效处理脑电图、心电图和光电容积脉搏波三种生物信号,在性能媲美甚至超越大模型的同时,非常适合部署在资源受限的可穿戴设备上。
源自 arXiv: 2604.04297