菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-12
📄 Abstract - WaveFormer: Wavelet Embedding Transformer for Biomedical Signals

Biomedical signal classification presents unique challenges due to long sequences, complex temporal dynamics, and multi-scale frequency patterns that are poorly captured by standard transformer architectures. We propose WaveFormer, a transformer architecture that integrates wavelet decomposition at two critical stages: embedding construction, where multi-channel Discrete Wavelet Transform (DWT) extracts frequency features to create tokens containing both time-domain and frequency-domain information, and positional encoding, where Dynamic Wavelet Positional Encoding (DyWPE) adapts position embeddings to signal-specific temporal structure through mono-channel DWT analysis. We evaluate WaveFormer on eight diverse datasets spanning human activity recognition and brain signal analysis, with sequence lengths ranging from 50 to 3000 timesteps and channel counts from 1 to 144. Experimental results demonstrate that WaveFormer achieves competitive performance through comprehensive frequency-aware processing. Our approach provides a principled framework for incorporating frequency-domain knowledge into transformer-based time series classification.

顶级标签: medical model training machine learning
详细标签: transformer wavelet decomposition biomedical signals time series classification frequency-domain embedding 或 搜索:

WaveFormer:用于生物医学信号的小波嵌入Transformer / WaveFormer: Wavelet Embedding Transformer for Biomedical Signals


1️⃣ 一句话总结

这篇论文提出了一种名为WaveFormer的新型Transformer架构,它通过小波变换在信号嵌入和位置编码两个关键阶段融入频率信息,从而能更有效地处理具有长序列和多尺度频率模式的生物医学信号分类任务。

源自 arXiv: 2602.12189