LongSpike:面向高效长序列学习的分数阶脉冲状态空间模型 / LongSpike: Fractional Order Spiking State Space Models for Efficient Long Sequence Learning
1️⃣ 一句话总结
LongSpike提出了一种将分数阶状态空间模型引入脉冲神经网络的新方法,通过引入类似“长期记忆”的数学机制,突破了传统SNN在处理长序列任务时的记忆瓶颈,在保持低能耗计算的同时大幅提升了对复杂长序列数据的建模能力。
Spiking Neural Networks (SNNs) are well-regarded for their biological plausibility and energy efficiency in processing sequential data. However, dominant SNN architectures typically rely on first-order Ordinary Differential Equations (ODEs) to govern neuronal state transitions. This first-order assumption imposes a "memoryless" bottleneck, limiting the model's capacity to capture the complex, long-range dependencies inherent in long-sequence tasks. In this work, we propose LongSpike, a novel SNN framework that integrates fractional-order State-Space Modeling, or f-SSM, from control theory into the spiking domain. By extending traditional integer-order SSMs to the fractional-calculus regime, LongSpike enables the hierarchical integration of neuronal dynamics with long-memory kernels. To mitigate the computational overhead and parallelization challenges typically associated with fractional operators, we leverage a state-space formulation that supports efficient, parallel training. Empirical evaluations on challenging benchmarks, including Long Range Arena (LRA), large-scale WikiText-103, and Speech Commands, demonstrate that LongSpike outperforms state-of-the-art SNNs in accuracy while preserving sparse synaptic computation. The code is available at this https URL.
LongSpike:面向高效长序列学习的分数阶脉冲状态空间模型 / LongSpike: Fractional Order Spiking State Space Models for Efficient Long Sequence Learning
LongSpike提出了一种将分数阶状态空间模型引入脉冲神经网络的新方法,通过引入类似“长期记忆”的数学机制,突破了传统SNN在处理长序列任务时的记忆瓶颈,在保持低能耗计算的同时大幅提升了对复杂长序列数据的建模能力。
源自 arXiv: 2606.12895