菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-03
📄 Abstract - Heterogeneous Time Constants Improve Stability in Equilibrium Propagation

Equilibrium propagation (EP) is a biologically plausible alternative to backpropagation for training neural networks. However, existing EP models use a uniform scalar time step dt, which corresponds biologically to a membrane time constant that is heterogeneous across neurons. Here, we introduce heterogeneous time steps (HTS) for EP by assigning neuron-specific time constants drawn from biologically motivated distributions. We show that HTS improves training stability while maintaining competitive task performance. These results suggest that incorporating heterogeneous temporal dynamics enhances both the biological realism and robustness of equilibrium propagation.

顶级标签: theory model training biology
详细标签: equilibrium propagation biologically plausible learning heterogeneous time constants training stability neural dynamics 或 搜索:

异质性时间常数提升平衡传播算法的稳定性 / Heterogeneous Time Constants Improve Stability in Equilibrium Propagation


1️⃣ 一句话总结

这篇论文提出在平衡传播算法中为不同神经元设置不同的时间常数,就像大脑神经元本身具有不同的反应速度一样,这种方法不仅让算法更贴近生物机制,还显著提高了训练过程的稳定性,同时保持了良好的任务性能。

源自 arXiv: 2603.03402