菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-28
📄 Abstract - Emergent Self-Attention from Astrocyte-Gated Associative Memory Dynamics

We introduce a Hopfield-type associative memory in which effective connectivity is multiplicatively modulated by astrocytic gains evolving under an entropy-regularized replicator equation. The coupled neuron-astrocyte dynamics admit a Lyapunov function, ensuring global convergence. At fixed points, astrocytic gains implement a softmax-normalized allocation over pattern similarity scores, yielding a mechanistic realization of self-attention as emergent routing on the gain simplex. In regimes of high memory load and interference, the model significantly improves retrieval accuracy relative to classical Hopfield dynamics and recent neuron-astrocyte baselines. These results establish a dynamical systems framework linking glial modulation, competitive resource allocation, and attention-like computation.

顶级标签: machine learning theory natural language processing
详细标签: associative memory self-attention hopfield network astrocyte modeling dynamical systems 或 搜索:

星形胶质细胞门控的联想记忆动力学中涌现的自注意力机制 / Emergent Self-Attention from Astrocyte-Gated Associative Memory Dynamics


1️⃣ 一句话总结

本文提出了一种新型联想记忆模型,通过模拟大脑中星形胶质细胞对神经连接的调控,在记忆检索时自动形成类似Transformer自注意力的注意力分配机制,从而在记忆冲突严重时显著提高信息回忆的准确性。

源自 arXiv: 2604.25481