稠密联想记忆的算法分析:有限规模保证与对抗鲁棒性 / Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adversarial Robustness
1️⃣ 一句话总结
这篇论文通过算法分析,为一种具有高阶交互的联想记忆模型提供了有限规模下的性能保证,证明了其在异步更新下能快速收敛、具备对抗攻击的容忍能力,并且其存储容量随网络规模呈多项式增长。
Dense Associative Memory (DAM) generalizes Hopfield networks through higher-order interactions and achieves storage capacity that scales as $O(N^{n-1})$ under suitable pattern separation conditions. Existing dynamical analyses primarily study the thermodynamic limit $N\to\infty$ with randomly sampled patterns and therefore do not provide finite-size guarantees or explicit convergence rates. We develop an algorithmic analysis of DAM retrieval dynamics that yields finite-$N$ guarantees under explicit, verifiable pattern conditions. Under a separation assumption and a bounded-interference condition at high loading, we prove geometric convergence of asynchronous retrieval dynamics, which implies $O(\log N)$ convergence time once the trajectory enters the basin of attraction. We further establish adversarial robustness bounds expressed through an explicit margin condition that quantifies the number of corrupted bits tolerable per sweep, and derive capacity guarantees that scale as $\Theta(N^{n-1})$ up to polylogarithmic factors in the worst case, while recovering the classical $\Theta(N^{n-1})$ scaling for random pattern ensembles. Finally, we show that DAM retrieval dynamics admit a potential-game interpretation that ensures convergence to pure Nash equilibria under asynchronous updates. Complete proofs are provided in the appendices, together with preliminary experiments that illustrate the predicted convergence, robustness, and capacity scaling behavior.
稠密联想记忆的算法分析:有限规模保证与对抗鲁棒性 / Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adversarial Robustness
这篇论文通过算法分析,为一种具有高阶交互的联想记忆模型提供了有限规模下的性能保证,证明了其在异步更新下能快速收敛、具备对抗攻击的容忍能力,并且其存储容量随网络规模呈多项式增长。
源自 arXiv: 2604.12811