基于分层高斯滤波器的闭式预测编码 / Closed-form predictive coding via hierarchical Gaussian filters
1️⃣ 一句话总结
本文针对现有预测编码网络速度慢、深度增加时性能下降的问题,通过重新引入精度加权的误差传递,并设计出一种分层高斯滤波器结构,使得网络能在无需迭代、无需全局误差信号的情况下快速学习,最终在多项任务上达到甚至超越传统反向传播的效果,同时保留了生物可解释性。
Predictive coding (PC) offers a local and biologically grounded alternative to backpropagation in the training of artificial neural networks, yet to date, it remains slower, and performance degrades sharply as network depth increases. We trace both problems to a single simplification: current PC networks fix the precision matrix to the identity, discarding precision-weighted prediction errors that the variational derivation requires to be fast, local, and Bayesian. We close this gap by expressing predictive coding networks as deep hierarchical Gaussian filters (HGFs) and restore precision-weighted message passing, yielding dynamic uncertainty estimates and Hebbian-compatible update rules at every layer. The resulting networks can simultaneously learn activations, weights, and precisions under a single free-energy objective, with no global error signal, and resolve inference without requiring iterations or automatic differentiation. On FashionMNIST, our solution approaches backpropagation in epoch-level wall-clock cost while converging in fewer epochs, and outperforms it on online, data efficiency, and concept-drift tasks. We thus establish that closed-form variational inference with online precision learning provides a tractable foundation for deep predictive coding networks, retaining biological and interpretative advantages, without requiring iterative relaxation or global error signals.
基于分层高斯滤波器的闭式预测编码 / Closed-form predictive coding via hierarchical Gaussian filters
本文针对现有预测编码网络速度慢、深度增加时性能下降的问题,通过重新引入精度加权的误差传递,并设计出一种分层高斯滤波器结构,使得网络能在无需迭代、无需全局误差信号的情况下快速学习,最终在多项任务上达到甚至超越传统反向传播的效果,同时保留了生物可解释性。
源自 arXiv: 2605.20293