菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-13
📄 Abstract - Continuous-time Online Learning via Mean-Field Neural Networks: Regret Analysis in Diffusion Environments

We study continuous-time online learning where data are generated by a diffusion process with unknown coefficients. The learner employs a two-layer neural network, continuously updating its parameters in a non-anticipative manner. The mean-field limit of the learning dynamics corresponds to a stochastic Wasserstein gradient flow adapted to the data filtration. We establish regret bounds for both the mean-field limit and finite-particle system. Our analysis leverages the logarithmic Sobolev inequality, Polyak-Lojasiewicz condition, Malliavin calculus, and uniform-in-time propagation of chaos. Under displacement convexity, we obtain a constant static regret bound. In the general non-convex setting, we derive explicit linear regret bounds characterizing the effects of data variation, entropic exploration, and quadratic regularization. Finally, our simulations demonstrate the outperformance of the online approach and the impact of network width and regularization parameters.

顶级标签: machine learning theory model training
详细标签: online learning mean-field neural networks regret analysis diffusion processes stochastic gradient flow 或 搜索:

基于平均场神经网络的连续时间在线学习:扩散环境中的遗憾分析 / Continuous-time Online Learning via Mean-Field Neural Networks: Regret Analysis in Diffusion Environments


1️⃣ 一句话总结

这篇论文研究了一种在数据由未知扩散过程生成的连续时间环境中,使用平均场神经网络进行在线学习的方法,并通过理论分析和实验证明了该方法在不同条件下的学习性能界限。

源自 arXiv: 2604.10958