菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-10
📄 Abstract - Upper Generalization Bounds for Neural Oscillators

Neural oscillators that originate from the second-order ordinary differential equations (ODEs) have shown competitive performance in learning mappings between dynamic loads and responses of complex nonlinear structural systems. Despite this empirical success, theoretically quantifying the generalization capacities of their neural network architectures remains undeveloped. In this study, the neural oscillator consisting of a second-order ODE followed by a multilayer perceptron (MLP) is considered. Its upper probably approximately correct (PAC) generalization bound for approximating causal and uniformly continuous operators between continuous temporal function spaces and that for approximating the uniformly asymptotically incrementally stable second-order dynamical systems are derived by leveraging the Rademacher complexity framework. The theoretical results show that the estimation errors grow polynomially with respect to both the MLP size and the time length, thereby avoiding the curse of parametric complexity. Furthermore, the derived error bounds demonstrate that constraining the Lipschitz constants of the MLPs via loss function regularization can improve the generalization ability of the neural oscillator. A numerical study considering a Bouc-Wen nonlinear system under stochastic seismic excitation validates the theoretically predicted power laws of the estimation errors with respect to the sample size and time length, and confirms the effectiveness of constraining MLPs' matrix and vector norms in enhancing the performance of the neural oscillator under limited training data.

顶级标签: theory machine learning model evaluation
详细标签: generalization bounds neural oscillators rademacher complexity dynamical systems pac learning 或 搜索:

神经振荡器的泛化上界 / Upper Generalization Bounds for Neural Oscillators


1️⃣ 一句话总结

这篇论文从理论上证明了,一种基于二阶微分方程构建的‘神经振荡器’模型,其预测误差会随着模型规模和任务时长缓慢增长,从而避免了参数过多带来的‘维数灾难’,并且通过限制模型复杂度可以有效提升其在小样本数据下的泛化能力。

源自 arXiv: 2603.09742