面向神经网络的显式超高效逼近方法 / On Explicit Super-Expressive Approximation for Neural Networks
1️⃣ 一句话总结
本文提出了一种新方法,通过引入中国剩余定理作为编码机制,构建了固定规模(深度和宽度有限)的神经网络,使其能以更小、更清晰的参数规模高效逼近各种复杂函数,并首次给出了参数大小与逼近误差之间的显式定量关系,从而克服了以往类似方法中参数大小未知、无法评估的缺陷。
In this work, we investigate the fixed-architecture neural network approximation with explicit parameter bounds and elementary activations. While prior work demonstrated super-expressive approximation using fixed-size networks, they lack quantitative and non-asymptotic characterizations of parameter magnitude with respect to the approximation error. We resolve this issue by introducing the Chinese Remainder Theorem as a constructive encoding mechanism. For Lipschitz continuous functions on $[0,1]^D$, we construct a width-$\max\{D,4\}$, depth-$5$ network with explicit parameter-error trade-offs. For Hölder-smooth functions in $C^{r,\gamma}_A\left([0,1]^D\right)$, our fixed network of width $\max\{2D,\ D+5N+1\}$ and depth $r + 9$ achieves the parameter magnitude $\mathcal{P}$ bounded by $\log_2 \mathcal{P}=\mathcal{O}\bigl(\varepsilon^{-2D/(r+\gamma)}\log(1/\varepsilon)\bigr)$. This is the dual result compared to those in the parameter-bounded and architecture-unbounded paradigm.
面向神经网络的显式超高效逼近方法 / On Explicit Super-Expressive Approximation for Neural Networks
本文提出了一种新方法,通过引入中国剩余定理作为编码机制,构建了固定规模(深度和宽度有限)的神经网络,使其能以更小、更清晰的参数规模高效逼近各种复杂函数,并首次给出了参数大小与逼近误差之间的显式定量关系,从而克服了以往类似方法中参数大小未知、无法评估的缺陷。
源自 arXiv: 2607.06781