噪声条件下谱学习的极限 / Limits of spectral learning under noise
1️⃣ 一句话总结
这篇论文研究了在带噪声的回归问题中,用谱方法学习函数时,噪声会如何导致估计的系数发生可预测的偏移,并揭示了当噪声超过某个关键阈值后,系数的估计会变得不稳定,从而从根本上限制了从含噪数据中恢复函数结构的能力。
Learning functional relationships from noisy data is a central problem in scientific inference. Spectral methods approximate unknown functions by expanding them in a basis and estimating the corresponding coefficients from data, but the stability of these coefficients under noise remains poorly understood. Here we study supervised regression with additive label noise using sparse spectral representations across multiple bases and dimensions. We show that noise induces a predictable drift in the learned coefficient vector whose magnitude depends on the effective number of active spectral modes. After whitening the empirical feature geometry, we derive a closed-form expression for the overlap between noisy and noiseless coefficient vectors, revealing a universal degradation curve governed by a single intrinsic noise scale. Numerical experiments across Fourier, Legendre, Bessel, and Haar bases confirm the theoretical prediction. The results demonstrate that spectral learning exhibits a fundamental noise threshold beyond which coefficient estimates become unstable, placing intrinsic limits on recovering functional structure from noisy data.
噪声条件下谱学习的极限 / Limits of spectral learning under noise
这篇论文研究了在带噪声的回归问题中,用谱方法学习函数时,噪声会如何导致估计的系数发生可预测的偏移,并揭示了当噪声超过某个关键阈值后,系数的估计会变得不稳定,从而从根本上限制了从含噪数据中恢复函数结构的能力。
源自 arXiv: 2606.13067