元加性模型:具有自动加权功能的可解释稀疏学习 / Meta Additive Model: Interpretable Sparse Learning With Auto Weighting
1️⃣ 一句话总结
本文提出了一种新的元加性模型,它能自动学习如何为不同样本分配权重,从而在数据存在噪声、异常值或不平衡时,依然能稳定地进行变量选择、回归和分类,并保持模型的可解释性。
Sparse additive models have attracted much attention in high-dimensional data analysis due to their flexible representation and strong interpretability. However, most existing models are limited to single-level learning under the mean-squared error criterion, whose empirical performance can degrade significantly in the presence of complex noise, such as non-Gaussian perturbations, outliers, noisy labels, and imbalanced categories. The sample reweighting strategy is widely used to reduce the model's sensitivity to atypical data; however, it typically requires prespecifying the weighting functions and manually selecting additional hyperparameters. To address this issue, we propose a new meta additive model (MAM) based on the bilevel optimization framework, which learns data-driven weighting of individual losses by parameterizing the weighting function via an MLP trained on meta data. MAM is capable of a variety of learning tasks, including variable selection, robust regression estimation, and imbalanced classification. Theoretically, MAM provides guarantees on convergence in computation, algorithmic generalization, and variable selection consistency under mild conditions. Empirically, MAM outperforms several state-of-the-art additive models on both synthetic and real-world data under various data corruptions.
元加性模型:具有自动加权功能的可解释稀疏学习 / Meta Additive Model: Interpretable Sparse Learning With Auto Weighting
本文提出了一种新的元加性模型,它能自动学习如何为不同样本分配权重,从而在数据存在噪声、异常值或不平衡时,依然能稳定地进行变量选择、回归和分类,并保持模型的可解释性。
源自 arXiv: 2604.20111