非凸双层优化的共识基粒子方法及其收敛性分析 / Convergence of Consensus-Based Particle Methods for Nonconvex Bi-Level Optimization
1️⃣ 一句话总结
本文提出一种无需导数的粒子优化方法,通过平滑分位数和拉普拉斯近似构建共识点,有效解决非凸双层优化问题,并从理论上证明了该方法在平均场和有限粒子近似下能以指数速率收敛到目标解。
In this paper, we study a consensus-based optimization method for nonconvex bi-level optimization, where the objective is to minimize an upper-level function over the set of global minimizers of a lower-level problem. The proposed approach is derivative-free, and constructs its consensus point via smooth quantile selection combined with a Gibbs-type Laplace approximation. We establish convergence guarantees for both the associated \textit{mean-field} dynamics and its \textit{finite-particle} approximation. In particular, under suitable assumptions on smooth quantile localization, error bounds, and stability, we show that the mean-field law reaches any arbitrary prescribed Wasserstein neighborhood of the target bi-level solution with an explicit exponential rate up to the hitting time. Numerical experiments on a two-dimensional constrained problem and neural network training further support the theoretical results.
非凸双层优化的共识基粒子方法及其收敛性分析 / Convergence of Consensus-Based Particle Methods for Nonconvex Bi-Level Optimization
本文提出一种无需导数的粒子优化方法,通过平滑分位数和拉普拉斯近似构建共识点,有效解决非凸双层优化问题,并从理论上证明了该方法在平均场和有限粒子近似下能以指数速率收敛到目标解。
源自 arXiv: 2605.19667