菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-13
📄 Abstract - Computation of Least Trimmed Squares: A Branch-and-Bound framework with Hyperplane Arrangement Enhancements

We study computational aspects of a key problem in robust statistics -- the penalized least trimmed squares (LTS) regression problem, a robust estimator that mitigates the influence of outliers in data by capping residuals with large magnitudes. Although statistically attractive, penalized LTS is NP-hard, and existing mixed-integer optimization (MIO) formulations scale poorly due to weak relaxations and exponential worst-case complexity in the number of observations. We propose a new MIO formulation that embeds hyperplane arrangement logic into a perspective reformulation, explicitly enforcing structural properties of optimal solutions. We show that, if the number of features is fixed, the resulting branch-and-bound tree is of polynomial size in the sample size. Moreover, we develop a tailored branch-and-bound algorithm that uses first-order methods with dual bounds to solve node relaxations efficiently. Computational experiments on synthetic and real datasets demonstrate substantial improvements over existing MIO approaches: on synthetic instances with 5000 samples and 20 features, our tailored solver reaches a 1% gap in 1 minute while competing approaches fail to do so within one hour. These gains enable exact robust regression at significantly larger sample sizes in low-dimensional settings.

顶级标签: theory machine learning systems
详细标签: robust regression mixed-integer optimization branch-and-bound hyperplane arrangement least trimmed squares 或 搜索:

最小截断平方和的计算:一种结合超平面排列增强的分支定界框架 / Computation of Least Trimmed Squares: A Branch-and-Bound framework with Hyperplane Arrangement Enhancements


1️⃣ 一句话总结

这篇论文提出了一种新的高效计算方法,通过结合超平面排列和分支定界算法,大幅提升了处理数据中异常值的稳健回归模型的求解速度和规模,使其能在短时间内精确处理大规模数据集。

源自 arXiv: 2604.11584