菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-10
📄 Abstract - Finding Sparse Subnetworks in One Training Cycle via Progressive Magnitude-Based Pruning

Neural network pruning reduces model size by removing less important parameters while aiming to preserve predictive performance. Although the Lottery Ticket Hypothesis (LTH) shows that sparse subnetworks can match dense networks when trained from suitable initializations, its iterative pruning procedure requires multiple complete training cycles. This work evaluates progressive magnitude-based pruning as a single-cycle alternative. The method gradually increases sparsity during training using a linear schedule and updates pruning masks based on active weight magnitudes. We conduct systematic experiments on CIFAR-10 and MNIST across ResNet, VGG-style, and LeNet architectures, comparing the proposed method with representative iterative and initialization-based pruning baselines, including LTH, SNIP, and GraSP. On CIFAR-10, the method achieves 95.12\% accuracy on ResNet-18 at 72.9\% sparsity, compared with 90.5\% reported for LTH. At extreme sparsity, it achieves 93.13\% accuracy on a VGG-like architecture at 97\% sparsity, compared with approximately 92.0\% for SNIP, and 93.44\% accuracy on VGG-19 at 97.97\% sparsity, compared with 92.19\% for GraSP at 98\% sparsity. A sparsity-accuracy analysis on ResNet-18 further shows that accuracy remains within 0.1 percentage points of the dense baseline across 70--85\% sparsity. These results indicate that progressive magnitude-based pruning provides an effective single-cycle approach for neural network sparsification under the evaluated settings.

顶级标签: machine learning model training
详细标签: neural network pruning lottery ticket hypothesis pruning sparsification sparse subnetworks 或 搜索:

通过渐进式基于幅度的剪枝在一次训练周期中发现稀疏子网络 / Finding Sparse Subnetworks in One Training Cycle via Progressive Magnitude-Based Pruning


1️⃣ 一句话总结

本文提出一种仅需一次完整训练即可逐步剪枝神经网络的简单方法,在多个标准模型和数据集上不仅速度更快,而且准确率优于需要多次训练的经典剪枝方法。

源自 arXiv: 2606.12278