菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-14
📄 Abstract - Are Candidate Models Really Needed for Active Learning?

Deep learning has profoundly impacted domains such as computer vision and natural language processing by uncovering complex patterns in vast datasets. However, the reliance on extensive labeled data poses significant challenges, including resource constraints and annotation errors, particularly in training Convolutional Neural Networks (CNNs) and transformers due to a larger number of parameters. Active learning offers a promising solution to reduce labeling burdens by strategically selecting the most informative samples for annotation. However, the current active learning frameworks are time-intensive which select the samples iteratively with the help of initial candidate models. This study investigates the feasibility of using CNNs and transformers with randomly initialized weights, eliminating the need for initial candidate models while achieving results comparable to active learning frameworks that depend on such candidate models. We evaluate three confidence-based sampling strategies: high confidence (HC), low confidence (LC), and a combination of high confidence in the early stages of training and low confidence at later stages of training (HCLC). Among these, mostly LC demonstrated the best performance in our experiments, showcasing its effectiveness as an active learning strategy without the need for candidate models. Further, extensive experiments verify the robustness of the proposed active learning methods. By challenging traditional frameworks, the proposed work introduces a streamlined approach to active learning, advancing efficiency and flexibility across diverse datasets and domains.

顶级标签: machine learning model training
详细标签: active learning confidence-based sampling cnn transformer efficiency 或 搜索:

主动学习中真的需要候选模型吗? / Are Candidate Models Really Needed for Active Learning?


1️⃣ 一句话总结

本文探索了在主动学习中去除初始候选模型的可行性,通过直接使用随机初始化的神经网络和低置信度采样策略,实现了与传统依赖候选模型的主动学习方法相当的标注效率,显著简化了流程并提升了灵活性。

源自 arXiv: 2605.14689