菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-06
📄 Abstract - AdaStop: Cost-Aware Early Stopping for DNN Test Selection

Existing methods for testing deep neural networks (DNNs) primarily prioritize test inputs likely to reveal model faults under a fixed labeling budget. In practice, choosing that budget is difficult: too little testing misses failures, while too much incurs unnecessary labeling costs. This work studies the stopping problem in DNN testing. We formulate testing as a cost--benefit decision process in which labeling an input incurs cost $c$ and discovering a fault yields value $v$. Based on this formulation, we introduce \textit{AdaStop}, a framework that estimates the marginal fault discovery rate during testing and stops labeling when the estimated rate falls below the threshold $\tau = c/v$. Experiments across multiple datasets, architectures, and selection strategies show that $65$--$84\%$ of faults can be discovered using only $9$--$31\%$ of the labeling budget.

顶级标签: model evaluation machine learning
详细标签: deep neural networks test selection early stopping cost-aware testing fault discovery 或 搜索:

AdaStop:面向深度神经网络测试选择的成本感知式早期停止方法 / AdaStop: Cost-Aware Early Stopping for DNN Test Selection


1️⃣ 一句话总结

本文提出了一种名为AdaStop的智能停止策略,它在深度学习模型测试过程中,通过实时评估发现新错误的边际收益与标注成本,自动决定何时停止测试,从而在仅使用9%~31%标注预算的情况下仍能发现65%~84%的错误,大幅降低测试成本。

源自 arXiv: 2607.05461