AdaStop:面向深度神经网络测试选择的成本感知式早期停止方法 / AdaStop: Cost-Aware Early Stopping for DNN Test Selection
1️⃣ 一句话总结
本文提出了一种名为AdaStop的智能停止策略,它在深度学习模型测试过程中,通过实时评估发现新错误的边际收益与标注成本,自动决定何时停止测试,从而在仅使用9%~31%标注预算的情况下仍能发现65%~84%的错误,大幅降低测试成本。
Existing methods for testing deep neural networks (DNNs) primarily prioritize test inputs likely to reveal model faults under a fixed labeling budget. In practice, choosing that budget is difficult: too little testing misses failures, while too much incurs unnecessary labeling costs. This work studies the stopping problem in DNN testing. We formulate testing as a cost--benefit decision process in which labeling an input incurs cost $c$ and discovering a fault yields value $v$. Based on this formulation, we introduce \textit{AdaStop}, a framework that estimates the marginal fault discovery rate during testing and stops labeling when the estimated rate falls below the threshold $\tau = c/v$. Experiments across multiple datasets, architectures, and selection strategies show that $65$--$84\%$ of faults can be discovered using only $9$--$31\%$ of the labeling budget.
AdaStop:面向深度神经网络测试选择的成本感知式早期停止方法 / AdaStop: Cost-Aware Early Stopping for DNN Test Selection
本文提出了一种名为AdaStop的智能停止策略,它在深度学习模型测试过程中,通过实时评估发现新错误的边际收益与标注成本,自动决定何时停止测试,从而在仅使用9%~31%标注预算的情况下仍能发现65%~84%的错误,大幅降低测试成本。
源自 arXiv: 2607.05461