ProgressLM:迈向视觉语言模型中的进度推理 / PROGRESSLM: Towards Progress Reasoning in Vision-Language Models
1️⃣ 一句话总结
这篇论文提出了一个名为Progress-Bench的基准测试来评估视觉语言模型在判断任务进度方面的能力,发现现有模型普遍表现不佳,并通过一种新的训练方法ProgressLM显著提升了模型在未见任务上的进度推理性能。
Estimating task progress requires reasoning over long-horizon dynamics rather than recognizing static visual content. While modern Vision-Language Models (VLMs) excel at describing what is visible, it remains unclear whether they can infer how far a task has progressed from partial observations. To this end, we introduce Progress-Bench, a benchmark for systematically evaluating progress reasoning in VLMs. Beyond benchmarking, we further explore a human-inspired two-stage progress reasoning paradigm through both training-free prompting and training-based approach based on curated dataset ProgressLM-45K. Experiments on 14 VLMs show that most models are not yet ready for task progress estimation, exhibiting sensitivity to demonstration modality and viewpoint changes, as well as poor handling of unanswerable cases. While training-free prompting that enforces structured progress reasoning yields limited and model-dependent gains, the training-based ProgressLM-3B achieves consistent improvements even at a small model scale, despite being trained on a task set fully disjoint from the evaluation tasks. Further analyses reveal characteristic error patterns and clarify when and why progress reasoning succeeds or fails.
ProgressLM:迈向视觉语言模型中的进度推理 / PROGRESSLM: Towards Progress Reasoning in Vision-Language Models
这篇论文提出了一个名为Progress-Bench的基准测试来评估视觉语言模型在判断任务进度方面的能力,发现现有模型普遍表现不佳,并通过一种新的训练方法ProgressLM显著提升了模型在未见任务上的进度推理性能。
源自 arXiv: 2601.15224