菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-07
📄 Abstract - AVA-VLM: Adaptive Visual Attention-Vision Language Model for In-the-Wild Construction Site Monitoring

Vision-Language Models (VLMs) are promising for construction-site monitoring, and recent construction-tailored VLMs have primarily adapted pretrained VLMs through direct QA-style fine-tuning from a single global image. We argue that this direct paradigm remains limited for in-the-wild deployment in terms of operational range, reliability under reduced-resolution inputs, and inference efficiency. To address these challenges, we propose AVA-VLM, an Adaptive Visual Attention-Vision Language Model that follows a human-inspired coarse-to-fine reasoning strategy. AVA-VLM first reasons over a low-resolution global image and selectively requests a high-resolution local crop only when detailed inspection is needed, similar to how a human inspector zooms in on hard-to-see yet important areas. We further introduce a region-aware Chain-of-Thought dataset that teaches the model when to inspect, where to crop, and how to use local evidence. Experiments show that AVA-VLM improves reliability under long-distance and reduced-resolution conditions while substantially reducing visual-token usage.

顶级标签: computer vision multi-modal systems
详细标签: vision-language model construction monitoring adaptive attention coarse-to-fine reasoning chain-of-thought 或 搜索:

自适应视觉注意力-视觉语言模型:用于野外施工现场监控 / AVA-VLM: Adaptive Visual Attention-Vision Language Model for In-the-Wild Construction Site Monitoring


1️⃣ 一句话总结

该论文提出一种模仿人类检查员从粗略到精细观察过程的视觉语言模型AVA-VLM,它先看全局低分辨率图像,仅在必要时自动请求高分辨率局部细节,从而在远距离、低分辨率等苛刻条件下显著提升建筑工地监控的可靠性和效率,同时大幅减少计算资源消耗。

源自 arXiv: 2607.05859