菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-08
📄 Abstract - Guide Me Out: A Framework to Benchmark VLM Operators Communication in Crisis Scenarios

Effective crisis response requires spatially grounded communication that bridges linguistic guidance of civilians with the physical environment, accounting for structural bottlenecks, evolving threats, and agent-specific contexts. Yet, current NLP research in crisis communication remains mainly limited to static, text-only classification settings, overlooking the critical communicative role of AI operators in dynamic, embodied scenarios. We address this gap with a novel benchmarking framework for evaluating Vision-Language Models (VLMs) tasked with guiding civilian agents through simulated evacuations. We test two communication strategies (narrowcast vs. broadcast), two environment representations (visual vs. graph-based), and two threat behaviors (static vs. moving) across nine maps of varying structural complexity. Our results show that Narrowcast consistently reduces civilian Fail rates compared to Broadcast across all difficulty levels. Guidance quality depends heavily on how the VLM operator represents the world: the visual modality drives performance, while adding an adjacency graph is model-dependent and often harmful. Moving threats raise Fail rates across all conditions as communication must continuously adapt over time. Together, these findings show that deploying VLMs as AI operators in evacuation scenarios remains a non-trivial challenge, where the choice of communication strategy and input representation can directly determine the success or failure of the intervention.

顶级标签: agents multi-modal benchmark
详细标签: crisis communication vision-language models evacuation simulation communication strategy environment representation 或 搜索:

引导我出去:一个用于评估危机场景中视觉语言模型操作员沟通能力的基准框架 / Guide Me Out: A Framework to Benchmark VLM Operators Communication in Crisis Scenarios


1️⃣ 一句话总结

该论文提出了一个评估视觉语言模型(VLM)在模拟疏散中引导平民的基准框架,发现定向通讯比广播更有效,视觉信息比附加地图更有助于提升引导效果,而移动威胁则显著增加了任务失败率。

源自 arXiv: 2606.09428