菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-07
📄 Abstract - UAVReason: A Unified, Large-Scale Benchmark for Multimodal Aerial Scene Reasoning and Generation

Vision-Language models (VLMs) have demonstrated remarkable capability in ground-view visual understanding but often fracture when deployed on high-altitude Unmanned Aerial Vehicles (UAVs). The failure largely stems from a pronounced domain shift, characterized by tiny and densely packed objects, repetitive textures, and ambiguous top-down orientations. These factors severely disrupt semantic grounding and hinder both spatial reasoning and controllable generation. To bridge this critical gap, we introduce UAVReason, the first unified large-scale multi-modal benchmark dedicated to nadir-view UAV scenarios, derived from a high-fidelity UAV simulation platform. In contrast to existing UAV benchmarks, which are largely siloed and focus on single tasks like object detection or segmentation, UAVReason uniquely consolidates over 273K Visual Question Answering (VQA) pairs, including 23.6K single frames with detailed captions, 68.2K 2-frame temporal sequences, and 188.8K cross-modal generation samples. The benchmark probes 22 diverse reasoning types across spatial and temporal axes while simultaneously evaluating high-fidelity generation across RGB, depth, and segmentation modalities. We further establish a strong, unified baseline model via multi-task learning. Extensive experiments validate the efficacy of our unified approach across diverse metrics, such as EM/F1 for VQA, mIoU for segmentation, and CLIP Score for generation. These results indicate limitations of general-domain vision-language models and show that unified multi-task learning substantially improves UAV-native performance. All data, code, and evaluation tools will be publicly released to advance UAV multimodal research.

顶级标签: multi-modal benchmark computer vision
详细标签: aerial scene understanding vision-language models visual question answering uav simulation multimodal generation 或 搜索:

UAVReason:一个用于多模态航空场景推理与生成的统一大规模基准 / UAVReason: A Unified, Large-Scale Benchmark for Multimodal Aerial Scene Reasoning and Generation


1️⃣ 一句话总结

这篇论文提出了首个专门针对无人机俯拍视角的大规模多模态基准数据集UAVReason,它整合了视觉问答、时序推理和图像生成等多种任务,并通过实验证明,采用统一的多任务学习方法能显著提升人工智能模型对复杂高空场景的理解和生成能力。

源自 arXiv: 2604.05377