菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-01-06
📄 Abstract - The Sonar Moment: Benchmarking Audio-Language Models in Audio Geo-Localization

Geo-localization aims to infer the geographic origin of a given signal. In computer vision, geo-localization has served as a demanding benchmark for compositional reasoning and is relevant to public safety. In contrast, progress on audio geo-localization has been constrained by the lack of high-quality audio-location pairs. To address this gap, we introduce AGL1K, the first audio geo-localization benchmark for audio language models (ALMs), spanning 72 countries and territories. To extract reliably localizable samples from a crowd-sourced platform, we propose the Audio Localizability metric that quantifies the informativeness of each recording, yielding 1,444 curated audio clips. Evaluations on 16 ALMs show that ALMs have emerged with audio geo-localization capability. We find that closed-source models substantially outperform open-source models, and that linguistic clues often dominate as a scaffold for prediction. We further analyze ALMs' reasoning traces, regional bias, error causes, and the interpretability of the localizability metric. Overall, AGL1K establishes a benchmark for audio geo-localization and may advance ALMs with better geospatial reasoning capability.

顶级标签: audio benchmark multi-modal
详细标签: audio-language models geo-localization evaluation geospatial reasoning audio localizability 或 搜索:

声纳时刻:在音频地理定位任务中评估音频-语言模型 / The Sonar Moment: Benchmarking Audio-Language Models in Audio Geo-Localization


1️⃣ 一句话总结

这篇论文提出了首个用于评估音频-语言模型地理定位能力的基准数据集AGL1K,发现闭源模型表现远超开源模型,且模型主要依赖语言线索而非纯音频特征进行地理位置推断。

源自 arXiv: 2601.03227