ONOTE:面向专家级音乐智能的全模态符号处理基准测试 / ONOTE: Benchmarking Omnimodal Notation Processing for Expert-level Music Intelligence
1️⃣ 一句话总结
本文提出了一个名为ONOTE的全新基准测试,它通过一种基于音高投影的确定性评估方法,客观衡量AI系统在处理音乐符号(包括听觉、视觉和符号三种模态)时的真实理解能力,并揭示了当前顶尖多模态模型在感知准确性与深层音乐逻辑之间存在的严重脱节。
Omnimodal Notation Processing (ONP) represents a unique frontier for omnimodal AI due to the rigorous, multi-dimensional alignment required across auditory, visual, and symbolic domains. Current research remains fragmented, focusing on isolated transcription tasks that fail to bridge the gap between superficial pattern recognition and the underlying musical logic. This landscape is further complicated by severe notation biases toward Western staff and the inherent unreliability of "LLM-as-a-judge" metrics, which often mask structural reasoning failures with systemic hallucinations. To establish a more rigorous standard, we introduce ONOTE, a multi-format benchmark that utilizes a deterministic pipeline--grounded in canonical pitch projection--to eliminate subjective scoring biases across diverse notation systems. Our evaluation of leading omnimodal models exposes a fundamental disconnect between perceptual accuracy and music-theoretic comprehension, providing a necessary framework for diagnosing reasoning vulnerabilities in complex, rule-constrained domains.
ONOTE:面向专家级音乐智能的全模态符号处理基准测试 / ONOTE: Benchmarking Omnimodal Notation Processing for Expert-level Music Intelligence
本文提出了一个名为ONOTE的全新基准测试,它通过一种基于音高投影的确定性评估方法,客观衡量AI系统在处理音乐符号(包括听觉、视觉和符号三种模态)时的真实理解能力,并揭示了当前顶尖多模态模型在感知准确性与深层音乐逻辑之间存在的严重脱节。
源自 arXiv: 2604.20719