菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-21
📄 Abstract - Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrieval

Composed Image Retrieval (CIR) has attracted significant attention due to its flexible multimodal query method, yet its development is severely constrained by the Noisy Triplet Correspondence (NTC) problem. Most existing robust learning methods rely on the "small loss hypothesis", but the unique semantic ambiguity in NTC, such as "partial matching", invalidates this assumption, leading to unreliable noise identification. This entraps the model in a self dependent vicious cycle where the learner is intertwined with the arbiter, ultimately causing catastrophic "representation pollution". To address this critical challenge, we propose a novel "Expert-Proxy-Diversion" decoupling paradigm, named Air-Know (ArbIteR calibrated Knowledge iNternalizing rObust netWork). Air-Know incorporates three core modules: (1) External Prior Arbitration (EPA), which utilizes Multimodal Large Language Models (MLLMs) as an offline expert to construct a high precision anchor dataset; (2) Expert Knowledge Internalization (EKI), which efficiently guides a lightweight proxy "arbiter" to internalize the expert's discriminative logic; (3) Dual Stream Reconciliation (DSR), which leverages the EKI's matching confidence to divert the training data, achieving a clean alignment stream and a representation feedback reconciliation stream. Extensive experiments on multiple CIR benchmark datasets demonstrate that Air-Know significantly outperforms existing SOTA methods under the NTC setting, while also showing strong competitiveness in traditional CIR.

顶级标签: multi-modal machine learning
详细标签: composed image retrieval noisy triplet correspondence robust learning multimodal large language model knowledge distillation 或 搜索:

Air-Know:基于仲裁器校准与知识内化的鲁棒组合图像检索网络 / Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrieval


1️⃣ 一句话总结

本文提出了一种名为Air-Know的新型鲁棒网络,通过引入多模态大模型作为外部专家来校准数据噪声,并利用轻量级仲裁器内化专家知识,从而有效解决了组合图像检索中由“部分匹配”等语义歧义导致的噪声干扰问题,显著提升了检索的准确性和鲁棒性。

源自 arXiv: 2604.19386