菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-22
📄 Abstract - ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval

The Composed Image Retrieval (CIR) task provides a flexible retrieval paradigm via a reference image and modification text, but it heavily relies on expensive and error-prone triplet annotations. This paper systematically investigates the Noisy Triplet Correspondence (NTC) problem introduced by annotations. We find that NTC noise, particularly ``hard noise'' (i.e., the reference and target images are highly similar but the modification text is incorrect), poses a unique challenge to existing Noise Correspondence Learning (NCL) methods because it breaks the traditional ``small loss hypothesis''. We identify and elucidate three key, yet overlooked, challenges in the NTC task, namely (C1) Modality Suppression, (C2) Negative Anchor Deficiency, and (C3) Unlearning Backlash. To address these challenges, we propose a Cone-based robuSt noisE-unlearning comPositional network (ConeSep). Specifically, we first propose Geometric Fidelity Quantization, theoretically establishing and practically estimating a noise boundary to precisely locate noisy correspondence. Next, we introduce Negative Boundary Learning, which learns a ``diagonal negative combination'' for each query as its explicit semantic opposite-anchor in the embedding space. Finally, we design Boundary-based Targeted Unlearning, which models the noisy correction process as an optimal transport problem, elegantly avoiding Unlearning Backlash. Extensive experiments on benchmark datasets (FashionIQ and CIRR) demonstrate that ConeSep significantly outperforms current state-of-the-art methods, which fully demonstrates the effectiveness and robustness of our method.

顶级标签: computer vision multi-modal machine learning
详细标签: composed image retrieval noisy correspondence unlearning noise robustness embedding learning 或 搜索:

ConeSep:基于锥体的鲁棒噪声遗忘组合网络用于组合图像检索 / ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval


1️⃣ 一句话总结

本文针对组合图像检索中因标注错误导致的噪声问题,提出了一种名为ConeSep的新型网络,通过几何精度量化、负边界学习和基于边界的定向遗忘三个创新模块,有效解决了传统方法难以应对的“硬噪声”挑战,在多个公开数据集上取得了领先性能。

源自 arXiv: 2604.20358