COMBINER:基于属性邻居关系的组合图像检索 / COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations
1️⃣ 一句话总结
本文提出了一种名为COMBINER的图像检索方法,通过将图像中的属性特征进行解耦和统一建模,能够区分那些看起来相似但属性不同的图像,从而更准确地根据用户的多模态描述(如文字+示例图)找到目标图片。
Composed Image Retrieval (CIR) represents a challenging retrieval task that targets locating specific images through multimodal inputs. Despite recent progress in CIR techniques, prior approaches often overlook cases where images appear visually alike yet differ in attributes, potentially undermining both multimodal feature fusion and similarity modeling. To mitigate this limitation, we design a unified representation of cross-modal features based on attribute prototypes. Nevertheless, the task is far from straightforward, owing to three core issues: (1) entanglement in attribute-level semantics, (2) inconsistency across modalities, and (3) supervised signal missing. To tackle the above obstacles, we introduce a COMposed image retrieval network guided By attrIbute-based NEighbor Relations (COMBINER). Specifically, we first design an Adaptive Semantic Disentanglement module, which is capable of disentangling attribute features based on multimodal primitive features. Secondly, we propose a Unified Prototype-based Composition module, which can construct cross-modal unified prototypes (CUP) and facilitate multimodal feature composition. Finally, we introduce a Dual Relations Modeling module, which can mine pairwise and neighbor relations based on attribute similarity. Compared to traditional neighbor relations modeling CIR methods, COMBINER represents the first study addressing the phenomenon of visually similar but attribute-unrelated samples. It achieves a more accurate understanding of the semantic relations among samples by employing an attribute prototype-based similarity metric. Comprehensive experiments conducted on three benchmark datasets confirm the effectiveness of our proposed COMBINER. The implementation of our method will be accessed at this https URL
COMBINER:基于属性邻居关系的组合图像检索 / COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations
本文提出了一种名为COMBINER的图像检索方法,通过将图像中的属性特征进行解耦和统一建模,能够区分那些看起来相似但属性不同的图像,从而更准确地根据用户的多模态描述(如文字+示例图)找到目标图片。
源自 arXiv: 2606.04604