菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-28
📄 Abstract - No More K-means: Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval

Multi-vector retrieval (MVR) models, exemplified by ColBERT, have established new benchmarks in retrieval accuracy by preserving fine-grained token-level interactions. However, this granularity imposes prohibitive storage and retrieval efficiency bottlenecks: to manage the immense memory footprint and computational overhead of billion-scale token vectors, state-of-the-art systems are forced to rely on aggressive dimension reduction and complex clustering (e.g., K-means). This compromise introduces two critical limitations: excessive indexing latency of clustering large-scale corpora and semantic information loss inherent to compression. In this paper, we propose Single-stage Sparse Retrieval (SSR}, a paradigm shift that replaces expensive clustering with efficient sparse coding. Instead of compressing features into low-dimensional dense vectors, we utilize Sparse Autoencoder (SAE) to project token embeddings into a high-dimensional but highly sparse representation. This transformation enables us to bypass vector clustering entirely and leverage inverted indexing for precise, high-throughput retrieval. Extensive experiments on the BEIR benchmark demonstrate that SSR achieves a "trifecta" of improvements: it reduces indexing time by 15x compared to ColBERTv2, halves retrieval latency, and simultaneously improves retrieval performance over leading baselines.

顶级标签: machine learning information retrieval systems
详细标签: multi-vector retrieval sparse coding sparse autoencoder inverted indexing efficiency 或 搜索:

告别K-means:用于高效多向量检索的单阶段稀疏编码方法 / No More K-means: Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval


1️⃣ 一句话总结

本文提出一种名为SSR的新方法,用稀疏自动编码器替代传统多向量检索中依赖K-means聚类的复杂压缩步骤,将词元向量转换为高维稀疏表示,从而大幅降低索引时间和检索延迟,同时提升检索准确率。

源自 arXiv: 2605.30120