增量图构建实现文本的鲁棒谱聚类 / Incremental Graph Construction Enables Robust Spectral Clustering of Texts
1️⃣ 一句话总结
这篇论文提出了一种简单有效的增量式构建邻居图的方法,通过确保图始终连通,解决了传统谱聚类在处理文本数据时因图结构不连通而性能不稳定的问题,在稀疏连接情况下显著提升了聚类效果。
Neighborhood graphs are a critical but often fragile step in spectral clustering of text embeddings. On realistic text datasets, standard $k$-NN graphs can contain many disconnected components at practical sparsity levels (small $k$), making spectral clustering degenerate and sensitive to hyperparameters. We introduce a simple incremental $k$-NN graph construction that preserves connectivity by design: each new node is linked to its $k$ nearest previously inserted nodes, which guarantees a connected graph for any $k$. We provide an inductive proof of connectedness and discuss implications for incremental updates when new documents arrive. We validate the approach on spectral clustering of SentenceTransformer embeddings using Laplacian eigenmaps across six clustering datasets from the Massive Text Embedding this http URL to standard $k$-NN graphs, our method outperforms in the low-$k$ regime where disconnected components are prevalent, and matches standard $k$-NN at larger $k$.
增量图构建实现文本的鲁棒谱聚类 / Incremental Graph Construction Enables Robust Spectral Clustering of Texts
这篇论文提出了一种简单有效的增量式构建邻居图的方法,通过确保图始终连通,解决了传统谱聚类在处理文本数据时因图结构不连通而性能不稳定的问题,在稀疏连接情况下显著提升了聚类效果。
源自 arXiv: 2603.03056