菜单

🤖 系统
📄 Abstract - GroupRank: A Groupwise Reranking Paradigm Driven by Reinforcement Learning

Large Language Models have shown strong potential as rerankers to enhance the overall performance of RAG systems. However, existing reranking paradigms are constrained by a core theoretical and practical dilemma: Pointwise methods, while simple and highly flexible, evaluate documents independently, making them prone to the Ranking Myopia Trap, overlooking the relative importance between documents. In contrast, Listwise methods can perceive the global ranking context, but suffer from inherent List Rigidity, leading to severe scalability and flexibility issues when handling large candidate sets. To address these challenges, we propose Groupwise, a novel reranking paradigm. In this approach, the query and a group of candidate documents are jointly fed into the model, which performs within-group comparisons to assign individual relevance scores to each document. This design retains the flexibility of Pointwise methods while enabling the comparative capability of Listwise methods. We further adopt GRPO for model training, equipped with a heterogeneous reward function that integrates ranking metrics with a distributional reward aimed at aligning score distributions across groups. To overcome the bottleneck caused by the scarcity of high quality labeled data, we further propose an innovative pipeline for synthesizing high quality retrieval and ranking data. The resulting data can be leveraged not only for training the reranker but also for training the retriever. Extensive experiments validate the effectiveness of our approach. On two reasoning intensive retrieval benchmarks, BRIGHT and R2MED.

顶级标签: llm reinforcement learning natural language processing
详细标签: document reranking rag systems groupwise ranking retrieval augmentation ranking optimization 或 搜索:

📄 论文总结

GroupRank:一种由强化学习驱动的分组重排序范式 / GroupRank: A Groupwise Reranking Paradigm Driven by Reinforcement Learning


1️⃣ 一句话总结

这篇论文提出了一种名为GroupRank的新型分组重排序方法,它结合了点式方法的灵活性和列式方法的全局比较能力,通过强化学习和合成数据训练,有效提升了检索增强生成系统的排序性能。


📄 打开原文 PDF