SmartSearch:面向搜索代理的、基于过程奖励引导的查询优化框架 / SmartSearch: Process Reward-Guided Query Refinement for Search Agents
1️⃣ 一句话总结
这篇论文提出了一个名为SmartSearch的新框架,它通过引入过程奖励来精细评估和优化大型语言模型搜索代理在推理过程中产生的中间搜索查询质量,从而显著提升了搜索的准确性和效率。
Large language model (LLM)-based search agents have proven promising for addressing knowledge-intensive problems by incorporating information retrieval capabilities. Existing works largely focus on optimizing the reasoning paradigms of search agents, yet the quality of intermediate search queries during reasoning remains overlooked. As a result, the generated queries often remain inaccurate, leading to unexpected retrieval results and ultimately limiting search agents' overall effectiveness. To mitigate this issue, we introduce SmartSearch, a framework built upon two key mechanisms: (1) Process rewards, which provide fine-grained supervision for the quality of each intermediate search query through Dual-Level Credit Assessment. (2) Query refinement, which promotes the optimization of query generation by selectively refining low-quality search queries and regenerating subsequent search rounds based on these refinements. To enable the search agent to progressively internalize the ability to improve query quality under the guidance of process rewards, we design a three-stage curriculum learning framework. This framework guides the agent through a progression from imitation, to alignment, and ultimately to generalization. Experimental results show that SmartSearch consistently surpasses existing baselines, and additional quantitative analyses further confirm its significant gains in both search efficiency and query quality. The code is available at this https URL.
SmartSearch:面向搜索代理的、基于过程奖励引导的查询优化框架 / SmartSearch: Process Reward-Guided Query Refinement for Search Agents
这篇论文提出了一个名为SmartSearch的新框架,它通过引入过程奖励来精细评估和优化大型语言模型搜索代理在推理过程中产生的中间搜索查询质量,从而显著提升了搜索的准确性和效率。
源自 arXiv: 2601.04888