SAGE:一种基于执行反馈的可控智能数据生成方法,用于深度搜索 / SAGE: Steerable Agentic Data Generation for Deep Search with Execution Feedback
1️⃣ 一句话总结
这篇论文提出了一种名为SAGE的自动化数据生成方法,它通过让数据生成器和搜索智能体进行多轮交互与反馈,能够自动为深度搜索任务生成高质量、难度可控的问答对,从而显著提升搜索智能体的性能,并降低对昂贵人工标注数据的依赖。
Deep search agents, which aim to answer complex questions requiring reasoning across multiple documents, can significantly speed up the information-seeking process. Collecting human annotations for this application is prohibitively expensive due to long and complex exploration trajectories. We propose an agentic pipeline that automatically generates high quality, difficulty-controlled deep search question-answer pairs for a given corpus and a target difficulty level. Our pipeline, SAGE, consists of a data generator which proposes QA pairs and a search agent which attempts to solve the generated question and provide execution feedback for the data generator. The two components interact over multiple rounds to iteratively refine the question-answer pairs until they satisfy the target difficulty level. Our intrinsic evaluation shows SAGE generates questions that require diverse reasoning strategies, while significantly increases the correctness and difficulty of the generated data. Our extrinsic evaluation demonstrates up to 23% relative performance gain on popular deep search benchmarks by training deep search agents with our synthetic data. Additional experiments show that agents trained on our data can adapt from fixed-corpus retrieval to Google Search at inference time, without further training.
SAGE:一种基于执行反馈的可控智能数据生成方法,用于深度搜索 / SAGE: Steerable Agentic Data Generation for Deep Search with Execution Feedback
这篇论文提出了一种名为SAGE的自动化数据生成方法,它通过让数据生成器和搜索智能体进行多轮交互与反馈,能够自动为深度搜索任务生成高质量、难度可控的问答对,从而显著提升搜索智能体的性能,并降低对昂贵人工标注数据的依赖。
源自 arXiv: 2601.18202