菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-03
📄 Abstract - Self-Evolving Deep Research via Joint Generation and Evaluation

Large Language Models (LLMs) have become increasingly adopted in daily applications, with deep research standing out as a particularly important capability. Unlike traditional question-answering (QA) tasks, deep research report generation lacks definitive ground-truth, making reward design inherently unverifiable and limiting effective reinforcement learning. Existing approaches mitigate this challenge with LLM-as-a-judge and query-dependent evaluation rubrics, but they still rely on static evaluators that cannot adapt their standards as the solver improves, leading to insufficient and eventually saturated optimization pressure. We address this limitation with a \textbf{s}elf-evolving \textbf{co}-evolutionary training framework for deep \textbf{re}search evaluation and generation (SCORE), which tightly couples an evaluator and a solver in a shared-parameter learning process. Rather than treating generation and evaluation as isolated modules, we leverage their intrinsic connection to enable joint improvement within a single shared-parameter model. To restrict this process, we introduce a meta-harness, which dynamically controls the evaluation environment based on solver performance, encouraging valid evaluation dimensions and sufficiently deep evaluator search. Extensive experiments on deep research benchmarks demonstrate consistent improvement in report generation quality, showing that co-evolving evaluation and generation is a promising direction for training open-ended research agents.

顶级标签: llm agents model training
详细标签: deep research co-evolutionary training self-evolving evaluation report generation 或 搜索:

自我进化的深度研究:通过联合生成与评估实现 / Self-Evolving Deep Research via Joint Generation and Evaluation


1️⃣ 一句话总结

本文提出了一种名为SCORE的协同进化训练框架,让评估器和生成器共享参数并动态互动,从而在不断优化研究报告质量的同时,自动提升评估标准,避免了传统方法中评估标准僵化导致的性能瓶颈。

源自 arXiv: 2606.04507