AgentDevel:将自我进化的LLM智能体重构为发布工程 / AgentDevel: Reframing Self-Evolving LLM Agents as Release Engineering
1️⃣ 一句话总结
这篇论文提出了一种名为AgentDevel的新方法,它将大型语言模型智能体的自我改进过程类比为软件发布工程,通过建立一套包含版本控制、回归测试和可审计诊断的标准化流程,旨在实现更稳定、可追溯且不易退化的智能体性能提升。
Recent progress in large language model (LLM) agents has largely focused on embedding self-improvement mechanisms inside the agent or searching over many concurrent variants. While these approaches can raise aggregate scores, they often yield unstable and hard-to-audit improvement trajectories, making it difficult to guarantee non-regression or to reason about failures across versions. We reframe agent improvement as \textbf{release engineering}: agents are treated as shippable artifacts, and improvement is externalized into a regression-aware release pipeline. We introduce \textbf{AgentDevel}, a release engineering pipeline that iteratively runs the current agent, produces implementation-blind, symptom-level quality signals from execution traces, synthesizes a single release candidate (RC) via executable diagnosis, and promotes it under flip-centered gating. AgentDevel features three core designs: (i) an implementation-blind LLM critic that characterizes failure appearances without accessing agent internals, (ii) script-based executable diagnosis that aggregates dominant symptom patterns and produces auditable engineering specifications, and (iii) flip-centered gating that prioritizes pass to fail regressions and fail to pass fixes as first-class evidence. Unlike population-based search or in-agent self-refinement, AgentDevel maintains a single canonical version line and emphasizes non-regression as a primary objective. Experiments on execution-heavy benchmarks demonstrate that AgentDevel yields stable improvements with significantly fewer regressions while producing reproducible, auditable artifacts. Overall, AgentDevel provides a practical development discipline for building, debugging, and releasing LLM agents as software development.
AgentDevel:将自我进化的LLM智能体重构为发布工程 / AgentDevel: Reframing Self-Evolving LLM Agents as Release Engineering
这篇论文提出了一种名为AgentDevel的新方法,它将大型语言模型智能体的自我改进过程类比为软件发布工程,通过建立一套包含版本控制、回归测试和可审计诊断的标准化流程,旨在实现更稳定、可追溯且不易退化的智能体性能提升。
源自 arXiv: 2601.04620