菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-21
📄 Abstract - Sibyl-AutoResearch: Autonomous Research Needs Self-Evolving Trial-and-Error Harnesses, Not Paper Generators

Autonomous research systems increasingly make the scientific workflow executable: agents can propose ideas, run code, inspect results, and draft papers. But executable workflows do not by themselves produce research judgment. We analyze where current systems lose trial experience: weak evidence becomes prose, pilot signals become broad claims, memory remains textual, and recurring process failures do not change later behavior. We introduce Sibyl-AutoResearch, a self-evolving AutoResearch framework built around Scientific Trial-and-Error Harnesses. A harness lets agents run bounded trials, preserve positive and negative outcomes, and route lessons into later planning, validation, claim scope, scheduling, critique, writing, and harness repair. We formalize this through two auditable conversion units: trial-to-behavior conversion, which links trial signals to later research actions, and trial-to-harness-behavior conversion, which links recurring process failures to system updates. We implement the framework in SIBYL, a file-backed autonomous research system that exposes the state, roles, memory, gates, and artifact traces needed to inspect these conversion paths. A retrospective audit identifies eight high-confidence conversion events, with a median latency of one iteration and a maximum latency of three iterations. A recovered-failure registry further shows how five naturally occurring failure classes, including duplicate results, stale numbers, and unsupported statistics, were blocked, downgraded, or routed into later repair. These traces do not establish a comparative performance claim; they show that the proposed conversion units are recoverable from realistic autonomous-research workspaces. The SIBYL framework and system are available at this https URL.

顶级标签: agents systems machine learning
详细标签: autonomous research trial-and-error self-evolving scientific workflow auditable conversion 或 搜索:

西比尔-自动研究:自主研究需要自我进化的试错框架,而非论文生成器 / Sibyl-AutoResearch: Autonomous Research Needs Self-Evolving Trial-and-Error Harnesses, Not Paper Generators


1️⃣ 一句话总结

本文指出当前自主研究系统虽然能自动执行实验和撰写论文,但缺乏从试错中学习的能力,因此提出了一个名为Sibyl-AutoResearch的新框架,它通过让系统记录每次实验的成功与失败,并将这些经验转化为后续研究决策和改进,从而让AI真正拥有自我进化的研究能力。

源自 arXiv: 2605.22343