菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-21
📄 Abstract - Evaluation-driven Scaling for Scientific Discovery

Language models are increasingly used in scientific discovery to generate hypotheses, propose candidate solutions, implement systems, and iteratively refine them. At the core of these trial-and-error loops lies evaluation: the process of obtaining feedback on candidate solutions via verifiers, simulators, or task-specific scoring functions. While prior work has highlighted the importance of evaluation, it has not explicitly formulated the problem of how evaluation-driven discovery loops can be scaled up in a principled and effective manner to push the boundaries of scientific discovery, a problem this paper seeks to address. We introduce Simple Test-time Evaluation-driven Scaling (SimpleTES), a general framework that strategically combines parallel exploration, feedback-driven refinement, and local selection, revealing substantial gains unlocked by scaling evaluation-driven discovery loops along the right dimensions. Across 21 scientific problems spanning six domains, SimpleTES discovers state-of-the-art solutions using gpt-oss models, consistently outperforming both frontier-model baselines and sophisticated optimization pipelines. Particularly, we sped up the widely used LASSO algorithm by over 2x, designed quantum circuit routing policies that reduce gate overhead by 24.5%, and discovered new Erdos minimum overlap constructions that surpass the best-known results. Beyond novel discoveries, SimpleTES produces trajectory-level histories that naturally supervise feedback-driven learning. When post-trained on successful trajectories, models not only improve efficiency on seen problems but also generalize to unseen problems, discovering solutions that base models fail to uncover. Together, our results establish effective evaluation-driven loop scaling as a central axis for advancing LLM-driven scientific discovery, and provide a simple yet practical framework for realizing these gains.

顶级标签: llm machine learning systems
详细标签: scientific discovery evaluation-driven scaling hypothesis generation test-time scaling post-training 或 搜索:

以评估驱动的科学发现规模化方法 / Evaluation-driven Scaling for Scientific Discovery


1️⃣ 一句话总结

本文提出了一种名为SimpleTES的通用框架,通过结合并行探索、反馈改进和局部选择,系统性地扩大评估驱动的研究循环规模,从而在多个科学领域中发现更优解决方案(如将经典LASSO算法加速两倍、减少量子电路开销24.5%等),并证明由此产生的成功轨迹还能用于训练模型,使其在解决新问题时表现更好。

源自 arXiv: 2604.19341