菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-01-24
📄 Abstract - Learning to Ideate for Machine Learning Engineering Agents

Existing machine learning engineering (MLE) agents struggle to iteratively optimize their implemented algorithms for effectiveness. To address this, we introduce MLE-Ideator, a dual-agent framework that separates ideation from implementation. In our system, an implementation agent can request strategic help from a dedicated Ideator. We show this approach is effective in two ways. First, in a training-free setup, our framework significantly outperforms implementation-only agent baselines on MLE-Bench. Second, we demonstrate that the Ideator can be trained with reinforcement learning (RL) to generate more effective ideas. With only 1K training samples from 10 MLE tasks, our RL-trained Qwen3-8B Ideator achieves an 11.5% relative improvement compared to its untrained counterpart and surpasses Claude Sonnet 3.5. These results highlights a promising path toward training strategic AI systems for scientific discovery.

顶级标签: agents model training machine learning
详细标签: multi-agent systems reinforcement learning machine learning engineering ideation benchmark 或 搜索:

为机器学习工程智能体学习构思方法 / Learning to Ideate for Machine Learning Engineering Agents


1️⃣ 一句话总结

这篇论文提出了一个名为MLE-Ideator的双智能体框架,它将构思与执行分离,通过让一个专门的‘构思者’智能体为执行智能体提供策略性建议,有效提升了机器学习工程任务的迭代优化能力,并且研究表明通过强化学习训练‘构思者’可以生成更有效的想法,性能甚至超过了更强的基线模型。

源自 arXiv: 2601.17596