菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-01-26
📄 Abstract - daVinci-Dev: Agent-native Mid-training for Software Engineering

Recently, the frontier of Large Language Model (LLM) capabilities has shifted from single-turn code generation to agentic software engineering-a paradigm where models autonomously navigate, edit, and test complex repositories. While post-training methods have become the de facto approach for code agents, **agentic mid-training**-mid-training (MT) on large-scale data that mirrors authentic agentic workflows-remains critically underexplored due to substantial resource requirements, despite offering a more scalable path to instilling foundational agentic behaviors than relying solely on expensive reinforcement learning. A central challenge in realizing effective agentic mid-training is the distribution mismatch between static training data and the dynamic, feedback-rich environment of real development. To address this, we present a systematic study of agentic mid-training, establishing both the data synthesis principles and training methodology for effective agent development at scale. Central to our approach is **agent-native data**-supervision comprising two complementary types of trajectories: **contextually-native trajectories** that preserve the complete information flow an agent experiences, offering broad coverage and diversity; and **environmentally-native trajectories** collected from executable repositories where observations stem from actual tool invocations and test executions, providing depth and interaction authenticity. We verify the model's agentic capabilities on `SWE-Bench Verified`. We demonstrate our superiority over the previous open software engineering mid-training recipe `Kimi-Dev` under two post-training settings with an aligned base model and agentic scaffold, while using less than half mid-training tokens (73.1B). Besides relative advantage, our best performing 32B and 72B models achieve **56.1%** and **58.5%** resolution rates, respectively, which are ...

顶级标签: llm agents model training
详细标签: software engineering agents mid-training agentic workflows data synthesis swe-bench 或 搜索:

达芬奇-开发:面向软件工程的智能体原生中期训练 / daVinci-Dev: Agent-native Mid-training for Software Engineering


1️⃣ 一句话总结

这篇论文提出了一种名为‘智能体原生中期训练’的新方法,通过生成和利用模拟真实软件开发流程的训练数据,让大型语言模型能像人类程序员一样自主地理解、修改和测试复杂代码库,从而显著提升其在软件工程任务中的表现。

源自 arXiv: 2601.18418