菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-10
📄 Abstract - Exploration Structure in LLM Agents for Multi-File Change Localization

Software engineering tools increasingly rely on LLM based agents to localize files to change to resolve a software issue. Most AI agents explore repositories linearly, that is, visiting one directory or file per step. We postulate that this is a structural mismatch for changes that span several subsystems. We compare linear sequential exploration against non-linear, domain-scoped parallel agentic exploration. Using SWE Bench Pro as initial benchmark, we focus on ansible as an exemplar. We construct an approach for persistent-session evaluation of GitHub issues anchored at a single base commit. We compare our non-linear domain-agent file traversal system against a base LLM without direct repository access, a single agent Recursive Language Model (RLM) baseline with a persistent Python REPL and an external CLI baseline using Codex 5.5 High. Domain scoped parallel agent spawning with a small Haiku-class model achieves the highest micro F1 among Haiku class models by a large margin. Domain-agents is the second highest behind only the much larger Codex 5.5 High on our own expanded benchmark including over more recent PRs from 2025 and 2026. On the original, curated, 2020 SWE-bench Pro benchmark, a larger Sonnet plain LLM baseline attains higher micro F1 by predicting few files, leading to higher precision, but at significantly lower all gold recall. We also present three additional findings. First, documentation evolution is a latent dependency unresolved by any approach. Second, naive file system access can degrade localization driven by test-file over prediction. Lastly, forced multi-agent consultation does not measurably help and raises token cost substantially.

顶级标签: llm agents systems
详细标签: file localization multi-file change exploration structure benchmark software engineering 或 搜索:

面向多文件更改定位的LLM智能体探索结构研究 / Exploration Structure in LLM Agents for Multi-File Change Localization


1️⃣ 一句话总结

本文提出了一种领域并行探索策略,让多个小型AI智能体同时在不同代码子系统中搜索,以此解决大型语言模型在定位需要同时修改多个分散文件的问题时效率低下的痛点,实验表明该方法的召回率显著优于传统的单一路径线性探索方式。

源自 arXiv: 2606.11976