菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-14
📄 Abstract - Is Grep All You Need? How Agent Harnesses Reshape Agentic Search

Recent advances in Large Language Model (LLM) agents have enabled complex agentic workflows where models autonomously retrieve information, call tools, and reason over large corpora to complete tasks on behalf of users. Despite the growing adoption of retrieval-augmented generation (RAG) in agentic search systems, existing literature lacks a systematic comparison of how retrieval strategy choice interacts with agent architecture and tool-calling paradigm. Important practical dimensions, including how tool outputs are presented to the model and how performance changes when searches must cope with more irrelevant surrounding text, remain under-explored in agent loops. This paper reports an empirical study organized into two experiments. Experiment 1 compares grep and vector retrieval on a 116-question sample from LongMemEval, using a custom agent harness (Chronos) and provider-native CLI harnesses (Claude Code, Codex, and Gemini CLI), for both inline tool results and file-based tool results that the model reads separately. Experiment 2 compares grep-only and vector-only retrieval while progressively mixing in additional unrelated conversation history, so that each query is embedded in more distracting material alongside the passages that matter. Across Chronos and the provider CLIs, grep generally yields higher accuracy than vector retrieval in our comparisons in experiment 1; at the same time, overall scores still depend strongly on which harness and tool-calling style is used, even when the underlying conversation data are the same.

顶级标签: llm agents systems
详细标签: retrieval-augmented generation tool calling agent harness grep vs vector search 或 搜索:

只需 Grep 就够了?智能体如何通过执行框架重塑搜索能力 / Is Grep All You Need? How Agent Harnesses Reshape Agentic Search


1️⃣ 一句话总结

本文通过实验发现,在智能体搜索系统中,简单的关键词搜索(grep)在准确性上往往优于复杂的向量检索,但最终效果更取决于智能体执行框架和工具调用方式的设计,而非单纯的检索算法本身。

源自 arXiv: 2605.15184