菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-06
📄 Abstract - Your Agent's Memories Are Not Its Own: Forged Reasoning Attacks on LLM Agent Memory and Defenses

Persistent memory has enabled large language model (LLM) agents to store factual knowledge, prior decisions, reasoning histories, tool usage information, and context. While this has improved the agent's functionality and continuity across tasks, it has also introduced a new attack surface: the agent's own reasoning history. In this paper, we introduce the Forged Amplifying Rationale Memory Attack (FARMA), which poisons an agent's remembered reasoning rather than its factual knowledge. It inserts forged reasoning traces using evasive language that bypasses keyword-based defenses, then amplifies them through self-referential reinforcement that defeats consensus-based defenses. To address FARMA, we introduce SENTINEL, a layered defense pipeline to detect forged reasoning entries. Its central component is the Reasoning Guard that structurally analyzes candidate entries for forgery using five weighted signals. We evaluate FARMA and SENTINEL across multiple agents and different LLM models with 50 trials and show that FARMA achieves an attack success rate of up to 100% under baseline conditions and is capable of defeating defense mechanisms like keyword filter and A-MemGuard. Our evaluation also shows that SENTINEL reduces FARMA's attack success rate to as low as 0% with no false positives observed across 326 benign agent traces. Our work demonstrates the need to protect not only an agent's retrieved content but also the integrity of its reasoning history.

顶级标签: llm agents security
详细标签: memory poisoning reasoning attack defense mechanism agent security 或 搜索:

你的智能体记忆并非其所独有:针对LLM智能体记忆的伪造推理攻击及防御 / Your Agent's Memories Are Not Its Own: Forged Reasoning Attacks on LLM Agent Memory and Defenses


1️⃣ 一句话总结

本文提出一种名为FARMA的新型攻击方法,通过向大语言模型智能体的记忆系统中注入伪造的推理过程(而非事实数据),利用逃避关键词检测和自引用强化等手段绕开现有防御,并设计了SENTINEL多层防御管线,其核心组件“推理护卫”通过五项加权信号结构性地分析候选记忆条目,实验表明FARMA在无防御下攻击成功率可达100%,而SENTINEL可将其降至0%且无误报,揭示了保护智能体推理历史完整性的重要性。

源自 arXiv: 2607.05029