MUZZLE:针对间接提示注入攻击的Web智能体自适应对抗性红队测试框架 / MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
1️⃣ 一句话总结
这篇论文提出了一个名为MUZZLE的自适应自动化框架,用于评估基于大语言模型的网页智能体在面对网页内容中隐藏的恶意指令攻击时的安全性,它能根据智能体的执行轨迹动态调整攻击策略,并在多个实际应用中发现了新的安全漏洞。
Large language model (LLM) based web agents are increasingly deployed to automate complex online tasks by directly interacting with web sites and performing actions on users' behalf. While these agents offer powerful capabilities, their design exposes them to indirect prompt injection attacks embedded in untrusted web content, enabling adversaries to hijack agent behavior and violate user intent. Despite growing awareness of this threat, existing evaluations rely on fixed attack templates, manually selected injection surfaces, or narrowly scoped scenarios, limiting their ability to capture realistic, adaptive attacks encountered in practice. We present MUZZLE, an automated agentic framework for evaluating the security of web agents against indirect prompt injection attacks. MUZZLE utilizes the agent's trajectories to automatically identify high-salience injection surfaces, and adaptively generate context-aware malicious instructions that target violations of confidentiality, integrity, and availability. Unlike prior approaches, MUZZLE adapts its attack strategy based on the agent's observed execution trajectory and iteratively refines attacks using feedback from failed executions. We evaluate MUZZLE across diverse web applications, user tasks, and agent configurations, demonstrating its ability to automatically and adaptively assess the security of web agents with minimal human intervention. Our results show that MUZZLE effectively discovers 37 new attacks on 4 web applications with 10 adversarial objectives that violate confidentiality, availability, or privacy properties. MUZZLE also identifies novel attack strategies, including 2 cross-application prompt injection attacks and an agent-tailored phishing scenario.
MUZZLE:针对间接提示注入攻击的Web智能体自适应对抗性红队测试框架 / MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
这篇论文提出了一个名为MUZZLE的自适应自动化框架,用于评估基于大语言模型的网页智能体在面对网页内容中隐藏的恶意指令攻击时的安全性,它能根据智能体的执行轨迹动态调整攻击策略,并在多个实际应用中发现了新的安全漏洞。
源自 arXiv: 2602.09222