菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-27
📄 Abstract - A Comparative Evaluation of AI Agent Security Guardrails

This report presents a comparative evaluation of DKnownAI Guard in AI agent security scenarios, benchmarked against three competing products: AWS Bedrock Guardrails, Azure Content Safety, and Lakera Guard. Using human annotation as the ground truth, we assess each guardrail's ability to detect two categories of risks: threats to the agent itself (e.g., instruction override, indirect injection, tool abuse) and requests intended to elicit harmful content (e.g., hate speech, pornography, violence). Evaluation results demonstrate that DKnownAI Guard achieves the highest recall rate at 96.5\% and ranks first in true negative rate (TNR) at 90.4\%, delivering the best overall performance among all evaluated guardrails.

顶级标签: llm agents model evaluation
详细标签: security guardrails benchmark risk detection comparative evaluation 或 搜索:

AI智能体安全防护栏的对比评估 / A Comparative Evaluation of AI Agent Security Guardrails


1️⃣ 一句话总结

本文通过对比评测DKnownAI Guard与AWS、Azure、Lakera三款主流AI安全防护产品,发现DKnownAI Guard在识别针对智能体自身的攻击和有害内容请求时,达到了96.5%的最高召回率和90.4%的最高真负率,综合表现最佳。

源自 arXiv: 2604.24826