菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-09
📄 Abstract - Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing

In large language model (LLM) agents, reasoning trajectories are treated as reliable internal beliefs for guiding actions and updating memory. However, coherent reasoning can still violate logical or evidential constraints, allowing unsupported beliefs repeatedly stored and propagated across decision steps, leading to systematic behavioral drift in long-horizon agentic systems. Most existing strategies rely on the consensus mechanism, conflating agreement with faithfulness. In this paper, inspired by the vulnerability of unfaithful intermediate reasoning trajectories, we propose \textbf{S}elf-\textbf{A}udited \textbf{Ve}rified \textbf{R}easoning (\textsc{SAVeR}), a novel framework that enforces verification over internal belief states within the agent before action commitment, achieving faithful reasoning. Concretely, we structurally generate persona-based diverse candidate beliefs for selection under a faithfulness-relevant structure space. To achieve reasoning faithfulness, we perform adversarial auditing to localize violations and repair through constraint-guided minimal interventions under verifiable acceptance criteria. Extensive experiments on six benchmark datasets demonstrate that our approach consistently improves reasoning faithfulness while preserving competitive end-task performance.

顶级标签: llm agents model evaluation
详细标签: faithful reasoning self-auditing verification adversarial auditing agentic systems 或 搜索:

承诺前先验证:通过自我审计实现LLM智能体的可信推理 / Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing


1️⃣ 一句话总结

这篇论文提出了一个名为SAVeR的新框架,它让大型语言模型智能体在采取行动前,先对自己的内部推理过程进行自我审计和验证,从而有效减少逻辑错误和证据不足的信念传播,提升长期决策的可信度。

源自 arXiv: 2604.08401