两步智能体:决策者与人工智能决策支持交互的框架 / 2-Step Agent: A Framework for the Interaction of a Decision Maker with AI Decision Support
1️⃣ 一句话总结
这篇论文提出了一个名为‘两步智能体’的计算框架,用于模拟人工智能决策支持对决策者的影响,并通过模拟发现,即使决策者只有一个错误的初始信念,使用AI支持也可能导致比不用更糟糕的决策结果,从而揭示了AI辅助决策的潜在风险。
Across a growing number of fields, human decision making is supported by predictions from AI models. However, we still lack a deep understanding of the effects of adoption of these technologies. In this paper, we introduce a general computational framework, the 2-Step Agent, which models the effects of AI-assisted decision making. Our framework uses Bayesian methods for causal inference to model 1) how a prediction on a new observation affects the beliefs of a rational Bayesian agent, and 2) how this change in beliefs affects the downstream decision and subsequent outcome. Using this framework, we show by simulations how a single misaligned prior belief can be sufficient for decision support to result in worse downstream outcomes compared to no decision support. Our results reveal several potential pitfalls of AI-driven decision support and highlight the need for thorough model documentation and proper user training.
两步智能体:决策者与人工智能决策支持交互的框架 / 2-Step Agent: A Framework for the Interaction of a Decision Maker with AI Decision Support
这篇论文提出了一个名为‘两步智能体’的计算框架,用于模拟人工智能决策支持对决策者的影响,并通过模拟发现,即使决策者只有一个错误的初始信念,使用AI支持也可能导致比不用更糟糕的决策结果,从而揭示了AI辅助决策的潜在风险。
源自 arXiv: 2602.21889