谁做什么?人类与AI决策过程中赋予大语言模型的角色原型 / Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making
1️⃣ 一句话总结
这篇论文通过分析大量文献,总结了17种人类与大语言模型在协作决策中的典型互动角色模式,并通过真实临床案例证明,选择不同的互动模式会直接影响AI的输出和最终决策结果,为系统设计者提供了重要的风险考量。
LLMs are increasingly supporting decision-making across high-stakes domains, requiring critical reflection on the socio-technical factors that shape how humans and LLMs are assigned roles and interact during human-in-the-loop decision-making. This paper introduces the concept of human-LLM archetypes -- defined as re-curring socio-technical interaction patterns that structure the roles of humans and LLMs in collaborative decision-making. We describe 17 human-LLM archetypes derived from a scoping literature review and thematic analysis of 113 LLM-supported decision-making papers. Then, we evaluate these diverse archetypes across real-world clinical diagnostic cases to examine the potential effects of adopting distinct human-LLM archetypes on LLM outputs and decision outcomes. Finally, we present relevant tradeoffs and design choices across human-LLM archetypes, including decision control, social hierarchies, cognitive forcing strategies, and information requirements. Through our analysis, we show that selection of human-LLM interaction archetype can influence LLM outputs and decisions, bringing important risks and considerations for the designers of human-AI decision-making systems
谁做什么?人类与AI决策过程中赋予大语言模型的角色原型 / Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making
这篇论文通过分析大量文献,总结了17种人类与大语言模型在协作决策中的典型互动角色模式,并通过真实临床案例证明,选择不同的互动模式会直接影响AI的输出和最终决策结果,为系统设计者提供了重要的风险考量。
源自 arXiv: 2602.11924