菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-08
📄 Abstract - Alignment Plausibility: A New Standard for Assuring AI in Healthcare

Large language models (LLMs) have become significant providers of mental health support, yet they remain products of an attention economy whose operational and commercial targets favour sustained engagement over the friction that effective psychological support often requires. Developers' safety responses have been largely reactive, addressing the most visible and acute harms while subtler, longer-term patterns of risk (e.g., dependency, boundary erosion, the amplification of distorted beliefs) receive less attention. We contend that making LLMs structurally safe requires alignment organised at three levels that mirror how society assures the safety of human clinical practice: 1) explicit value specification grounded in the codified normative commitments of clinical practice; 2) training that embeds those values in the model; and 3) oversight that detects drift and longer-term harm during deployment, much as clinical supervision does for human practice. Organising alignment in this way yields a construct we call alignment plausibility - a structured demonstration that a system's values, training regime, and oversight mechanisms are together consistent with safe and positive outcomes. We propose alignment plausibility as a regulatory construct (by drawing analogy to the established construct of biological plausibility) for AI in health: a principled way to argue for, or against, trust that systems are aligned to positive health outcomes, will cause no harm even where capable of doing so, and will ultimately lead to patient benefit.

顶级标签: llm medical
详细标签: alignment mental health safety regulation clinical practice 或 搜索:

对齐可信度:确保医疗人工智能安全的新标准 / Alignment Plausibility: A New Standard for Assuring AI in Healthcare


1️⃣ 一句话总结

本文提出一种名为“对齐可信度”的监管框架,主张通过价值规范、训练嵌入和持续监督三个层次来系统性地确保大语言模型在医疗(尤其是心理健康)领域的安全,防止其因商业驱动而导致用户依赖、信念扭曲等长期风险。

源自 arXiv: 2607.07766