菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-13
📄 Abstract - Consistency of AI-Generated Exercise Prescriptions: A Repeated Generation Study Using a Large Language Model

Background: Large language models (LLMs) have been explored as tools for generating personalized exercise prescriptions, yet the consistency of outputs under identical conditions remains insufficiently examined. Objective: This study evaluated the intra-model consistency of LLM-generated exercise prescriptions using a repeated generation design. Methods: Six clinical scenarios were used to generate exercise prescriptions using Gemini 2.5 Flash (20 outputs per scenario; total n = 120). Consistency was assessed across three dimensions: (1) semantic consistency using SBERT-based cosine similarity, (2) structural consistency based on the FITT principle using an AI-as-a-judge approach, and (3) safety expression consistency, including inclusion rates and sentence-level quantification. Results: Semantic similarity was high across scenarios (mean cosine similarity: 0.879-0.939), with greater consistency in clinically constrained cases. Frequency showed consistent patterns, whereas variability was observed in quantitative components, particularly exercise intensity. Unclassifiable intensity expressions were observed in 10-25% of resistance training outputs. Safety-related expressions were included in 100% of outputs; however, safety sentence counts varied significantly across scenarios (H=86.18, p less than 0.001), with clinical cases generating more safety expressions than healthy adult cases. Conclusions: LLM-generated exercise prescriptions demonstrated high semantic consistency but showed variability in key quantitative components. Reliability depends substantially on prompt structure, and additional structural constraints and expert validation are needed before clinical deployment.

顶级标签: llm medical model evaluation
详细标签: exercise prescription output consistency clinical validation safety evaluation ai reliability 或 搜索:

AI生成运动处方的稳定性:一项使用大语言模型的重复生成研究 / Consistency of AI-Generated Exercise Prescriptions: A Repeated Generation Study Using a Large Language Model


1️⃣ 一句话总结

这项研究发现,大语言模型生成的个性化运动处方在整体语义上很稳定,但在关键的强度、时长等具体数值上存在波动,其可靠性高度依赖于提问方式,因此需要额外约束和专家审核才能用于临床。

源自 arXiv: 2604.11287