📄
Abstract - When the Target Domain Changes: AI-Mediated Construct Drift in High-Stakes English Language AssessmenW
High-stakes English proficiency tests treat standardized, unaided performance as evidence for score interpretations about academic English proficiency. This interpretation remains meaningful, but as target language use domains increasingly involve generative AI, the extrapolation from unaided test performance to academic communicative readiness becomes less self-evident. This conceptual validity argument reframes AI as a score-interpretation problem in high-stakes language testing, not only an operational issue of scoring, feedback, security, or misconduct. Synthesizing current literature in three uneven layers, the paper shows that most work treats AI as assessment infrastructure, while far less theorizes its implications for construct validity and extrapolation warrants. It defines AI-mediated construct drift as the misalignment that arises when communicative abilities required in the target domain change through AI mediation while test constructs remain anchored to an unaided-performance model. It proposes bounded AI mediation as a validity-oriented design principle: a standardized condition in which all test takers access the same institutionally controlled AI assistant, with predefined assistance boundaries, logged interactions, and tasks that distinguish comprehension support from answer generation. The paper argues that score interpretations should be narrowed and supplemented when used to support claims about AI-mediated academic communication.
当目标领域改变:高风险英语评估中的人工智能介导构念漂移 /
When the Target Domain Changes: AI-Mediated Construct Drift in High-Stakes English Language AssessmenW
1️⃣ 一句话总结
这篇论文指出,在高风险的英语考试中,由于现实中越来越多地使用人工智能进行交流,传统考试只考察无辅助能力的评分解释变得不够合理,并提出了“人工智能介导构念漂移”这一概念,即考试评估的技能与实际所需的技能出现脱节,为此建议引入一种标准化的、受控的人工智能辅助条件来更新考试设计,以更准确地反映真实学术环境中的沟通能力。