为技术而培训:生成式人工智能在法律分析中的采纳与高效使用 / Training for Technology: Adoption and Productive Use of Generative AI in Legal Analysis
1️⃣ 一句话总结
这项研究发现,对法律学生进行简短的生成式AI使用培训,不仅能显著提高他们对AI工具的采纳率,还能有效提升他们在案例分析考试中的成绩,这表明在专业领域,用户培训是释放AI生产力潜力的关键。
Can targeted user training unlock the productive potential of generative artificial intelligence (GenAI) in professional settings? We investigate this question using a randomized study involving 164 law students completing an issue-spotting examination. Participants were assigned to one of three conditions: no GenAI access, optional access to a large language model (LLM), or optional access accompanied by an approximately ten-minute training intervention. Training significantly increased LLM adoption--the usage rate rose from 26% to 41%--and improved examination performance. Students with trained access scored 0.27 grade points higher than those with untrained access (p = 0.027), equivalent to roughly one-third of a letter grade. By contrast, access to an LLM without training did not improve performance and was associated with shorter answers relative to no access. Using principal stratification, we decompose the overall effect into adoption and effectiveness channels. Point estimates are consistent with training operating primarily by expanding the scope of GenAI use rather than by enhancing effectiveness among existing users, though confidence intervals are wide. Overall, our findings provide evidence that complementary investments in user training are critical for realizing GenAI productivity gains in knowledge-intensive fields where concerns about reliability may inhibit adoption.
为技术而培训:生成式人工智能在法律分析中的采纳与高效使用 / Training for Technology: Adoption and Productive Use of Generative AI in Legal Analysis
这项研究发现,对法律学生进行简短的生成式AI使用培训,不仅能显著提高他们对AI工具的采纳率,还能有效提升他们在案例分析考试中的成绩,这表明在专业领域,用户培训是释放AI生产力潜力的关键。
源自 arXiv: 2603.04982