谁写了这本书?检测与归因LLM代笔 / Who Wrote the Book? Detecting and Attributing LLM Ghostwriters
1️⃣ 一句话总结
这篇论文提出了一个名为GhostWriteBench的基准数据集和一个名为TRACE的轻量级指纹方法,用于有效识别和追踪不同大型语言模型生成的长文本作者,即使在模型未知或数据有限的情况下也能保持高性能。
In this paper, we introduce GhostWriteBench, a dataset for LLM authorship attribution. It comprises long-form texts (50K+ words per book) generated by frontier LLMs, and is designed to test generalisation across multiple out-of-distribution (OOD) dimensions, including domain and unseen LLM author. We also propose TRACE -- a novel fingerprinting method that is interpretable and lightweight -- that works for both open- and closed-source models. TRACE creates the fingerprint by capturing token-level transition patterns (e.g., word rank) estimated by another lightweight language model. Experiments on GhostWriteBench demonstrate that TRACE achieves state-of-the-art performance, remains robust in OOD settings, and works well in limited training data scenarios.
谁写了这本书?检测与归因LLM代笔 / Who Wrote the Book? Detecting and Attributing LLM Ghostwriters
这篇论文提出了一个名为GhostWriteBench的基准数据集和一个名为TRACE的轻量级指纹方法,用于有效识别和追踪不同大型语言模型生成的长文本作者,即使在模型未知或数据有限的情况下也能保持高性能。
源自 arXiv: 2603.28054