超越准确率:社群视角下的机器翻译 / Beyond Accuracy: Community Perspectives on Machine Translation
1️⃣ 一句话总结
本文发现,尽管机器翻译技术在准确率上取得显著进步,但AI开发者、专业翻译、语言学习者及语言服务提供商这四个社群对机器翻译的关注点截然不同,AI社群更注重技术指标,而非AI用户社群更关心信任、成本和质量细节等实际社会问题,因此研究者需要倾听用户声音以缩小技术与真实需求之间的差距。
Despite remarkable progress in machine translation (MT), non-AI communities have raised growing concerns about MT systems, suggesting a noticeable gap between technical advancement and the needs of real-world users. For instance, while NLP researchers focus on benchmark performance, end users care about ethical concerns, trust, reliability, costs, and more. We argue that listening to various user communities is essential so that research efforts would be directed towards the problems that the communities care about. To this end, we present a large-scale analysis, for the first time, that investigates what four stakeholder communities (AI developers, professional translators, language learners, and language service providers) post about MT technology on social media. To do so, we construct a dataset of 79,286 posts and comments from Reddit, Facebook, Bluesky, and Mastodon from 2019 to 2025, and analyse where these communities disagree, and how and why. Overall, we find that communities often disagree, and even show strong conflicts due to polarised sentiments on topics such as translation quality, efficiency, and reliability. This is because these communities approach these topics differently: the AI community frames them as technical and computational problems, while non-AI (user) communities care more about quality nuances, time savings, user trust, and broader social issues.
超越准确率:社群视角下的机器翻译 / Beyond Accuracy: Community Perspectives on Machine Translation
本文发现,尽管机器翻译技术在准确率上取得显著进步,但AI开发者、专业翻译、语言学习者及语言服务提供商这四个社群对机器翻译的关注点截然不同,AI社群更注重技术指标,而非AI用户社群更关心信任、成本和质量细节等实际社会问题,因此研究者需要倾听用户声音以缩小技术与真实需求之间的差距。
源自 arXiv: 2606.09655