PLURAL:一个用于价值对齐的全球数据集 / PLURAL: A Global Dataset for Value Alignment
1️⃣ 一句话总结
为解决大型语言模型过度反映西方价值观的问题,研究者创建了PLURAL数据集,它基于覆盖92个国家的大规模社会调查,通过特殊方法将调查数据转化为约50万个偏好样本,使模型能学习并适配不同国家的文化价值观,实验证明该方法能显著提升模型对目标国家价值观的匹配度。
Large language models (LLMs) are used worldwide, yet disproportionately reflect Western values, limiting their ability to represent diverse value systems. We introduce PLURAL, a large-scale, value-focused preference dataset grounded in the Integrated Values Survey (IVS), a nationally representative survey spanning 92 countries. Using a two-stage generation pipeline, we transform survey responses into synthetic preference triplets that preserve normative value signals while producing realistic scenarios. We release an initial version of PLURAL containing ~500,000 preference triplets representing people in 20 diverse countries. We evaluate PLURAL in three ways: (i) dataset-level validation showing that it preserves both cross-country value differences and within-country diversity from the original survey; (ii) automated evaluation showing that training on PLURAL improves alignment with target countries' cultural profiles, reducing mean absolute error by up to 27.7% relative to strong baselines; and (iii) blind human evaluation with 176 evaluators in India, Brazil, and Japan, who judge PLURAL-aligned responses as more representative of their national values. Together, these results show that PLURAL contains learnable signal for value steering, offering a scalable resource for pluralistic alignment. Dataset: this https URL
PLURAL:一个用于价值对齐的全球数据集 / PLURAL: A Global Dataset for Value Alignment
为解决大型语言模型过度反映西方价值观的问题,研究者创建了PLURAL数据集,它基于覆盖92个国家的大规模社会调查,通过特殊方法将调查数据转化为约50万个偏好样本,使模型能学习并适配不同国家的文化价值观,实验证明该方法能显著提升模型对目标国家价值观的匹配度。
源自 arXiv: 2607.08034