菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-07
📄 Abstract - Stories of Your Life as Others: A Round-Trip Evaluation of LLM-Generated Life Stories Conditioned on Rich Psychometric Profiles

Personality traits are richly encoded in natural language, and large language models (LLMs) trained on human text can simulate personality when conditioned on persona descriptions. However, existing evaluations rely predominantly on questionnaire self-report by the conditioned model, are limited in architectural diversity, and rarely use real human psychometric data. Without addressing these limitations, it remains unclear whether personality conditioning produces psychometrically informative representations of individual differences or merely superficial alignment with trait descriptors. To test how robustly LLMs can encode personality into extended text, we condition LLMs on real psychometric profiles from 290 participants to generate first-person life story narratives, and then task independent LLMs to recover personality scores from those narratives alone. We show that personality scores can be recovered from the generated narratives at levels approaching human test-retest reliability (mean r = 0.750, 85% of the human ceiling), and that recovery is robust across 10 LLM narrative generators and 3 LLM personality scorers spanning 6 providers. Decomposing systematic biases reveals that scoring models achieve their accuracy while counteracting alignment-induced defaults. Content analysis of the generated narratives shows that personality conditioning produces behaviourally differentiated text: nine of ten coded features correlate significantly with the same features in participants' real conversations, and personality-driven emotional reactivity patterns in narratives replicate in real conversational data. These findings provide evidence that the personality-language relationship captured during pretraining supports robust encoding and decoding of individual differences, including characteristic emotional variability patterns that replicate in real human behaviour.

顶级标签: llm natural language processing model evaluation
详细标签: personality simulation psychometric evaluation text generation round-trip evaluation human behavior modeling 或 搜索:

作为他人的你的人生故事:基于丰富心理测量特征的大语言模型生成人生故事的往返式评估 / Stories of Your Life as Others: A Round-Trip Evaluation of LLM-Generated Life Stories Conditioned on Rich Psychometric Profiles


1️⃣ 一句话总结

这项研究证明,大语言模型能够根据真实用户的性格特征生成具有个人特色的人生故事,并且其他独立的大语言模型可以仅从这些故事中准确地反推出用户的性格分数,其准确度接近人类自我测评的可信度,表明模型能捕捉并复现真实人类行为中与性格相关的语言模式和情感变化。

源自 arXiv: 2604.06071