菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-13
📄 Abstract - Production and Perception in LLMs: A Token Probability Approach

The asymmetry between language production and perception has been well-documented in psycholinguistics. Whether large language models (LLMs) exhibit a functionally analogous distinction remains an open question, particularly given that LLMs rely on the same underlying mechanism (next-token prediction) for both input and output processing. In this exploratory study, we operationalize the production-perception distinction through direct token probability measurements rather than metalinguistic prompting. Using the base Llama-3.1-8B model, we generated poems under a production prompt and re-scored the same tokens under both rephrased production prompts and perception-oriented prompts. Across an extended experiment with four production and three perception prompts, production-perception distances consistently and substantially exceeded production-production distances, with non-overlapping ranges across conditions and an overall average ratio of approximately 1.8. Near-ceiling correlations in the production-production control confirm that the effect is specific to communicative framing rather than prompt surface variation, and we show the effect replicates across five open-weight models (Llama-3.1-8B, EuroLLM-9B, gemma-2-9b-it, Mistral-7B-Instruct-v0.3, and Qwen2.5-7B-Instruct), spanning both base and instruction-tuned variants. Temporal analysis revealed that the perception prompt exerts its strongest influence at the beginning of the sequence, with divergence decaying as generated context accumulates, though the specific shape of this decay varies across prompt pairs. These findings suggest that prompt framing alone induces a production-perception distinction in LLM probability distributions, even within a decoder-only architecture.

顶级标签: llm natural language processing
详细标签: token probability production-perception prompt framing decoder-only psycholinguistics 或 搜索:

大语言模型中的生成与感知:一种基于标记概率的方法 / Production and Perception in LLMs: A Token Probability Approach


1️⃣ 一句话总结

本研究通过直接测量语言模型中词元(token)的概率分布,发现仅改变提示(prompt)的表述方式(从“生成”到“感知”),就能在相同的解码器大模型中引发类似人类语言产生与理解的不对称现象,且该效应在多种模型上稳定存在。

源自 arXiv: 2607.11703