当话语基于感知和语篇时,信息密度是否均匀? / Is Information Density Uniform when Utterances are Grounded on Perception and Discourse?
1️⃣ 一句话总结
这篇论文首次通过计算研究发现,在结合视觉感知或语篇情境的多模态语言使用中,信息分布比纯文本环境更加均匀,支持了信息密度均匀假说在真实语境下的适用性。
The Uniform Information Density (UID) hypothesis posits that speakers are subject to a communicative pressure to distribute information evenly within utterances, minimising surprisal variance. While this hypothesis has been tested empirically, prior studies are limited exclusively to text-only inputs, abstracting away from the perceptual context in which utterances are produced. In this work, we present the first computational study of UID in visually grounded settings. We estimate surprisal using multilingual vision-and-language models over image-caption data in 30 languages and visual storytelling data in 13 languages, together spanning 11 families. We find that grounding on perception consistently smooths the distribution of information, increasing both global and local uniformity across typologically diverse languages compared to text-only settings. In visual narratives, grounding in both image and discourse contexts has additional effects, with the strongest surprisal reductions occurring at the onset of discourse units. Overall, this study takes a first step towards modelling the temporal dynamics of information flow in ecologically plausible, multimodal language use, and finds that grounded language exhibits greater information uniformity, supporting a context-sensitive formulation of UID.
当话语基于感知和语篇时,信息密度是否均匀? / Is Information Density Uniform when Utterances are Grounded on Perception and Discourse?
这篇论文首次通过计算研究发现,在结合视觉感知或语篇情境的多模态语言使用中,信息分布比纯文本环境更加均匀,支持了信息密度均匀假说在真实语境下的适用性。
源自 arXiv: 2602.14653