大语言模型中的“忽略零效应”分析 / Analysis of the Neglect-Zero Effect in Large Language Models
1️⃣ 一句话总结
本文通过结构启动实验,检测大语言模型是否像人类一样存在一种认知偏差——倾向于忽略那些因条件集为空而自动成立的逻辑推理(即“忽略零效应”),结果发现当前测试的模型并未表现出这种人类特有的推理习惯。
We investigate the extent to which the language processing of LLMs resembles human cognitive processes, focusing on a human cognitive bias called the $\textit{neglect-zero effect}$. This effect refers to the human tendency to ignore $\textit{zero-models}$, which are configurations that render a proposition vacuously true by virtue of an empty set. We focus on two types of inferences driven by the neglect-zero effect, and examine how LLMs process these inferences by comparing their behavior with that in an inference that does not involve the neglect-zero effect. For this purpose, we employ a paradigm based on $\textit{structural priming}$, where recent exposure to a preceding sentence (the $\textit{prime}$) facilitates the processing of a subsequent sentence (the $\textit{target}$) due to their structural similarity. We prepare primes to force LLMs to consider the zero-model, and analyze whether they also consider it in the target. The results suggest that the neglect-zero effect may not occur in the LLMs analyzed in this study. Our code is available at this https URL
大语言模型中的“忽略零效应”分析 / Analysis of the Neglect-Zero Effect in Large Language Models
本文通过结构启动实验,检测大语言模型是否像人类一样存在一种认知偏差——倾向于忽略那些因条件集为空而自动成立的逻辑推理(即“忽略零效应”),结果发现当前测试的模型并未表现出这种人类特有的推理习惯。
源自 arXiv: 2606.05864