全息神经概率上下文无关文法用于无监督解析 / Holographic Neural PCFG for Unsupervised Parsing
1️⃣ 一句话总结
该论文提出了一种名为Hol-PCFG的新模型,通过用全息嵌入(一种基于圆环相关性的代数方法)来替代传统黑箱神经网络,使得语法规则的概率计算具有可解释的数学公式,从而在无监督句法解析中大幅减少参数(减少99.94%)、提高训练稳定性,并在六种语言上达到最优性能,甚至能直接从日语字符进行解析而无需分词。
Unsupervised constituency parsing aims to accurately induce latent tree structures from raw text alone. Recent neural parameterizations of PCFGs achieve strong performance in both supervised and unsupervised parsing, yet rely on high-capacity black-box networks for rule scoring -- as exemplified by the Neural PCFG family -- leaving rule probabilities without an interpretable mathematical form. In this paper, we propose Holographic Neural PCFG (Hol-PCFG), which recasts PCFG rule scoring as algebraic relation modeling among grammar-symbol embeddings. Hol-PCFG adapts Holographic Embeddings (Nickel et al., 2016), which scores knowledge-graph triples via circular correlation, to the left-child, right-child, and lexical-emission relations over torus-constrained embeddings, giving every rule probability a closed form that carries the intrinsic structure of grammar rules by construction. Hol-PCFG achieves state-of-the-art parsing performance in six languages while cutting rule-scoring parameters by 99.94% relative to the baseline model and training more stably. Additionally, we demonstrate that Hol-PCFG can parse Japanese directly from characters without any morphological segmentation, retaining nearly the same morpheme-level performance.
全息神经概率上下文无关文法用于无监督解析 / Holographic Neural PCFG for Unsupervised Parsing
该论文提出了一种名为Hol-PCFG的新模型,通过用全息嵌入(一种基于圆环相关性的代数方法)来替代传统黑箱神经网络,使得语法规则的概率计算具有可解释的数学公式,从而在无监督句法解析中大幅减少参数(减少99.94%)、提高训练稳定性,并在六种语言上达到最优性能,甚至能直接从日语字符进行解析而无需分词。
源自 arXiv: 2607.08063