菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-17
📄 Abstract - G-IdiomAlign: A Gloss-Pivoted Benchmark for Cross-Lingual Idiom Alignment

Idioms are difficult to transfer across languages due to their non-compositionality and weak surface-form grounding, making literal mappings unreliable. We present G-IdiomAlign, a gloss-pivoted benchmark where each idiom is anchored by an English gloss from Wiktionary. We further construct a high-confidence reference alignment set for reproducible evaluation. G-IdiomAlign supports two protocols: (1) a controlled Multiple-Choice Idiom Equivalence with typed distractors for error attribution; and (2) a Gloss-Contrastive Generation contrasting No-gloss and With-gloss inputs to isolate the effect of an explicit semantic pivot. Across diverse LLMs, a bias to literal translation is a dominant failure mode, especially when the target is a low-resource language. Glosses consistently improve Gloss-Contrastive Generation under an embedding-based semantic proxy, but performance remains modest, indicating substantial headroom in the open output space. Subsequent analysis on Qwen3-8B further suggests that cross-condition differences are concentrated more in attention heads than in layers, while better With-gloss generations coincide with stronger gloss anchoring.

顶级标签: natural language processing llm benchmark
详细标签: idiom alignment cross-lingual gloss pivot evaluation literal translation bias 或 搜索:

G-IdiomAlign:基于释义锚点的跨语言习语对齐基准 / G-IdiomAlign: A Gloss-Pivoted Benchmark for Cross-Lingual Idiom Alignment


1️⃣ 一句话总结

该论文提出了一个名为G-IdiomAlign的新基准,通过为每个习语附上英语释义(gloss)来帮助大语言模型更准确地跨语言对齐习语含义,实验结果发现模型容易偏向直译,而加入释义虽能改善效果,但整体表现仍有较大提升空间。

源自 arXiv: 2606.18989