从脚本到语义:面向非洲自然语言推理的提示策略研究 / From Script to Semantics: Prompting Strategies for African NLI
1️⃣ 一句话总结
本文系统研究了在斯瓦希里语、约鲁巴语和豪萨语等非洲低资源语言上,通过精心设计的提示策略(无需微调)即可显著提升大语言模型在自然语言推理任务中的表现,其中“对比性提示”策略在准确性和类别平衡上最为稳定可靠。
Large language models (LLMs) are increasingly evaluated in multilingual settings, yet their inference behavior in low-resource African languages remains underexplored especially under pure prompting without fine-tuning. We present a systematic study of prompting strategies for Natural Language Inference (NLI) in Swahili, Yoruba, and Hausa using the AfriXNLI benchmark. We evaluate five prompting strategies Baseline (zero-shot), Script-Aware, Language Specific, Contrastive, and Native-Label Self-Translation (NL-STP) across two mid-sized open weight models (Llama3.2-3B and Gemma3-4B). To isolate the effect of prompt design, the effect of few-shot examples and Chain-of-Thought reasoning is eliminated in our study. We find a significant difference in performance of class wise across strategies with highly neutral class collapse and high prediction skew in some configurations. Contrastive prompting proves to be the most reliable and steadily improving strategy over language and model and has better balance of class behavior and balance of overall accuracy gains. Notably, well-constructed prompts are sufficient to beat more powerful baselines that are provided with few-shot prompts and Chain-of-Thought prompts. We have found that prompt formulation is essential to multilingual NLI with low-resource languages and that language aware decision structuring can be used to meaningfully enhance robustness in resource challenged settings.
从脚本到语义:面向非洲自然语言推理的提示策略研究 / From Script to Semantics: Prompting Strategies for African NLI
本文系统研究了在斯瓦希里语、约鲁巴语和豪萨语等非洲低资源语言上,通过精心设计的提示策略(无需微调)即可显著提升大语言模型在自然语言推理任务中的表现,其中“对比性提示”策略在准确性和类别平衡上最为稳定可靠。
源自 arXiv: 2606.03304