菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-29
📄 Abstract - ARMOR: Adaptive Retriever Optimization for Low-Resource Telecom Question Answering

Telecom question answering (QA) is a challenging setting for retrieval-augmented generation (RAG): evidence is fragmented across standards, papers, encyclopedic resources, and web documents, and answers often hinge on technical tables, equations, and specialized protocol language. In low-resource subdomains, generator fine-tuning can over-specialize and degrade general capability, making query-side retriever adaptation an attractive alternative. To this end, we ask whether a fixed-generator, query-adapted RAG system can outperform generator-side adaptation, and which retriever objectives best support that setting. We motivate retrieval, rather than generator fine-tuning, as the adaptation target through a capacity comparison: under bounded-parameter and soft-retrieval assumptions, query-encoder tuning can have a smaller estimation term than supervised fine-tuning when its effective dimension is smaller. We identify two particularly relevant objectives -- the latent-document RAG likelihood, which optimizes generation utility, and the InfoNCE contrastive objective, which improves semantic retrieval geometry -- and leverage them jointly through a retriever optimization method targeting downstream QA performance in the telecom domain. Specifically, we introduce ARMOR, Adaptive Regularized Mixture Optimization for Retrievers, which learns separate temperatures for the RAG retrieval distribution and InfoNCE softmax and regularizes the adapted query encoder toward the frozen base query encoder. Across telecom-specific retrieval and generative QA benchmarks, we show that ARMOR improves evidence retrieval and answer generation in several in-domain settings. Code is available at this https URL.

顶级标签: natural language processing retrieval augmented generation
详细标签: telecom question answering adaptive retriever rag query adaptation retrieval optimization 或 搜索:

ARMOR:面向低资源电信问答的自适应检索器优化方法 / ARMOR: Adaptive Retriever Optimization for Low-Resource Telecom Question Answering


1️⃣ 一句话总结

本文提出ARMOR方法,通过联合优化生成似然和对比学习目标来调整检索器的查询编码器,在固定生成器不变的情况下,显著提升了低资源电信领域问答系统从专业文档中检索和生成答案的能力,避免了对生成器微调可能导致的泛化能力下降问题。

源自 arXiv: 2606.29706