菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-02
📄 Abstract - GLoRIA: Gated Low-Rank Interpretable Adaptation for Dialectal ASR

Automatic Speech Recognition (ASR) in dialect-heavy settings remains challenging due to strong regional variation and limited labeled data. We propose GLoRIA, a parameter-efficient adaptation framework that leverages metadata (e.g., coordinates) to modulate low-rank updates in a pre-trained encoder. GLoRIA injects low-rank matrices into each feed-forward layer, with a gating MLP determining the non-negative contribution of each LoRA rank-1 component based on location metadata. On the GCND corpus, GLoRIA outperforms geo-conditioned full fine-tuning, LoRA, and both dialect-specific and unified full fine-tuning, achieving state-of-the-art word error rates while updating under 10% of parameters. GLoRIA also generalizes well to unseen dialects, including in extrapolation scenarios, and enables interpretable adaptation patterns that can be visualized geospatially. These results show metadata-gated low-rank adaptation is an effective, interpretable, and efficient solution for dialectal ASR.

顶级标签: audio model training machine learning
详细标签: speech recognition parameter-efficient fine-tuning dialect adaptation low-rank adaptation metadata conditioning 或 搜索:

GLoRIA:用于方言语音识别的门控低秩可解释适配方法 / GLoRIA: Gated Low-Rank Interpretable Adaptation for Dialectal ASR


1️⃣ 一句话总结

这篇论文提出了一种名为GLoRIA的新方法,它利用地理位置等元数据,通过一个门控机制智能地调整预训练语音识别模型中的少量参数,从而高效、可解释地提升模型对不同方言的识别能力,并在参数更新量很少的情况下取得了优异效果。

源自 arXiv: 2603.02464