菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-20
📄 Abstract - Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages

We present a phoneme-level analysis of automatic speech recognition (ASR) for two low-resourced and phonologically complex East Caucasian languages, Archi and Rutul, based on curated and standardized speech-transcript resources totaling approximately 50 minutes and 1 hour 20 minutes of audio, respectively. Existing recordings and transcriptions are consolidated and processed into a form suitable for ASR training and evaluation. We evaluate several state-of-the-art audio and audio-language models, including wav2vec2, Whisper, and Qwen2-Audio. For wav2vec2, we introduce a language-specific phoneme vocabulary with heuristic output-layer initialization, which yields consistent improvements and achieves performance comparable to or exceeding Whisper in these extremely low-resource settings. Beyond standard word and character error rates, we conduct a detailed phoneme-level error analysis. We find that phoneme recognition accuracy strongly correlates with training frequency, exhibiting a characteristic sigmoid-shaped learning curve. For Archi, this relationship partially breaks for Whisper, pointing to model-specific generalization effects beyond what is predicted by training frequency. Overall, our results indicate that many errors attributed to phonological complexity are better explained by data scarcity. These findings demonstrate the value of phoneme-level evaluation for understanding ASR behavior in low-resource, typologically complex languages.

顶级标签: audio natural language processing model evaluation
详细标签: automatic speech recognition low-resource languages phoneme-level analysis endangered languages speech data 或 搜索:

难以被听清:针对音系复杂、资源匮乏濒危语言的音素级自动语音识别分析 / Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages


1️⃣ 一句话总结

这篇论文通过分析两种濒危高加索语言的少量语音数据发现,在资源极度匮乏的情况下,自动语音识别的错误主要源于数据不足而非语言本身的复杂性,并且通过引入针对性的音素词汇表可以显著提升识别效果。

源自 arXiv: 2604.18204