菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-24
📄 Abstract - Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesis

While large language model (LLM)-based text-to-speech (TTS) systems have achieved high-quality speech synthesis, most existing systems focus on English and Chinese. Japanese, however, remains under-explored, and its unique linguistic challenges, such as widespread context-dependent kanji polyphony, have yet to be adequately tackled. Here we introduce Sarashina2.2-TTS (this https URL), a Japanese-centric LLM-TTS system that tackles these challenges through a dual approach: data strategy and evaluation methodology. First, we scale training to approximately 361k hours of speech, incorporating a balanced mix of Japanese and English data. Furthermore, we design a targeted data augmentation pipeline covering all 2,136 Joyo (regular-use) kanji designated by Japan's Agency for Cultural Affairs to efficiently address kanji polyphony disambiguation. Second, we introduce the Joyo Kanji Yomi Benchmark (this https URL), covering all 2,136 Joyo kanji and their 4,378 readings. Alongside this benchmark, we propose Kana-CER, a metric that compares synthesized speech against reference readings in the kana space, eliminating orthographic variations to directly measure pronunciation correctness. Experiments demonstrate that our targeted data augmentation significantly improves reading accuracy. Overall, Sarashina2.2-TTS achieves state-of-the-art kanji-level reading accuracy and matches top baselines on general sentence-level pronunciation, while delivering the highest speaker similarity in zero-shot Japanese speech synthesis. Furthermore, cross-lingual evaluation reveals that Sarashina2.2-TTS is the only system that maintains stable Japanese pronunciation regardless of the prompt language, confirming that our balanced training approach improves cross-lingual robustness.

顶级标签: llm multi-modal audio
详细标签: text-to-speech japanese kanji polyphony data augmentation benchmark 或 搜索:

Sarashina2.2-TTS:通过数据扩展与针对性数据合成攻克日语语音生成中的汉字多音问题 / Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesis


1️⃣ 一句话总结

本文提出了一个面向日语的语音合成系统Sarashina2.2-TTS,通过大规模扩展训练数据(约361千小时)并设计针对全部2136个常用汉字的读音增强流程,有效解决了日语中汉字多音歧义问题,同时构建了新的评测基准与指标,在汉字读音准确率、零样本语音合成及跨语言鲁棒性上均达到最优水平。

源自 arXiv: 2606.25369