📄
Abstract - AnimeScore: A Preference-Based Dataset and Framework for Evaluating Anime-Like Speech Style
Evaluating 'anime-like' voices currently relies on costly subjective judgments, yet no standardized objective metric exists. A key challenge is that anime-likeness, unlike naturalness, lacks a shared absolute scale, making conventional Mean Opinion Score (MOS) protocols unreliable. To address this gap, we propose AnimeScore, a preference-based framework for automatic anime-likeness evaluation via pairwise ranking. We collect 15,000 pairwise judgments from 187 evaluators with free-form descriptions, and acoustic analysis reveals that perceived anime-likeness is driven by controlled resonance shaping, prosodic continuity, and deliberate articulation rather than simple heuristics such as high pitch. We show that handcrafted acoustic features reach a 69.3% AUC ceiling, while SSL-based ranking models achieve up to 90.8% AUC, providing a practical metric that can also serve as a reward signal for preference-based optimization of generative speech models.
AnimeScore:一个基于偏好的数据集与框架,用于评估动漫风格语音 /
AnimeScore: A Preference-Based Dataset and Framework for Evaluating Anime-Like Speech Style
1️⃣ 一句话总结
这篇论文提出了一个名为AnimeScore的自动化评估框架,通过收集大量语音偏好对比数据并训练模型,来客观衡量语音的‘动漫感’,解决了以往依赖主观打分且标准不一的问题,并发现动漫感主要源于共振峰控制、韵律连贯和刻意发音等声学特征。