分数识别鲍勃的声音:说话人模仿攻击 / Scores Know Bobs Voice: Speaker Impersonation Attack
1️⃣ 一句话总结
这篇论文提出了一种基于特征对齐反演的新型生成式攻击框架,通过将语音合成模型的潜在空间与说话人识别系统的判别特征空间对齐,显著提高了针对说话人识别系统的分数模仿攻击的查询效率,仅用少量查询就能实现高成功率。
Advances in deep learning have enabled the widespread deployment of speaker recognition systems (SRSs), yet they remain vulnerable to score-based impersonation attacks. Existing attacks that operate directly on raw waveforms require a large number of queries due to the difficulty of optimizing in high-dimensional audio spaces. Latent-space optimization within generative models offers improved efficiency, but these latent spaces are shaped by data distribution matching and do not inherently capture speaker-discriminative geometry. As a result, optimization trajectories often fail to align with the adversarial direction needed to maximize victim scores. To address this limitation, we propose an inversion-based generative attack framework that explicitly aligns the latent space of the synthesis model with the discriminative feature space of SRSs. We first analyze the requirements of an inverse model for score-based attacks and introduce a feature-aligned inversion strategy that geometrically synchronizes latent representations with speaker embeddings. This alignment ensures that latent updates directly translate into score improvements. Moreover, it enables new attack paradigms, including subspace-projection-based attacks, which were previously infeasible due to the absence of a faithful feature-to-audio mapping. Experiments show that our method significantly improves query efficiency, achieving competitive attack success rates with on average 10x fewer queries than prior approaches. In particular, the enabled subspace-projection-based attack attains up to 91.65% success using only 50 queries. These findings establish feature-aligned inversion as a key tool for evaluating the robustness of modern SRSs against score-based impersonation threats.
分数识别鲍勃的声音:说话人模仿攻击 / Scores Know Bobs Voice: Speaker Impersonation Attack
这篇论文提出了一种基于特征对齐反演的新型生成式攻击框架,通过将语音合成模型的潜在空间与说话人识别系统的判别特征空间对齐,显著提高了针对说话人识别系统的分数模仿攻击的查询效率,仅用少量查询就能实现高成功率。
源自 arXiv: 2603.02781