AlphaFlowTSE:基于条件AlphaFlow的一步式生成目标说话人提取 / AlphaFlowTSE: One-Step Generative Target Speaker Extraction via Conditional AlphaFlow
1️⃣ 一句话总结
这篇论文提出了一种名为AlphaFlowTSE的新方法,它能够仅用一步就从多人混合的语音中,根据一小段参考语音,准确、快速地分离出目标说话人的声音,同时提升了语音质量和在真实场景下的适用性。
In target speaker extraction (TSE), we aim to recover target speech from a multi-talker mixture using a short enrollment utterance as reference. Recent studies on diffusion and flow-matching generators have improved target-speech fidelity. However, multi-step sampling increases latency, and one-step solutions often rely on a mixture-dependent time coordinate that can be unreliable for real-world conversations. We present AlphaFlowTSE, a one-step conditional generative model trained with a Jacobian-vector product (JVP)-free AlphaFlow objective. AlphaFlowTSE learns mean-velocity transport along a mixture-to-target trajectory starting from the observed mixture, eliminating auxiliary mixing-ratio prediction, and stabilizes training by combining flow matching with an interval-consistency teacher-student target. Experiments on Libri2Mix and REAL-T confirm that AlphaFlowTSE improves target-speaker similarity and real-mixture generalization for downstream automatic speech recognition (ASR).
AlphaFlowTSE:基于条件AlphaFlow的一步式生成目标说话人提取 / AlphaFlowTSE: One-Step Generative Target Speaker Extraction via Conditional AlphaFlow
这篇论文提出了一种名为AlphaFlowTSE的新方法,它能够仅用一步就从多人混合的语音中,根据一小段参考语音,准确、快速地分离出目标说话人的声音,同时提升了语音质量和在真实场景下的适用性。
源自 arXiv: 2603.10701