菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-22
📄 Abstract - EmoTaG: Emotion-Aware Talking Head Synthesis on Gaussian Splatting with Few-Shot Personalization

Audio-driven 3D talking head synthesis has advanced rapidly with Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). By leveraging rich pre-trained priors, few-shot methods enable instant personalization from just a few seconds of video. However, under expressive facial motion, existing few-shot approaches often suffer from geometric instability and audio-emotion mismatch, highlighting the need for more effective emotion-aware motion modeling. In this work, we present EmoTaG, a few-shot emotion-aware 3D talking head synthesis framework built on the Pretrain-and-Adapt paradigm. Our key insight is to reformulate motion prediction in a structured FLAME parameter space rather than directly deforming 3D Gaussians, thereby introducing explicit geometric priors that improve motion stability. Building upon this, we propose a Gated Residual Motion Network (GRMN), which captures emotional prosody from audio while supplementing head pose and upper-face cues absent from audio, enabling expressive and coherent motion generation. Extensive experiments demonstrate that EmoTaG achieves state-of-the-art performance in emotional expressiveness, lip synchronization, visual realism, and motion stability.

顶级标签: computer vision multi-modal aigc
详细标签: talking head synthesis 3d gaussian splatting emotion-aware generation few-shot personalization audio-driven animation 或 搜索:

EmoTaG:基于高斯泼溅的少样本个性化情感感知说话头合成 / EmoTaG: Emotion-Aware Talking Head Synthesis on Gaussian Splatting with Few-Shot Personalization


1️⃣ 一句话总结

这篇论文提出了一个名为EmoTaG的新方法,它能够仅用几秒钟的视频就生成一个表情生动、口型同步且动作稳定的3D虚拟说话头像,其核心是通过结构化的人脸模型参数和创新的门控网络来精准控制情感和动作,解决了现有技术中表情与语音不匹配、动作不稳定的问题。

源自 arXiv: 2603.21332