VividFace:面向仿人机器人的实时逼真面部表情模仿系统 / VividFace: Real-Time and Realistic Facial Expression Shadowing for Humanoid Robots
1️⃣ 一句话总结
这篇论文提出了一个名为VividFace的系统,它能让仿人机器人以极低的延迟(0.05秒内)实时、逼真地模仿人类的面部表情,从而显著提升机器人的拟人化表现和情感交互能力。
Humanoid facial expression shadowing enables robots to realistically imitate human facial expressions in real time, which is critical for lifelike, facially expressive humanoid robots and affective human-robot interaction. Existing progress in humanoid facial expression imitation remains limited, often failing to achieve either real-time performance or realistic expressiveness due to offline video-based inference designs and insufficient ability to capture and transfer subtle expression details. To address these limitations, we present VividFace, a real-time and realistic facial expression shadowing system for humanoid robots. An optimized imitation framework X2CNet++ enhances expressiveness by fine-tuning the human-to-humanoid facial motion transfer module and introducing a feature-adaptation training strategy for better alignment across different image sources. Real-time shadowing is further enabled by a video-stream-compatible inference pipeline and a streamlined workflow based on asynchronous I/O for efficient communication across devices. VividFace produces vivid humanoid faces by mimicking human facial expressions within 0.05 seconds, while generalizing across diverse facial configurations. Extensive real-world demonstrations validate its practical utility. Videos are available at: this https URL.
VividFace:面向仿人机器人的实时逼真面部表情模仿系统 / VividFace: Real-Time and Realistic Facial Expression Shadowing for Humanoid Robots
这篇论文提出了一个名为VividFace的系统,它能让仿人机器人以极低的延迟(0.05秒内)实时、逼真地模仿人类的面部表情,从而显著提升机器人的拟人化表现和情感交互能力。
源自 arXiv: 2602.07506