菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-22
📄 Abstract - InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars

Recent diffusion-based models have enabled realistic audio-driven avatar generation in real-time streaming. However, existing approaches struggle to maintain visual temporal consistency and fail to explicitly perceive user intent in complex interactive streaming scenarios. To address these challenges, we propose InteractiveAvatar, a real-time infinite-streaming video generation framework that supports visually consistent avatar video generation and intent-aware interactions. With autoregressive distillation, InteractiveAvatar achieves real-time str-eaming generation of human avatars over arbitrarily long durations. For visual consistency, we introduce a Long-Short Visual Memory (LSVM) mechanism that flexibly compresses historical visual information into compact tokens, preserving both short-range coherence and long-term consistency. To generate avatars with speeches and actions aligned with user intent, we propose a Reasoning-Reaction Module (RRM), which incorporates a State-Cycling strategy and a Cache-Switching mechanism. Extensive experimental results over diverse scenarios demonstrate that our method achieves state-of-the-art visual consistency in long-duration generation, while enabling complex user-avatar interaction in real time.

顶级标签: video generation multi-modal agents
详细标签: real-time streaming avatar generation visual consistency intent-aware diffusion model 或 搜索:

交互式虚拟人:面向实时流式视频生成的一致性与意图感知虚拟人 / InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars


1️⃣ 一句话总结

本文提出了一种名为InteractiveAvatar的实时流式视频生成框架,通过自回归蒸馏实现无限时长生成,并引入长-短视觉记忆机制来保持画面连续性和一致性,同时借助推理-反应模块让虚拟人能够理解用户意图并做出相应的语音和动作回应,从而在复杂交互场景中生成既稳定又智能的虚拟形象。

源自 arXiv: 2606.22905