菜单

关于 🐙 GitHub
arXiv 提交日期: 2025-12-15
📄 Abstract - KlingAvatar 2.0 Technical Report

Avatar video generation models have achieved remarkable progress in recent years. However, prior work exhibits limited efficiency in generating long-duration high-resolution videos, suffering from temporal drifting, quality degradation, and weak prompt following as video length increases. To address these challenges, we propose KlingAvatar 2.0, a spatio-temporal cascade framework that performs upscaling in both spatial resolution and temporal dimension. The framework first generates low-resolution blueprint video keyframes that capture global semantics and motion, and then refines them into high-resolution, temporally coherent sub-clips using a first-last frame strategy, while retaining smooth temporal transitions in long-form videos. To enhance cross-modal instruction fusion and alignment in extended videos, we introduce a Co-Reasoning Director composed of three modality-specific large language model (LLM) experts. These experts reason about modality priorities and infer underlying user intent, converting inputs into detailed storylines through multi-turn dialogue. A Negative Director further refines negative prompts to improve instruction alignment. Building on these components, we extend the framework to support ID-specific multi-character control. Extensive experiments demonstrate that our model effectively addresses the challenges of efficient, multimodally aligned long-form high-resolution video generation, delivering enhanced visual clarity, realistic lip-teeth rendering with accurate lip synchronization, strong identity preservation, and coherent multimodal instruction following.

顶级标签: video generation multi-modal aigc
详细标签: avatar video generation long-form video spatio-temporal cascade multimodal alignment identity preservation 或 搜索:

KlingAvatar 2.0 技术报告 / KlingAvatar 2.0 Technical Report


1️⃣ 一句话总结

这篇论文提出了一个名为KlingAvatar 2.0的新框架,它通过一个时空级联结构和一套智能导演模块,高效地生成了长时长、高分辨率、身份一致且能精准遵循多模态指令的虚拟人视频,解决了现有方法在长视频生成中常见的质量下降、时间漂移和指令跟随弱的问题。


源自 arXiv: 2512.13313