菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-01-24
📄 Abstract - SkyReels-V3 Technique Report

Video generation serves as a cornerstone for building world models, where multimodal contextual inference stands as the defining test of capability. In this end, we present SkyReels-V3, a conditional video generation model, built upon a unified multimodal in-context learning framework with diffusion Transformers. SkyReels-V3 model supports three core generative paradigms within a single architecture: reference images-to-video synthesis, video-to-video extension and audio-guided video generation. (i) reference images-to-video model is designed to produce high-fidelity videos with strong subject identity preservation, temporal coherence, and narrative consistency. To enhance reference adherence and compositional stability, we design a comprehensive data processing pipeline that leverages cross frame pairing, image editing, and semantic rewriting, effectively mitigating copy paste artifacts. During training, an image video hybrid strategy combined with multi-resolution joint optimization is employed to improve generalization and robustness across diverse scenarios. (ii) video extension model integrates spatio-temporal consistency modeling with large-scale video understanding, enabling both seamless single-shot continuation and intelligent multi-shot switching with professional cinematographic patterns. (iii) Talking avatar model supports minute-level audio-conditioned video generation by training first-and-last frame insertion patterns and reconstructing key-frame inference paradigms. On the basis of ensuring visual quality, synchronization of audio and videos has been optimized. Extensive evaluations demonstrate that SkyReels-V3 achieves state-of-the-art or near state-of-the-art performance on key metrics including visual quality, instruction following, and specific aspect metrics, approaching leading closed-source systems. Github: this https URL.

顶级标签: video generation multi-modal model training
详细标签: diffusion transformers in-context learning talking avatar video-to-video image-to-video 或 搜索:

SkyReels-V3 技术报告 / SkyReels-V3 Technique Report


1️⃣ 一句话总结

这篇论文介绍了SkyReels-V3视频生成模型,它在一个统一的架构内实现了三种核心功能:根据参考图片生成连贯视频、无缝延长现有视频以及根据音频生成口型同步的虚拟人像视频,其综合性能接近顶尖的闭源系统。

源自 arXiv: 2601.17323