基于扩散模型的压缩视频增强方法 / DiffCVE: Diffusion-based Compressed Video Enhancement
1️⃣ 一句话总结
本文提出了一种名为DiffCVE的视频增强方法,利用扩散模型来修复严重压缩造成的视频质量损失,通过引入编码先验信息(如残差和运动矢量)和压缩程度感知的文本提示,在保持视频结构一致性的同时显著提升压缩视频的视觉体验。
Perceptual quality enhancement of severely compressed videos remains challenging due to complex artifact patterns and substantial information loss. Recent diffusion models have demonstrated strong generative capability for visual restoration, but directly applying them to compressed video often ignores compression degradation characteristics and may introduce structure-inconsistent hallucinations. To address this issue, this paper presents a diffusion-based compressed video enhancement method, named DiffCVE. Coding Prior-enhanced Dual Conditioning (CPDC) branches are designed to jointly model compressed video and coding prior conditions, where coding priors including residuals and motion vectors provide complementary structural and motion guidance during the diffusion denoising process. To make the diffusion process aware of compression severity, a Compression Degradation Semantic Prompting (CDSP) mechanism is introduced to leverage QP-conditioned textual prompts together with LoRA fine-tuning. In addition, a Coding Prior-guided Weighted Fusion (CPWF) module is incorporated into the VAE decoder to fuse VAE encoder and coding prior encoder features with QP-predicted weights. Extensive experiments demonstrate the effectiveness of the proposed method in improving perceptual quality, especially under severe compression settings. The project page with enhanced video demonstrations is available at this https URL.
基于扩散模型的压缩视频增强方法 / DiffCVE: Diffusion-based Compressed Video Enhancement
本文提出了一种名为DiffCVE的视频增强方法,利用扩散模型来修复严重压缩造成的视频质量损失,通过引入编码先验信息(如残差和运动矢量)和压缩程度感知的文本提示,在保持视频结构一致性的同时显著提升压缩视频的视觉体验。
源自 arXiv: 2607.07195