菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-09
📄 Abstract - OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators

We propose OPSD-V, an on-policy self-distillation paradigm for post-training few-step autoregressive (AR) video diffusion models. Existing few-step AR video generators can produce long videos with low latency, but still suffer from error accumulation and weakened motion dynamics during long autoregressive rollout. OPSD-V reduces long-horizon degradation while preserving the original few-step inference path. The key idea is to introduce real long-video data as temporal context during training and use it to provide dense trajectory-level supervision. Specifically, the student follows the exact inference-time rollout, generating each chunk conditioned on its own previously generated KV cache. In parallel, the teacher is evaluated at the same student-visited denoising states, but uses a cleaner AR-consistent temporal cache in which older history can be replaced by real-video context. This provides dense denoising-level corrective targets under on-policy AR cache dynamics, without changing the sampler, number of denoising steps, or inference-time cache mechanism. We apply OPSD-V to representative few-step AR video models, including Self-Forcing and LongLive. Experiments show consistent improvements in visual quality, motion dynamics, and VBenchLong scores. A user study with 10 participants comparing 20 video pairs shows that OPSD-V is preferred over the base models in 66.0% of overall-preference judgments (82.5% excluding ties).

顶级标签: video generation model training
详细标签: few-step diffusion self-distillation autoregressive video motion dynamics long video generation 或 搜索:

OPSD-V:用于训练后少步自回归视频生成器的在线策略自蒸馏方法 / OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators


1️⃣ 一句话总结

本文提出一种名为OPSD-V的训练后自蒸馏技术,通过在长视频生成过程中利用真实视频片段作为上下文,让模型在推理阶段自行纠正累积错误,从而在不增加计算成本的条件下显著提升少步自回归视频生成器的视觉质量和动作连贯性。

源自 arXiv: 2607.08766