基于上下文稀疏注意力的闪电式统一视频编辑 / Lightning Unified Video Editing via In-Context Sparse Attention
1️⃣ 一句话总结
该论文提出了一种名为“上下文稀疏注意力”的高效方法,通过智能筛选和分组视频编辑中的信息,大幅降低计算量,在保持编辑质量的同时将处理速度提升近60%,并基于此构建了一个轻量级但性能领先的统一视频编辑系统。
Video editing has evolved toward In-Context Learning (ICL) paradigms, yet the resulting quadratic attention costs create a critical computational bottleneck. In this work, we propose In-context Sparse Attention (ISA), the first near-lossless empirical sparse framework tailored for ICL video editing. Our design is grounded in two key insights: first, context tokens exhibit significantly lower saliency than source tokens; second, we theoretically prove and empirically validate that Query sharpness correlates with approximation error. Motivated by these findings, ISA implements an efficient pre-selection strategy to prune redundant context, followed by a dynamic query grouping mechanism that routes high-error queries to full attention and low-error ones to a computationally efficient 0-th order Taylor sparse attention. Furthermore, we build \textbf{\texttt{LIVEditor}} , a novel lightning video editing model via ISA and a proposed video-editing data pipeline that curated a 1.7M high-quality dataset. Extensive experiments demonstrate that LIVEditor achieves a $\sim$60% reduction in attention-module latency while surpassing state-of-the-art methods across EditVerseBench, IVE-Bench, and VIE-Bench, delivering near-lossless acceleration without compromising visual fidelity.
基于上下文稀疏注意力的闪电式统一视频编辑 / Lightning Unified Video Editing via In-Context Sparse Attention
该论文提出了一种名为“上下文稀疏注意力”的高效方法,通过智能筛选和分组视频编辑中的信息,大幅降低计算量,在保持编辑质量的同时将处理速度提升近60%,并基于此构建了一个轻量级但性能领先的统一视频编辑系统。
源自 arXiv: 2605.04569