菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-24
📄 Abstract - DA-Flow: Degradation-Aware Optical Flow Estimation with Diffusion Models

Optical flow models trained on high-quality data often degrade severely when confronted with real-world corruptions such as blur, noise, and compression artifacts. To overcome this limitation, we formulate Degradation-Aware Optical Flow, a new task targeting accurate dense correspondence estimation from real-world corrupted videos. Our key insight is that the intermediate representations of image restoration diffusion models are inherently corruption-aware but lack temporal awareness. To address this limitation, we lift the model to attend across adjacent frames via full spatio-temporal attention, and empirically demonstrate that the resulting features exhibit zero-shot correspondence capabilities. Based on this finding, we present DA-Flow, a hybrid architecture that fuses these diffusion features with convolutional features within an iterative refinement framework. DA-Flow substantially outperforms existing optical flow methods under severe degradation across multiple benchmarks.

顶级标签: computer vision model training machine learning
详细标签: optical flow diffusion models video degradation corruption robustness feature fusion 或 搜索:

DA-Flow:基于扩散模型的退化感知光流估计 / DA-Flow: Degradation-Aware Optical Flow Estimation with Diffusion Models


1️⃣ 一句话总结

这篇论文提出了一种名为DA-Flow的新方法,它通过结合扩散模型对图像退化的感知能力和卷积网络的时间信息处理能力,有效提升了光流估计模型在处理模糊、噪声等真实世界退化视频时的准确性。

源自 arXiv: 2603.23499