基于扩散框架的逼真且高效景深虚化渲染 / Towards Photorealistic and Efficient Bokeh Rendering via Diffusion Framework
1️⃣ 一句话总结
本文提出一种名为MagicBokeh的统一扩散模型框架,能同时完成图像超分辨率和景深虚化效果生成,解决了手机小光圈在低分辨率、高倍变焦照片上难以产生自然虚化效果的问题,且比传统两步法更高效、更逼真。
Existing mobile devices are constrained by compact optical designs, such as small apertures, which make it difficult to produce natural, optically realistic bokeh effects. Although recent learning-based methods have shown promising results, they still struggle with photos captured under high digital zoom levels, which often suffer from reduced resolution and loss of fine details. A naive solution is to enhance image quality before applying bokeh rendering, yet this two-stage pipeline reduces efficiency and introduces unnecessary error accumulation. To overcome these limitations, we propose MagicBokeh, a unified diffusion-based framework designed for high-quality and efficient bokeh rendering. Through an alternative training strategy and a focus-aware masked attention mechanism, our method jointly optimizes bokeh rendering and super-resolution, substantially improving both controllability and visual fidelity. Furthermore, we introduce degradation-aware depth module to enable more accurate depth estimation from low-quality inputs. Experimental results demonstrate that MagicBokeh efficiently produces photorealistic bokeh effects, particularly on real-world low-resolution images, paving the way for future advancements in bokeh rendering. Our code and models are available at this https URL.
基于扩散框架的逼真且高效景深虚化渲染 / Towards Photorealistic and Efficient Bokeh Rendering via Diffusion Framework
本文提出一种名为MagicBokeh的统一扩散模型框架,能同时完成图像超分辨率和景深虚化效果生成,解决了手机小光圈在低分辨率、高倍变焦照片上难以产生自然虚化效果的问题,且比传统两步法更高效、更逼真。
源自 arXiv: 2605.07429