DiffBMP:基于位图图元的可微分渲染 / DiffBMP: Differentiable Rendering with Bitmap Primitives
1️⃣ 一句话总结
这篇论文提出了一个名为DiffBMP的高效可微分渲染引擎,它能够直接对数千个位图图像(而非仅限于矢量图)的位置、颜色等属性进行快速优化,并集成了多种技术来提升优化效果,旨在无缝融入创意设计工作流程。
We introduce DiffBMP, a scalable and efficient differentiable rendering engine for a collection of bitmap images. Our work addresses a limitation that traditional differentiable renderers are constrained to vector graphics, given that most images in the world are bitmaps. Our core contribution is a highly parallelized rendering pipeline, featuring a custom CUDA implementation for calculating gradients. This system can, for example, optimize the position, rotation, scale, color, and opacity of thousands of bitmap primitives all in under 1 min using a consumer GPU. We employ and validate several techniques to facilitate the optimization: soft rasterization via Gaussian blur, structure-aware initialization, noisy canvas, and specialized losses/heuristics for videos or spatially constrained images. We demonstrate DiffBMP is not just an isolated tool, but a practical one designed to integrate into creative workflows. It supports exporting compositions to a native, layered file format, and the entire framework is publicly accessible via an easy-to-hack Python package.
DiffBMP:基于位图图元的可微分渲染 / DiffBMP: Differentiable Rendering with Bitmap Primitives
这篇论文提出了一个名为DiffBMP的高效可微分渲染引擎,它能够直接对数千个位图图像(而非仅限于矢量图)的位置、颜色等属性进行快速优化,并集成了多种技术来提升优化效果,旨在无缝融入创意设计工作流程。
源自 arXiv: 2602.22625