PIXLRelight:通过内在条件实现可控重光照 / PIXLRelight: Controllable Relighting via Intrinsic Conditioning
1️⃣ 一句话总结
本文提出了一种名为PIXLRelight的快速算法,能够根据用户指定的物理光照条件,对单张照片进行真实感重光照,通过将物理渲染与神经网络巧妙结合,既实现了灵活的光照控制,又保留了照片的细节,且每张图片处理时间不到0.1秒。
We present PIXLRelight, a feed-forward approach for physically controllable single-image relighting. Existing methods either provide limited lighting control (e.g. through text or environment maps), accumulate errors when chaining inverse and forward rendering, or require costly per-image optimization. Our key idea is to bridge physically based rendering (PBR) and learned image synthesis through a shared intrinsic conditioning that can be obtained from either real photographs or PBR renders. At training time, paired multi-illumination photographs are decomposed into albedo, diffuse shading, and non-diffuse residuals, which condition the model. At inference time, the same conditioning is computed from a path-traced render of a coarse 3D reconstruction of the input under user-specified PBR lights. A transformer-based neural renderer then applies the target illumination to the source photograph, preserving fine image detail through a per-pixel affine modulation. PIXLRelight enables arbitrary PBR-style lighting control, achieves state-of-the-art relighting quality, and runs in under a tenth of a second per image. Code and models are available at this https URL.
PIXLRelight:通过内在条件实现可控重光照 / PIXLRelight: Controllable Relighting via Intrinsic Conditioning
本文提出了一种名为PIXLRelight的快速算法,能够根据用户指定的物理光照条件,对单张照片进行真实感重光照,通过将物理渲染与神经网络巧妙结合,既实现了灵活的光照控制,又保留了照片的细节,且每张图片处理时间不到0.1秒。
源自 arXiv: 2605.18735