菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-21
📄 Abstract - Generative Relightable Avatars

We present Generative Relightable Avatars (GRA), a person-specific method for photorealistic free-view rendering and environment-map relighting of full-body humans. We postulate that modeling fine-grained appearance details is inherently a one-to-many problem that can benefit from a generative formulation. In contrast to fully regressive relightable avatar methods, GRA follows a hybrid approach that combines controllable, physics-grounded relighting with probabilistic refinement. Starting from a tracked animated mesh, we optimize material parameters in UV-space and render a coarse relit appearance under a target HDR environment map. Next, we refine the textures with a feed-forward model to capture pose-dependent texture dynamics and illumination effects beyond simplified reflectance assumptions. Finally, a fine-tuned video-to-video diffusion model transforms the physically grounded renderings into temporally coherent, high-detail videos while preserving 3D control, with an error-recycling strategy for generating long videos. Experimental evaluations demonstrate our method's improved perceptual quality over prior relightable avatar baselines. Project Page: this https URL

顶级标签: machine learning computer vision video generation
详细标签: relightable avatars generative model human avatar diffusion model novel view synthesis 或 搜索:

生成式可重新光照的数字人 / Generative Relightable Avatars


1️⃣ 一句话总结

本文提出了一种结合物理光照与生成式模型的新方法,能够在任意视角和不同环境光照下生成高逼真度的全身数字人视频,尤其擅长处理复杂的服装纹理和动态细节,效果优于传统技术。

源自 arXiv: 2606.22718