CaricatureGS:利用高斯曲率夸张化3D高斯泼溅人脸 / CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvature
1️⃣ 一句话总结
这篇论文提出了一种能实时生成逼真且可控的3D人脸漫画的新方法,它通过结合表面曲率分析和先进的3D渲染技术,让用户能够自由调整夸张程度,并保持高质量的视觉效果。
A photorealistic and controllable 3D caricaturization framework for faces is introduced. We start with an intrinsic Gaussian curvature-based surface exaggeration technique, which, when coupled with texture, tends to produce over-smoothed renders. To address this, we resort to 3D Gaussian Splatting (3DGS), which has recently been shown to produce realistic free-viewpoint avatars. Given a multiview sequence, we extract a FLAME mesh, solve a curvature-weighted Poisson equation, and obtain its exaggerated form. However, directly deforming the Gaussians yields poor results, necessitating the synthesis of pseudo-ground-truth caricature images by warping each frame to its exaggerated 2D representation using local affine transformations. We then devise a training scheme that alternates real and synthesized supervision, enabling a single Gaussian collection to represent both natural and exaggerated avatars. This scheme improves fidelity, supports local edits, and allows continuous control over the intensity of the caricature. In order to achieve real-time deformations, an efficient interpolation between the original and exaggerated surfaces is introduced. We further analyze and show that it has a bounded deviation from closed-form solutions. In both quantitative and qualitative evaluations, our results outperform prior work, delivering photorealistic, geometry-controlled caricature avatars.
CaricatureGS:利用高斯曲率夸张化3D高斯泼溅人脸 / CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvature
这篇论文提出了一种能实时生成逼真且可控的3D人脸漫画的新方法,它通过结合表面曲率分析和先进的3D渲染技术,让用户能够自由调整夸张程度,并保持高质量的视觉效果。
源自 arXiv: 2601.03319