菜单

🤖 系统
📄 Abstract - NaTex: Seamless Texture Generation as Latent Color Diffusion

We present NaTex, a native texture generation framework that predicts texture color directly in 3D space. In contrast to previous approaches that rely on baking 2D multi-view images synthesized by geometry-conditioned Multi-View Diffusion models (MVDs), NaTex avoids several inherent limitations of the MVD pipeline. These include difficulties in handling occluded regions that require inpainting, achieving precise mesh-texture alignment along boundaries, and maintaining cross-view consistency and coherence in both content and color intensity. NaTex features a novel paradigm that addresses the aforementioned issues by viewing texture as a dense color point cloud. Driven by this idea, we propose latent color diffusion, which comprises a geometry-awared color point cloud VAE and a multi-control diffusion transformer (DiT), entirely trained from scratch using 3D data, for texture reconstruction and generation. To enable precise alignment, we introduce native geometry control that conditions the DiT on direct 3D spatial information via positional embeddings and geometry latents. We co-design the VAE-DiT architecture, where the geometry latents are extracted via a dedicated geometry branch tightly coupled with the color VAE, providing fine-grained surface guidance that maintains strong correspondence with the texture. With these designs, NaTex demonstrates strong performance, significantly outperforming previous methods in texture coherence and alignment. Moreover, NaTex also exhibits strong generalization capabilities, either training-free or with simple tuning, for various downstream applications, e.g., material generation, texture refinement, and part segmentation and texturing.

顶级标签: computer vision model training aigc
详细标签: texture generation 3d generation diffusion models point cloud geometry-aware 或 搜索:

📄 论文总结

NaTex:作为潜在颜色扩散的无缝纹理生成 / NaTex: Seamless Texture Generation as Latent Color Diffusion


1️⃣ 一句话总结

这篇论文提出了一个名为NaTex的新方法,它直接在三维空间中生成纹理颜色,通过将纹理视为密集颜色点云并采用创新的潜在颜色扩散技术,有效解决了传统方法在遮挡区域处理、纹理与模型精确对齐以及多视图一致性方面的难题,显著提升了纹理生成的质量和适用范围。


📄 打开原文 PDF