SegviGen:将3D生成模型重新用于部件分割 / SegviGen: Repurposing 3D Generative Model for Part Segmentation
1️⃣ 一句话总结
这篇论文提出了一个名为SegviGen的新框架,它巧妙地利用预训练好的3D生成模型内部的结构化知识,通过给3D物体不同部件着色来实现高效、精确的部件分割,仅需极少量的标注数据就能超越现有方法的性能。
We introduce SegviGen, a framework that repurposes native 3D generative models for 3D part segmentation. Existing pipelines either lift strong 2D priors into 3D via distillation or multi-view mask aggregation, often suffering from cross-view inconsistency and blurred boundaries, or explore native 3D discriminative segmentation, which typically requires large-scale annotated 3D data and substantial training resources. In contrast, SegviGen leverages the structured priors encoded in pretrained 3D generative model to induce segmentation through distinctive part colorization, establishing a novel and efficient framework for part segmentation. Specifically, SegviGen encodes a 3D asset and predicts part-indicative colors on active voxels of a geometry-aligned reconstruction. It supports interactive part segmentation, full segmentation, and full segmentation with 2D guidance in a unified framework. Extensive experiments show that SegviGen improves over the prior state of the art by 40% on interactive part segmentation and by 15% on full segmentation, while using only 0.32% of the labeled training data. It demonstrates that pretrained 3D generative priors transfer effectively to 3D part segmentation, enabling strong performance with limited supervision. See our project page at this https URL.
SegviGen:将3D生成模型重新用于部件分割 / SegviGen: Repurposing 3D Generative Model for Part Segmentation
这篇论文提出了一个名为SegviGen的新框架,它巧妙地利用预训练好的3D生成模型内部的结构化知识,通过给3D物体不同部件着色来实现高效、精确的部件分割,仅需极少量的标注数据就能超越现有方法的性能。
源自 arXiv: 2603.16869