Muses:无需训练即可设计、组合并生成不存在的幻想3D生物 / Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training
1️⃣ 一句话总结
这篇论文提出了一种名为Muses的新方法,它无需额外训练,就能通过构建并利用3D骨架来智能组合不同物体的部件,从而直接生成外观和谐、符合文字描述的幻想3D生物。
We present Muses, the first training-free method for fantastic 3D creature generation in a feed-forward paradigm. Previous methods, which rely on part-aware optimization, manual assembly, or 2D image generation, often produce unrealistic or incoherent 3D assets due to the challenges of intricate part-level manipulation and limited out-of-domain generation. In contrast, Muses leverages the 3D skeleton, a fundamental representation of biological forms, to explicitly and rationally compose diverse elements. This skeletal foundation formalizes 3D content creation as a structure-aware pipeline of design, composition, and generation. Muses begins by constructing a creatively composed 3D skeleton with coherent layout and scale through graph-constrained reasoning. This skeleton then guides a voxel-based assembly process within a structured latent space, integrating regions from different objects. Finally, image-guided appearance modeling under skeletal conditions is applied to generate a style-consistent and harmonious texture for the assembled shape. Extensive experiments establish Muses' state-of-the-art performance in terms of visual fidelity and alignment with textual descriptions, and potential on flexible 3D object editing. Project page: this https URL.
Muses:无需训练即可设计、组合并生成不存在的幻想3D生物 / Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training
这篇论文提出了一种名为Muses的新方法,它无需额外训练,就能通过构建并利用3D骨架来智能组合不同物体的部件,从而直接生成外观和谐、符合文字描述的幻想3D生物。
源自 arXiv: 2601.03256