Interact3D:交互式物体的组合式3D生成 / Interact3D: Compositional 3D Generation of Interactive Objects
1️⃣ 一句话总结
这篇论文提出了一个名为Interact3D的新框架,它能够从单张图片生成多个物理上合理、互不穿透且保持正确空间关系的3D物体组合,并通过一个结合了智能体反馈的闭环流程来自动优化和修正生成结果。
Recent breakthroughs in 3D generation have enabled the synthesis of high-fidelity individual assets. However, generating 3D compositional objects from single images--particularly under occlusions--remains challenging. Existing methods often degrade geometric details in hidden regions and fail to preserve the underlying object-object spatial relationships (OOR). We present a novel framework Interact3D designed to generate physically plausible interacting 3D compositional objects. Our approach first leverages advanced generative priors to curate high-quality individual assets with a unified 3D guidance scene. To physically compose these assets, we then introduce a robust two-stage composition pipeline. Based on the 3D guidance scene, the primary object is anchored through precise global-to-local geometric alignment (registration), while subsequent geometries are integrated using a differentiable Signed Distance Field (SDF)-based optimization that explicitly penalizes geometry intersections. To reduce challenging collisions, we further deploy a closed-loop, agentic refinement strategy. A Vision-Language Model (VLM) autonomously analyzes multi-view renderings of the composed scene, formulates targeted corrective prompts, and guides an image editing module to iteratively self-correct the generation pipeline. Extensive experiments demonstrate that Interact3D successfully produces promising collsion-aware compositions with improved geometric fidelity and consistent spatial relationships.
Interact3D:交互式物体的组合式3D生成 / Interact3D: Compositional 3D Generation of Interactive Objects
这篇论文提出了一个名为Interact3D的新框架,它能够从单张图片生成多个物理上合理、互不穿透且保持正确空间关系的3D物体组合,并通过一个结合了智能体反馈的闭环流程来自动优化和修正生成结果。
源自 arXiv: 2603.16085