📄
Abstract - 3D-Fixer: Coarse-to-Fine In-place Completion for 3D Scenes from a Single Image
Compositional 3D scene generation from a single view requires the simultaneous recovery of scene layout and 3D assets. Existing approaches mainly fall into two categories: feed-forward generation methods and per-instance generation methods. The former directly predict 3D assets with explicit 6DoF poses through efficient network inference, but they generalize poorly to complex scenes. The latter improve generalization through a divide-and-conquer strategy, but suffer from time-consuming pose optimization. To bridge this gap, we introduce 3D-Fixer, a novel in-place completion paradigm. Specifically, 3D-Fixer extends 3D object generative priors to generate complete 3D assets conditioned on the partially visible point cloud at the original locations, which are cropped from the fragmented geometry obtained from the geometry estimation methods. Unlike prior works that require explicit pose alignment, 3D-Fixer uses fragmented geometry as a spatial anchor to preserve layout fidelity. At its core, we propose a coarse-to-fine generation scheme to resolve boundary ambiguity under occlusion, supported by a dual-branch conditioning network and an Occlusion-Robust Feature Alignment (ORFA) strategy for stable training. Furthermore, to address the data scarcity bottleneck, we present ARSG-110K, the largest scene-level dataset to date, comprising over 110K diverse scenes and 3M annotated images with high-fidelity 3D ground truth. Extensive experiments show that 3D-Fixer achieves state-of-the-art geometric accuracy, which significantly outperforms baselines such as MIDI and Gen3DSR, while maintaining the efficiency of the diffusion process. Code and data will be publicly available at this https URL.
3D-Fixer:基于单张图像的3D场景从粗到精原位补全方法 /
3D-Fixer: Coarse-to-Fine In-place Completion for 3D Scenes from a Single Image
1️⃣ 一句话总结
这篇论文提出了一种名为3D-Fixer的新方法,它能够仅凭一张图片,就快速且高质量地生成完整的3D场景模型,其核心创新在于利用图片中已可见的物体碎片作为空间锚点,通过从粗到精的生成策略来补全被遮挡的部分,从而在保证生成速度的同时,大幅提升了复杂场景的构建精度。