SIMART:通过多模态大语言模型将整体网格分解为仿真就绪的关节化资产 / SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM
1️⃣ 一句话总结
这篇论文提出了一个名为SIMART的统一框架,它利用稀疏三维表示和多模态大语言模型,能够一次性将单个三维模型自动分解成多个部件并预测其运动方式,从而高效生成可直接用于物理仿真的交互式物体。
High-quality articulated 3D assets are indispensable for embodied AI and physical simulation, yet 3D generation still focuses on static meshes, leaving a gap in "sim-ready" interactive objects. Most recent articulated object creation methods rely on multi-stage pipelines that accumulate errors across decoupled modules. Alternatively, unified MLLMs offer a single-stage path to joint static asset understanding and sim-ready asset generation. However dense voxel-based 3D tokenization yields long 3D token sequences and high memory overhead, limiting scalability to complex articulated objects. To address this, we propose SIMART, a unified MLLM framework that jointly performs part-level decomposition and kinematic prediction. By introducing a Sparse 3D VQ-VAE, SIMART reduces token counts by 70% vs. dense voxel tokens, enabling high-fidelity multi-part assemblies. SIMART achieves state-of-the-art performance on PartNet-Mobility and in-the-wild AIGC datasets, and enables physics-based robotic simulation.
SIMART:通过多模态大语言模型将整体网格分解为仿真就绪的关节化资产 / SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM
这篇论文提出了一个名为SIMART的统一框架,它利用稀疏三维表示和多模态大语言模型,能够一次性将单个三维模型自动分解成多个部件并预测其运动方式,从而高效生成可直接用于物理仿真的交互式物体。
源自 arXiv: 2603.23386