📄
Abstract - Benchmarking the Effects of Object Pose Estimation and Reconstruction on Robotic Grasping Success
3D reconstruction serves as the foundational layer for numerous robotic perception tasks, including 6D object pose estimation and grasp pose generation. Modern 3D reconstruction methods for objects can produce visually and geometrically impressive meshes from multi-view images, yet standard geometric evaluations do not reflect how reconstruction quality influences downstream tasks such as robotic manipulation performance. This paper addresses this gap by introducing a large-scale, physics-based benchmark that evaluates 6D pose estimators and 3D mesh models based on their functional efficacy in grasping. We analyze the impact of model fidelity by generating grasps on various reconstructed 3D meshes and executing them on the ground-truth model, simulating how grasp poses generated with an imperfect model affect interaction with the real object. This assesses the combined impact of pose error, grasp robustness, and geometric inaccuracies from 3D reconstruction. Our results show that reconstruction artifacts significantly decrease the number of grasp pose candidates but have a negligible effect on grasping performance given an accurately estimated pose. Our results also reveal that the relationship between grasp success and pose error is dominated by spatial error, and even a simple translation error provides insight into the success of the grasping pose of symmetric objects. This work provides insight into how perception systems relate to object manipulation using robots.
评估物体姿态估计与三维重建对机器人抓取成功率影响的基准研究 /
Benchmarking the Effects of Object Pose Estimation and Reconstruction on Robotic Grasping Success
1️⃣ 一句话总结
这篇论文通过建立一个大规模、基于物理的基准测试,发现虽然三维重建的几何误差会减少可用的抓取候选姿态,但只要物体姿态估计准确,它对实际机器人抓取成功率的影响微乎其微,并揭示了姿态误差中空间平移误差是影响抓取成功的关键因素。