人形机器人全景占据数据集:基于立体视觉的全身感知 / Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI
1️⃣ 一句话总结
本文提出了一个专为人形机器人设计的大规模全景立体视觉占据数据集,通过“真实到模拟再到真实”的闭环流程,在模拟环境中训练模型后直接用于真实场景,显著提升了复杂环境中的三维空间感知能力。
Occupancy prediction at voxel-level granularity is essential for safe robotic navigation and interaction in complex environments. Existing occupancy datasets, however, are predominantly designed for autonomous driving with vehicle-centric biases -- forward-facing cameras, far-field geometry, and static road priors -- limiting their applicability to embodied humanoid perception. We present Humanoid-OmniOcc, a large-scale panoramic stereo-based occupancy dataset tailored for humanoid robots. The dataset encompasses 15 diverse simulated indoor scenes and 5 real-world environments, yielding over 155K samples with broad scene and style diversity. Importantly, the dataset is designed around a Real2Sim2Real closed-loop paradigm: real sensor specifications drive physically accurate simulation, simulation produces large-scale annotated training data, and models trained in simulation are directly evaluated on real-world captures -- enabling iterative refinement of the sim-to-real pipeline. We further propose \textbf{H}umanoid \textbf{S}urround \textbf{S}tereo-guided \textbf{Occ}upancy model (Humanoid-OmniOcc) that exploits robust depth priors for accurate 2D-to-3D lifting. Extensive experiments show that Humanoid-OmniOcc consistently outperforms monocular baselines and generalizes well to both unseen simulated test scenes and real-world environments, validating the effectiveness of the Real2Sim2Real design. Code and data will be available upon acceptance at this https URL.
人形机器人全景占据数据集:基于立体视觉的全身感知 / Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI
本文提出了一个专为人形机器人设计的大规模全景立体视觉占据数据集,通过“真实到模拟再到真实”的闭环流程,在模拟环境中训练模型后直接用于真实场景,显著提升了复杂环境中的三维空间感知能力。
源自 arXiv: 2606.22971