菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-10
📄 Abstract - SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimation

Autonomous space operations such as on-orbit servicing and active debris removal demand robust part-level semantic understanding and precise relative navigation of target spacecraft, yet collecting large-scale real data in orbit remains impractical due to cost and access constraints. Existing synthetic datasets, moreover, suffer from limited target diversity, single-modality sensing, and incomplete ground-truth annotations. We present \textbf{SpaceSense-Bench}, a large-scale multi-modal benchmark for spacecraft perception encompassing 136~satellite models with approximately 70~GB of data. Each frame provides time-synchronized 1024$\times$1024 RGB images, millimeter-precision depth maps, and 256-beam LiDAR point clouds, together with dense 7-class part-level semantic labels at both the pixel and point level as well as accurate 6-DoF pose ground truth. The dataset is generated through a high-fidelity space simulation built in Unreal Engine~5 and a fully automated pipeline covering data acquisition, multi-stage quality control, and conversion to mainstream formats. We benchmark five representative tasks (object detection, 2D semantic segmentation, RGB--LiDAR fusion-based 3D point cloud segmentation, monocular depth estimation, and orientation estimation) and identify two key findings: (i)~perceiving small-scale components (\emph{e.g.}, thrusters and omni-antennas) and generalizing to entirely unseen spacecraft in a zero-shot setting remain critical bottlenecks for current methods, and (ii)~scaling up the number of training satellites yields substantial performance gains on novel targets, underscoring the value of large-scale, diverse datasets for space perception research. The dataset, code, and toolkit are publicly available at this https URL.

顶级标签: computer vision multi-modal benchmark
详细标签: spacecraft perception pose estimation semantic segmentation dataset simulation 或 搜索:

SpaceSense-Bench:一个用于航天器感知与姿态估计的大规模多模态基准数据集 / SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimation


1️⃣ 一句话总结

这篇论文提出了一个名为SpaceSense-Bench的大规模、多模态航天器感知基准数据集,它通过高保真模拟生成了包含多种传感器数据和详细标注的数据,用于评估和推动航天器视觉感知与姿态估计技术的发展,并发现当前方法在识别小部件和泛化到新航天器方面仍面临挑战。

源自 arXiv: 2603.09320