菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-10
📄 Abstract - $M^2$-Occ: Resilient 3D Semantic Occupancy Prediction for Autonomous Driving with Incomplete Camera Inputs

Semantic occupancy prediction enables dense 3D geometric and semantic understanding for autonomous driving. However, existing camera-based approaches implicitly assume complete surround-view observations, an assumption that rarely holds in real-world deployment due to occlusion, hardware malfunction, or communication failures. We study semantic occupancy prediction under incomplete multi-camera inputs and introduce $M^2$-Occ, a framework designed to preserve geometric structure and semantic coherence when views are missing. $M^2$-Occ addresses two complementary challenges. First, a Multi-view Masked Reconstruction (MMR) module leverages the spatial overlap among neighboring cameras to recover missing-view representations directly in the feature space. Second, a Feature Memory Module (FMM) introduces a learnable memory bank that stores class-level semantic prototypes. By retrieving and integrating these global priors, the FMM refines ambiguous voxel features, ensuring semantic consistency even when observational evidence is incomplete. We introduce a systematic missing-view evaluation protocol on the nuScenes-based SurroundOcc benchmark, encompassing both deterministic single-view failures and stochastic multi-view dropout scenarios. Under the safety-critical missing back-view setting, $M^2$-Occ improves the IoU by 4.93%. As the number of missing cameras increases, the robustness gap further widens; for instance, under the setting with five missing views, our method boosts the IoU by 5.01%. These gains are achieved without compromising full-view performance. The source code will be publicly released at this https URL.

顶级标签: computer vision autonomous driving multi-modal
详细标签: 3d semantic occupancy missing view reconstruction multi-camera perception robustness feature memory 或 搜索:

M²-Occ:面向自动驾驶的、对不完整相机输入具有鲁棒性的3D语义占据栅格预测 / $M^2$-Occ: Resilient 3D Semantic Occupancy Prediction for Autonomous Driving with Incomplete Camera Inputs


1️⃣ 一句话总结

这篇论文提出了一个名为M²-Occ的新方法,它能让自动驾驶汽车在部分摄像头失效或被遮挡时,依然能稳定、准确地预测周围环境的3D结构和物体类别,从而提升了系统的安全性和鲁棒性。

源自 arXiv: 2603.09737