菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-08
📄 Abstract - PUF: Plug-and-Play Uncertainty-Aware Fusion for Online 3D Scene Graph Generation

Online 3D scene graph generation builds a persistent, structured representation of a scene by incrementally fusing 2D observations into a global 3D graph. Existing online methods treat this fusion as a fully deterministic pipeline, where we identify three sources of uncertainty that are overlooked: observation, 2D model, and 3D representation. We propose PUF: a Plug-and-play, Uncertainty-aware, and training-free Fusion framework. Scene graph node association is reformulated as a probabilistic likelihood over semantic and spatial factors, replacing binary accept/reject gates. Dirichlet evidence accumulation distributes class and relationship evidence across plausible candidates proportional to association likelihood. An optional class-conditional prior completes edges for sparsely or never co-observed object pairs. We instantiate PUF with both a 3D Gaussian and a 3D voxel backend and observe consistent improvements, demonstrating its ability to generalize across different representations. Experiments on the 3DSSG and ReplicaSSG benchmarks show that our method substantially outperforms existing approaches while maintaining real-time latency. These results establish uncertainty-aware fusion as a principled and effective paradigm for online 3D scene understanding. The source code is publicly available at this https URL.

顶级标签: computer vision 3d scene understanding
详细标签: scene graph generation uncertainty fusion online reconstruction 3d representation 或 搜索:

PUF:用于在线三维场景图生成的即插即用不确定性感知融合方法 / PUF: Plug-and-Play Uncertainty-Aware Fusion for Online 3D Scene Graph Generation


1️⃣ 一句话总结

本文提出了一种名为PUF的轻量级融合框架,通过引入概率建模来量化并处理在线三维场景构建中来自观测、二维模型和三维表示的三种不确定性,无需重新训练即可显著提升场景图生成的准确性与鲁棒性,同时保持实时运行速度。

源自 arXiv: 2607.07170