菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-06
📄 Abstract - ReCal3R: Reliability-Calibrated Learning Rates for Streaming 3D Reconstruction

Streaming 3D reconstruction relies on a compact recurrent scene state to process long image streams in linear time and bounded memory. However, repeated updates can gradually corrupt this state, causing reliable historical information to be overwritten by noisy or ambiguous observations. We introduce ReCal3R, a reliability-calibrated learning rate method for recurrent 3D reconstruction. Instead of directly applying a candidate learning rate, our method estimates state token reliability from the maintained scene state and uses it to calibrate a candidate learning rate derived from token alignment, state reconstruction residual, and recent update pressure. The resulting token-wise learning rate interpolates between a conservative base rate and the candidate rate, suppressing aggressive updates on unreliable tokens while preserving adaptation to informative frames. Applied to CUT3R as a training-free calibration rule, ReCal3R reaches strong performance on long sequences in pose, depth, and reconstruction quality, including a 3.7$\times$ reduction in ATE, with comparable runtime and memory. Code is available at: this https URL.

顶级标签: computer vision 3d reconstruction machine learning
详细标签: streaming 3d reconstruction learning rate calibration recurrent scene state token reliability pose estimation 或 搜索:

ReCal3R:面向流式三维重建的可靠性校准学习率方法 / ReCal3R: Reliability-Calibrated Learning Rates for Streaming 3D Reconstruction


1️⃣ 一句话总结

本文提出一种无需额外训练的校准方法,通过实时评估每个场景状态单元的可靠性来动态调整学习率,从而在流式三维重建中避免历史信息被噪声观测污染,显著提升长序列处理的位姿和深度重建精度。

源自 arXiv: 2607.05356