BA-T:一种用于双目光束法平差的迭代式Transformer / BA-T: An Iterative Transformer for Two-View Bundle Adjustment
1️⃣ 一句话总结
本文提出了一种轻量级的迭代Transformer模型BA-T,通过模拟经典光束法平差中位姿与几何信息迭代传播的过程,在隐式特征空间内用单层结构实现高效的三维重建,显著提高了跨视图一致性并大幅减少了模型参数。
Feed-forward models for 3D reconstruction have achieved strong performance using deep cross-view attention to exchange information across images. However, these approaches often depend on heavy decoder stacks and lack a structured mechanism for geometry refinement, resulting in poor multi-view consistency. We address this by drawing inspiration from classical bundle adjustment (BA), which can be viewed as an iterative information propagation process between poses and local geometry. Inspired by BA, we propose BA-T, an iterative Transformer that implements BA-style structured updates as a repeatable layer in implicit token space. Instead of relying on deep attention stacks, BA-T refines predictions based on latent residual by a single lightweight layer. Experiments demonstrate that BA-T progressively improves pose and reconstruction accuracy across iterations, achieves stronger cross-view consistency than conventional decoders, and matches or surpasses substantially larger models while using only 16% of their decoder parameters. BA-T provides a compact, efficient, and structural alternative to depth-heavy attention, enabling accurate 3D reconstruction within a lightweight architecture. The code will be made publicly at this https URL.
BA-T:一种用于双目光束法平差的迭代式Transformer / BA-T: An Iterative Transformer for Two-View Bundle Adjustment
本文提出了一种轻量级的迭代Transformer模型BA-T,通过模拟经典光束法平差中位姿与几何信息迭代传播的过程,在隐式特征空间内用单层结构实现高效的三维重建,显著提高了跨视图一致性并大幅减少了模型参数。
源自 arXiv: 2606.03287