InCaRPose:一种用于舱内相对相机位姿估计的模型与数据集 / InCaRPose: In-Cabin Relative Camera Pose Estimation Model and Dataset
1️⃣ 一句话总结
这篇论文提出了一个名为InCaRPose的Transformer模型,它能够仅使用合成数据训练,就能在汽车舱内等复杂扭曲环境中,快速、准确地估计出两个摄像头之间的相对位置和朝向,并发布了一个真实世界的测试数据集。
Camera extrinsic calibration is a fundamental task in computer vision. However, precise relative pose estimation in constrained, highly distorted environments, such as in-cabin automotive monitoring (ICAM), remains challenging. We present InCaRPose, a Transformer-based architecture designed for robust relative pose prediction between image pairs, which can be used for camera extrinsic calibration. By leveraging frozen backbone features such as DINOv3 and a Transformer-based decoder, our model effectively captures the geometric relationship between a reference and a target view. Unlike traditional methods, our approach achieves absolute metric-scale translation within the physically plausible adjustment range of in-cabin camera mounts in a single inference step, which is critical for ICAM, where accurate real-world distances are required for safety-relevant perception. We specifically address the challenges of highly distorted fisheye cameras in automotive interiors by training exclusively on synthetic data. Our model is capable of generalization to real-world cabin environments without relying on the exact same camera intrinsics and additionally achieves competitive performance on the public 7-Scenes dataset. Despite having limited training data, InCaRPose maintains high precision in both rotation and translation, even with a ViT-Small backbone. This enables real-time performance for time-critical inference, such as driver monitoring in supervised autonomous driving. We release our real-world In-Cabin-Pose test dataset consisting of highly distorted vehicle-interior images and our code at this https URL.
InCaRPose:一种用于舱内相对相机位姿估计的模型与数据集 / InCaRPose: In-Cabin Relative Camera Pose Estimation Model and Dataset
这篇论文提出了一个名为InCaRPose的Transformer模型,它能够仅使用合成数据训练,就能在汽车舱内等复杂扭曲环境中,快速、准确地估计出两个摄像头之间的相对位置和朝向,并发布了一个真实世界的测试数据集。
源自 arXiv: 2604.03814