菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-06
📄 Abstract - InFlux++: Real and Synthetic Data for Estimating Dynamic Camera Intrinsics

Camera intrinsics are vital for recovering 3D structure from 2D video. However, most 3D algorithms assume fixed intrinsics throughout a video, an assumption that often fails for real-world in-the-wild videos. Consequently, estimating per-frame intrinsics from RGB images is critical for making 3D methods robust to videos with dynamic intrinsics. InFlux previously advanced this research direction by establishing the first real-world benchmark with per-frame ground truth intrinsics for dynamic intrinsics videos. Nevertheless, existing methods remain inaccurate due to two obstacles: (i) training data is scarce and lacks intrinsics diversity; and (ii) benchmarks, including InFlux, have limited scene and camera motion diversity, making it difficult to properly evaluate methods. To address both gaps, we present InFlux++, consisting of two components. InFlux++ Synth is a large-scale procedurally generated synthetic video dataset with 441K+ annotated frames from 1841 high-resolution videos, providing accurate per-frame ground truth intrinsics for training dynamic intrinsics prediction models; a subset also includes per-frame pose, depth, and normals. The videos feature rich intrinsics diversity through changes in camera zoom and focus, as well as dynamic objects and realistic rendering effects such as lens distortion and defocus blur. InFlux++ Real is a large-scale real-world benchmark that extends InFlux with 514K+ newly captured frames across 334 high-resolution videos, spanning a wider range of scenes and camera motions. Finetuning existing intrinsics prediction methods on InFlux++ Synth consistently improves focal length estimation across both InFlux++ Real and InFlux, suggesting that synthetic supervision is promising for RGB-based intrinsics prediction. For the dataset, benchmark, code, videos, submission instructions, and live leaderboard, please visit this https URL .

顶级标签: computer vision data benchmark
详细标签: camera intrinsics dynamic intrinsics synthetic dataset real-world benchmark focal length estimation 或 搜索:

InFlux++:用于估计动态相机内参的真实与合成数据 / InFlux++: Real and Synthetic Data for Estimating Dynamic Camera Intrinsics


1️⃣ 一句话总结

本文通过构建大规模合成视频数据集(InFlux++ Synth)和更丰富的真实世界基准(InFlux++ Real),解决了动态相机内参估计中训练数据稀缺和评估场景单一的问题,实验表明合成数据能有效提升焦距估计的准确性。

源自 arXiv: 2607.05389