视觉同步:通过跨视角物体运动实现多相机同步 / Visual Sync: Multi-Camera Synchronization via Cross-View Object Motion
1️⃣ 一句话总结
这篇论文提出了一种名为VisualSync的优化框架,它利用不同视角下物体运动的几何约束,能够自动、高精度地同步来自多个普通相机的未标定、未同步的视频,无需昂贵硬件或人工干预。
Today, people can easily record memorable moments, ranging from concerts, sports events, lectures, family gatherings, and birthday parties with multiple consumer cameras. However, synchronizing these cross-camera streams remains challenging. Existing methods assume controlled settings, specific targets, manual correction, or costly hardware. We present VisualSync, an optimization framework based on multi-view dynamics that aligns unposed, unsynchronized videos at millisecond accuracy. Our key insight is that any moving 3D point, when co-visible in two cameras, obeys epipolar constraints once properly synchronized. To exploit this, VisualSync leverages off-the-shelf 3D reconstruction, feature matching, and dense tracking to extract tracklets, relative poses, and cross-view correspondences. It then jointly minimizes the epipolar error to estimate each camera's time offset. Experiments on four diverse, challenging datasets show that VisualSync outperforms baseline methods, achieving an median synchronization error below 50 ms.
视觉同步:通过跨视角物体运动实现多相机同步 / Visual Sync: Multi-Camera Synchronization via Cross-View Object Motion
这篇论文提出了一种名为VisualSync的优化框架,它利用不同视角下物体运动的几何约束,能够自动、高精度地同步来自多个普通相机的未标定、未同步的视频,无需昂贵硬件或人工干预。