📄
Abstract - FoundDP: Revisiting Weak Disparity Observability in Dual-Pixel Depth Estimation
Dual-pixel (DP) imaging enables metric depth estimation from a single camera using sub-aperture disparity. However, the extremely small effective baseline limits disparity observability, leading to structural degradation and depth failure in textureless, low-contrast, or downsampled regions. Existing DP-based methods rely primarily on local disparity cues and therefore become unreliable when disparity signals are weak or ambiguous. To address this limitation, we propose \emph{FoundDP}, a unified framework that integrates metric DP depth with global structural priors from a monocular depth foundation model. Our method preserves metric scale through DP-derived depth and leverages Vision Transformer (ViT) features to restore structural consistency in weak-disparity regions. To ensure reliable metric guidance under DP imaging conditions, we identify and mitigate ViT representation degradation induced by DP defocus blur via ViT feature alignment, enabling stable metric-guided depth estimation. Extensive experiments on synthetic and real-world DP benchmarks show that FoundDP delivers superior performance, with consistent gains in structural fidelity and metric accuracy, especially under reduced disparity observability. Code will be available at: this https URL
FoundDP:重审双像素深度估计中的弱视差可观测性 /
FoundDP: Revisiting Weak Disparity Observability in Dual-Pixel Depth Estimation
1️⃣ 一句话总结
针对双像素相机在弱纹理或低对比度区域因视差过小导致深度估计失败的问题,本文提出一种统一框架FoundDP,通过融合单目深度基础模型的全局结构先验与双像素的度量深度,并利用ViT特征对齐消除散焦模糊带来的表示退化,从而在弱视差条件下显著提升深度估计的结构保真度和度量精度。