菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-24
📄 Abstract - PolarAPP: Beyond Polarization Demosaicking for Polarimetric Applications

Polarimetric imaging enables advanced vision applications such as normal estimation and de-reflection by capturing unique surface-material interactions. However, existing applications (alternatively called downstream tasks) rely on datasets constructed by naively regrouping raw measurements from division-of-focal-plane sensors, where pixels of the same polarization angle are extracted and aligned into sparse images without proper demosaicking. This reconstruction strategy results in suboptimal, incomplete targets that limit downstream performance. Moreover, current demosaicking methods are task-agnostic, optimizing only for photometric fidelity rather than utility in downstream tasks. Towards this end, we propose PolarAPP, the first framework to jointly optimize demosaicking and its downstream tasks. PolarAPP introduces a feature alignment mechanism that semantically aligns the representations of demosaicking and downstream networks via meta-learning, guiding the reconstruction to be task-aware. It further employs an equivalent imaging constraint for demosaicking training, enabling direct regression to physically meaningful outputs without relying on rearranged data. Finally, a task-refinement stage fine-tunes the task network using the stable demosaicking front-end to further enhance accuracy. Extensive experimental results demonstrate that PolarAPP outperforms existing methods in both demosaicking quality and downstream performance. Code is available upon acceptance.

顶级标签: computer vision systems model training
详细标签: polarimetric imaging demosaicking multi-task learning feature alignment sensor processing 或 搜索:

PolarAPP:超越偏振去马赛克,面向偏振成像应用 / PolarAPP: Beyond Polarization Demosaicking for Polarimetric Applications


1️⃣ 一句话总结

这篇论文提出了一个名为PolarAPP的新框架,它首次将偏振图像的去马赛克处理与后续的视觉应用(如表面法线估计)联合优化,通过元学习等方法让重建过程更“懂”任务需求,从而显著提升了最终应用的效果。

源自 arXiv: 2603.23071