菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-07
📄 Abstract - From Measurement to Mitigation: Quantifying and Reducing Identity Leakage in Image Representation Encoders with Linear Subspace Removal

Frozen visual embeddings (e.g., CLIP, DINOv2/v3, SSCD) power retrieval and integrity systems, yet their use on face-containing data is constrained by unmeasured identity leakage and a lack of deployable mitigations. We take an attacker-aware view and contribute: (i) a benchmark of visual embeddings that reports open-set verification at low false-accept rates, a calibrated diffusion-based template inversion check, and face-context attribution with equal-area perturbations; and (ii) propose a one-shot linear projector that removes an estimated identity subspace while preserving the complementary space needed for utility, which for brevity we denote as the identity sanitization projection ISP. Across CelebA-20 and VGGFace2, we show that these encoders are robust under open-set linear probes, with CLIP exhibiting relatively higher leakage than DINOv2/v3 and SSCD, robust to template inversion, and are context-dominant. In addition, we show that ISP drives linear access to near-chance while retaining high non-biometric utility, and transfers across datasets with minor degradation. Our results establish the first attacker-calibrated facial privacy audit of non-FR encoders and demonstrate that linear subspace removal achieves strong privacy guarantees while preserving utility for visual search and retrieval.

顶级标签: computer vision model evaluation systems
详细标签: privacy face recognition embedding leakage subspace removal benchmark 或 搜索:

从测量到缓解:通过线性子空间移除来量化并减少图像表征编码器中的身份信息泄露 / From Measurement to Mitigation: Quantifying and Reducing Identity Leakage in Image Representation Encoders with Linear Subspace Removal


1️⃣ 一句话总结

这篇论文提出了一种新方法,通过一个简单的线性投影器,在基本不影响图像检索等实用功能的前提下,有效移除主流视觉编码器(如CLIP)从人脸图像中提取出的敏感身份信息,从而保护个人隐私。

源自 arXiv: 2604.05296