面向多模态检索增强生成中视觉证据的身份解耦匿名化方法 / Identity-Decoupled Anonymization for Visual Evidence in Multi-modal Retrieval-Augmented Generation
1️⃣ 一句话总结
本文提出一种新的匿名化框架,能在保留人脸中非身份视觉信息(如表情、姿态)的同时,安全地替换身份特征,从而让AI系统在引用图片回答问题时,既能保护个人隐私,又不影响推理的准确性。
Multi-modal retrieval-augmented generation (MRAG) systems retrieve visual evidence from large image corpora to ground the responses of large multi-modal models, yet the retrieved images frequently contain human faces whose identities constitute sensitive personal information. Existing anonymization techniques that destroy the non-identity visual cues that downstream reasoning depends on or fail to provide principled privacy guarantees. We propose Identity-Decoupled MRAG, a framework that interposes a generative anonymization module between retrieval and generation. Our approach consists of three components: (i)a disentangled variational encoder that factorizes each face into an identity code and a spatially-structured attribute code, regularized by a mutual-information penalty and a gradient-based independence term; (ii)a manifold-aware rejection sampler that replaces the identity code with a synthetic one guaranteed to be both distinct from the original and realistic; and (iii)a conditional latent diffusion generator that synthesizes the anonymized face from the replacement identity and the preserved attributes, distilled into a latent consistency model for low-latency deployment. Privacy is enforced through a multi-oracle ensemble of face recognition models with a hinge-based loss that halts optimization once identity similarity drops below the impostor-regime threshold.
面向多模态检索增强生成中视觉证据的身份解耦匿名化方法 / Identity-Decoupled Anonymization for Visual Evidence in Multi-modal Retrieval-Augmented Generation
本文提出一种新的匿名化框架,能在保留人脸中非身份视觉信息(如表情、姿态)的同时,安全地替换身份特征,从而让AI系统在引用图片回答问题时,既能保护个人隐私,又不影响推理的准确性。
源自 arXiv: 2604.23584