菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-18
📄 Abstract - CATA: Continual Machine Unlearning via Conflict-Averse Task Arithmetic

Vision-language models (VLMs) have shown remarkable ability in aligning visual and textual representations, enabling a wide range of multimodal applications. However, their large-scale training data inevitably raises concerns about privacy, copyright, and undesirable content, creating a strong need for machine unlearning. While existing studies mainly focus on single-shot unlearning, practical VLM deployment often involves sequential removal requests over time, giving rise to continual machine unlearning. In this work, we make the first attempt to study continual unlearning for VLMs and identify three key challenges in this setting: effectiveness in removing target knowledge, fidelity in preserving retained model utility, and persistence in preventing knowledge re-emergence under sequential updates. To address these challenges, we propose CATA, a conflict-averse task arithmetic method that represents each forget request as an unlearning task vector. By maintaining historical task vectors and performing sign-aware conflict-averse aggregation, CATA suppresses conflicting update components that may weaken previous forgetting effects. Extensive experiments under both single-shot and continual settings show that CATA outperforms baselines in terms of forgetting effectiveness, model fidelity, and forgetting persistence.

顶级标签: multi-modal machine learning model training
详细标签: machine unlearning vision-language models continual learning task arithmetic privacy 或 搜索:

CATA:通过冲突避免的任务算术实现持续机器去学习 / CATA: Continual Machine Unlearning via Conflict-Averse Task Arithmetic


1️⃣ 一句话总结

本文提出了一种名为CATA的新方法,用于解决视觉语言模型在持续收到删除特定知识请求(如隐私或版权内容)时的机器遗忘问题,通过将每个遗忘请求表示为任务向量,并采用一种避免冲突的聚合策略,从而在依次遗忘多个任务时,既能有效删除目标信息,又能保持模型原有性能,并防止被删除的知识再次出现。

源自 arXiv: 2605.18610