菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-16
📄 Abstract - SAILS: Segment Anything with Incrementally Learned Semantics for Task-Invariant and Training-Free Continual Learning

Continual learning remains constrained by the need for repeated retraining, high computational costs, and the persistent challenge of forgetting. These factors significantly limit the applicability of continuous learning in real-world settings, as iterative model updates require significant computational resources and inherently exacerbate forgetting. We present SAILS -- Segment Anything with Incrementally Learned Semantics, a training-free framework for Class-Incremental Semantic Segmentation (CISS) that sidesteps these challenges entirely. SAILS leverages foundational models to decouple CISS into two stages: Zero-shot region extraction using Segment Anything Model (SAM), followed by semantic association through prototypes in a fixed feature space. SAILS incorporates selective intra-class clustering, resulting in multiple prototypes per class to better model intra-class variability. Our results demonstrate that, despite requiring no incremental training, SAILS typically surpasses the performance of existing training-based approaches on standard CISS datasets, particularly in long and challenging task sequences where forgetting tends to be most severe. By avoiding parameter updates, SAILS completely eliminates forgetting and maintains consistent, task-invariant performance. Furthermore, SAILS exhibits positive backward transfer, where the introduction of new classes can enhance performance on previous classes.

顶级标签: computer vision model training machine learning
详细标签: continual learning semantic segmentation segment anything model incremental learning training-free 或 搜索:

SAILS:通过增量学习语义实现任务不变且免训练的持续学习,用于任意分割 / SAILS: Segment Anything with Incrementally Learned Semantics for Task-Invariant and Training-Free Continual Learning


1️⃣ 一句话总结

这篇论文提出了一个名为SAILS的免训练持续学习框架,它巧妙地利用基础模型将图像分割任务分解为两个步骤——先用SAM模型进行零样本区域提取,再用原型进行语义关联,从而在完全不更新模型参数的情况下,不仅避免了传统持续学习中常见的“遗忘”问题,甚至还能让学习新知识反过来提升旧任务的性能。

源自 arXiv: 2602.14767