通过协同细粒度优化将SAM模型适配于细胞核实例分割与分类 / Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement
1️⃣ 一句话总结
这篇论文提出了一种高效微调框架,通过增强局部结构感知、融合多尺度细节和优化边界预测,让强大的通用图像分割模型SAM能够以较低计算成本,精准地完成医学图像中的细胞核分割任务。
Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leveraging its rich priors and powerful global context modeling capabilities derived from large-scale pre-training on natural images. However, directly applying SAM to the medical imaging domain faces significant limitations: it lacks sufficient perception of the local structural features that are crucial for nuclei segmentation, and full fine-tuning for downstream tasks requires substantial computational costs. To efficiently transfer SAM's robust prior knowledge to nuclei instance segmentation while supplementing its task-aware local perception, we propose a parameter-efficient fine-tuning framework, named Cooperative Fine-Grained Refinement of SAM, consisting of three core components: 1) a Multi-scale Adaptive Local-aware Adapter, which enables effective capability transfer by augmenting the frozen SAM backbone with minimal parameters and instilling a powerful perception of local structures through dynamically generated, multi-scale convolutional kernels; 2) a Hierarchical Modulated Fusion Module, which dynamically aggregates multi-level encoder features to preserve fine-grained spatial details; and 3) a Boundary-Guided Mask Refinement, which integrates multi-context boundary cues with semantic features through explicit supervision, producing a boundary-focused signal to refine initial mask predictions for sharper delineation. These three components work cooperatively to enhance local perception, preserve spatial details, and refine boundaries, enabling SAM to perform accurate nuclei instance segmentation directly.
通过协同细粒度优化将SAM模型适配于细胞核实例分割与分类 / Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement
这篇论文提出了一种高效微调框架,通过增强局部结构感知、融合多尺度细节和优化边界预测,让强大的通用图像分割模型SAM能够以较低计算成本,精准地完成医学图像中的细胞核分割任务。
源自 arXiv: 2603.28027