📄
Abstract - VQ-Seg: Vector-Quantized Token Perturbation for Semi-Supervised Medical Image Segmentation
Consistency learning with feature perturbation is a widely used strategy in semi-supervised medical image segmentation. However, many existing perturbation methods rely on dropout, and thus require a careful manual tuning of the dropout rate, which is a sensitive hyperparameter and often difficult to optimize and may lead to suboptimal regularization. To overcome this limitation, we propose VQ-Seg, the first approach to employ vector quantization (VQ) to discretize the feature space and introduce a novel and controllable Quantized Perturbation Module (QPM) that replaces dropout. Our QPM perturbs discrete representations by shuffling the spatial locations of codebook indices, enabling effective and controllable regularization. To mitigate potential information loss caused by quantization, we design a dual-branch architecture where the post-quantization feature space is shared by both image reconstruction and segmentation tasks. Moreover, we introduce a Post-VQ Feature Adapter (PFA) to incorporate guidance from a foundation model (FM), supplementing the high-level semantic information lost during quantization. Furthermore, we collect a large-scale Lung Cancer (LC) dataset comprising 828 CT scans annotated for central-type lung carcinoma. Extensive experiments on the LC dataset and other public benchmarks demonstrate the effectiveness of our method, which outperforms state-of-the-art approaches. Code available at: this https URL.
VQ-Seg:用于半监督医学图像分割的向量量化令牌扰动方法 /
VQ-Seg: Vector-Quantized Token Perturbation for Semi-Supervised Medical Image Segmentation
1️⃣ 一句话总结
这篇论文提出了一种名为VQ-Seg的新方法,它通过向量量化技术对图像特征进行可控的扰动,并结合双分支架构和预训练大模型的知识,有效解决了半监督医学图像分割中传统扰动方法(如随机失活)难以调节且可能丢失信息的问题,从而在多个数据集上取得了领先的分割效果。