一种可解释的视觉Transformer框架用于自动脑肿瘤分类 / an interpretable vision transformer framework for automated brain tumor classification
1️⃣ 一句话总结
本文提出了一种基于视觉Transformer的深度学习模型,用于自动将脑部MRI扫描图像分类为脑膜瘤、胶质瘤、垂体瘤或健康组织,并通过注意力可视化技术让医生能够理解模型判断的依据,最终达到了99%以上的分类准确率。
Brain tumors represent one of the most critical neurological conditions, where early and accurate diagnosis is directly correlated with patient survival rates. Manual interpretation of Magnetic Resonance Imaging (MRI) scans is time-intensive, subject to inter-observer variability, and demands significant specialist expertise. This paper proposes a deep learning framework for automated four-class brain tumor classification distinguishing glioma, meningioma, pituitary tumor, and healthy brain tissue from a dataset of 7,023 MRI scans. The proposed system employs a Vision Transformer (ViT-B/16) pretrained on ImageNet-21k as the backbone, augmented with a clinically motivated preprocessing and training pipeline. Contrast Limited Adaptive Histogram Equalization (CLAHE) is applied to enhance local contrast and accentuate tumor boundaries invisible to standard normalization. A two-stage fine-tuning strategy is adopted: the classification head is warmed up with the backbone frozen, followed by full fine-tuning with discriminative learning rates. MixUp and CutMix augmentation is applied per batch to improve generalization. Exponential Moving Average (EMA) of weights and Test-Time Augmentation (TTA) further stabilize and boost performance. Attention Rollout visualization provides clinically interpretable heatmaps of the brain regions driving each prediction. The proposed model achieves a test accuracy of 99.29%, macro F1-score of 99.25%, and perfect recall on both healthy and meningioma classes, outperforming all CNN-based baselines
一种可解释的视觉Transformer框架用于自动脑肿瘤分类 / an interpretable vision transformer framework for automated brain tumor classification
本文提出了一种基于视觉Transformer的深度学习模型,用于自动将脑部MRI扫描图像分类为脑膜瘤、胶质瘤、垂体瘤或健康组织,并通过注意力可视化技术让医生能够理解模型判断的依据,最终达到了99%以上的分类准确率。
源自 arXiv: 2604.21311