菜单

关于 🐙 GitHub
arXiv 提交日期: 2025-12-16
📄 Abstract - TAT: Task-Adaptive Transformer for All-in-One Medical Image Restoration

Medical image restoration (MedIR) aims to recover high-quality medical images from their low-quality counterparts. Recent advancements in MedIR have focused on All-in-One models capable of simultaneously addressing multiple different MedIR tasks. However, due to significant differences in both modality and degradation types, using a shared model for these diverse tasks requires careful consideration of two critical inter-task relationships: task interference, which occurs when conflicting gradient update directions arise across tasks on the same parameter, and task imbalance, which refers to uneven optimization caused by varying learning difficulties inherent to each task. To address these challenges, we propose a task-adaptive Transformer (TAT), a novel framework that dynamically adapts to different tasks through two key innovations. First, a task-adaptive weight generation strategy is introduced to mitigate task interference by generating task-specific weight parameters for each task, thereby eliminating potential gradient conflicts on shared weight parameters. Second, a task-adaptive loss balancing strategy is introduced to dynamically adjust loss weights based on task-specific learning difficulties, preventing task domination or undertraining. Extensive experiments demonstrate that our proposed TAT achieves state-of-the-art performance in three MedIR tasks--PET synthesis, CT denoising, and MRI super-resolution--both in task-specific and All-in-One settings. Code is available at this https URL.

顶级标签: medical computer vision model training
详细标签: medical image restoration all-in-one model task interference loss balancing transformer 或 搜索:

TAT:面向一体化医学图像复原的任务自适应Transformer / TAT: Task-Adaptive Transformer for All-in-One Medical Image Restoration


1️⃣ 一句话总结

这篇论文提出了一种名为TAT的新型任务自适应Transformer框架,它通过动态生成任务专属参数和智能平衡不同任务的损失权重,有效解决了多个医学图像复原任务同时训练时的相互干扰和优化不平衡问题,从而在一体化模型中实现了更优的性能。


源自 arXiv: 2512.14550