自适应三角Transformer用于云去除 / ATT-CR: Adaptive Triangular Transformer for Cloud Removal
1️⃣ 一句话总结
该论文提出了一种名为ATT-CR的高效云去除模型,通过创新的三角注意力机制(计算复杂度从O(N²)降至O(N))和特征选通门控模块,在不牺牲精度的情况下大幅减少了计算量,并有效避免了云层像素对图像重建的干扰,在遥感图像云去除任务上取得了优于现有方法的性能。
Cloud removal aims to accurately reconstruct the ground objects obscured by clouds in remote sensing images. Existing Transformer-based methods utilizing self-attention have shown impressive results by effectively modeling long-range dependencies in cloudy images. However, they suffer from the following issues: 1) the high computational complexity of self-attention limits scalability; 2) treating both cloudy and clean pixels as valid within the attention computation brings disturbances in subsequent layers, leading to suboptimal performance. To address these challenges, we propose the Adaptive Triangular Transformer for Cloud Removal (ATT-CR), a model that effectively reduces computational costs and mitigates interference from cloudy pixels. Specifically, it consists of two core components: Triangular Attention (TAN) and Feature Selected Gating Module (FSGM). TAN employs lower and upper triangular matrices to approximate Softmax attention with O(N) computational complexity, significantly reducing the computational costs. The FSGM, on the other hand, integrates with TAN to adaptively distinguish between cloudy and clean features, which minimizes the introduction of invalid information into subsequent layers. Extensive experiments on cloud removal benchmarks demonstrate that ATT-CR delivers superior performance compared to existing methods.
自适应三角Transformer用于云去除 / ATT-CR: Adaptive Triangular Transformer for Cloud Removal
该论文提出了一种名为ATT-CR的高效云去除模型,通过创新的三角注意力机制(计算复杂度从O(N²)降至O(N))和特征选通门控模块,在不牺牲精度的情况下大幅减少了计算量,并有效避免了云层像素对图像重建的干扰,在遥感图像云去除任务上取得了优于现有方法的性能。
源自 arXiv: 2606.05999