📄
Abstract - CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration
Multimodal Image Fusion (MMIF) integrates complementary information from various modalities to produce clearer and more informative fused images. MMIF under adverse weather is particularly crucial in autonomous driving and UAV monitoring applications. However, existing adverse weather fusion methods generally only tackle single types of degradation such as haze, rain, or snow, and fail when multiple degradations coexist (e.g., haze+rain, rain+snow). To address this challenge, we propose Compound Adverse Weather Mamba (CAWM-Mamba), the first end-to-end framework that jointly performs image fusion and compound weather restoration with unified shared weights. Our network contains three key components: (1) a Weather-Aware Preprocess Module (WAPM) to enhance degraded visible features and extracts global weather embeddings; (2) a Cross-modal Feature Interaction Module (CFIM) to facilitate the alignment of heterogeneous modalities and exchange of complementary features across modalities; and (3) a Wavelet Space State Block (WSSB) that leverages wavelet-domain decomposition to decouple multi-frequency degradations. WSSB includes Freq-SSM, a module that models anisotropic high-frequency degradation without redundancy, and a unified degradation representation mechanism to further improve generalization across complex compound weather conditions. Extensive experiments on the AWMM-100K benchmark and three standard fusion datasets demonstrate that CAWM-Mamba consistently outperforms state-of-the-art methods in both compound and single-weather scenarios. In addition, our fusion results excel in downstream tasks covering semantic segmentation and object detection, confirming the practical value in real-world adverse weather perception. The source code will be available at this https URL.
CAWM-Mamba:一种用于红外-可见光图像融合与复合恶劣天气恢复的统一模型 /
CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration
1️⃣ 一句话总结
这篇论文提出了一个名为CAWM-Mamba的统一AI模型,它能够同时处理红外与可见光图像的融合,并修复多种恶劣天气(如雾、雨、雪)共同造成的图像质量下降问题,从而为自动驾驶等应用在复杂天气下提供更清晰、信息更丰富的视觉感知。