超越严格配对:面向高性能红外与可见光图像融合的任意配对训练 / Beyond Strict Pairing: Arbitrarily Paired Training for High-Performance Infrared and Visible Image Fusion
1️⃣ 一句话总结
这篇论文提出了一种新的训练方法,允许使用未对齐或任意配对的红外与可见光图像进行模型训练,从而大幅降低数据收集成本,并在数据量极少的情况下达到与使用大量严格配对数据相当的性能。
Infrared and visible image fusion(IVIF) combines complementary modalities while preserving natural textures and salient thermal signatures. Existing solutions predominantly rely on extensive sets of rigidly aligned image pairs for training. However, acquiring such data is often impractical due to the costly and labour-intensive alignment process. Besides, maintaining a rigid pairing setting during training restricts the volume of cross-modal relationships, thereby limiting generalisation performance. To this end, this work challenges the necessity of Strictly Paired Training Paradigm (SPTP) by systematically investigating UnPaired and Arbitrarily Paired Training Paradigms (UPTP and APTP) for high-performance IVIF. We establish a theoretical objective of APTP, reflecting the complementary nature between UPTP and SPTP. More importantly, we develop a practical framework capable of significantly enriching cross-modal relationships even with severely limited and unaligned training data. To validate our propositions, three end-to-end lightweight baselines, alongside a set of innovative loss functions, are designed to cover three classic frameworks (CNN, Transformer, GAN). Comprehensive experiments demonstrate that the proposed APTP and UPTP are feasible and capable of training models on a severely limited and content-inconsistent infrared and visible dataset, achieving performance comparable to that of a dataset 100$\times$ larger in SPTP. This finding fundamentally alleviates the cost and difficulty of data collection while enhancing model robustness from the data perspective, delivering a feasible solution for IVIF studies. The code is available at \href{this https URL}{\textcolor{blue}{this https URL\_unpair}}.
超越严格配对:面向高性能红外与可见光图像融合的任意配对训练 / Beyond Strict Pairing: Arbitrarily Paired Training for High-Performance Infrared and Visible Image Fusion
这篇论文提出了一种新的训练方法,允许使用未对齐或任意配对的红外与可见光图像进行模型训练,从而大幅降低数据收集成本,并在数据量极少的情况下达到与使用大量严格配对数据相当的性能。
源自 arXiv: 2603.21820