菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-13
📄 Abstract - WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning

Infrared-visible object detection improves detection performance by combining complementary features from multispectral images. Existing backbone-specific and backbone-shared approaches still suffer from the problems of severe bias of modality-shared features and the insufficiency of modality-specific features. To address these issues, we propose a novel detection framework WD-FQDet that explicitly decouples modality-shared and modality-specific information from infrared and visible modalities in the new view of low- and high-frequency domains, allowing fusion strategies tailored to their frequency characteristics. Specifically, a low-frequency homogeneity alignment module is proposed to align modality-shared features across modalities via a cross-modal attention mechanism, and a high-frequency specificity retention module is proposed to preserve modality-specific features through the multi-scale gradient consistency loss. To reinforce the feature representation in the frequency domain, we propose a hybrid feature enhancement module that incorporates spatial cues. Furthermore, considering that the contributions of homogeneous and modality-specific features to object detection vary across scenarios, we propose a frequency-aware query selection module to dynamically regulate their contributions. Experimental results on the FLIR, LLVIP, and M3FD datasets demonstrate that WD-FQDet achieves state-of-the-art performance across multiple evaluation metrics.

顶级标签: computer vision multi-modal
详细标签: object detection infrared-visible fusion frequency decomposition transformer query learning 或 搜索:

基于小波分解与频率感知查询学习的多光谱检测Transformer / WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning


1️⃣ 一句话总结

这篇论文提出了一种新的多光谱目标检测框架,通过将红外和可见光图像分解为低频和高频信息,分别对齐共享特征和保留独有特征,并利用频率感知机制动态调整两者在检测中的贡献,从而显著提升了复杂场景下的检测精度。

源自 arXiv: 2605.13621