IRDFusion: Iterative Relation-Map Difference guided Feature Fusion for Multispectral Object Detection
We have provided portions of our code and training logs in the train_log directory. Once the paper is accepted, we will release the full code and training weights.
Current multispectral object detection methods often retain extraneous background or noise during feature fusion, limiting perceptual performance. To address this, we propose an innovative feature fusion framework based on cross-modal feature contrastive and screening strategy, diverging from conventional approaches. The proposed method adaptively enhances salient structures by fusing object-aware complementary cross-modal features while suppressing shared background interference. Our solution centers on two novel, specially designed modules: the Mutual Feature Refinement Module (MFRM) and the Differential Feature Feedback Module (DFFM). The MFRM enhances intra- and inter-modal feature representations by modeling their relationships, thereby improving cross-modal alignment and discriminative power. Inspired by feedback differential amplifiers, the DFFM dynamically computes inter-modal differential features as guidance signals and feeds them back to the MFRM, enabling adaptive fusion of complementary information while suppressing common-mode noise across modalities. To enable robust feature learning, the MFRM and DFFM are integrated into a unified framework, which is formally formulated as an Iterative Relation-Map Differential Guided Feature Fusion mechanism, termed IRDFusion. IRDFusion enables high-quality cross-modal fusion by progressively amplifying salient relational signals through iterative feedback, while suppressing feature noise, leading to significant performance gains. In extensive experiments on FLIR, LLVIP and M3FD datasets, IRDFusion achieves state-of-the-art performance and consistently outperforms existing methods across diverse challenging scenarios, demonstrating its robustness and effectiveness.
Paper download in IRDFusion
FLIR
| Detector | mAP@50 | mAP@75 | mAP |
|---|---|---|---|
| YOLOv5 | 84.8 | 38.1 | 43.4 |
| Co-DETR | 88.3 | 48.0 | 50.7 |
LLVIP
| Detector | mAP@50 | mAP@75 | mAP |
|---|---|---|---|
| YOLOv5 | 97.9 | 75.7 | 65.5 |
| Co-DETR | 98.4 | 83.1 | 70.9 |
M³FD
| Detector | mAP@50 | mAP@75 | mAP |
|---|---|---|---|
| YOLOv5 | 89.8 | 65.8 | 60.5 |
| Co-DETR | 90.8 | 65.4 | 61.9 |
M4-SAR (YOLOv11 OBB)
| bridge | harbor | oil_tank | playground | airport | wind_turbine | mAP@50 | mAP |
|---|---|---|---|---|---|---|---|
| 77.2 | 93.9 | 66.5 | 93.2 | 90.2 | 98.4 | 86.5 | 62.4 |
Weights now are available at https://drive.google.com/drive/folders/1qbRkwi48xyDfSd-rl5AA1fusx3u9SAwn?usp=drive_link
@article{shen2026irdfusion,
title={IRDFusion: Iterative relation-map difference guided feature fusion for multispectral object detection},
author={Shen, Jifeng and Zhan, Haibo and Zuo, Xin and Fan, Heng and Yuan, Xiaohui and Li, Jun and Yang, Wankou},
journal={Pattern Recognition},
pages={113189},
year={2026},
publisher={Elsevier}
}