IVIF-Code-Interpretation

Provide a summary of open-source deep learning-based infrared and visible image fusion (IVIF) and some vision algorithms for those in the field of image fusion and computer vision.
(Survey, Code, Dataset, Evaluation and more).

🏃 keep updating. 🏃
🚩2024.4.2 Add MTDFusion, SFCFusion, MetaFusion.
🚩2024.4.11 Add some clarifications.
🚩2024.4.18 Add a general image fusion framework using multi-task semi-supervised learning
🚩2024.5.19 Add Text-IF, Diff-IF, TC-MoA, and MMIF-EMMA

Reprinted please specify the source~

https://github.com/liushh39

Content:

1. Survey

Year	Title
2023	Visible and Infrared Image Fusion Using Deep Learning 🤗🤗
2023	基于深度学习的图像融合方法综述 🤗🤗

2. AE-based IVIF method

Year	Title
2024	TextFusion: Unveiling the Power of Textual Semantics for Controllable Image Fusion 🤗🤗🤗
2023	LRRNet: A Novel Representation Learning Guided Fusion Framework for Infrared and Visible Images 🤗🤗🤗
2023	MURF: Mutually Reinforcing Multi-modal Image Registration and Fusion
2023	CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion
2023	Recurrent Correction Network for Fast and Efficient Multi-modality Image Fusion
2023	CAMF: An Interpretable Infrared and Visible Image Fusion Network Based on Class Activation Mapping
2023	DIVFusion: Darkness-free infrared and visible image fusion
2023	MUFusion: A general unsupervised image fusion network based on memory unit 🤗🤗
2023	SOSMaskFuse: An Infrared and Visible Image Fusion Architecture Based on Salient Object Segmentation Mask 🤗🤗
2023	Semantics lead all: Towards unified image registration and fusion from a semantic perspective 🤗🤗🤗
2022	Res2Fusion: Infrared and visible image fusion based on dense Res2net and double nonlocal attention models
2022	CUFD: An encoder-decoder network for visible and infrared image fusion based on common and unique feature decomposition
2022	Breaking Free from Fusion Rule: A Fully Semantic-driven Infrared and Visible Image Fusion
2021	SEDRFuse: A Symmetric Enocder-Decoder with Residual Network for Infrared and Visible Image Fusion
2021	RFN-Nest: An end-to-end residual fusion network for infrared and visible images
2021	Efficient and Interpretable Infrared and Visible Image Fusion Via Algorithm Unrolling
2020	NestFuse: An Infrared and Visible Image Fusion Architecture based on Nest Connection and Spatial/Channel Attention Models
2020	DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion
2020	Classification Saliency-Based Rule for Visible and Infrared Image Fusion
2020	UNIFusion: A Lightweight Unified Image Fusion Network
2020	SMoA: Searching a Modality-Oriented Architecture for Infrared and Visible Image Fusion
2019	Densefuse: A Fusion Approach to Infrared and Visible Images 🤗🤗
2018	Infrared and Visible Image Fusion using a Deep Learning Framework

3. CNN-based IVIF method

Year	Title
2023	MTDFusion: A Multilayer Triple Dense Network for Infrared and Visible Image Fusion
2023	LE2Fusion: A novel local edge enhancement module for infrared and visible image fusion
2023	Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation 🤗🤗🤗
2023	LDRepFM: A Real-Time End-to-End Visible and Infrared Image Fusion Model Based on Layer Decomposition and Re-Parameterization
2023	An interactively reinforced paradigm for joint infrared-visible image fusion and saliency object detection 🤗🤗🤗
2022	Attention-Guided Polarization Image Fusion Using Salient Information Distribution
2022	PIAFusion: A Progressive Infrared and Visible Image Fusion Network Based on Illumination Aware
2022	Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network 🤗🤗
2022	CLF-Net: "Contrastive Learning for Infrared and Visible Image Fusion Network
2022	Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration
2022	IPLF:A Novel Image Pair Learning Fusion Network for Infrared and Visible Image
2022	Learn to Search a Lightweight Architecture for Target-aware Infrared and Visible Image Fusion
2022	SuperFusion: A Versatile Image Registration and Fusion Network with Semantic Awareness
2022	DetFusion: A Detection-driven Infrared and Visible Image Fusion Network
2022	FLFuse-Net: A Fast and Lightweight Infrared and Visible Image Fusion Network Via Feature Flow and Edge Compensation for Salient Information 🤗🤗
2022	Multiscale Progressive Fusion of Infrared and Visible Images 🤗
2022	Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution 🤗
2021	STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection 🤗🤗
2021	DRF: Disentangled Representation for Visible and Infrared Image Fusion
2021	Different Input Resolutions and Arbitrary Output Resolution: A Meta-Learning Based Deep Framework for Infrared and Visible Image Fusion 🤗🤗
2021	SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
2021	MIFFuse: A Multi-level Feature Fusion Network for Infrared and visible Images 🤗
2020	IFCNN: A General Image Fusion Framework Based on Convolutional Neural Network
2020	FusionDN: A Unified Densely Connected Network for Image Fusion
2020	Rethinking the image fusion: A fast unified image fusion network based on proportional maintenance of gradient and intensity
2020	U2Fusion: A Unified Unsupervised Image Fusion Network 🤗🤗

4. GAN-based IVIF method

Year	Title
2023	A Cross-scale Iterative Attentional Adversarial Fusion Network for Infrared and Visible Images
2023	Infrared and Visible Image Fusion Based on Multiclassification Adversarial Mechanism in Feature Space
2022	Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection 🤗🤗
2022	Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning
2021	Coupled GAN with Relativistic Discriminators for Infrared and Visible Images Fusion
2021	Sematic-Supervised Infrared and Visible Image Fusion via Dual-Discriminator Generative Adversarial Network
2021	MFEIF: Learning a Deep Multi-scale Feature Ensemble and an Edge-attention Guidance for Image Fusion
2021	GANMcC: A Generative Adversarial Network with Multi-classification Constraints for Infrared and Visible Image Fusion
2021	GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators
2019	FusionGAN: A generative adversarial network for infrared and visible image fusion
2019	DDcGAN:infrared and visible image fusion via dual-discriminator conditional generative adversarial network

5. Transformer-based IVIF method

Year	Title
2023	PTET: A Progressive Token Exchanging Transformer for Infrared and Visible Image Fusion
2023	SFPFusion: An Improved Vision Transformer Combining Super Feature Attention and Wavelet-Guided Pooling for Infrared and Visible Images Fusion
2023	Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity
2023	CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion 🤗🤗🤗
2023	DATFuse: Infrared and Visible Image Fusion via Dual Attention Transformer
2023	Cross-Modal Transformers for Infrared and Visible Image Fusion 🤗🤗🤗
2022	YDTR: Infrared and Visible Image Fusion via Y-shape Dynamic Transformer 🤗🤗
2022	SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images
2022	SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
2022	Image fusion transformer

6. Other novel IVIF model

Year	Title
2024	A general image fusion framework using multi-task semi-supervised learning 🤗🤗🤗🤗
2024	Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion 🤗🤗🤗🤗
2024	Diff-IF: Multi-modality image fusion via diffusion model with fusion knowledge prior 🤗🤗🤗🤗
2024	Task-Customized Mixture of Adapters for General Image Fusion
2024	Equivariant Multi-Modality Image Fusion
2024	SFCFusion: Spatial–Frequency Collaborative Infrared and Visible Image Fusion
2023	DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion 🤗🤗🤗
2023	A Task-guided, Implicitly-searched and Meta- initialized Deep Model for Image Fusion 🤗🤗🤗
2023	Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyond 🤗🤗🤗
2023	MetaFusion: Infrared and Visible Image Fusion via Meta-Feature Embedding from Object Detection
2022	Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion

7. Datasets

TNO, RoadScene, M3FD, MFNet, MSRS, LLVIP, IVS, HDO, AVIID,

8. Evaluation

Excellent code

If you have any other questions about the IVIF, please email liushh39@mail2.sysu.edu.cn !!!

Reprinted please specify the source~

https://github.com/liushh39

Thanks to the above authors for their excellent work！🤗🤗