This repository maintains a list of papers that apply self-supervised learning to medical images. For each paper, we list its release year, paper title, publication venue, existence of code, included imaging modality, evaluation methodology (T for transfer learning, S for semi-supervised learning, A for active learning, F for fully-supervised learning), used dataset, and learning methodology.
Feel free to open an issue if you find any related paper is missed from the list.
| Date | Title | Venue | Code | Paper | Modality | Eval | Dataset | Method |
|---|---|---|---|---|---|---|---|---|
| 2022 | Robust and Efficient Medical Imaging with Self-Supervision | N/A | N/A | Preprint | 2D (Dermatology, Retinopathy, X-ray, Pathology, Mammography) | S, F, T | NIH ChestX-ray, CheXpert, CAMELYON16 | Comparative |
| 2022 | DiRA: Discriminative, Restorative, and Adversarial Learning for Self-supervised Medical Image Analysis | CVPR | Github | Preprint | 2D (X-ray) & 3D (CT, MRI) | S, F, T | NIH ChestX-ray, CheXPert, SIIM-ACR, NIH Montgomery, LUNA, PE-CAD, LIDC-IDRI, LiTS, BraTS | Predictive & Comparative |
| 2022 | CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging | MIDL | Github | Preprint | 2D (X-ray) | T | ChestX-ray14, CheXpert, SIIM-ACR, NIH Montgomery | Predictive & Comparative |
| 2022 | Generalized radiograph representation learning via cross-supervision between images and free-text radiology reports | Nature Machine Intelligence | Github | Preprint, Official | 2D (X-ray) | S, F, T | NIH ChestX-ray, VinBigData ChestX-ray MIMIC-CXR, Shenzhen Tuberculosis, COVID-19 Image Collection | Predictive & Comparative |
| 2022 | Self-supervised Learning from 100 Million Medical Images | N/A | N/A | Preprint | 2D (X-ray, Ultrasound) & 3d (CT, MRI) | T | LIDC-IDRI | Supervised & Comparative |
| 2021 | GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-efficient Medical Image Recognition | ICCV | Github | Official | 2D (X-ray) | S, F, T | CheXpert, RSNA Pneumonia, SIIM-ACR | Predictive & Comparative |
| 2021 | Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse Contexts | ICCV | Github | Preprint, Official | 2D (X-ray) & 3D (CT, MRI) | S, F, T | NIH ChestX-ray, CheXpert, LUNA, LiTS, BraTS | Predictive & Comparative |
| 2021 | Big Self-Supervised Models Advance Medical Image Classification | ICCV | N/A | Preprint | 2D (Dermatology, X-ray) | S, F, T | CheXpert | Comparative |
| 2021 | Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis | TMI | Github | Official | 2D (Retinopathy) | T | Ichallenge-AMD, Ichallenge-PM, EyePACS | Predictive & Contrastive |
| 2021 | Self-Supervised driven Consistency Training for Annotation Efficient Histopathology Image Analysis | MedIA | Github | Preprint, Official | 2D (Pathology) | S, F, T | BreastPathQ, CAMELYON16, Kather | Predictive |
| 2021 | Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learning | TMI | Github | Preprint | 2D (X-ray) & 3D (CT, MRI) | S, F, T | NIH ChestX-ray, SIIM-ACR, LUNA, PE-CAD, LIDC-IDRI, LiTS, BraTS | Predictive |
| 2021 | Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotations | TMI | N/A | Preprint, Official | 2D (Pathology) | S, F, T | CAMELYON16, Kather | Supervised & Predictive |
| 2021 | Interpretability-Driven Sample Selection Using Self Supervised Learning for Disease Classification and Segmentation | TMI | N/A | Preprint, Official | 2D (X-ray, Pathology) | A, T | NIH ChestX-ray, GLaS | Supervised & Predictive |
| 2021 | SMORE: A Self-Supervised Anti-Aliasing and Super-Resolution Algorithm for MRI Using Deep Learning | TMI | N/A | Official | 3D (MRI) | F | N/A | Predictive |
| 2021 | Context Matters: Graph-based Self-supervised Representation Learning for Medical Images | AAAI | Github | Preprint | 3D (CT) | T | COPDGene, MosMed, COVID-19 CT | Contrastive |
| 2021 | Multimodal Self-Supervised Learning for Medical Image Analysis | IPMI | N/A | Preprint | 3D (CT, MRI) | S, F, T | BraTS, CHAOS, MSD | Predictive |
| 2021 | MoCo-CXR: MoCo Pretraining Improves Representation and Transferability of Chest X-ray Models | MIDL | Github | Official | 2D (X-ray) | S, F, T | CheXpert, Shenzhen Tuberculosis | Contrastive |
| 2021 | How Transferable are Self-supervised Features in Medical Image Classification Tasks? | ML4H | N/A | Preprint | 2D (X-ray, Pathology, Retinopathy) | T | CAMELYON16, APTOS, NIH ChestX-ray, Guangzhou Pneumonina | N/A |
| 2020 | Contrastive learning of global and local features for medical image segmentation with limited annotations | NeurIPS | Github | Preprint | 3D (CT, MRI) | S, F | ACDC, MSD, MMWHS | Contrastive |
| 2020 | Self-Supervised Feature Learning via Exploiting Multi-Modal Data for Retinal Disease Diagnosis | TMI | Github | Preprint | 2D (Retinopathy) | T | Ichallenge-AMD, Ichallenge-PM, EyePACS, Fundus-FFA | Contrastive |
| 2020 | Comparing to Learn: Surpassing ImageNet Pretraining on Radiographs By Comparing Image Representations | MICCAI | Github | Preprint | 2D (X-ray) | T | NIH ChestX-ray, CheXpert, MURA, MIMIC-CXR, RSNA Pneumonia | Contrastive |
| 2020 | Contrastive Rendering for Ultrasound Image Segmentation | MICCAI | N/A | Preprint | 2D (Ultrasound) | F | Private | Supervised & Contrastive |
| 2020 | Region-of-Interest Guided Supervoxel Inpainting for Self-supervision | MICCAI | Github | Preprint | 3D (MRI) | S, F, T | BraTS, WMH | Predictive |
| 2020 | Revisiting Rubik’s Cube: Self-supervised Learning with Volume-Wise Transformation for 3D Medical Image Segmentation | MICCAI | N/A | Preprint | 3D (CT, MRI) | S, F, T | NIH Pancreas, MRBrainS18 | Predictive |
| 2020 | Self-supervised Depth Estimation to Regularise Semantic Segmentation in Knee Arthroscopy | MICCAI | N/A | Preprint | 2D (Arthroscopy) | T | Private | Predictive |
| 2020 | Self-supervised Discovery of Anatomical Shape Landmarks | MICCAI | Github | Preprint | 2D & 3D (CT) | T | Private | Predictive |
| 2020 | Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotation | ECCV | Github | Preprint | 3D (CT, MRI) | S, F | Synapse, MSCMR | Predictive |
| 2020 | AF-SEG: An Annotation-Free Approach for Image Segmentation by Self-Supervision and Generative Adversarial Network | ISBI | N/A | Official | 2D (Cell, Vessel) | F | SCD RBC, DSA | Predictive (Syn.) |
| 2020 | Leveraging Self-supervised Denoising for Image Segmentation | ISBI | Github | N/A | 2D (Cell) | S, F | DSB, BBBC | Predictive |
| 2020 | PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation | N/A | N/A | Preprint | 3D (CT) | S, T | MSD, KiTS, Synapse | Predictive |
| 2019 | Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysis | MICCAI | Github | Preprint | 2D (X-ray) & 3D (CT, MRI) | S, F, T | NIH ChestX-ray, UFL MCAEL, LUNA, PE-CAD, LIDC-IDRI, LiTS, BraTS | Predictive |
| 2019 | Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction | MICCAI | N/A | Preprint | 3D (MRI) | F | Private | Predictive |
| 2019 | Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik’s Cube | MICCAI | N/A | Preprint | 3D (MRI) | F | BraTS | Predictive |
| 2019 | How to Learn from Unlabeled Volume Data: Self-supervised 3D Context Feature Learning | MICCAI | Github | Official | 3D (CT) | S, F | VISCERAL Anatomy3 | Predictive |
| 2019 | Self-supervised learning for medical image analysis using image context restoration | MedIA | N/A | Official | 2D (Ultrasound) & 3D (CT, MRI) | S, F, T | BraTS | Predictive |
| 2019 | Surrogate Supervision for Medical Image Analysis: Effective Deep Learning From Limited Quantities of Labeled Data | ISBI | N/A | Preprint | 2D (X-ray, Dermatology) & 3D (CT) | S, F | Kaggle Diabetic Retinopathy Detection | Predictive |
| 2018 | Improving Cytoarchitectonic Segmentation of Human Brain Areas with Self-supervised Siamese Networks | MICCAI | N/A | Preprint | 2D (Cell) | F | BigBrain | Predictive |
| 2018 | Exploiting the potential of unlabeled endoscopic video data with self-supervised learning | IJCARS | N/A | Preprint | 2D (Endoscopy) | S, F, T | MICCAI Endoscopic Vision Challenge 2017 | Predictive |
| 2017 | Self-supervised learning for spinal MRIs | N/A | N/A | Preprint | 3D (MRI) | S, T | Private | Contrastive |
| 2017 | Self supervised deep representation learning for fine-grained body part recognition | ISBI | N/A | Official | 3D (CT, MRI) | S, F | Private | Predictive |