Skip to content

Code for the paper "OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing"

License

MIT, Unknown licenses found

Licenses found

MIT
LICENSE
Unknown
LICENSE.txt
Notifications You must be signed in to change notification settings

Retinal-Research/OTRE

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

60 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing

[ISBI '2023] Optimal Transport Guided Unsupervised Learning for Enhancin Low-Quality Retinal Images Include Other baseline GAN models and training code

Abstract

Non-mydriatic retinal color fundus photography (CFP) is widely available due to the advantage of not requiring pupillary dilation, however, is prone to poor quality due to operators, systemic imperfections, or patient-related causes. Optimal retinal image quality is mandated for accurate medical diagnoses and automated analyses. Herein, we leveraged the \emph{Optimal Transport (OT)} theory to propose an unpaired image-to-image translation scheme for mapping low-quality retinal CFPs to high-quality counterparts. Furthermore, to improve the flexibility, robustness, and applicability of our image enhancement pipeline in the clinical practice, we generalized a state-of-the-art model-based image reconstruction method, regularization by denoising, by plugging in priors learned by our OT-guided image-to-image translation network. We named it \emph{regularization by enhancing (RE)}. We validated the integrated framework, OTRE, on three publicly available retinal image datasets by assessing the quality after enhancement and their performance on various downstream tasks, including diabetic retinopathy grading, vessel segmentation, and diabetic lesion segmentation. The experimental results demonstrated the superiority of our proposed framework over some state-of-the-art unsupervised competitors and a state-of-the-art supervised method.

This repository will be maintained and updated! Stay Tuned!

We will appreciate any suggestions and comments. If you find this code helpful, please cite our papers. Thanks!

@inproceedings{zhu2023otre,
  title={OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing},
  author={Zhu, Wenhui and Qiu, Peijie and Dumitrascu, Oana M and Sobczak, Jacob M and Farazi, Mohammad and Yang, Zhangsihao and Nandakumar, Keshav and Wang, Yalin},
  booktitle={International Conference on Information Processing in Medical Imaging},
  pages={415--427},
  year={2023},
  organization={Springer}
}
@article{zhu2023optimal,
  title={Optimal Transport Guided Unsupervised Learning for Enhancing low-quality Retinal Images},
  author={Zhu, Wenhui and Qiu, Peijie and Farazi, Mohammad and Nandakumar, Keshav and Dumitrascu, Oana M and Wang, Yalin},
  journal={arXiv preprint arXiv:2302.02991},
  year={2023}
}

Dependencies

1. Train the OT-guided GAN

2. Run the Regularization by Enhancing during inference

License

Released under the ASU GitHub Project License.

About

Code for the paper "OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing"

Topics

Resources

License

MIT, Unknown licenses found

Licenses found

MIT
LICENSE
Unknown
LICENSE.txt

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages