Automatic Diabetic Retinopathy Diagnosis Using Adaptive Fine-Tuned Convolutional Neural Network

Fahman Saeed,Muhammad Hussain,Hatim A Aboalsamh

doi:10.1109/access.2021.3065273

Fahman Saeed, Muhammad Hussain + Show 1 more

Open Access

https://doi.org/10.1109/access.2021.3065273

Copy DOI

Abstract

Diabetic retinopathy (DR) is a complication of diabetes that leads to blindness. The manual screening of color fundus images to detect DR at early stages is expensive and time consuming. Deep learning (DL) techniques have been employed for automatic DR screening on fundus images due to their outstanding performance in many applications. However, training a DL model needs a huge amount of data, which are usually unavailable in the case of DR, and overfitting is unavoidable. Employing a two-stage transfer learning method, we developed herein an intelligent computer-aided system using a pre-trained convolutional neural network (CNN) for automatic DR screening on fundus images. A CNN model learns the domain-specific hierarchy of low- to high-level features. Given this, using the regions of interest (ROIs) of lesions extracted from the annotated fundus images, the first layer of a pre-trained CNN model is re-initialized. The model is then fine-tuned, such that the low-level layers learn the local structures of the lesion and normal regions. As the fully connected layer (FC) layers encode high-level features, which are global in nature and domain specific, we replace them with a new FC layer based on the principal component analysis PCA and use it in an unsupervised manner to extract discriminate features from the fundus images. This step reduces the model complexity, significantly avoiding the overfitting problem. This step also lets the model adopt the fundus image structures, making it suitable for DR feature detection. Finally, we add a gradient boosting-based classification layer. The evaluation of the proposed system using a 10-fold cross-validation on two challenging datasets (i.e., EyePACS and Messidor) indicates that it outperforms state-of-the-art methods. It will be useful for the initial screening of DR patients and will help graders in deciding quickly as regards patient referral to an ophthalmologist for further diagnosis and treatment.

Highlights

Diabetes is one of the main health dilemmas worldwide
We proposed a two-stage fine-tuning method to adapt a pre-trained model to retinal fundus images: in the first stage, it embeds the diabetic retinopathy (DR) lesion structures in a pre-trained convolutional neural network (CNN) model using lesion regions of interest (ROIs), and in the second stage, it adapts high-level layers to extract the discriminate structures of the retinal fundus images by removing the domain-specific fully connected layer (FC) layers of a pre-trained model and introducing a new PCA layer, which significantly reduces the model complexity and helps overcome the overfitting problem; this overcomes the limitations of Deep learning (DL) model learning due to the small amount of available data for DR detection
We developed an automatic system based on deep learning for grading retinal fundus images and referring a DR patient to an ophthalmologist at an early stage

Summary

Introduction

Diabetes is one of the main health dilemmas worldwide. One complication of diabetes is diabetic retinopathy (DR), which is one of the main causes of blindness [1]. It has different levels of severity [2] and can be controlled if detected at early stages. DR affects the retina, which is responsible for the conversion of light to the electric signal interpreted to create an image. The retina contains a network of blood vessels that provide nutrition to the retina. Diabetes damages the blood vessels; the retina does not receive blood

Methods

Findings

Conclusion