Automated detection of crystalline retinopathy via fundus photography using multistage generative adversarial networks

Abstract

PurposeCrystalline retinopathy is characterized by reflective crystal deposits in the macula and is caused by various systemic conditions including hereditary, toxic, and embolic etiologies. Herein, we introduce a novel application of deep learning with a multistage generative adversarial network (GAN) to detect crystalline retinopathy using fundus photography. MethodsThe dataset comprised major classes (healthy retina, diabetic retinopathy, exudative age-related macular degeneration, and drusen) and a crystalline retinopathy class (minor set). To overcome the limited data on crystalline retinopathy, we proposed a novel multistage GAN framework. The GAN was retrained after CutMix combination by inputting the GAN-generated synthetic data as new inputs to the original training data. After the multistage CycleGAN augmented the data for crystalline retinopathy, we built a deep-learning classifier model for detection. ResultsUsing the multistage CycleGAN facilitated realistic fundus photography synthesis with the characteristic features of retinal crystalline deposits. The proposed method outperformed typical transfer learning, prototypical networks, and knowledge distillation for both multiclass and binary classifications. The final model achieved an area under the curve of the receiver operating characteristics of 0.962 for internal validation and 0.987 for external validation for the detection of crystalline retinopathy. ConclusionWe introduced a deep learning approach for detecting crystalline retinopathy, a potential biomarker of underlying systemic pathological conditions. Our approach enables realistic pathological image synthesis and more accurate prediction of crystalline retinopathy, an essential but minor retinal condition.