Synthesizing New Retinal Symptom Images by Multiple Generative Models

Yi Chieh Liu, Hao Hsiang Yang, C. H. Huck Yang, Jia-Hong Huang, Meng Tian, Hiromasa Morikawa, Yi Chang James Tsai, Jesper Tegner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Age-Related Macular Degeneration (AMD) is an asymptomatic retinal disease which may result in loss of vision. There is limited access to high-quality relevant retinal images and poor understanding of the features defining sub-classes of this disease. Motivated by recent advances in machine learning we specifically explore the potential of generative modeling, using Generative Adversarial Networks (GANs) and style transferring, to facilitate clinical diagnosis and disease understanding by feature extraction. We design an analytic pipeline which first generates synthetic retinal images from clinical images; a subsequent verification step is applied. In the synthesizing step we merge GANs (DCGANs and WGANs architectures) and style transferring for the image generation, whereas the verified step controls the accuracy of the generated images. We find that the generated images contain sufficient pathological details to facilitate ophthalmologists’ task of disease classification and in discovery of disease relevant features. In particular, our system predicts the drusen and geographic atrophy sub-classes of AMD. Furthermore, the performance using CFP images for GANs outperforms the classification based on using only the original clinical dataset. Our results are evaluated using existing classifier of retinal diseases and class activated maps, supporting the predictive power of the synthetic images and their utility for feature extraction. Our code examples are available online. (https://github.com/huckiyang/EyeNet-GANs).
Original languageEnglish (US)
Title of host publicationComputer Vision – ACCV 2018 Workshops
PublisherSpringer Nature
Pages235-250
Number of pages16
ISBN (Print)9783030210731
DOIs
StatePublished - Jun 19 2019

Fingerprint

Dive into the research topics of 'Synthesizing New Retinal Symptom Images by Multiple Generative Models'. Together they form a unique fingerprint.

Cite this