Automated foveal location detection on spectral-domain optical coherence tomography in geographic atrophy patients.

PURPOSE: To develop a fully automated algorithm for accurate detection of fovea location in atrophic age-related macular degeneration (AMD), based on spectral-domain optical coherence tomography (SD-OCT) scans. METHODS: Image processing was conducted on a cohort of patients affected by geographic atrophy (GA). SD-OCT images (cube volume) from 55 eyes (51 patients) were extracted and processed with a layer segmentation algorithm to segment Ganglion Cell Layer (GCL) and Inner Plexiform Layer (IPL). Their en face thickness projection was convolved with a 2D Gaussian filter to find the global maximum, which corresponded to the detected fovea. The detection accuracy was evaluated by computing the distance between manual annotation and predicted location. RESULTS: The mean total location error was 0.101±0.145mm; the mean error in horizontal and vertical en face axes was 0.064±0.140mm and 0.063±0.060mm, respectively. The mean error for foveal and extrafoveal retinal pigment epithelium and outer retinal atrophy (RORA) was 0.096±0.070mm and 0.107±0.212mm, respectively. Our method obtained a significantly smaller error than the fovea localization algorithm inbuilt in the OCT device (0.313±0.283mm, p <.001) or a method based on the thinnest central retinal thickness (0.843±1.221, p <.001). Significant outliers are depicted with the reliability score of the method. CONCLUSION: Despite retinal anatomical alterations related to GA, the presented algorithm was able to detect the foveal location on SD-OCT cubes with high reliability. Such an algorithm could be useful for studying structural-functional correlations in atrophic AMD and could have further applications in different retinal pathologies.

Artificial intelligence-based fluid quantification and associated visual outcomes in a real-world, multicentre neovascular age-related macular degeneration national database.

AIM: To explore associations between artificial intelligence (AI)-based fluid compartment quantifications and 12 months visual outcomes in OCT images from a real-world, multicentre, national cohort of naïve neovascular age-related macular degeneration (nAMD) treated eyes. METHODS: Demographics, visual acuity (VA), drug and number of injections data were collected using a validated web-based tool. Fluid compartment quantifications including intraretinal fluid (IRF), subretinal fluid (SRF) and pigment epithelial detachment (PED) in the fovea (1 mm), parafovea (3 mm) and perifovea (6 mm) were measured in nanoliters (nL) using a validated AI-tool. RESULTS: 452 naïve nAMD eyes presented a mean VA gain of +5.5 letters with a median of 7 injections over 12 months. Baseline foveal IRF associated poorer baseline (44.7 vs 63.4 letters) and final VA (52.1 vs 69.1), SRF better final VA (67.1 vs 59.0) and greater VA gains (+7.1 vs +1.9), and PED poorer baseline (48.8 vs 57.3) and final VA (55.1 vs 64.1). Predicted VA gains were greater for foveal SRF (+6.2 vs +0.6), parafoveal SRF (+6.9 vs +1.3), perifoveal SRF (+6.2 vs -0.1) and parafoveal IRF (+7.4 vs +3.6, all p<0.05). Fluid dynamics analysis revealed the greatest relative volume reduction for foveal SRF (-16.4 nL, -86.8%), followed by IRF (-17.2 nL, -84.7%) and PED (-19.1 nL, -28.6%). Subgroup analysis showed greater reductions in eyes with higher number of injections. CONCLUSION: This real-world study describes an AI-based analysis of fluid dynamics and defines baseline OCT-based patient profiles that associate 12-month visual outcomes in a large cohort of treated naïve nAMD eyes nationwide.

Development of LuxIA, a Cloud-Based AI Diabetic Retinopathy Screening Tool Using a Single Color Fundus Image.

Purpose: Diabetic retinopathy (DR) is the leading cause of vision impairment in working-age adults. Automated screening can increase DR detection at early stages at relatively low costs. We developed and evaluated a cloud-based screening tool that uses artificial intelligence (AI), the LuxIA algorithm, to detect DR from a single fundus image. Methods: Color fundus images that were previously graded by expert readers were collected from the Canarian Health Service (Retisalud) and used to train LuxIA, a deep-learning-based algorithm for the detection of more than mild DR. The algorithm was deployed in the Discovery cloud platform to evaluate each test set. Sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve were computed using a bootstrapping method to evaluate the algorithm performance and compared through different publicly available datasets. A usability test was performed to assess the integration into a clinical tool. Results: Three separate datasets, Messidor-2, APTOS, and a holdout set from Retisalud were evaluated. Mean sensitivity and specificity with 95% confidence intervals (CIs) reached for these three datasets were 0.901 (0.901-0.902) and 0.955 (0.955-0.956), 0.995 (0.995-0.995) and 0.821 (0.821-0.823), and 0.911 (0.907-0.912) and 0.880 (0.879-0.880), respectively. The usability test confirmed the successful integration of LuxIA into Discovery. Conclusions: Clinical data were used to train the deep-learning-based algorithm LuxIA to an expert-level performance. The whole process (image uploading and analysis) was integrated into the cloud-based platform Discovery, allowing more patients to have access to expert-level screening tools. Translational Relevance: Using the cloud-based LuxIA tool as part of a screening program may give diabetic patients greater access to specialist-level decisions, without the need for consultation.

Convolutional neural networks for decoding electroencephalography responses and visualizing trial by trial changes in discriminant features.

BACKGROUND: Deep learning has revolutionized the field of computer vision, where convolutional neural networks (CNNs) extract complex patterns of information from large datasets. The use of deep networks in neuroscience is mainly focused to neuroimaging or brain computer interface -BCI- applications. In electroencephalography (EEG) research, multivariate pattern analysis (MVPA) mainly relies on linear algorithms, which require a homogeneous dataset and assume that discriminant features appear at consistent latencies and electrodes across trials. However, neural responses may shift in time or space during an experiment, resulting in under-estimation of discriminant features. Here, we aimed at using CNNs to classify EEG responses to external stimuli, by taking advantage of time- and space- unlocked neural activity, and at examining how discriminant features change over the course of an experiment, on a trial by trial basis. NEW METHOD: We present a novel pipeline, consisting of data augmentation, CNN training, and feature visualization techniques, fine-tuned for MVPA on EEG data. RESULTS: Our pipeline provides high classification performance and generalizes to new datasets. Additionally, we show that the features identified by the CNN for classification are electrophysiologically interpretable and can be reconstructed at the single-trial level to study trial-by-trial evolution of class-specific discriminant activity. COMPARISON WITH EXISTING TECHNIQUES: The developed pipeline was compared to commonly used MVPA algorithms like logistic regression and support vector machines, as well as to shallow and deep convolutional neural networks. Our approach yielded significantly higher classification performance than existing MVPA techniques (p = 0.006) and comparable results to other CNNs for EEG data. CONCLUSION: In summary, we present a novel deep learning pipeline for MVPA of EEG data, that can extract trial-by-trial discriminative activity in a data-driven way.

Fully-automated atrophy segmentation in dry age-related macular degeneration in optical coherence tomography.

Age-related macular degeneration (AMD) is a progressive retinal disease, causing vision loss. A more detailed characterization of its atrophic form became possible thanks to the introduction of Optical Coherence Tomography (OCT). However, manual atrophy quantification in 3D retinal scans is a tedious task and prevents taking full advantage of the accurate retina depiction. In this study we developed a fully automated algorithm segmenting Retinal Pigment Epithelial and Outer Retinal Atrophy (RORA) in dry AMD on macular OCT. 62 SD-OCT scans from eyes with atrophic AMD (57 patients) were collected and split into train and test sets. The training set was used to develop a Convolutional Neural Network (CNN). The performance of the algorithm was established by cross validation and comparison to the test set with ground-truth annotated by two graders. Additionally, the effect of using retinal layer segmentation during training was investigated. The algorithm achieved mean Dice scores of 0.881 and 0.844, sensitivity of 0.850 and 0.915 and precision of 0.928 and 0.799 in comparison with Expert 1 and Expert 2, respectively. Using retinal layer segmentation improved the model performance. The proposed model identified RORA with performance matching human experts. It has a potential to rapidly identify atrophy with high consistency.

Personalized Atrophy Risk Mapping in Age-Related Macular Degeneration.

Purpose: To develop and validate an automatic retinal pigment epithelial and outer retinal atrophy (RORA) progression prediction model for nonexudative age-related macular degeneration (AMD) cases in optical coherence tomography (OCT) scans. Methods: Longitudinal OCT data from 129 eyes/119 patients with RORA was collected and separated into training and testing groups. RORA was automatically segmented in all scans and additionally manually annotated in the test scans. OCT-based features such as layers thicknesses, mean reflectivity, and a drusen height map served as an input to the deep neural network. Based on the baseline OCT scan or the previous visit OCT, en face RORA predictions were calculated for future patient visits. The performance was quantified over time with the means of Dice scores and square root area errors. Results: The average Dice score for segmentations at baseline was 0.85. When predicting progression from baseline OCTs, the Dice scores ranged from 0.73 to 0.80 for total RORA area and from 0.46 to 0.72 for RORA growth region. The square root area error ranged from 0.13 mm to 0.33 mm. By providing continuous time output, the model enabled creation of a patient-specific atrophy risk map. Conclusions: We developed a machine learning method for RORA progression prediction, which provides continuous-time output. It was used to compute atrophy risk maps, which indicate time-to-RORA-conversion, a novel and clinically relevant way of representing disease progression. Translational Relevance: Application of recent advances in artificial intelligence to predict patient-specific progression of atrophic AMD.

Automated Quantification of Pathological Fluids in Neovascular Age-Related Macular Degeneration, and Its Repeatability Using Deep Learning.

Purpose: To develop a reliable algorithm for the automated identification, localization, and volume measurement of exudative manifestations in neovascular age-related macular degeneration (nAMD), including intraretinal (IRF), subretinal fluid (SRF), and pigment epithelium detachment (PED), using a deep-learning approach. Methods: One hundred seven spectral domain optical coherence tomography (OCT) cube volumes were extracted from nAMD eyes. Manual annotation of IRF, SRF, and PED was performed. Ninety-two OCT volumes served as training and validation set, and 15 OCT volumes from different patients as test set. The performance of our fluid segmentation method was quantified by means of pixel-wise metrics and volume correlations and compared to other methods. Repeatability was tested on 42 other eyes with five OCT volume scans acquired on the same day. Results: The fully automated algorithm achieved good performance for the detection of IRF, SRF, and PED. The area under the curve for detection, sensitivity, and specificity was 0.97, 0.95, and 0.99, respectively. The correlation coefficients for the fluid volumes were 0.99, 0.99, and 0.91, respectively. The Dice score was 0.73, 0.67, and 0.82, respectively. For the largest volume quartiles the Dice scores were >0.90. Including retinal layer segmentation contributed positively to the performance. The repeatability of volume prediction showed a standard deviations of 4.0 nL, 3.5 nL, and 20.0 nL for IRF, SRF, and PED, respectively. Conclusions: The deep-learning algorithm can simultaneously acquire a high level of performance for the identification and volume measurements of IRF, SRF, and PED in nAMD, providing accurate and repeatable predictions. Including layer segmentation during training and squeeze-excite block in the network architecture were shown to boost the performance. Translational Relevance: Potential applications include measurements of specific fluid compartments with high reproducibility, assistance in treatment decisions, and the diagnostic or scientific evaluation of relevant subgroups.

Comparison of Drusen Volume Assessed by Two Different OCT Devices.

To compare drusen volume between Heidelberg Spectral Domain (SD-) and Zeiss Swept-Source (SS) PlexElite Optical Coherence Tomography (OCT) determined by manual and automated segmentation methods. Thirty-two eyes of 24 patients with Age-Related Macular Degeneration (AMD) and drusen maculopathy were included. In the central 1 and 3 mm ETDRS circle drusen volumes were calculated and compared. Drusen segmentation was performed using automated manufacturer algorithms of the two OCT devices. Then, the automated segmentation was manually corrected and compared and finally analyzed using customized software. Though on SD-OCT, there was a significant difference of mean drusen volume prior to and after manual correction (mean difference: 0.0188 ± 0.0269 mm3, p < 0.001, corr. p < 0.001, correlation of r = 0.90), there was no difference found on SS-OCT (mean difference: 0.0001 ± 0.0003 mm3, p = 0.262, corr. p = 0.524, r = 1.0). Heidelberg-acquired mean drusen volume after manual correction was significantly different from Zeiss-acquired drusen volume after manual correction (mean difference: 0.1231 ± 0.0371 mm3, p < 0.001, corr. p < 0.001, r = 0.68). Using customized software, the difference of measurements between both devices decreased and correlation among the measurements improved (mean difference: 0.0547 ± 0.0744 mm3, p = 0.02, corr. p = 0.08, r = 0.937). Heidelberg SD-OCT, the Zeiss PlexElite SS-OCT, and customized software all measured significantly different drusen volumes. Therefore, devices/algorithms may not be interchangeable. Third-party customized software helps to minimize differences, which may allow a pooling of data of different devices, e.g., in multicenter trials.

Automatically Enhanced OCT Scans of the Retina: A proof of concept study.

In this work we evaluated a postprocessing, customized automatic retinal OCT B-scan enhancement software for noise reduction, contrast enhancement and improved depth quality applicable to Heidelberg Engineering Spectralis OCT devices. A trained deep neural network was used to process images from an OCT dataset with ground truth biomarker gradings. Performance was assessed by the evaluation of two expert graders who evaluated image quality for B-scan with a clear preference for enhanced over original images. Objective measures such as SNR and noise estimation showed a significant improvement in quality. Presence grading of seven biomarkers IRF, SRF, ERM, Drusen, RPD, GA and iRORA resulted in similar intergrader agreement. Intergrader agreement was also compared with improvement in IRF and RPD, and disagreement in high variance biomarkers such as GA and iRORA.

RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge.

Retinal swelling due to the accumulation of fluid is associated with the most vision-threatening retinal diseases. Optical coherence tomography (OCT) is the current standard of care in assessing the presence and quantity of retinal fluid and image-guided treatment management. Deep learning methods have made their impact across medical imaging, and many retinal OCT analysis methods have been proposed. However, it is currently not clear how successful they are in interpreting the retinal fluid on OCT, which is due to the lack of standardized benchmarks. To address this, we organized a challenge RETOUCH in conjunction with MICCAI 2017, with eight teams participating. The challenge consisted of two tasks: fluid detection and fluid segmentation. It featured for the first time: all three retinal fluid types, with annotated images provided by two clinical centers, which were acquired with the three most common OCT device vendors from patients with two different retinal diseases. The analysis revealed that in the detection task, the performance on the automated fluid detection was within the inter-grader variability. However, in the segmentation task, fusing the automated methods produced segmentations that were superior to all individual methods, indicating the need for further improvements in the segmentation performance.

Efficient OCT Volume Reconstruction From Slitlamp Microscopes.

Since its introduction 25 years ago, Optical Coherence Tomography (OCT) has contributed tremendously to diagnostic and monitoring capabilities of pathologies in the field of ophthalmology. Despite rapid progress in hardware and software technology however, the price of OCT devices has remained high, limiting their use in private practice, and in screening examinations. In this paper, we present a slitlamp-integrated OCT device, built with off-the-shelf components, which can generate high-quality volumetric images of the posterior eye segment. To do so, we present a novel strategy for 3D image reconstruction in this challenging domain that allows us for state-of-the-art OCT volumes to be generated at fast speeds. The result is an OCT device that can match current systems in clinical practice, at a significantly lower cost.