Novel Fractal-Based Sub-RPE Compartment OCT Radiomics Biomarkers Are Associated With Subfoveal Geographic Atrophy in Dry AMD.

OBJECTIVE: The purpose of this study was to quantitatively characterize the shape of the sub-retinal pigment epithelium (sub-RPE, i.e., space bounded by RPE and Bruch's membrane) compartment on SD-OCT using fractal dimension (FD) features and evaluate their impact on risk of subfoveal geographic atrophy (sfGA) progression. METHODS: This was an IRB-approved retrospective study of 137 subjects with dry age-related macular degeneration (AMD) with subfoveal GA. Based on sfGA status at year five, eyes were categorized as "Progressors" and "Non-progressors". FD analysis allows quantification of the degree of shape complexity and architectural disorder associated with a structure. To characterize the structural irregularities along the sub-RPE surface between the two groups of patients, a total of 15 shape descriptors of FD were extracted from the sub-RPE compartment of baseline OCT scans. The top four features were identified using minimum Redundancy maximum Relevance (mRmR) feature selection method and evaluated with Random Forest (RF) classifier using three-fold cross validation from the training set (N = 90). Classifier performance was subsequently validated on the independent test set (N = 47). RESULTS: Using the top four FD features, a RF classifier yielded an AUC of 0.85 on the independent test set. Mean fractal entropy (p-value = 4.8e-05) was identified as the most significant biomarker; higher values of entropy being associated with greater shape disorder and risk for sfGA progression. CONCLUSIONS: FD assessment holds promise for identifying high-risk eyes for GA progression. SIGNIFICANCE: With further validation, FD features could be potentially used for clinical trial enrichment and assessments for therapeutic response in dry AMD patients.

OCT-Derived Radiomic Features Predict Anti-VEGF Response and Durability in Neovascular Age-Related Macular Degeneration.

Purpose: No established biomarkers currently exist for therapeutic efficacy and durability of anti-VEGF therapy in neovascular age-related macular degeneration (nAMD). This study evaluated radiomic-based quantitative OCT biomarkers that may be predictive of anti-VEGF treatment response and durability. Design: Assessment of baseline biomarkers using machine learning (ML) classifiers to predict tolerance to anti-VEGF therapy. Participants: Eighty-one participants with treatment-naïve nAMD from the OSPREY study, including 15 super responders (patients who achieved and maintained retinal fluid resolution) and 66 non-super responders (patients who did not achieve or maintain retinal fluid resolution). Methods: A total of 962 texture-based radiomic features were extracted from fluid, subretinal hyperreflective material (SHRM), and different retinal tissue compartments of OCT scans. The top 8 features, chosen by the minimum redundancy maximum relevance feature selection method, were evaluated using 4 ML classifiers in a cross-validated approach to distinguish between the 2 patient groups. Longitudinal assessment of changes in different texture-based radiomic descriptors (delta-texture features) between baseline and month 3 also was performed to evaluate their association with treatment response. Additionally, 8 baseline clinical parameters and a combination of baseline OCT, delta-texture features, and the clinical parameters were evaluated in a cross-validated approach in terms of association with therapeutic response. Main Outcome Measures: The cross-validated area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity were calculated to validate the classifier performance. Results: The cross-validated AUC by the quadratic discriminant analysis classifier was 0.75 ± 0.09 using texture-based baseline OCT features. The delta-texture features within different OCT compartments between baseline and month 3 yielded an AUC of 0.78 ± 0.08. The baseline clinical parameters sub-retinal pigment epithelium volume and intraretinal fluid volume yielded an AUC of 0.62 ± 0.07. When all the baseline, delta, and clinical features were combined, a statistically significant improvement in the classifier performance (AUC, 0.81 ± 0.07) was obtained. Conclusions: Radiomic-based quantitative assessment of OCT images was shown to distinguish between super responders and non-super responders to anti-VEGF therapy in nAMD. The baseline fluid and SHRM delta-texture features were found to be most discriminating across groups.

Computational Imaging Biomarker Correlation with Intraocular Cytokine Expression in Diabetic Macular Edema: Radiomics Insights from the IMAGINE Study.

Purpose: Various pathways and cytokines are implicated in pathogenesis of diabetic macular edema (DME). Computational imaging biomarkers (CIBs) of vessel tortuosity from ultra-widefield fluorescein angiography (UWFA) and texture patterns from OCT images have been associated with anti-vascular endothelial growth factor (VEGF) therapy treatment response in DME. This analysis was a radiogenomic assessment of the association between underlying cytokines, UWFA, and OCT-based DME CIBs. Design: Biclustering analysis based on UWFA and OCT CIBs to identify a common imaging phenotype across patients with subsequent assessment of underlying cytokine signatures and treatment response attributes. Participants: The IMAGINE DME study was a post hoc study of cytokine expressions that included 24 eyes with sufficient baseline aqueous humor samples and an in-depth assessment of the imaging studies obtained during the phase I/II DmeAntiVEgf study (DAVE) that measured different cytokine expressions. Methods: A total of 151 graph or morphologic features quantifying leakage shape, size, density, interobject distance, and architecture of leakage spots and 5 vessel tortuosity features were extracted from the baseline UWFA scans, and 494 texture-based radiomics features were extracted from each of the fluid and retinal tissue compartments of OCT images. Biclustering enables simultaneous clustering of patients and features and was used to aggregate patients in terms of their commonality of phenotypes (based on similar imaging attributes) and to identify commonality in terms of cytokine expression and treatment response to anti-VEGF therapy. Main Outcome Measures: Identification of eyes with similar imaging phenotypes to evaluate commonalities of patterns and underlying cytokine expression. Results: Strong correlations between VEGF and 7 UWFA leakage morphologic features (Pearson correlation coefficient [PCC], 0.45-0.51; P < 0.05), 1 vascular tortuosity-based UWFA feature (PCC, 0.45; P = 0.00016), and 2 OCT-derived intraretinal fluid texture features (PCC, 0.58-0.63; P < 0.05) were identified. Strong correlation between intraretinal fluid features and other cytokines (PCC, 0.41-0.59; P < 0.05) were also observed. Conclusions: This study identified groups of eyes with similar imaging phenotypes as defined by UWFA and OCT CIBs that demonstrated similar treatment response patterns and cytokine expression, including a strong association between VEGF with UWFA-derived leakage morphologic and vessel tortuosity features.

Evaluating the utility of deep learning for predicting therapeutic response in diabetic eye disease.

Purpose: Deep learning (DL) is a technique explored within ophthalmology that requires large datasets to distinguish feature representations with high diagnostic performance. There is a need for developing DL approaches to predict therapeutic response, but completed clinical trial datasets are limited in size. Predicting treatment response is more complex than disease diagnosis, where hallmarks of treatment response are subtle. This study seeks to understand the utility of DL for clinical problems in ophthalmology such as predicting treatment response and where large sample sizes for model training are not available. Materials and Methods: Four DL architectures were trained using cross-validated transfer learning to classify ultra-widefield angiograms (UWFA) and fluid-compartmentalized optical coherence tomography (OCT) images from a completed clinical trial (PERMEATE) dataset (n=29) as tolerating or requiring extended interval Anti-VEGF dosing. UWFA images (n=217) from the Anti-VEGF study were divided into five increasingly larger subsets to evaluate the influence of dataset size on performance. Class activation maps (CAMs) were generated to identify regions of model attention. Results: The best performing DL model had a mean AUC of 0.507 ± 0.042 on UWFA images, and highest observed AUC of 0.503 for fluid-compartmentalized OCT images. DL had a best performing AUC of 0.634 when dataset size was incrementally increased. Resulting CAMs show inconsistent regions of interest. Conclusions: This study demonstrated the limitations of DL for predicting therapeutic response when large datasets were not available for model training. Our findings suggest the need for hand-crafted approaches for complex and data scarce prediction problems in ophthalmology.

Quantitative Imaging Biomarkers in Age-Related Macular Degeneration and Diabetic Eye Disease: A Step Closer to Precision Medicine.

The management of retinal diseases relies heavily on digital imaging data, including optical coherence tomography (OCT) and fluorescein angiography (FA). Targeted feature extraction and the objective quantification of features provide important opportunities in biomarker discovery, disease burden assessment, and predicting treatment response. Additional important advantages include increased objectivity in interpretation, longitudinal tracking, and ability to incorporate computational models to create automated diagnostic and clinical decision support systems. Advances in computational technology, including deep learning and radiomics, open new doors for developing an imaging phenotype that may provide in-depth personalized disease characterization and enhance opportunities in precision medicine. In this review, we summarize current quantitative and radiomic imaging biomarkers described in the literature for age-related macular degeneration and diabetic eye disease using imaging modalities such as OCT, FA, and OCT angiography (OCTA). Various approaches used to identify and extract these biomarkers that utilize artificial intelligence and deep learning are also summarized in this review. These quantifiable biomarkers and automated approaches have unleashed new frontiers of personalized medicine where treatments are tailored, based on patient-specific longitudinally trackable biomarkers, and response monitoring can be achieved with a high degree of accuracy.

Characterization of Ultra-Widefield Angiographic Vascular Features in Diabetic Retinopathy with Automated Severity Classification.

PURPOSE: To determine the association between diabetic retinopathy (DR) severity and quantitative retinal vascular features. DESIGN: Retrospective image analysis study. PARTICIPANTS: Eyes with DR and eyes with no posterior segment disease (normal eyes) that had undergone ultra-widefield fluorescein angiography (UWFA) with associated color fundus photography. Exclusion criteria were any previous laser photocoagulation, low image quality, intravitreal or periocular pharmacotherapy within 6 months of imaging, and any other significant retinal disease including posterior uveitis, retinal vein occlusion, and choroidal neovascularization. METHODS: The centered early mid-phase UWFA frame that captured the maximum vessel area was selected using automated custom software for each eye. Panretinal and zonal vascular features were extracted using a machine learning algorithm. Eyes with DR were graded for DR severity as mild nonproliferative DR (NPDR), moderate NPDR, severe NPDR, and proliferative DR (PDR). Parameters of normal eyes were compared with age- and gender-matched patients with DR using the t test. Differences between severity groups were evaluated by the analysis of variance and Kruskal-Wallis tests, generalized linear mixed-effects models, and random forest regression models. MAIN OUTCOME MEASURES: Diabetic retinopathy severity and vascular features (panretinal and zonal vessel area, length and geodesic distance, panretinal area index, tortuosity measures, vascular density measures, and zero vessel density rate). RESULTS: Ninety-seven eyes from 60 patients with DR and 12 normal eyes from 12 patients that underwent UWFA for evaluation of fellow eye pathology had images of sufficient quality to be included in this analysis. The mean age was 60 ± 10 years in DR eyes and 46 ± 17 years in normal eyes. Panretinal vessel area, mean geodesic distance, skewness, and kurtosis of local vessel density was significantly higher in normal eyes compared with the age- and gender-matched eyes with DR (P < 0.05). Zero vessel density rate, skewness of vessel density, and mean mid-peripheral geodesic distance were among the most important features for distinguishing mild NPDR from advanced forms of DR and PDR versus eyes without PDR. CONCLUSIONS: Automated analysis of retinal vasculature demonstrated associations with DR severity and visual and subvisual vascular biomarkers. Further studies are needed to evaluate the clinical significance of these parameters for DR prognosis and therapeutic response.

Automatic Detection of Retinal Lesions for Screening of Diabetic Retinopathy.

OBJECTIVE: Diabetic retinopathy (DR) is characterized by the progressive deterioration of retina with the appearance of different types of lesions that include microaneurysms, hemorrhages, exudates, etc. Detection of these lesions plays a significant role for early diagnosis of DR. METHODS: To this aim, this paper proposes a novel and automated lesion detection scheme, which consists of the four main steps: vessel extraction and optic disc removal, preprocessing, candidate lesion detection, and postprocessing. The optic disc and the blood vessels are suppressed first to facilitate further processing. Curvelet-based edge enhancement is done to separate out the dark lesions from the poorly illuminated retinal background, while the contrast between the bright lesions and the background is enhanced through an optimally designed wideband bandpass filter. The mutual information of the maximum matched filter response and the maximum Laplacian of Gaussian response are then jointly maximized. Differential evolution algorithm is used to determine the optimal values for the parameters of the fuzzy functions that determine the thresholds of segmenting the candidate regions. Morphology-based postprocessing is finally applied to exclude the falsely detected candidate pixels. RESULTS AND CONCLUSIONS: Extensive simulations on different publicly available databases highlight an improved performance over the existing methods with an average accuracy of and robustness in detecting the various types of DR lesions irrespective of their intrinsic properties.

Blood vessel extraction and optic disc removal using curvelet transform and kernel fuzzy c-means.

This paper proposes an automatic blood vessel extraction method on retinal images using matched filtering in an integrated system design platform that involves curvelet transform and kernel based fuzzy c-means. Since curvelet transform represents the lines, the edges and the curvatures very well and in compact form (by less number of coefficients) compared to other multi-resolution techniques, this paper uses curvelet transform for enhancement of the retinal vasculature. Matched filtering is then used to intensify the blood vessels' response which is further employed by kernel based fuzzy c-means algorithm that extracts the vessel silhouette from the background through non-linear mapping. For pathological images, in addition to matched filtering, Laplacian of Gaussian filter is also employed to distinguish the step and the ramp like signal from that of vessel structure. To test the efficacy of the proposed method, the algorithm has also been applied to images in presence of additive white Gaussian noise where the curvelet transform has been used for image denoising. Performance is evaluated on publicly available DRIVE, STARE and DIARETDB1 databases and is compared with the large number of existing blood vessel extraction methodologies. Simulation results demonstrate that the proposed method is very much efficient in detecting the long and the thick as well as the short and the thin vessels with an average accuracy of 96.16% for the DRIVE and 97.35% for the STARE database wherein the existing methods fail to extract the tiny and the thin vessels.