[Monitoring of the progression of geographic atrophy with optical coherence tomography]. / Monitoring der Progression von geografischer Atrophie in der optischen Kohärenztomographie.

With the prospect of available therapy for geographic atrophy in the near future and consequently increasing patient numbers, appropriate management strategies for the clinical practice are needed. Optical coherence tomography (OCT) as well as automated OCT analysis using artificial intelligence algorithms provide optimal conditions for assessing disease activity as well as the treatment response for geographic atrophy through a rapid, precise and resource-efficient evaluation.

Deep survival modeling of longitudinal retinal OCT volumes for predicting the onset of atrophy in patients with intermediate AMD.

In patients with age-related macular degeneration (AMD), the risk of progression to late stages is highly heterogeneous, and the prognostic imaging biomarkers remain unclear. We propose a deep survival model to predict the progression towards the late atrophic stage of AMD. The model combines the advantages of survival modelling, accounting for time-to-event and censoring, and the advantages of deep learning, generating prediction from raw 3D OCT scans, without the need for extracting a predefined set of quantitative biomarkers. We demonstrate, in an extensive set of evaluations, based on two large longitudinal datasets with 231 eyes from 121 patients for internal evaluation, and 280 eyes from 140 patients for the external evaluation, that this model improves the risk estimation performance over standard deep learning classification models.

Progression Dynamics of Early versus Later Stage Atrophic Lesions in Nonneovascular Age-Related Macular Degeneration Using Quantitative OCT Biomarker Segmentation.

PURPOSE: To investigate the progression of geographic atrophy secondary to nonneovascular age-related macular degeneration in early and later stage lesions using artificial intelligence-based precision tools. DESIGN: Retrospective analysis of an observational cohort study. SUBJECTS: Seventy-four eyes of 49 patients with ≥ 1 complete retinal pigment epithelial and outer retinal atrophy (cRORA) lesion secondary to age-related macular degeneration were included. Patients were divided between recently developed cRORA and lesions with advanced disease status. METHODS: Patients were prospectively imaged by spectral-domain OCT volume scans. The study period encompassed 18 months with scheduled visits every 6 months. Growth rates of recent cRORA-converted lesions were compared with lesions in an advanced disease status using mixed effect models. MAIN OUTCOME MEASURES: The progression of retinal pigment epithelial loss (RPEL) was considered the primary end point. Secondary end points consisted of external limiting membrane disruption and ellipsoid zone loss. These pathognomonic imaging biomarkers were quantified using validated deep-learning algorithms. Further, the ellipsoid zone/RPEL ratio was analyzed in both study cohorts. RESULTS: Mean (95% confidence interval [CI]) square root progression of recently converted lesions was 79.68 (95% CI, -77.14 to 236.49), 68.22 (95% CI, -101.21 to 237.65), and 84.825 (95% CI, -124.82 to 294.47) mm/half year for RPEL, external limiting membrane loss, and ellipsoid zone loss respectively. Mean square root progression of advanced lesions was 131.74 (95% CI, -22.57 to 286.05), 129.96 (95% CI, -36.67 to 296.59), and 116.84 (95% CI, -90.56 to 324.3) mm/half year for RPEL, external limiting membrane loss, and ellipsoid zone loss, respectively. RPEL (P = 0.038) and external limiting membrane disruption (P = 0.026) progression showed significant differences between the 2 study cohorts. Further recent converters had significantly (P < 0.001) higher ellipsoid zone/RPEL ratios at all time points compared with patients in an advanced disease status (1.71 95% CI, 1.12-2.28 vs. 1.14; 95% CI, 0.56-1.71). CONCLUSION: Early cRORA lesions have slower growth rates in comparison to atrophic lesions in advanced disease stages. Differences in growth dynamics may play a crucial role in understanding the pathophysiology of nonneovascular age-related macular degeneration and for the interpretation of clinical trials in geographic atrophy. Individual disease monitoring using artificial intelligence-based quantification paves the way toward optimized geographic atrophy management. FINANCIAL DISCLOSURE(S): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

Point-to-point associations of drusen and hyperreflective foci volumes with retinal sensitivity in non-exudative age-related macular degeneration.

OBJECTIVES: To evaluate the quantitative impact of drusen and hyperreflective foci (HRF) volumes on mesopic retinal sensitivity in non-exudative age-related macular degeneration (AMD). METHODS: In a standardized follow-up scheme of every three months, retinal sensitivity of patients with early or intermediate AMD was assessed by microperimetry using a custom pattern of 45 stimuli (Nidek MP-3, Gamagori, Japan). Eyes were consecutively scanned using Spectralis SD-OCT (20° × 20°, 1024 × 97 × 496). Fundus photographs obtained by the MP-3 allowed to map the stimuli locations onto the corresponding OCT scans. The volume and mean thickness of drusen and HRF within a circle of 240 µm centred at each stimulus point was determined using automated AI-based image segmentation algorithms. RESULTS: 8055 individual stimuli from 179 visits from 51 eyes of 35 consecutive patients were matched with the respective OCT images in a point-to-point manner. The patients mean age was 76.85 ± 6.6 years. Mean retinal sensitivity at baseline was 25.7 dB. 73.47% of all MP-spots covered drusen area and 2.02% of MP-spots covered HRF. A negative association between retinal sensitivity and the volume of underlying drusen (p < 0.001, Estimate -0.991 db/µm3) and HRF volume (p = 0.002, Estimate -5.230 db/µm3) was found. During observation time, no eye showed conversion to advanced AMD. CONCLUSION: A direct correlation between drusen and lower sensitivity of the overlying photoreceptors can be observed. For HRF, a small but significant correlation was shown, which is compromised by their small size. Biomarker quantification using AI-methods allows to determine the impact of sub-clinical features in the progression of AMD.

Clinical validation for automated geographic atrophy monitoring on OCT under complement inhibitory treatment.

Geographic atrophy (GA) represents a late stage of age-related macular degeneration, which leads to irreversible vision loss. With the first successful therapeutic approach, namely complement inhibition, huge numbers of patients will have to be monitored regularly. Given these perspectives, a strong need for automated GA segmentation has evolved. The main purpose of this study was the clinical validation of an artificial intelligence (AI)-based algorithm to segment a topographic 2D GA area on a 3D optical coherence tomography (OCT) volume, and to evaluate its potential for AI-based monitoring of GA progression under complement-targeted treatment. 100 GA patients from routine clinical care at the Medical University of Vienna for internal validation and 113 patients from the FILLY phase 2 clinical trial for external validation were included. Mean Dice Similarity Coefficient (DSC) was 0.86 ± 0.12 and 0.91 ± 0.05 for total GA area on the internal and external validation, respectively. Mean DSC for the GA growth area at month 12 on the external test set was 0.46 ± 0.16. Importantly, the automated segmentation by the algorithm corresponded to the outcome of the original FILLY trial measured manually on fundus autofluorescence. The proposed AI approach can reliably segment GA area on OCT with high accuracy. The availability of such tools represents an important step towards AI-based monitoring of GA progression under treatment on OCT for clinical management as well as regulatory trials.

Correlation of vascular and fluid-related parameters in neovascular age-related macular degeneration using deep learning.

PURPOSE: To identify correlations between the vascular characteristics of macular neovascularization (MNV) obtained by optical coherence tomography angiography (OCTA) and distinct retinal fluid volumes in neovascular age-related macular degeneration (nAMD). METHODS: In this prospective interventional study, 54 patients with treatment-naïve type 1 or 2 nAMD were included and treated with intravitreal aflibercept. At baseline and month 1, each patient underwent a SD-OCT volume scan and volumetric flow scan using a swept-source OCTA. A deep learning algorithm was used to automatically detect and quantify fluid in OCT scans. Angio Tool, a National Cancer Institute algorithm, was used to skeletonize MNV properties and quantify lesion size (LS), vessel area (VA), vessel density (VD), total number of endpoints (TNE), total number of junctions (TNJ), junction density (JD), total vessel length (TVL), average vessel length (AVL) and mean-e-lacunarity (MEL). Subsequently, linear regression models were used to investigate a correlation between OCTA parameters and fluid quantifications. RESULTS: The median amount of fluid within the central 6-mm EDTRS ring was 173.7 nl at baseline, consisting of 156.6 nl of subretinal fluid (SRF) and 2.3 nl of intraretinal fluid (IRF). Fluid decreased significantly in all compartments to 1.76 nl (SRF) and 0.64 nl (IRF). The investigated MNV parameters did not change significantly after the first treatment. There was no significant correlation between MNV parameters and relative fluid decrease after anti-VEGF treatment. Baseline fluid correlated statistically significant but weakly with TNE (p = 0.002, R2  = 0.17), SRF with TVL (p = 0.04, R2  = 0.08), VD (p = 0.046, R2  = 0.08), TNE (p = 0.001, R2  = 0.20) and LS (p = 0.033, R2  = 0.09). IRF correlated with VA (p = 0.042, R2  = 0.08).The amount of IRF at month 1 correlated significantly but weakly with VD (p = 0.036, R2  = 0.08), JD (p = 0.019, R2  = 0.10) and MEL (p = 0.005, R2  = 0.14). CONCLUSION: Macular neovascularization parameters at baseline and month 1 played only a minor role in the exudation process in nAMD. None of the MNV parameters were correlated with the treatment response.

Predicting Topographic Disease Progression and Treatment Response of Pegcetacoplan in Geographic Atrophy Quantified by Deep Learning.

PURPOSE: To identify disease activity and effects of intravitreal pegcetacoplan treatment on the topographic progression of geographic atrophy (GA) secondary to age-related macular degeneration quantified in spectral-domain OCT (SD-OCT) by automated deep learning assessment. DESIGN: Retrospective analysis of a phase II clinical trial study evaluating pegcetacoplan in GA patients (FILLY, NCT02503332). SUBJECTS: SD-OCT scans of 57 eyes with monthly treatment, 46 eyes with every-other-month (EOM) treatment, and 53 eyes with sham injection from baseline and 12-month follow-ups were included, in a total of 312 scans. METHODS: Retinal pigment epithelium loss, photoreceptor (PR) integrity, and hyperreflective foci (HRF) were automatically segmented using validated deep learning algorithms. Local progression rate (LPR) was determined from a growth model measuring the local expansion of GA margins between baseline and 1 year. For each individual margin point, the eccentricity to the foveal center, the progression direction, mean PR thickness, and HRF concentration in the junctional zone were computed. Mean LPR in disease activity and treatment effect conditioned on these properties were estimated by spatial generalized additive mixed-effect models. MAIN OUTCOME MEASURES: LPR of GA, PR thickness, and HRF concentration in µm. RESULTS: A total of 31,527 local GA margin locations were analyzed. LPR was higher for areas with low eccentricity to the fovea, thinner PR layer thickness, or higher HRF concentration in the GA junctional zone. When controlling for topographic and structural risk factors, we report on average a significantly lower LPR by -28.0% (95% confidence interval [CI], -42.8 to -9.4; P = 0.0051) and -23.9% (95% CI, -40.2 to -3.0; P = 0.027) for monthly and EOM-treated eyes, respectively, compared with sham. CONCLUSIONS: Assessing GA progression on a topographic level is essential to capture the pathognomonic heterogeneity in individual lesion growth and therapeutic response. Pegcetacoplan-treated eyes showed a significantly slower GA lesion progression rate compared with sham, and an even slower growth rate toward the fovea. This study may help to identify patient cohorts with faster progressing lesions, in which pegcetacoplan treatment would be particularly beneficial. Automated artificial intelligence-based tools will provide reliable guidance for the management of GA in clinical practice.

Comparison of Fundus Autofluorescence Versus Optical Coherence Tomography-based Evaluation of the Therapeutic Response to Pegcetacoplan in Geographic Atrophy.

PURPOSE: To perform an optical coherence tomography (OCT)-based analysis of geographic atrophy (GA) progression in patients treated with pegcetacoplan. DESIGN: Post hoc analysis of a phase 2 multicenter, randomized, sham-controlled trial. METHODS: Manual annotation of retinal pigment epithelium (RPE), ellipsoid zone (EZ), and external limiting membrane (ELM) loss was performed on OCT volumes from baseline and month 12 from the phase 2 FILLY trial of intravitreal pegcetacoplan for the treatment of GA secondary to age-related macular degeneration. MAIN OUTCOME MEASURES: Correlation of GA areas measured on fundus autofluorescence and OCT. Difference in square root transformed growth rates of RPE, EZ, and ELM loss between treatment groups (monthly injection [AM], injection every other month [AEOM], and sham [SM]). RESULTS: OCT volumes from 113 eyes of 113 patients (38 AM, 36 AEOM, and 39 SM) were included, resulting in 11 074 B-scans. The median growth of RPE loss was significantly slower in the AM group (0.158 [0.057-0.296]) than the SM group (0.255 [0.188-0.359], P = .014). Importantly, the growth of EZ loss was also significantly slower in the AM group (0.127 [0.041-0.247]) than the SM group (0.232 [0.130-0.349], P = .017). There was no significant difference in the growth of ELM loss between the treatment groups (P = .114). CONCLUSIONS: OCT imaging provided consistent results for GA growth compared with fundus autofluorescence. In addition to slower RPE atrophy progression in patients treated with pegcetacoplan, a significant reduction in EZ impairment was also identified by OCT, suggesting the use of OCT as a potentially more sensitive monitoring tool in GA therapy.

The Effect of Pegcetacoplan Treatment on Photoreceptor Maintenance in Geographic Atrophy Monitored by Artificial Intelligence-Based OCT Analysis.

PURPOSE: To investigate the therapeutic effect of intravitreal pegcetacoplan on the inhibition of photoreceptor (PR) loss and thinning in geographic atrophy (GA) on conventional spectral-domain OCT (SD-OCT) imaging by deep learning-based automated PR quantification. DESIGN: Post hoc analysis of a prospective, multicenter, randomized, sham (SM)-controlled, masked phase II trial investigating the safety and efficacy of pegcetacoplan for the treatment of GA because of age-related macular degeneration. PARTICIPANTS: Study eyes of 246 patients, randomized 1:1:1 to monthly (AM), bimonthly (AEOM), and SM treatment. METHODS: We performed fully automated, deep learning-based segmentation of retinal pigment epithelium (RPE) loss and PR thickness on SD-OCT volumes acquired at baseline and months 2, 6, and 12. The difference in the change of PR loss area was compared among the treatment arms. Change in PR thickness adjacent to the GA borders and the entire 20° scanning area was compared between treatment arms. MAIN OUTCOME MEASURES: Square-root transformed PR loss area in µm or mm, PR thickness in µm, and PR loss/RPE loss ratio. RESULTS: A total of 31 556 B-scans of 644 SD-OCT volumes of 161 study eyes (AM 52, AEOM 54, SM 56) were evaluated from baseline to month 12. Comparison of the mean change in PR loss area revealed statistically significantly less growth in the AM group at months 2, 6, and 12 than in the SM group (-41 µm ± 219 vs. 77 µm ± 126; P = 0.0004; -5 µm ± 221 vs. 156 µm ± 139; P < 0.0001; 106 µm ± 400 vs. 283 µm ± 226; P = 0.0014). Photoreceptor thinning was significantly reduced under AM treatment compared with SM within the GA junctional zone, as well as throughout the 20° area. A trend toward greater inhibition of PR loss than RPE loss was observed under therapy. CONCLUSIONS: Distinct and reliable quantification of PR loss using deep learning-based algorithms offers an essential tool to evaluate therapeutic efficacy in slowing disease progression. Photoreceptor loss and thinning are reduced by intravitreal complement C3 inhibition. Automated quantification of PR loss/maintenance based on OCT images is an ideal approach to reliably monitor disease activity and therapeutic efficacy in GA management in clinical routine and regulatory trials.

Linking Function and Structure with ReSensNet: Predicting Retinal Sensitivity from OCT using Deep Learning.

PURPOSE: The currently used measures of retinal function are limited by being subjective, nonlocalized, or taxing for patients. To address these limitations, we sought to develop and evaluate a deep learning (DL) method to automatically predict the functional end point (retinal sensitivity) based on structural OCT images. DESIGN: Retrospective, cross-sectional study. SUBJECTS: In total, 714 volumes of 289 patients were used in this study. METHODS: A DL algorithm was developed to automatically predict a comprehensive retinal sensitivity map from an OCT volume. Four hundred sixty-three spectral-domain OCT volumes from 174 patients and their corresponding microperimetry examinations (Nidek MP-1) were used for development and internal validation, with a total of 15 563 retinal sensitivity measurements. The patients presented with a healthy macula, early or intermediate age-related macular degeneration, choroidal neovascularization, or geographic atrophy. In addition, an external validation was performed using 251 volumes of 115 patients, comprising 3 different patient populations: those with diabetic macular edema, retinal vein occlusion, or epiretinal membrane. MAIN OUTCOME MEASURES: We evaluated the performance of the algorithm using the mean absolute error (MAE), limits of agreement (LoA), and correlation coefficients of point-wise sensitivity (PWS) and mean sensitivity (MS). RESULTS: The algorithm achieved an MAE of 2.34 dB and 1.30 dB, an LoA of 5.70 and 3.07, a Pearson correlation coefficient of 0.66 and 0.84, and a Spearman correlation coefficient of 0.68 and 0.83 for PWS and MS, respectively. In the external test set, the method achieved an MAE of 2.73 dB and 1.66 dB for PWS and MS, respectively. CONCLUSIONS: The proposed approach allows the prediction of retinal function at each measured location directly based on an OCT scan, demonstrating how structural imaging can serve as a surrogate of visual function. Prospectively, the approach may help to complement retinal function measures, explore the association between image-based information and retinal functionality, improve disease progression monitoring, and provide objective surrogate measures for future clinical trials.

AI-based monitoring of retinal fluid in disease activity and under therapy.

Retinal fluid as the major biomarker in exudative macular disease is accurately visualized by high-resolution three-dimensional optical coherence tomography (OCT), which is used world-wide as a diagnostic gold standard largely replacing clinical examination. Artificial intelligence (AI) with its capability to objectively identify, localize and quantify fluid introduces fully automated tools into OCT imaging for personalized disease management. Deep learning performance has already proven superior to human experts, including physicians and certified readers, in terms of accuracy and speed. Reproducible measurement of retinal fluid relies on precise AI-based segmentation methods that assign a label to each OCT voxel denoting its fluid type such as intraretinal fluid (IRF) and subretinal fluid (SRF) or pigment epithelial detachment (PED) and its location within the central 1-, 3- and 6-mm macular area. Such reliable analysis is most relevant to reflect differences in pathophysiological mechanisms and impacts on retinal function, and the dynamics of fluid resolution during therapy with different regimens and substances. Yet, an in-depth understanding of the mode of action of supervised and unsupervised learning, the functionality of a convolutional neural net (CNN) and various network architectures is needed. Greater insight regarding adequate methods for performance, validation assessment, and device- and scanning-pattern-dependent variations is necessary to empower ophthalmologists to become qualified AI users. Fluid/function correlation can lead to a better definition of valid fluid variables relevant for optimal outcomes on an individual and a population level. AI-based fluid analysis opens the way for precision medicine in real-world practice of the leading retinal diseases of modern times.

Impact of Intra- and Subretinal Fluid on Vision Based on Volume Quantification in the HARBOR Trial.

PURPOSE: To investigate the functional associations of intraretinal fluid (IRF) and subretinal fluid (SRF) volumes at baseline and after the loading dose as well as fluid change after the first injection with best-corrected visual acuity (BCVA) in patients with neovascular age-related macular degeneration (nAMD) who received an anti-VEGF treatment over 24 months. DESIGN: Post hoc analysis of a phase III, randomized, multicenter trial in which ranibizumab was administered monthly or in a pro re nata regimen (HARBOR). PARTICIPANTS: Study eyes of 1094 treatment-naïve patients with nAMD. METHODS: IRF and SRF volumes were segmented automatically on monthly spectral domain OCT images. Fluid volumes and changes thereof were included as covariates into longitudinal mixed-effects models, which modeled BCVA trajectories. MAIN OUTCOME MEASURES: BCVA estimates corresponding to baseline, follow-up, and persistent IRF/SRF volumes after the loading dose; BCVA estimates of change in fluid volumes after the first injection; and marginal and conditional R2. RESULTS: Analysis of 22 494 volumetric scans revealed that foveal IRF consistently shows a negative correlation with BCVA at baseline and subsequent visits (-3.23 and -4.32 letters/100 nL, respectively). After the first injection, BCVA increased by +2.13 letters/100 nL decrease in foveal IRF. Persistent IRF was associated with lower baseline BCVA and less improvement. Foveal SRF correlated with better BCVA at baseline and subsequent visits (+6.52 and +1.42 letters/100 nL, respectively). After the first injection, SRF decrease was associated with significant vision gain (+5.88 letters/100 nL). Foveal fluid correlated more with BCVA than parafoveal IRF/SRF. CONCLUSIONS: Although IRF consistently correlates with decreased function and recovery throughout therapy, SRF is associated with a more pronounced functional improvement. Moreover, SRF resolution provides increased benefit. Fluid-function correlation represents an essential base for the development of personalized treatment regimens, optimizing functional outcomes, and reducing treatment burden.

Spatio-temporal alterations in retinal and choroidal layers in the progression of age-related macular degeneration (AMD) in optical coherence tomography.

Age-related macular degeneration (AMD) is the predominant cause of vision loss in the elderly with a major impact on ageing societies and healthcare systems. A major challenge in AMD management is the difficulty to determine the disease stage, the highly variable progression speed and the risk of conversion to advanced AMD, where irreversible functional loss occurs. In this study we developed an optical coherence tomography (OCT) imaging based spatio-temporal reference frame to characterize the morphologic progression of intermediate age-related macular degeneration (AMD) and to identify distinctive patterns of conversion to the advanced stages macular neovascularization (MNV) and macular atrophy (MA). We included 10,040 OCT volumes of 518 eyes with intermediate AMD acquired according to a standardized protocol in monthly intervals over two years. Two independent masked retina specialists determined the time of conversion to MNV or MA. All scans were aligned to a common reference frame by intra-patient and inter-patient registration. Automated segmentations of retinal layers and the choroid were computed and en-face maps were transformed into the common reference frame. Population maps were constructed in the subgroups converting to MNV (n=135), MA (n=50) and in non-progressors (n=333). Topographically resolved maps of changes were computed and tested for statistical significant differences. The development over time was analysed by a joint model accounting for longitudinal and right-censoring aspect. Significantly enhanced thinning of the outer nuclear layer (ONL) and retinal pigment epithelium (RPE)-photoreceptorinner segment/outer segment (PR-IS/OS) layers within the central 3 mm and a faster thinning speed preceding conversion was documented for MA progressors. Converters to MNV presented an accelerated thinning of the choroid and appearance changes in the choroid prior to MNV onset. The large-scale automated image analysis allowed us to distinctly assess the progression of morphologic changes in intermediate AMD based on conventional OCT imaging. Distinct topographic and temporal patterns allow to prospectively determine eyes with risk of progression and thereby greatly improving early detection, prevention and development of novel therapeutic strategies.

ANALYSIS OF FLUID VOLUME AND ITS IMPACT ON VISUAL ACUITY IN THE FLUID STUDY AS QUANTIFIED WITH DEEP LEARNING.

PURPOSE: To investigate quantitative differences in fluid volumes between subretinal fluid (SRF)-tolerant and SRF-intolerant treat-and-extend regimens for neovascular age-related macular degeneration and analyze the association with best-corrected visual acuity. METHODS: Macular fluid (SRF and intraretinal fluid) was quantified on optical coherence tomography volumetric scans using a trained and validated deep learning algorithm. Fluid volumes and complete resolution was automatically assessed throughout the study. The impact of fluid location and volumes on best-corrected visual acuity was computed using mixed-effects regression models. RESULTS: Baseline fluid quantifications for 348 eyes from 348 patients were balanced (all P > 0.05). No quantitative differences in SRF/intraretinal fluid between the treatment arms was found at any study-specific time point (all P > 0.05). Compared with qualitative assessment, the proportion of eyes without SRF/intraretinal fluid did not differ between the groups at any time point (all P > 0.05). Intraretinal fluid in the central 1 mm and SRF in the 1-mm to 6-mm macular area were negatively associated with best-corrected visual acuity (-2.8 letters/100 nL intraretinal fluid, P = 0.007 and -0.20 letters/100 nL SRF, P = 0.005, respectively). CONCLUSION: Automated fluid quantification using artificial intelligence allows objective and precise assessment of macular fluid volume and location. Precise determination of fluid parameters will help improve therapeutic efficacy of treatment in neovascular age-related macular degeneration.

Quantification of Fluid Resolution and Visual Acuity Gain in Patients With Diabetic Macular Edema Using Deep Learning: A Post Hoc Analysis of a Randomized Clinical Trial.

Importance: Large amounts of optical coherence tomographic (OCT) data of diabetic macular edema (DME) are acquired, but many morphologic features have yet to be identified and quantified. Objective: To examine the volumetric change of intraretinal fluid (IRF) and subretinal fluid (SRF) in DME during anti-vascular endothelial growth factor treatment using deep learning algorithms. Design, Setting, and Participants: This post hoc analysis of a randomized clinical trial, the Diabetic Retinopathy Clinical Research Network (protocol T), assessed 6945 spectral-domain OCT volume scans of 570 eyes from 570 study participants with DME. The original trial was performed from August 21, 2012, to October 18, 2018. This analysis was performed from December 7, 2017, to January 15, 2020. Interventions: Participants were treated according to a predefined, standardized protocol with aflibercept, ranibizumab, or bevacizumab with or without deferred laser. Main Outcomes and Measures: The association of treatment with IRF and SRF volumes and best-corrected visual acuity (BCVA) during 12 months using deep learning algorithms. Results: Among the 570 study participants (302 [53%] male; 369 [65%] white; mean [SD] age, 43.4 [12.6] years), the mean fluid volumes in the central 3 mm were 448.6 nL (95% CI, 412.3-485.0 nL) of IRF and 36.9 nL (95% CI, 27.0-46.7 nL) of SRF at baseline and 161.2 nL (95% CI, 135.1-187.4 nL) of IRF and 4.4 nL (95% CI, 1.7-7.1 nL) of SRF at 12 months. The presence of SRF at baseline was associated with a worse baseline BCVA Early Treatment Diabetic Retinopathy Study (ETDRS) score of 63.2 (95% CI, 60.2-66.1) (approximate Snellen equivalent of 20/63 [95% CI, 20/50-20/63]) in eyes with SRF vs 66.9 (95% CI, 65.7-68.1) (approximate Snellen equivalent, 20/50 [95% CI, 20/40-20/50]) without SRF (P < .001) and a greater gain in ETDRS score (0.5; 95% CI, 0.3-0.8) every 4 weeks during follow-up in eyes with SRF at baseline vs 0.4 (95% CI, 0.3-0.5) in eyes without SRF at baseline (P = .02) when adjusted for baseline BCVA. Aflibercept was associated with greater reduction of IRF volume compared with bevacizumab after the first injection (difference, 79.8 nL; 95% CI, 5.3-162.5 nL; P < .001) and every 4 weeks thereafter (difference, 10.4 nL; 95% CI, 0.7-20.0 nL; P = .004). Ranibizumab was associated with a greater reduction of IRF after the first injection compared with bevacizumab (difference, 75.2 nL; 95% CI, 1.4-154.7 nL; P < .001). Conclusions and Relevance: Automated segmentation of fluid in DME revealed that the presence of SRF was associated with lower baseline BCVA but with good response to anti-vascular endothelial growth factor therapy. These automated spectral-domain OCT analyses may be used clinically to assess anatomical change during therapy. Trial Registration: ClinicalTrials.gov Identifier: NCT01627249.

Characterization of Drusen and Hyperreflective Foci as Biomarkers for Disease Progression in Age-Related Macular Degeneration Using Artificial Intelligence in Optical Coherence Tomography.

Importance: The morphologic changes and their pathognomonic distribution in progressing age-related macular degeneration (AMD) are not well understood. Objectives: To characterize the pathognomonic distribution and time course of morphologic patterns in AMD and to quantify changes distinctive for progression to macular neovascularization (MNV) and macular atrophy (MA). Design, Setting, and Participants: This cohort study included optical coherence tomography (OCT) volumes from study participants with early or intermediate AMD in the fellow eye in the HARBOR (A Study of Ranibizumab Administered Monthly or on an As-needed Basis in Patients With Subfoveal Neovascular Age-Related Macular Degeneration) trial. Patients underwent imaging monthly for 2 years (July 1, 2009, to August 31, 2012) following a standardized protocol. Data analysis was performed from June 1, 2018, to January 21, 2020. Main Outcomes and Measures: To obtain topographic correspondence between patients and over time, all scans were mapped into a joint reference frame. The time of progression to MNV and MA was established, and drusen volumes and hyperreflective foci (HRF) volumes were automatically segmented in 3 dimensions using validated artificial intelligence algorithms. Topographically resolved population means of these markers were constructed by averaging quantified drusen and HRF maps in the patient subgroups. Results: Of 1097 patients enrolled in HARBOR, 518 (mean [SD] age, 78.1 [8.2] years; 309 [59.7%] female) had early or intermediate AMD in the fellow eye at baseline. During the 24-month follow-up period, 135 (26%) eyes developed MNV, 50 eyes (10%) developed MA, and 333 (64%) eyes did not progress to advanced AMD. Drusen and HRF had distinct topographic patterns. Mean drusen thickness at the fovea was 29.6 µm (95% CI, 20.2-39.0 µm) for eyes progressing to MNV, 17.2 µm (95% CI, 9.8-24.6 µm) for eyes progressing to MA, and 17.1 µm (95% CI, 12.5-21.7 µm) for eyes without disease progression. At 0.5-mm eccentricity, mean drusen thickness was 25.8 µm (95% CI, 19.1-32.5 µm) for eyes progressing to MNV, 21.7 µm (95% CI, 14.6-28.8 µm) for eyes progressing to MA, and 14.4 µm (95% CI, 11.2-17.6 µm) for eyes without disease progression. The mean HRF thickness at the foveal center was 0.072 µm (95% CI, 0-0.152 µm) for eyes progressing to MNV, 0.059 µm (95% CI, 0-0.126 µm) for eyes progressing to MA, and 0.044 µm (95% CI, 0.007-0.081) for eyes without disease progression. At 0.5-mm eccentricity, the largest mean HRF thickness was seen in eyes progressing to MA (0.227 µm; 95% CI, 0.104-0.349 µm) followed by eyes progressing to MNV (0.161 µm; 95% CI, 0.101-0.221 µm) and eyes without disease progression (0.085 µm; 95% CI, 0.058-0.112 µm). Conclusions and Relevance: In this study, drusen and HRF represented imaging biomarkers of disease progression in AMD, demonstrating distinct topographic patterns over time that differed between eyes progressing to MNV, eyes progressing to MA, or eyes without disease progression. Automated localization and precise quantification of these factors may help to develop reliable methods of predicting future disease progression.

Application of Automated Quantification of Fluid Volumes to Anti-VEGF Therapy of Neovascular Age-Related Macular Degeneration.

PURPOSE: Anti-vascular endothelial growth factor (VEGF) treatment of neovascular age-related macular degeneration (AMD) is a highly effective advance in the retinal armentarium. OCT offering 3-dimensional imaging of the retina is widely used to guide treatment. Although poor outcomes reported from clinical practice are multifactorial, availability of reliable, reproducible, and quantitative evaluation tools to accurately measure the fluid response, that is, a "VEGF meter," may be a better means of monitoring and treating than the current purely qualitative evaluation used in clinical practice. DESIGN: Post hoc analysis of a phase III, randomized, multicenter study. PARTICIPANTS: Study eyes of 1095 treatment-naive subjects receiving pro re nata (PRN) or monthly ranibizumab therapy according to protocol-specified criteria in the HARBOR study. METHODS: A deep learning method for localization and quantification of fluid in all retinal compartments was applied for automated segmentation of fluid with every voxel classified by a convolutional neural network (CNN). Three-dimensional volumes (nanoliters) for intraretinal fluid (IRF), subretinal fluid (SRF), and pigment epithelial detachment (PED) were determined in 24 362 volume scans obtained from 1095 patients treated over 24 months in a phase III clinical trial with randomization to 2 drug dosages (0.5 mg and 2.0 mg ranibizumab) and 2 regimens (monthly and PRN). A multivariable mixed-effects regression model was used to test for differences in fluid between the arms and for fluid/function correlation. MAIN OUTCOME MEASURES: Fluid volume in nanoliters, structure-function as Pearson's correlation coefficient, and as a coefficient of determination (R2). RESULTS: Fluid volumes were quantified in all visits of all patients. Automated segmentation demonstrated characteristic response patterns for each fluid compartment individually: Intraretinal fluid showed the greatest and most rapid resolution, followed by SRF and PED the least. The loading dose treatment achieved resolution of all fluid types close to the lowest levels attainable. Dosage and regimen parameters correlated directly with resulting fluid volumes. Fluid/function correlation showed a volume-dependent negative impact of IRF on vision and weak positive prognostic effect of SRF. CONCLUSIONS: Automated quantification of the fluid response may improve therapeutic management of neovascular AMD, avoid discrepancies between clinicians/investigators, and establish structure/function correlations.

Automatic segmentation and classification of breast lesions through identification of informative multiparametric PET/MRI features.

BACKGROUND: Multiparametric positron emission tomography/magnetic resonance imaging (mpPET/MRI) shows clinical potential for detection and classification of breast lesions. Yet, the contribution of features for computer-aided segmentation and diagnosis (CAD) need to be better understood. We proposed a data-driven machine learning approach for a CAD system combining dynamic contrast-enhanced (DCE)-MRI, diffusion-weighted imaging (DWI), and 18F-fluorodeoxyglucose (18F-FDG)-PET. METHODS: The CAD incorporated a random forest (RF) classifier combined with mpPET/MRI intensity-based features for lesion segmentation and shape features, kinetic and spatio-temporal texture features, for lesion classification. The CAD pipeline detected and segmented suspicious regions and classified lesions as benign or malignant. The inherent feature selection method of RF and alternatively the minimum-redundancy-maximum-relevance feature ranking method were used. RESULTS: In 34 patients, we report a detection rate of 10/12 (83.3%) and 22/22 (100%) for benign and malignant lesions, respectively, a Dice similarity coefficient of 0.665 for segmentation, and a classification performance with an area under the curve at receiver operating characteristics analysis of 0.978, a sensitivity of 0.946, and a specificity of 0.936. Segmentation but not classification performance of DCE-MRI improved with information from DWI and FDG-PET. Feature ranking revealed that kinetic and spatio-temporal texture features had the highest contribution for lesion classification. 18F-FDG-PET and morphologic features were less predictive. CONCLUSION: Our CAD enables the assessment of the relevance of mpPET/MRI features on segmentation and classification accuracy. It may aid as a novel computational tool for exploring different modalities/features and their contributions for the detection and classification of breast lesions.

THREE-DIMENSIONAL ANALYSIS OF RETINAL MICROANEURYSMS WITH ADAPTIVE OPTICS OPTICAL COHERENCE TOMOGRAPHY.

PURPOSE: To characterize retinal microaneurysms (MAs) in patients with diabetes using adaptive optics optical coherence tomography (AOOCT) and compare details found in AOOCT with those found in commercially available retinal imaging techniques. METHODS: Patients with diabetes and MA in the macular area were included in this pilot study. The area of interest, identified in standard fluorescein angiography, was imaged using an AO fundus camera and AOOCT. Microaneurysms were characterized in AOOCT (visibility, reflectivity, feeding/draining vessels, and intraretinal location) and compared with findings in AO fundus camera, OCT angiography, and fluorescein angiography. RESULTS: Fifty-three MAs were imaged in 15 eyes of 10 patients. Feeding and/or draining vessels from both capillary plexus could be identified in 34 MAs in AOOCT images. Of 45 MAs imaged with OCT angiography, 18 (40%) were visible in the superior plexus, 12 (27%) in the deep capillary plexus, and 15 MAs (33%) could not be identified at all. Intraluminal hyperreflectivity, commonly seen in AO fundus camera, corresponded only in 8 of 27 cases (30%) to intraluminal densities seen in AOOCT. CONCLUSION: Adaptive optics OCT imaging revealed that MAs located in the inner nuclear layer were connected to the intermediate and/or deep capillary plexus. Intraluminal hyperreflectivity seen on AO fundus camera images originated from a strong reflection from the vessel wall and only in a third of the cases from intraluminal clots. Currently, AOOCT is the most expedient in vivo imaging method to capture morphologic details of retinal microvasculature in 3D and in the context of the surrounding retinal anatomy.