3DTINC: Time-Equivariant Non-Contrastive Learning for Predicting Disease Progression from Longitudinal OCTs.

Self-supervised learning (SSL) has emerged as a powerful technique for improving the efficiency and effectiveness of deep learning models. Contrastive methods are a prominent family of SSL that extract similar representations of two augmented views of an image while pushing away others in the representation space as negatives. However, the state-of-the-art contrastive methods require large batch sizes and augmentations designed for natural images that are impractical for 3D medical images. To address these limitations, we propose a new longitudinal SSL method, 3DTINC, based on non-contrastive learning. It is designed to learn perturbation-invariant features for 3D optical coherence tomography (OCT) volumes, using augmentations specifically designed for OCT. We introduce a new non-contrastive similarity loss term that learns temporal information implicitly from intra-patient scans acquired at different times. Our experiments show that this temporal information is crucial for predicting progression of retinal diseases, such as age-related macular degeneration (AMD). After pretraining with 3DTINC, we evaluated the learned representations and the prognostic models on two large-scale longitudinal datasets of retinal OCTs where we predict the conversion to wet-AMD within a six-month interval. Our results demonstrate that each component of our contributions is crucial for learning meaningful representations useful in predicting disease progression from longitudinal volumetric scans.

Deep Learning-Based Prediction of Individual Geographic Atrophy Progression from a Single Baseline OCT.

Objective: To identify the individual progression of geographic atrophy (GA) lesions from baseline OCT images of patients in routine clinical care. Design: Clinical evaluation of a deep learning-based algorithm. Subjects: One hundred eighty-four eyes of 100 consecutively enrolled patients. Methods: OCT and fundus autofluorescence (FAF) images (both Spectralis, Heidelberg Engineering) of patients with GA secondary to age-related macular degeneration in routine clinical care were used for model validation. Fundus autofluorescence images were annotated manually by delineating the GA area by certified readers of the Vienna Reading Center. The annotated FAF images were anatomically registered in an automated manner to the corresponding OCT scans, resulting in 2-dimensional en face OCT annotations, which were taken as a reference for the model performance. A deep learning-based method for modeling the GA lesion growth over time from a single baseline OCT was evaluated. In addition, the ability of the algorithm to identify fast progressors for the top 10%, 15%, and 20% of GA growth rates was analyzed. Main Outcome Measures: Dice similarity coefficient (DSC) and mean absolute error (MAE) between manual and predicted GA growth. Results: The deep learning-based tool was able to reliably identify disease activity in GA using a standard OCT image taken at a single baseline time point. The mean DSC for the total GA region increased for the first 2 years of prediction (0.80-0.82). With increasing time intervals beyond 3 years, the DSC decreased slightly to a mean of 0.70. The MAE was low over the first year and with advancing time slowly increased, with mean values ranging from 0.25 mm to 0.69 mm for the total GA region prediction. The model achieved an area under the curve of 0.81, 0.79, and 0.77 for the identification of the top 10%, 15%, and 20% growth rates, respectively. Conclusions: The proposed algorithm is capable of fully automated GA lesion growth prediction from a single baseline OCT in a time-continuous fashion in the form of en face maps. The results are a promising step toward clinical decision support tools for therapeutic dosing and guidance of patient management because the first treatment for GA has recently become available. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Learning Spatio-Temporal Model of Disease Progression With NeuralODEs From Longitudinal Volumetric Data.

Robust forecasting of the future anatomical changes inflicted by an ongoing disease is an extremely challenging task that is out of grasp even for experienced healthcare professionals. Such a capability, however, is of great importance since it can improve patient management by providing information on the speed of disease progression already at the admission stage, or it can enrich the clinical trials with fast progressors and avoid the need for control arms by the means of digital twins. In this work, we develop a deep learning method that models the evolution of age-related disease by processing a single medical scan and providing a segmentation of the target anatomy at a requested future point in time. Our method represents a time-invariant physical process and solves a large-scale problem of modeling temporal pixel-level changes utilizing NeuralODEs. In addition, we demonstrate the approaches to incorporate the prior domain-specific constraints into our method and define temporal Dice loss for learning temporal objectives. To evaluate the applicability of our approach across different age-related diseases and imaging modalities, we developed and tested the proposed method on the datasets with 967 retinal OCT volumes of 100 patients with Geographic Atrophy and 2823 brain MRI volumes of 633 patients with Alzheimer's Disease. For Geographic Atrophy, the proposed method outperformed the related baseline models in the atrophy growth prediction. For Alzheimer's Disease, the proposed method demonstrated remarkable performance in predicting the brain ventricle changes induced by the disease, achieving the state-of-the-art result on TADPOLE cross-sectional prediction challenge dataset.

[Monitoring of the progression of geographic atrophy with optical coherence tomography]. / Monitoring der Progression von geografischer Atrophie in der optischen Kohärenztomographie.

With the prospect of available therapy for geographic atrophy in the near future and consequently increasing patient numbers, appropriate management strategies for the clinical practice are needed. Optical coherence tomography (OCT) as well as automated OCT analysis using artificial intelligence algorithms provide optimal conditions for assessing disease activity as well as the treatment response for geographic atrophy through a rapid, precise and resource-efficient evaluation.

Progression Dynamics of Early versus Later Stage Atrophic Lesions in Nonneovascular Age-Related Macular Degeneration Using Quantitative OCT Biomarker Segmentation.

PURPOSE: To investigate the progression of geographic atrophy secondary to nonneovascular age-related macular degeneration in early and later stage lesions using artificial intelligence-based precision tools. DESIGN: Retrospective analysis of an observational cohort study. SUBJECTS: Seventy-four eyes of 49 patients with ≥ 1 complete retinal pigment epithelial and outer retinal atrophy (cRORA) lesion secondary to age-related macular degeneration were included. Patients were divided between recently developed cRORA and lesions with advanced disease status. METHODS: Patients were prospectively imaged by spectral-domain OCT volume scans. The study period encompassed 18 months with scheduled visits every 6 months. Growth rates of recent cRORA-converted lesions were compared with lesions in an advanced disease status using mixed effect models. MAIN OUTCOME MEASURES: The progression of retinal pigment epithelial loss (RPEL) was considered the primary end point. Secondary end points consisted of external limiting membrane disruption and ellipsoid zone loss. These pathognomonic imaging biomarkers were quantified using validated deep-learning algorithms. Further, the ellipsoid zone/RPEL ratio was analyzed in both study cohorts. RESULTS: Mean (95% confidence interval [CI]) square root progression of recently converted lesions was 79.68 (95% CI, -77.14 to 236.49), 68.22 (95% CI, -101.21 to 237.65), and 84.825 (95% CI, -124.82 to 294.47) mm/half year for RPEL, external limiting membrane loss, and ellipsoid zone loss respectively. Mean square root progression of advanced lesions was 131.74 (95% CI, -22.57 to 286.05), 129.96 (95% CI, -36.67 to 296.59), and 116.84 (95% CI, -90.56 to 324.3) mm/half year for RPEL, external limiting membrane loss, and ellipsoid zone loss, respectively. RPEL (P = 0.038) and external limiting membrane disruption (P = 0.026) progression showed significant differences between the 2 study cohorts. Further recent converters had significantly (P < 0.001) higher ellipsoid zone/RPEL ratios at all time points compared with patients in an advanced disease status (1.71 95% CI, 1.12-2.28 vs. 1.14; 95% CI, 0.56-1.71). CONCLUSION: Early cRORA lesions have slower growth rates in comparison to atrophic lesions in advanced disease stages. Differences in growth dynamics may play a crucial role in understanding the pathophysiology of nonneovascular age-related macular degeneration and for the interpretation of clinical trials in geographic atrophy. Individual disease monitoring using artificial intelligence-based quantification paves the way toward optimized geographic atrophy management. FINANCIAL DISCLOSURE(S): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

Clinical validation for automated geographic atrophy monitoring on OCT under complement inhibitory treatment.

Geographic atrophy (GA) represents a late stage of age-related macular degeneration, which leads to irreversible vision loss. With the first successful therapeutic approach, namely complement inhibition, huge numbers of patients will have to be monitored regularly. Given these perspectives, a strong need for automated GA segmentation has evolved. The main purpose of this study was the clinical validation of an artificial intelligence (AI)-based algorithm to segment a topographic 2D GA area on a 3D optical coherence tomography (OCT) volume, and to evaluate its potential for AI-based monitoring of GA progression under complement-targeted treatment. 100 GA patients from routine clinical care at the Medical University of Vienna for internal validation and 113 patients from the FILLY phase 2 clinical trial for external validation were included. Mean Dice Similarity Coefficient (DSC) was 0.86 ± 0.12 and 0.91 ± 0.05 for total GA area on the internal and external validation, respectively. Mean DSC for the GA growth area at month 12 on the external test set was 0.46 ± 0.16. Importantly, the automated segmentation by the algorithm corresponded to the outcome of the original FILLY trial measured manually on fundus autofluorescence. The proposed AI approach can reliably segment GA area on OCT with high accuracy. The availability of such tools represents an important step towards AI-based monitoring of GA progression under treatment on OCT for clinical management as well as regulatory trials.

Segmentation of Bruch's Membrane in Retinal OCT With AMD Using Anatomical Priors and Uncertainty Quantification.

Bruch's membrane (BM) segmentation on optical coherence tomography (OCT) is a pivotal step for the diagnosis and follow-up of age-related macular degeneration (AMD), one of the leading causes of blindness in the developed world. Automated BM segmentation methods exist, but they usually do not account for the anatomical coherence of the results, neither provide feedback on the confidence of the prediction. These factors limit the applicability of these systems in real-world scenarios. With this in mind, we propose an end-to-end deep learning method for automated BM segmentation in AMD patients. An Attention U-Net is trained to output a probability density function of the BM position, while taking into account the natural curvature of the surface. Besides the surface position, the method also estimates an A-scan wise uncertainty measure of the segmentation output. Subsequently, the A-scans with high uncertainty are interpolated using thin plate splines (TPS). We tested our method with ablation studies on an internal dataset with 138 patients covering all three AMD stages, and achieved a mean absolute localization error of 4.10 µm. In addition, the proposed segmentation method was compared against the state-of-the-art methods and showed a superior performance on an external publicly available dataset from a different patient cohort and OCT device, demonstrating strong generalization ability.

Predicting Topographic Disease Progression and Treatment Response of Pegcetacoplan in Geographic Atrophy Quantified by Deep Learning.

PURPOSE: To identify disease activity and effects of intravitreal pegcetacoplan treatment on the topographic progression of geographic atrophy (GA) secondary to age-related macular degeneration quantified in spectral-domain OCT (SD-OCT) by automated deep learning assessment. DESIGN: Retrospective analysis of a phase II clinical trial study evaluating pegcetacoplan in GA patients (FILLY, NCT02503332). SUBJECTS: SD-OCT scans of 57 eyes with monthly treatment, 46 eyes with every-other-month (EOM) treatment, and 53 eyes with sham injection from baseline and 12-month follow-ups were included, in a total of 312 scans. METHODS: Retinal pigment epithelium loss, photoreceptor (PR) integrity, and hyperreflective foci (HRF) were automatically segmented using validated deep learning algorithms. Local progression rate (LPR) was determined from a growth model measuring the local expansion of GA margins between baseline and 1 year. For each individual margin point, the eccentricity to the foveal center, the progression direction, mean PR thickness, and HRF concentration in the junctional zone were computed. Mean LPR in disease activity and treatment effect conditioned on these properties were estimated by spatial generalized additive mixed-effect models. MAIN OUTCOME MEASURES: LPR of GA, PR thickness, and HRF concentration in µm. RESULTS: A total of 31,527 local GA margin locations were analyzed. LPR was higher for areas with low eccentricity to the fovea, thinner PR layer thickness, or higher HRF concentration in the GA junctional zone. When controlling for topographic and structural risk factors, we report on average a significantly lower LPR by -28.0% (95% confidence interval [CI], -42.8 to -9.4; P = 0.0051) and -23.9% (95% CI, -40.2 to -3.0; P = 0.027) for monthly and EOM-treated eyes, respectively, compared with sham. CONCLUSIONS: Assessing GA progression on a topographic level is essential to capture the pathognomonic heterogeneity in individual lesion growth and therapeutic response. Pegcetacoplan-treated eyes showed a significantly slower GA lesion progression rate compared with sham, and an even slower growth rate toward the fovea. This study may help to identify patient cohorts with faster progressing lesions, in which pegcetacoplan treatment would be particularly beneficial. Automated artificial intelligence-based tools will provide reliable guidance for the management of GA in clinical practice.

Comparison of Fundus Autofluorescence Versus Optical Coherence Tomography-based Evaluation of the Therapeutic Response to Pegcetacoplan in Geographic Atrophy.

PURPOSE: To perform an optical coherence tomography (OCT)-based analysis of geographic atrophy (GA) progression in patients treated with pegcetacoplan. DESIGN: Post hoc analysis of a phase 2 multicenter, randomized, sham-controlled trial. METHODS: Manual annotation of retinal pigment epithelium (RPE), ellipsoid zone (EZ), and external limiting membrane (ELM) loss was performed on OCT volumes from baseline and month 12 from the phase 2 FILLY trial of intravitreal pegcetacoplan for the treatment of GA secondary to age-related macular degeneration. MAIN OUTCOME MEASURES: Correlation of GA areas measured on fundus autofluorescence and OCT. Difference in square root transformed growth rates of RPE, EZ, and ELM loss between treatment groups (monthly injection [AM], injection every other month [AEOM], and sham [SM]). RESULTS: OCT volumes from 113 eyes of 113 patients (38 AM, 36 AEOM, and 39 SM) were included, resulting in 11 074 B-scans. The median growth of RPE loss was significantly slower in the AM group (0.158 [0.057-0.296]) than the SM group (0.255 [0.188-0.359], P = .014). Importantly, the growth of EZ loss was also significantly slower in the AM group (0.127 [0.041-0.247]) than the SM group (0.232 [0.130-0.349], P = .017). There was no significant difference in the growth of ELM loss between the treatment groups (P = .114). CONCLUSIONS: OCT imaging provided consistent results for GA growth compared with fundus autofluorescence. In addition to slower RPE atrophy progression in patients treated with pegcetacoplan, a significant reduction in EZ impairment was also identified by OCT, suggesting the use of OCT as a potentially more sensitive monitoring tool in GA therapy.

The Effect of Pegcetacoplan Treatment on Photoreceptor Maintenance in Geographic Atrophy Monitored by Artificial Intelligence-Based OCT Analysis.

PURPOSE: To investigate the therapeutic effect of intravitreal pegcetacoplan on the inhibition of photoreceptor (PR) loss and thinning in geographic atrophy (GA) on conventional spectral-domain OCT (SD-OCT) imaging by deep learning-based automated PR quantification. DESIGN: Post hoc analysis of a prospective, multicenter, randomized, sham (SM)-controlled, masked phase II trial investigating the safety and efficacy of pegcetacoplan for the treatment of GA because of age-related macular degeneration. PARTICIPANTS: Study eyes of 246 patients, randomized 1:1:1 to monthly (AM), bimonthly (AEOM), and SM treatment. METHODS: We performed fully automated, deep learning-based segmentation of retinal pigment epithelium (RPE) loss and PR thickness on SD-OCT volumes acquired at baseline and months 2, 6, and 12. The difference in the change of PR loss area was compared among the treatment arms. Change in PR thickness adjacent to the GA borders and the entire 20° scanning area was compared between treatment arms. MAIN OUTCOME MEASURES: Square-root transformed PR loss area in µm or mm, PR thickness in µm, and PR loss/RPE loss ratio. RESULTS: A total of 31 556 B-scans of 644 SD-OCT volumes of 161 study eyes (AM 52, AEOM 54, SM 56) were evaluated from baseline to month 12. Comparison of the mean change in PR loss area revealed statistically significantly less growth in the AM group at months 2, 6, and 12 than in the SM group (-41 µm ± 219 vs. 77 µm ± 126; P = 0.0004; -5 µm ± 221 vs. 156 µm ± 139; P < 0.0001; 106 µm ± 400 vs. 283 µm ± 226; P = 0.0014). Photoreceptor thinning was significantly reduced under AM treatment compared with SM within the GA junctional zone, as well as throughout the 20° area. A trend toward greater inhibition of PR loss than RPE loss was observed under therapy. CONCLUSIONS: Distinct and reliable quantification of PR loss using deep learning-based algorithms offers an essential tool to evaluate therapeutic efficacy in slowing disease progression. Photoreceptor loss and thinning are reduced by intravitreal complement C3 inhibition. Automated quantification of PR loss/maintenance based on OCT images is an ideal approach to reliably monitor disease activity and therapeutic efficacy in GA management in clinical routine and regulatory trials.