Differential Capillary and Large Vessel Analysis Improves OCTA Classification of Diabetic Retinopathy.

Purpose: This study aimed to investigate the impact of distinctive capillary-large vessel (CLV) analysis in optical coherence tomography angiography (OCTA) on the classification performance of diabetic retinopathy (DR). Methods: This multicenter study analyzed 212 OCTA images from 146 patients, including 28 controls, 36 diabetic patients without DR (NoDR), 31 with mild non-proliferative DR (NPDR), 28 with moderate NPDR, and 23 with severe NPDR. Quantitative features were derived from the whole image as well as the parafovea and perifovea regions. A support vector machine classifier was employed for DR classification. The accuracy and area under the receiver operating characteristic curve were used to evaluate the classification performance, utilizing features derived from the whole image and specific regions, both before and after CLV analysis. Results: Differential CLV analysis significantly improved OCTA classification of DR. In binary classifications, accuracy improved by 11.81%, rising from 77.45% to 89.26%, when utilizing whole image features. For multiclass classifications, accuracy increased by 7.55%, from 78.68% to 86.23%. Incorporating features from the whole image, parafovea, and perifovea further improved binary classification accuracy from 83.07% to 93.80%, and multiclass accuracy from 82.64% to 87.92%. Conclusions: This study demonstrated that feature changes in capillaries are more sensitive during DR progression, and CLV analysis can significantly improve DR classification performance by extracting features that are specific to large vessels and capillaries in OCTA. Incorporating regional features further improves DR classification accuracy. Differential CLV analysis promises better disease screening, diagnosis, and treatment outcome assessment.

Assessing spectral effectiveness in color fundus photography for deep learning classification of retinopathy of prematurity.

Significance: Retinopathy of prematurity (ROP) poses a significant global threat to childhood vision, necessitating effective screening strategies. This study addresses the impact of color channels in fundus imaging on ROP diagnosis, emphasizing the efficacy and safety of utilizing longer wavelengths, such as red or green for enhanced depth information and improved diagnostic capabilities. Aim: This study aims to assess the spectral effectiveness in color fundus photography for the deep learning classification of ROP. Approach: A convolutional neural network end-to-end classifier was utilized for deep learning classification of normal, stage 1, stage 2, and stage 3 ROP fundus images. The classification performances with individual-color-channel inputs, i.e., red, green, and blue, and multi-color-channel fusion architectures, including early-fusion, intermediate-fusion, and late-fusion, were quantitatively compared. Results: For individual-color-channel inputs, similar performance was observed for green channel (88.00% accuracy, 76.00% sensitivity, and 92.00% specificity) and red channel (87.25% accuracy, 74.50% sensitivity, and 91.50% specificity), which is substantially outperforming the blue channel (78.25% accuracy, 56.50% sensitivity, and 85.50% specificity). For multi-color-channel fusion options, the early-fusion and intermediate-fusion architecture showed almost the same performance when compared to the green/red channel input, and they outperformed the late-fusion architecture. Conclusions: This study reveals that the classification of ROP stages can be effectively achieved using either the green or red image alone. This finding enables the exclusion of blue images, acknowledged for their increased susceptibility to light toxicity.

Differential artery-vein analysis improves the OCTA classification of diabetic retinopathy.

This study investigates the impact of differential artery-vein (AV) analysis in optical coherence tomography angiography (OCTA) on machine learning classification of diabetic retinopathy (DR). Leveraging deep learning for arterial-venous area (AVA) segmentation, six quantitative features, including perfusion intensity density (PID), blood vessel density (BVD), vessel area flux (VAF), blood vessel caliber (BVC), blood vessel tortuosity (BVT), and vessel perimeter index (VPI) features, were derived from OCTA images before and after AV differentiation. A support vector machine (SVM) classifier was utilized to assess both binary and multiclass classifications of control, diabetic patients without DR (NoDR), mild DR, moderate DR, and severe DR groups. Initially, one-region features, i.e., quantitative features extracted from the entire OCTA, were evaluated for DR classification. Differential AV analysis improved classification accuracies from 78.86% to 87.63% and from 79.62% to 85.66% for binary and multiclass classifications, respectively. Additionally, three-region features derived from the entire image, parafovea, and perifovea, were incorporated for DR classification. Differential AV analysis further enhanced classification accuracies from 84.43% to 93.33% and from 83.40% to 89.25% for binary and multiclass classifications, respectively. These findings highlight the potential of differential AV analysis in augmenting disease diagnosis and treatment assessment using OCTA.

Colour fusion effect on deep learning classification of uveal melanoma.

BACKGROUND: Reliable differentiation of uveal melanoma and choroidal nevi is crucial to guide appropriate treatment, preventing unnecessary procedures for benign lesions and ensuring timely treatment for potentially malignant cases. The purpose of this study is to validate deep learning classification of uveal melanoma and choroidal nevi, and to evaluate the effect of colour fusion options on the classification performance. METHODS: A total of 798 ultra-widefield retinal images of 438 patients were included in this retrospective study, comprising 157 patients diagnosed with UM and 281 patients diagnosed with choroidal naevus. Colour fusion options, including early fusion, intermediate fusion and late fusion, were tested for deep learning image classification with a convolutional neural network (CNN). F1-score, accuracy and the area under the curve (AUC) of a receiver operating characteristic (ROC) were used to evaluate the classification performance. RESULTS: Colour fusion options were observed to affect the deep learning performance significantly. For single-colour learning, the red colour image was observed to have superior performance compared to green and blue channels. For multi-colour learning, the intermediate fusion is better than early and late fusion options. CONCLUSION: Deep learning is a promising approach for automated classification of uveal melanoma and choroidal nevi. Colour fusion options can significantly affect the classification performance.

Multispectral Fundus Photography of Choroidal Nevi With Trans-Palpebral Illumination.

Purpose: The purpose of this study was to investigate the spectral characteristics of choroidal nevi and assess the feasibility of quantifying the basal diameter of choroidal nevi using multispectral fundus images captured with trans-palpebral illumination. Methods: The study used a widefield fundus camera with multispectral (625 nm, 780 nm, 850 nm, and 970 nm) trans-palpebral illumination to examine eight subjects diagnosed with choroidal nevi. Geometric features of nevi, including border clarity, overlying drusen, and lesion basal diameter, were characterized. Clinical imagers, including scanning laser ophthalmoscopy (SLO), autofluorescence (AF), and optical coherence tomography (OCT), were utilized for comparative assessment. Results: Fundus images depicted nevi as dark regions with high contrast against the background. Near-infrared (NIR) fundus images provided enhanced visibility of lesion borders compared to visible fundus images and SLO images. Lesion-background contrast measurements revealed 635 nm SLO at 11% and 625 nm fundus at 42%. Significantly enhanced contrasts were observed in NIR fundus images at 780 nm (73%), 850 nm (63%), and 970 nm (67%). For quantifying the diameter of nevi, NIR fundus images at 780 nm and 850 nm yielded a deviation of less than 10% when compared to OCT measurements. Conclusions: NIR fundus photography with trans-palpebral illumination enhances nevi visibility and boundary definition compared to SLO. Agreement in diameter measurements with OCT validates the accuracy and reliability of this method for choroidal nevi assessment. Translational Relevance: Multispectral fundus imaging with trans-palpebral illumination improves choroidal nevi visibility and accurately measures basal diameter, promising to enhance clinical practices in screening, diagnosis, and monitoring of choroidal nevi.

Multispectral Fundus Photography of Choroidal Nevi with Trans-Palpebral Illumination.

Purpose: To investigate the spectral characteristics of choroidal nevi and assess the feasibility of quantifying the basal diameter of choroidal nevi using multispectral fundus images captured with trans-palpebral illumination. Methods: The study employed a widefield fundus camera with multispectral (625 nm, 780 nm, 850 nm, and 970 nm) trans-palpebral illumination. Geometric features of choroidal nevi, including border clarity, overlying drusen, and lesion basal diameter, were characterized. Clinical imagers, including scanning laser ophthalmoscopy (SLO), autofluorescence (AF), and optical coherence tomography (OCT), were utilized for comparative assessment. Results: Fundus images captured with trans-palpebral illumination depicted nevi as dark regions with high contrast against the background. Near-infrared (NIR) fundus images provided enhanced visibility of lesion borders compared to visible light fundus images and SLO images. Lesion-background contrast measurements revealed 635 nm SLO at 11% and 625 nm fundus at 42%. Significantly enhanced contrasts were observed in NIR fundus images at 780 nm (73%), 850 nm (63%), and 970 nm (67%). For quantifying the basal diameter of nevi, NIR fundus images at 780 nm and 850 nm yielded a deviation of less than 10% when compared to OCT B-scan measurements. Conclusion: NIR fundus photography with trans-palpebral illumination enhances nevi visibility and boundary definition compared to SLO. Agreement in basal diameter measurements with OCT validates the accuracy and reliability of this method for choroidal nevi assessment.

Color Fusion Effect on Deep Learning Classification of Uveal Melanoma.

Background: Reliable differentiation of uveal melanoma and choroidal nevi is crucial to guide appropriate treatment, preventing unnecessary procedures for benign lesions and ensuring timely treatment for potentially malignant cases. The purpose of this study is to validate deep learning classification of uveal melanoma and choroidal nevi, and to evaluate the effect of color fusion options on the classification performance. Methods: A total of 798 ultra-widefield retinal images of 438 patients were included in this retrospective study, comprising 157 patients diagnosed with UM and 281 patients diagnosed with choroidal nevus. Color fusion options, including early fusion, intermediate fusion and late fusion, were tested for deep learning image classification with a convolutional neural network (CNN). Specificity, sensitivity, F1-score, accuracy, and the area under the curve (AUC) of a receiver operating characteristic (ROC) were used to evaluate the classification performance. The saliency map visualization technique was used to understand the areas in the image that had the most influence on classification decisions of the CNN. Results: Color fusion options were observed to affect the deep learning performance significantly. For single-color learning, the red color image was observed to have superior performance compared to green and blue channels. For multi-color learning, the intermediate fusion is better than early and late fusion options. Conclusion: Deep learning is a promising approach for automated classification of uveal melanoma and choroidal nevi, and color fusion options can significantly affect the classification performance.

Evaluating spatial dependency of the spectral efficiency in trans-palpebral illumination for widefield fundus photography.

Multi-spectral widefield fundus photography is valuable for the clinical diagnosis and management of ocular conditions that may impact both central and peripheral regions of the retina and choroid. Trans-palpebral illumination has been demonstrated as an alternative to transpupillary illumination for widefield fundus photography without requiring pupil dilation. However, spectral efficiency can be complicated due to the spatial variance of the light property through the palpebra and sclera. This study aims to investigate the effect of light delivery location on spectral efficiency in trans-palpebral illumination. Four narrow-band light sources, covering both visible and near infrared (NIR) wavelengths, were used to evaluate spatial dependency of spectral illumination efficiency. Comparative analysis indicated a significant dependence of visible light efficiency on spatial location, while NIR light efficiency is only slightly affected by the illumination location. This study confirmed the pars plana as the optimal location for delivering visible light to achieve color imaging of the retina. Conversely, spatial location is not critical for NIR light imaging of the choroid.

Optimizing the OCTA layer fusion option for deep learning classification of diabetic retinopathy.

The purpose of this study is to evaluate layer fusion options for deep learning classification of optical coherence tomography (OCT) angiography (OCTA) images. A convolutional neural network (CNN) end-to-end classifier was utilized to classify OCTA images from healthy control subjects and diabetic patients with no retinopathy (NoDR) and non-proliferative diabetic retinopathy (NPDR). For each eye, three en-face OCTA images were acquired from the superficial capillary plexus (SCP), deep capillary plexus (DCP), and choriocapillaris (CC) layers. The performances of the CNN classifier with individual layer inputs and multi-layer fusion architectures, including early-fusion, intermediate-fusion, and late-fusion, were quantitatively compared. For individual layer inputs, the superficial OCTA was observed to have the best performance, with 87.25% accuracy, 78.26% sensitivity, and 90.10% specificity, to differentiate control, NoDR, and NPDR. For multi-layer fusion options, the best option is the intermediate-fusion architecture, which achieved 92.65% accuracy, 87.01% sensitivity, and 94.37% specificity. To interpret the deep learning performance, the Gradient-weighted Class Activation Mapping (Grad-CAM) was utilized to identify spatial characteristics for OCTA classification. Comparative analysis indicates that the layer data fusion options can affect the performance of deep learning classification, and the intermediate-fusion approach is optimal for OCTA classification of DR.

Deep learning for artery-vein classification in optical coherence tomography angiography.

Major retinopathies can differentially impact the arteries and veins. Traditional fundus photography provides limited resolution for visualizing retinal vascular details. Optical coherence tomography (OCT) can provide improved resolution for retinal imaging. However, it cannot discern capillary-level structures due to the limited image contrast. As a functional extension of OCT modality, optical coherence tomography angiography (OCTA) is a non-invasive, label-free method for enhanced contrast visualization of retinal vasculatures at the capillary level. Recently differential artery-vein (AV) analysis in OCTA has been demonstrated to improve the sensitivity for staging of retinopathies. Therefore, AV classification is an essential step for disease detection and diagnosis. However, current methods for AV classification in OCTA have employed multiple imagers, that is, fundus photography and OCT, and complex algorithms, thereby making it difficult for clinical deployment. On the contrary, deep learning (DL) algorithms may be able to reduce computational complexity and automate AV classification. In this article, we summarize traditional AV classification methods, recent DL methods for AV classification in OCTA, and discuss methods for interpretability in DL models.

An open-source deep learning network AVA-Net for arterial-venous area segmentation in optical coherence tomography angiography.

BACKGROUND: Differential artery-vein (AV) analysis in optical coherence tomography angiography (OCTA) holds promise for the early detection of eye diseases. However, currently available methods for AV analysis are limited for binary processing of retinal vasculature in OCTA, without quantitative information of vascular perfusion intensity. This study is to develop and validate a method for quantitative AV analysis of vascular perfusion intensity. METHOD: A deep learning network AVA-Net has been developed for automated AV area (AVA) segmentation in OCTA. Seven new OCTA features, including arterial area (AA), venous area (VA), AVA ratio (AVAR), total perfusion intensity density (T-PID), arterial PID (A-PID), venous PID (V-PID), and arterial-venous PID ratio (AV-PIDR), were extracted and tested for early detection of diabetic retinopathy (DR). Each of these seven features was evaluated for quantitative evaluation of OCTA images from healthy controls, diabetic patients without DR (NoDR), and mild DR. RESULTS: It was observed that the area features, i.e., AA, VA and AVAR, can reveal significant differences between the control and mild DR. Vascular perfusion parameters, including T-PID and A-PID, can differentiate mild DR from control group. AV-PIDR can disclose significant differences among all three groups, i.e., control, NoDR, and mild DR. According to Bonferroni correction, the combination of A-PID and AV-PIDR can reveal significant differences in all three groups. CONCLUSIONS: AVA-Net, which is available on GitHub for open access, enables quantitative AV analysis of AV area and vascular perfusion intensity. Comparative analysis revealed AV-PIDR as the most sensitive feature for OCTA detection of early DR. Ensemble AV feature analysis, e.g., the combination of A-PID and AV-PIDR, can further improve the performance for early DR assessment.

Some people with diabetes develop diabetic retinopathy, in which the blood flow through the eye changes, resulting in damage to the back of the eye, called the retina. Changes in blood flow can be measured by imaging the eye using a method called optical coherence tomography angiography (OCTA). The authors developed a computer program named AVA-Net that determines changes in blood flow through the eye from OCTA images. The program was tested on images from people with healthy eyes, people with diabetes but no eye disease, and people with mild diabetic retinopathy. Their program found differences between these groups and so could be used to improve diagnosis of people with diabetic retinopathy.

Normalized Blood Flow Index in Optical Coherence Tomography Angiography Provides a Sensitive Biomarker of Early Diabetic Retinopathy.

Purpose: To evaluate the sensitivity of normalized blood flow index (NBFI) for detecting early diabetic retinopathy (DR). Methods: Optical coherence tomography angiography (OCTA) images of healthy controls, diabetic patients without DR (NoDR), and patients with mild nonproliferative DR (NPDR) were analyzed in this study. The OCTA images were centered on the fovea and covered a 6 mm × 6 mm area. Enface projections of the superficial vascular plexus (SVP) and the deep capillary plexus (DCP) were obtained for the quantitative OCTA feature analysis. Three quantitative OCTA features were examined: blood vessel density (BVD), blood flow flux (BFF), and NBFI. Each feature was calculated from both the SVP and DCP and their sensitivities to distinguish the three cohorts of the study were evaluated. Results: The only quantitative feature capable of distinguishing all three cohorts was NBFI in the DCP image. Comparative study revealed that both BVD and BFF were able to distinguish the controls and NoDR from mild NPDR. However, neither BVD nor BFF was sensitive enough to separate NoDR from the healthy controls. Conclusions: The NBFI has been demonstrated as a sensitive biomarker of early DR, revealing retinal blood flow abnormality better than traditional BVD and BFF. The NBFI in the DCP was verified as the most sensitive biomarker, supporting that diabetes affects the DCP earlier than SVP in DR. Translational Relevance: NBFI provides a robust biomarker for quantitative analysis of DR-caused blood flow abnormalities, promising early detection and objective classification of DR.

MF-AV-Net: an open-source deep learning network with multimodal fusion options for artery-vein segmentation in OCT angiography.

This study is to demonstrate the effect of multimodal fusion on the performance of deep learning artery-vein (AV) segmentation in optical coherence tomography (OCT) and OCT angiography (OCTA); and to explore OCT/OCTA characteristics used in the deep learning AV segmentation. We quantitatively evaluated multimodal architectures with early and late OCT-OCTA fusions, compared to the unimodal architectures with OCT-only and OCTA-only inputs. The OCTA-only architecture, early OCT-OCTA fusion architecture, and late OCT-OCTA fusion architecture yielded competitive performances. For the 6 mm×6 mm and 3 mm×3 mm datasets, the late fusion architecture achieved an overall accuracy of 96.02% and 94.00%, slightly better than the OCTA-only architecture which achieved an overall accuracy of 95.76% and 93.79%. 6 mm×6 mm OCTA images show AV information at pre-capillary level structure, while 3 mm×3 mm OCTA images reveal AV information at capillary level detail. In order to interpret the deep learning performance, saliency maps were produced to identify OCT/OCTA image characteristics for AV segmentation. Comparative OCT and OCTA saliency maps support the capillary-free zone as one of the possible features for AV segmentation in OCTA. The deep learning network MF-AV-Net used in this study is available on GitHub for open access.