INTEGRATING MACULAR OPTICAL COHERENCE TOMOGRAPHY WITH ULTRAWIDE-FIELD IMAGING IN A DIABETIC RETINOPATHY TELEMEDICINE PROGRAM USING A SINGLE DEVICE.

PURPOSE: To determine the effect of combined macular spectral-domain optical coherence tomography (SD-OCT) and ultrawide field retinal imaging (UWFI) within a telemedicine program. METHODS: Comparative cohort study of consecutive patients with both UWFI and SD-OCT. Ultrawide field retinal imaging and SD-OOCT were independently evaluated for diabetic macular edema (DME) and nondiabetic macular abnormality. Sensitivity and specificity were calculated with SD-OCT as the gold standard. RESULTS: Four hundred twenty-two eyes from 211 diabetic patients were evaluated. Diabetic macular edema severity by UWFI was as follows: no DME 93.4%, noncenter involved DME (nonciDME) 5.1%, ciDME 0.7%, ungradable DME 0.7%. SD-OCT was ungradable in 0.5%. Macular abnormality was identified in 34 (8.1%) eyes by UWFI and in 44 (10.4%) eyes by SD-OCT. Diabetic macular edema represented only 38.6% of referable macular abnormality identified by SD-OCT imaging. Sensitivity/specificity of UWFI compared with SD-OCT was 59%/96% for DME and 33%/99% for ciDME. Sensitivity/specificity of UWFI compared with SDOCT was 3%/98% for epiretinal membrane. CONCLUSION: Addition of SD-OCT increased the identification of macular abnormality by 29.4%. More than 58.3% of the eyes believed to have any DME on UWF imaging alone were false-positives by SD-OCT. The integration of SD-OCT with UWFI markedly increased detection and reduced false-positive assessments of DME and macular abnormality in a teleophthalmology program.

Comparisons of Handheld Retinal Imaging with Optical Coherence Tomography for the Identification of Macular Pathology in Patients with Diabetes.

INTRODUCTION: Handheld retinal imaging cameras are relatively inexpensive and highly portable devices that have the potential to significantly expand diabetic retinopathy (DR) screening, allowing a much broader population to be evaluated. However, it is essential to evaluate if these devices can accurately identify vision-threatening macular diseases if DR screening programs will rely on these instruments. Thus, the purpose of this study was to evaluate the detection of diabetic macular pathology using monoscopic macula-centered images using mydriatic handheld retinal imaging compared with spectral domain optical coherence tomography (SDOCT). METHODS: Mydriatic 40°-60° macula-centered images taken with 3 handheld retinal imaging devices (Aurora [AU], SmartScope [SS], RetinaVue 700 [RV]) were compared with the Cirrus 6000 SDOCT taken during the same visit. Images were evaluated for the presence of diabetic macular edema (DME) on monoscopic fundus photographs adapted from Early Treatment Diabetic Retinopathy Study (ETDRS) definitions (no DME, noncenter-involved DME [non-ciDME], and center-involved DME [ciDME]). Sensitivity, specificity, positive predictive value, and negative predictive value were calculated for each device with SDOCT as gold standard. RESULTS: Severity by ETDRS photos: no DR 33.3%, mild NPDR 20.4%, moderate 14.2%, severe 11.6%, proliferative 20.4%, and ungradable for DR 0%; no DME 83.1%, non-ciDME 4.9%, ciDME 12.0%, and ungradable for DME 0%. Gradable images by SDOCT (N = 217, 96.4%) showed no DME in 75.6%, non-ciDME in 9.8%, and ciDME in 11.1%. The ungradable rate for images (poor visualization in >50% of the macula) was AU: 0.9%, SS: 4.4%, and RV: 6.2%. For DME, sensitivity and specificity were similar across devices (0.5-0.64, 0.93-0.97). For nondiabetic macular pathology (ERM, pigment epithelial detachment, traction retinal detachment) across all devices, sensitivity was low to moderate (0.2-0.5) but highly specific (0.93-1.00). CONCLUSIONS: Compared to SDOCT, handheld macular imaging attained high specificity but low sensitivity in identifying macular pathology. This suggests the importance of SDOCT evaluation for patients suspected to have DME on fundus photography, leading to more appropriate referral refinement.

Performance of Automated Machine Learning for Diabetic Retinopathy Image Classification from Multi-field Handheld Retinal Images.

PURPOSE: To create and validate code-free automated deep learning models (AutoML) for diabetic retinopathy (DR) classification from handheld retinal images. DESIGN: Prospective development and validation of AutoML models for DR image classification. PARTICIPANTS: A total of 17 829 deidentified retinal images from 3566 eyes with diabetes, acquired using handheld retinal cameras in a community-based DR screening program. METHODS: AutoML models were generated based on previously acquired 5-field (macula-centered, disc-centered, superior, inferior, and temporal macula) handheld retinal images. Each individual image was labeled using the International DR and diabetic macular edema (DME) Classification Scale by 4 certified graders at a centralized reading center under oversight by a senior retina specialist. Images for model development were split 8-1-1 for training, optimization, and testing to detect referable DR ([refDR], defined as moderate nonproliferative DR or worse or any level of DME). Internal validation was performed using a published image set from the same patient population (N = 450 images from 225 eyes). External validation was performed using a publicly available retinal imaging data set from the Asia Pacific Tele-Ophthalmology Society (N = 3662 images). MAIN OUTCOME MEASURES: Area under the precision-recall curve (AUPRC), sensitivity (SN), specificity (SP), positive predictive value (PPV), negative predictive value (NPV), accuracy, and F1 scores. RESULTS: Referable DR was present in 17.3%, 39.1%, and 48.0% of the training set, internal validation, and external validation sets, respectively. The model's AUPRC was 0.995 with a precision and recall of 97% using a score threshold of 0.5. Internal validation showed that SN, SP, PPV, NPV, accuracy, and F1 scores were 0.96 (95% confidence interval [CI], 0.884-0.99), 0.98 (95% CI, 0.937-0.995), 0.96 (95% CI, 0.884-0.99), 0.98 (95% CI, 0.937-0.995), 0.97, and 0.96, respectively. External validation showed that SN, SP, PPV, NPV, accuracy, and F1 scores were 0.94 (95% CI, 0.929-0.951), 0.97 (95% CI, 0.957-0.974), 0.96 (95% CI, 0.952-0.971), 0.95 (95% CI, 0.935-0.956), 0.97, and 0.96, respectively. CONCLUSIONS: This study demonstrates the accuracy and feasibility of code-free AutoML models for identifying refDR developed using handheld retinal imaging in a community-based screening program. Potentially, the use of AutoML may increase access to machine learning models that may be adapted for specific programs that are guided by the clinical need to rapidly address disparities in health care delivery. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found after the references.

Effect of Accessible Nonmydriatic Retinal Imaging on Diabetic Retinopathy Surveillance Rates.

Purpose: To evaluate the impact on surveillance rates for diabetic retinopathy (DR) by providing nonmydriatic retinal imaging as part of comprehensive diabetes care at no cost to patients or insurers. Methods: A retrospective comparative cohort study was designed. Patients were imaged from April 1, 2016 to March 31, 2017 at a tertiary diabetes-specific academic medical center. Retinal imaging was provided without additional cost beginning October 16, 2016. Images were evaluated for DR and diabetic macular edema using standard protocol at a centralized reading center. Diabetes surveillance rates before and after no-cost imaging were compared. Results: A total of 759 and 2,080 patients respectively were imaged before and after offering no-cost retinal imaging. The difference represents a 274% increase in the number of patients screened. Furthermore, there was a 292% and 261% increase in the number of eyes with mild DR and referable DR, respectively. In the comparative 6-month period, 92 additional cases of proliferative DR were identified, estimated to prevent 6.7 cases of severe visual loss with annual cost savings of $180,230 (estimated yearly cost of severe vision loss per person: $26,900). In patients with referable DR, self-awareness was low, with no significant difference in the before and after groups (39.4% vs. 43.8%, p = 0.3725). Conclusions: Providing retinal imaging as part of comprehensive diabetes care substantially increased the number of patients identified by nearly threefold. The data suggest that the removal of out-of-pocket costs substantially increased patient surveillance rates, which may translate to improved long-term patient outcomes.

Association of Maximizing Visible Retinal Area by Manual Eyelid Lifting With Grading of Diabetic Retinopathy Severity and Detection of Predominantly Peripheral Lesions When Using Ultra-Widefield Imaging.

IMPORTANCE: Methods that increase visible retinal area (VRA; measured in millimeters squared) may improve identification of diabetic retinopathy (DR) lesions. OBJECTIVE: To evaluate the association of dilation and manual eyelid lifting (MLL) with VRA on ultra-widefield imaging (UWFI) and the association of VRA with grading of DR severity and detection of predominantly peripheral lesions (PPLs). DESIGN, SETTING, AND PARTICIPANTS: Retrospective, comparative case-control study at the Joslin Diabetes Center, Boston, Massachusetts. Nonmydriatic UWFI with MLL was acquired from a DR teleophthalmology program (Joslin Vision Network [JVN]). A second cohort of mydriatic UWFI was acquired at an academic retina practice (Beetham Eye Institute [BEI]) from November 6, 2017, to November 6, 2018, and with MLL thereafter until November 6, 2019. Fully automated algorithms determined VRA and hemorrhage and/or microaneurysm (HMA) counts. Predominantly peripheral lesions and HMAs were defined as present when at least 1 field had greater HMA number in the peripheral retina than within the corresponding Early Treatment Diabetic Retinopathy Study field. Participants included 3014 consecutive patients (5919 eyes) undergoing retinal imaging at JVN and BEI. EXPOSURES: Dilation and MLL performed at the time of UWFI. MAIN OUTCOMES AND MEASURES: Visible retinal area, DR severity, and presence of PPLs. RESULTS: Of the 3014 participants, mean (SD) age was 56.1 (14.5) years, 1302 (43.2%) were female, 2450 (81.3%) were White, and mean (SD) diabetes duration was 15.9 (11.4) years. All images from 5919 eyes with UWFI were analyzed. Mean (SD) VRA was 665.1 (167.6) mm2 for all eyes (theoretical maximal VRA, 923.9 mm2), 550.8 (240.7) mm2 for nonmydriatic JVN with MLL (1418 eyes [24.0%]), 688.1 (119.9) mm2 for mydriatic BEI images (3650 eyes [61.7%]), and 757.0 (69.7) mm2 for mydriatic and MLL BEI images (851 eyes [14.4%]). Dilation increased VRA by 25% (P < .001) and MLL increased VRA an additional 10% (P < .001). Nonmydriatic MLL increased VRA by 11.0%. With MLL, HMA counts in UWFI fields increased by 41.7% (from 4.8 to 6.8; P < .001). Visible retinal area was moderately associated with increasing PPL-HMA overall and in each cohort (all, r = 0.33; BEI, r = 0.29; JVN, r = 0.36; P < .001). In JVN images, increasing VRA was associated with more PPL-HMA (quartile 1 [Q1], 23.7%; Q2, 45.8%; Q3, 60.6%; and Q4, 69.2%; P < .001). CONCLUSIONS AND RELEVANCE: Using fully automated VRA and HMA detection algorithms, pupillary dilation and eyelid lifting were shown to substantially increase VRA and PLL-HMA detection. Given the importance of HMA and PPL for determining risk of DR progression, these findings emphasize the importance of maximizing VRA for optimal risk assessment in clinical trials and teleophthalmology programs.