Implementation of Direct-to-Patient Mobile Teledermatology in VA.

BACKGROUND: Innovative technology can enhance patient access to healthcare but must be successfully implemented to be effective. OBJECTIVE: We evaluated Department of Veterans Affairs' (VA's) implementation of My VA Images, a direct-to-patient asynchronous teledermatology mobile application enabling established dermatology patients to receive follow-up care remotely instead of in-person. DESIGN /PARTICIPANTS/APPROACH: Following pilot testing at 3 facilities, the app was introduced to 28 facilities (4 groups of 7) every 3 months using a stepped-wedge cluster-randomized design. Using the Organizational Theory of Implementation Effectiveness, we examined the app's implementation using qualitative and quantitative data consisting of encounter data from VA's corporate data warehouse; app usage from VA's Mobile Health database; bi-monthly reports from facility representatives; phone interviews with clinicians; and documented communications between the operational partner and facility staff. KEY RESULTS: Implementation policies and practices included VA's vision to expand home telehealth and marketing/communication strategies. The COVID-19 pandemic dominated the implementation climate by stressing staffing, introducing competing demands, and influencing stakeholder attitudes to the app, including its fit to their values. These factors were associated with mixed implementation effectiveness, defined as high quality consistent use. Nineteen of 31 exposed facilities prepared to use the app; 10 facilities used it for actual patient care, 7 as originally intended. Residents, nurse practitioners, and physician assistants were more likely than attendings to use the app. Facilities exposed to the app pre-pandemic were more likely to use and sustain the new process. CONCLUSIONS: Considerable heterogeneity existed in implementing mobile teledermatology, despite VA's common mission, integrated healthcare system, and stakeholders' broad interest. Identifying opportunities to target favorable facilities and user groups (such as teaching facilities and physician extenders, respectively) while addressing internal implementation barriers including incomplete integration with the electronic health record as well as inadequate staffing may help optimize the initial impact of direct-to-patient telehealth. The COVID pandemic was a notable extrinsic barrier. CLINICAL TRIALS REGISTRATION: NCT03241589.

Arteriovenous Graft Failure in the Veterans Health Administration: Outcome Disparities Associated with Race.

Background Vascular access for ongoing hemodialysis often fails, frequently requiring repeated procedures to maintain vascular patency. While research has shown racial discrepancies in multiple aspects of renal failure treatment, there is poor understanding of how these factors might relate to vascular access maintenance procedures after arteriovenous graft (AVG) placement. Purpose To evaluate racial disparities associated with premature vascular access failure after percutaneous access maintenance procedures following AVG placement using a retrospective national cohort from the Veterans Health Administration (VHA). Materials and Methods All hemodialysis vascular maintenance procedures performed at VHA hospitals between October 2016 and March 2020 were identified. To ensure the sample represented patients who consistently used the VHA, patients without AVG placement within 5 years of their first maintenance procedure were excluded. Access failure was defined as a repeat access maintenance procedure or as hemodialysis catheter placement occurring 1-30 days after the index procedure. Multivariable logistic regression analyses were performed to calculate prevalence ratios (PRs) measuring the association between hemodialysis maintenance failure and African American race compared with all other races. Models controlled for vascular access history, patient socioeconomic status, and procedure and facility characteristics. Results In total, 1950 access maintenance procedures in 995 patients (mean age, 69 years ± 9 [SD], 1870 men) with an AVG created in one of 61 VHA facilities were identified. Most procedures involved African American patients (1169 of 1950, 60%) and patients residing in the South (1002 of 1950, 51%). Premature access failure occurred in 215 of 1950 (11%) procedures. When compared with all other races, African American race was associated with premature access site failure (PR, 1.4; 95% CI: 1.07, 1.43; P = .02). Among the 1057 procedures in 30 facilities with interventional radiology resident training programs, there was no evidence of racial disparity in the outcome (PR, 1.1; P = .63). Conclusion African American race was associated with higher risk-adjusted rates of premature arteriovenous graft failure after dialysis maintenance. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Forman and Davis in this issue.

Organizational Readiness for Patient-Facing Mobile Teledermatology to Care for Established Veteran Patients in the United States.

Purpose: To improve patient access to skin care, the Department of Veterans Affairs (VA) developed a patient-facing asynchronous mobile teledermatology application (app), which allows patients to follow up remotely with dermatologists. To understand how the app would be received in VA, we examined Organizational Readiness for Change (ORC), an important prelude to effective implementation, which includes the shared resolve and collective ability of organizational members to implement a change. Methods: We used a mixed-methods multiple case study approach to assess ORC at three VA facilities. Data derived from a site process call, surveys, and semistructured telephone interviews of VA staff, field notes, and administrative data. Results: Participants at all three facilities supported the intervention and recognized the value of using the app to increase patients' access to dermatologists, but expressed concerns largely related to disruption of the pre-existing clinical workflow. Participants at the facility most actively using the app had the highest overall ORC score and reported the most facilitators. Facility leadership support when guided by a clinical champion minimized barriers by recognizing the complexities of health care provision at specialty clinics. Discussion: While provider buy-in remained a barrier, leadership, guided by the clinical champion, played a critical role instituting implementation strategies. The strong association between the ORC survey score and the presence of facilitators and barriers suggests that the ORC survey may be a rapid, convenient, and effective tool for health care systems to identify favorable sites for wider implementation of mobile telehealth care. Clinical Trials Identifier: NCT03241589.

Implementing Teledermatology for Rural Veterans: An Evaluation Using the RE-AIM Framework.

Introduction: Few systematic evaluations of implementing teledermatology programs in large health care systems exist. We conducted a longitudinal evaluation of a U.S. Department of Veterans Affairs (VA) initiative to expand asynchronous consultative teledermatology services for rural veterans. Methods: The reach, effectiveness, adoption, implementation, and maintenance framework guided the evaluation, which included analysis of quantitative VA administrative data as well as an online survey completed by participating facilities. The first 2 years of the program were compared with the year before the start of funding. Results: Sixteen hub facilities expanded teledermatology's reach over the 2-year period, increasing the number of referral spoke sites, unique patients served, and teledermatology encounters. Effectiveness was reflected as teledermatology constituted an increasing fraction of dermatology activity and served more remotely located patients. Adoption through defined stages of implementation progressed as facilities engaged in a variety of strategies to enhance teledermatology implementation, and facilitators and barriers were identified. Program maintenance was assessed by Program Sustainability Index scores, which reflected the importance of executive support, and ongoing concerns about staffing and longitudinal funding. Discussion: Enabling hubs to create solutions that best fit their needs and culture likely increased reach and effectiveness. Important facilitators included organizational leadership and encouraging communication between stakeholders before and during the intervention. Conclusions: A systematic analysis of teledermatology implementation to serve rural sites in VA documented a high degree of implementation and sustainability as well as areas for improvement.

Implementation of Mobile Teledermatology: Challenges and Opportunities.

Background: While teledermatology is well-established in the Department of Veterans Affairs (VA), its implementation is far from complete. To facilitate consultative teledermatology and extend its reach, VA introduced a mobile teledermatology application (app) at three VA sites. Methods: We evaluated the initial implementation process using a mixed-methods, multiple case study approach to assess organizational readiness for change (ORC), which included examining facilitators, barriers, and contextual factors that affected implementation. We conducted: (1) group interviews and bimonthly reports to understand site processes; (2) semistructured interviews and surveys of individual participants representing a range of implementation roles; and (3) a review of internal organizational documents. We identified themes from interviews using an iterative process, and computed an ORC score based on surveys. Results: Forty-three individuals participated in the study. Qualitative data from all sites, corroborated by survey data available from one site, revealed a high readiness for change with an ORC score of 4.2, where 5 = maximal readiness for change. Facilitators included support from leadership and clinical champions, active telehealth programs, and an understanding and appreciation of the program and the resources needed. At all sites, however, technical issues negatively affected adoption; these included a suboptimal information technology infrastructure, which led to the inoperability of the app at two sites, and technical inefficiencies related to users' unfamiliarity with new devices and inconsistent internet access. Conclusions: Although a strong commitment to change and a confidence to effect change existed, these alone were insufficient to surmount barriers to implementation effectiveness. Clinical Trials Registration: NCT03241589.

Development and Validation of an Electronic Adverse Event Model for Patient Safety Surveillance in Interventional Radiology.

BACKGROUND: Comprehensive adverse event (AE) surveillance programs in interventional radiology (IR) are rare. Our aim was to develop and validate a retrospective electronic surveillance model to identify outpatient IR procedures that are likely to have an AE, to support patient safety and quality improvement. METHODS: We identified outpatient IR procedures performed in the period from October 2017 to September 2019 from the Veterans Health Administration (n = 135,283) and applied electronic triggers based on posyprocedure care to flag cases with a potential AE. From the trigger-flagged cases, we randomly sampled n = 1,500 for chart review to identify AEs. We also randomly sampled n = 600 from the unflagged cases. Chart-reviewed cases were merged with patient, procedure, and facility factors to estimate a mixed-effects logistic regression model designed to predict whether an AE occurred. Using model fit and criterion validity, we determined the best predicted probability threshold to identify cases with a likely AE. We reviewed a random sample of 200 cases above the threshold and 100 cases from below the threshold from October 2019 to March 2020 (n = 20,849) for model validation. RESULTS: In our development sample of mostly trigger-flagged cases, 444 of 2,096 cases (21.8%) had an AE. The optimal predicted probability threshold for a likely AE from our surveillance model was >50%, with positive predictive value of 68.9%, sensitivity of 38.3%, and specificity of 95.3%. In validation, chart-reviewed cases with AE probability >50% had a positive predictive value of 63% (n = 203). For the period from October 2017 to March 2020, the model identified approximately 70 IR cases per month that were likely to have an AE. CONCLUSIONS: This electronic trigger-based approach to AE surveillance could be used for patient-safety reporting and quality review.

Development of a Periprocedure Trigger for Outpatient Interventional Radiology Procedures in the Veterans Health Administration.

OBJECTIVES: Interventional radiology (IR) is the newest medical specialty. However, it lacks robust quality assurance metrics, including adverse event (AE) surveillance tools. Considering the high frequency of outpatient care provided by IR, automated electronic triggers offer a potential catalyst to support accurate retrospective AE detection. METHODS: We programmed previously validated AE triggers (admission, emergency visit, or death up to 14 days after procedure) for elective, outpatient IR procedures performed in Veterans Health Administration surgical facilities between fiscal years 2017 and 2019. We then developed a text-based algorithm to detect AEs that explicitly occurred in the periprocedure time frame: before, during, and shortly after the IR procedure. Guided by the literature and clinical expertise, we generated clinical note keywords and text strings to flag cases with high potential for periprocedure AEs. Flagged cases underwent targeted chart review to measure criterion validity (i.e., the positive predictive value), to confirm AE occurrence, and to characterize the event. RESULTS: Among 135,285 elective outpatient IR procedures, the periprocedure algorithm flagged 245 cases (0.18%); 138 of these had ≥1 AE, yielding a positive predictive value of 56% (95% confidence interval, 50%-62%). The previously developed triggers for admission, emergency visit, or death in 14 days flagged 119 of the 138 procedures with AEs (73%). Among the 43 AEs detected exclusively by the periprocedure trigger were allergic reactions, adverse drug events, ischemic events, bleeding events requiring blood transfusions, and cardiac arrest requiring cardiopulmonary resuscitation. CONCLUSIONS: The periprocedure trigger performed well on IR outpatient procedures and offers a complement to other electronic triggers developed for outpatient AE surveillance.

A Novel Informatics Tool to Detect Periprocedural Antibiotic Allergy Adverse Events for Near Real-time Surveillance to Support Audit and Feedback.

Importance: Standardized processes for identifying when allergic-type reactions occur and linking reactions to drug exposures are limited. Objective: To develop an informatics tool to improve detection of antibiotic allergic-type events. Design, Setting, and Participants: This retrospective cohort study was conducted from October 1, 2015, to September 30, 2019, with data analyzed between July 1, 2021, and January 31, 2022. The study was conducted across Veteran Affairs hospitals among patients who underwent cardiovascular implantable electronic device (CIED) procedures and received periprocedural antibiotic prophylaxis. The cohort was split into training and test cohorts, and cases were manually reviewed to determine presence of allergic-type reaction and its severity. Variables potentially indicative of allergic-type reactions were selected a priori and included allergies entered in the Veteran Affair's Allergy Reaction Tracking (ART) system (either historical [reported] or observed), allergy diagnosis codes, medications administered to treat allergic reactions, and text searches of clinical notes for keywords and phrases indicative of a potential allergic-type reaction. A model to detect allergic-type reaction events was iteratively developed on the training cohort and then applied to the test cohort. Algorithm test characteristics were assessed. Exposure: Preprocedural and postprocedural prophylactic antibiotic administration. Main Outcomes and Measures: Antibiotic allergic-type reactions. Results: The cohort of 36 344 patients included 34 703 CIED procedures with antibiotic exposures (mean [SD] age, 72 [10] years; 34 008 [98%] male patients); median duration of postprocedural prophylaxis was 4 days (IQR, 2-7 days; maximum, 45 days). The final algorithm included 7 variables: entries in the Veteran Affair's hospitals ART, either historic (odds ratio [OR], 42.37; 95% CI, 11.33-158.43) or observed (OR, 175.10; 95% CI, 44.84-683.76); PheCodes for "symptoms affecting skin" (OR, 8.49; 95% CI, 1.90-37.82), "urticaria" (OR, 7.01; 95% CI, 1.76-27.89), and "allergy or adverse event to an antibiotic" (OR, 11.84, 95% CI, 2.88-48.69); keyword detection in clinical notes (OR, 3.21; 95% CI, 1.27-8.08); and antihistamine administration alone or in combination (OR, 6.51; 95% CI, 1.90-22.30). In the final model, antibiotic allergic-type reactions were identified with an estimated probability of 30% or more; positive predictive value was 61% (95% CI, 45%-76%); and sensitivity was 87% (95% CI, 70%-96%). Conclusions and Relevance: In this retrospective cohort study of patients receiving periprocedural antibiotic prophylaxis, an algorithm with a high sensitivity to detect incident antibiotic allergic-type reactions that can be used to provide clinician feedback about antibiotic harms from unnecessarily prolonged antibiotic exposures was developed.

Using the RE-AIM framework to assess national teledermatology expansion.

Background: Teledermatology has been utilized in the United States Department of Veterans Affairs (VA) for decades but continues to have incomplete penetration. VA has funded an initiative to enhance access to dermatology services since 2017 to support asynchronous teledermatology for Veterans living in rural areas. As part of an ongoing evaluation of this program, we assessed the teledermatology activity between the fiscal years 2020 and 2022. We focused on the second cohort of the initiative, comprising six VA facilities and their 54 referral clinics. Methods: We studied teledermatology programs at cohort facilities using the reach, effectiveness, adoption, implementation, and maintenance framework. We used a mixed-methods design including annual online reports completed by participating facilities and VA administrative data. When possible, we compared the data from the 3 years of teledermatology funding with the baseline year prior to the start of funding. Findings: Reach: Compared with the baseline year, there was a 100% increase in encounters and a 62% increase in patients seen at the funded facilities. Over 500 clinicians and support staff members were trained. Effectiveness: In FY 2022, primary or specialty care clinics affiliated with the funded facilities had more dermatology programs than primary or specialty care clinics across the VA (83% vs. 71% of sites). Adoption: By the end of the funding period, teledermatology constituted 16% of dermatology encounters at the funded facilities compared with 12% nationally. This reflected an increase from 9.2% at the funded facilities and 10.3% nationally prior to the funding period. Implementation: The continued funding for staff and equipment facilitated the expansion to rural areas. Maintenance: By the end of the funding period, all facilities indicated that they had fully implemented their program for patients of targeted primary care providers. The Program Sustainability Index scores generally increased during the funding period. Conclusions: Targeted funding to support asynchronous teledermatology implementation for rural Veterans increased its reach, adoption, and implementation, ultimately improving access. Providing program guidance with staffing and training resources can increase the impact of these programs. Ongoing efforts to maintain and increase communication between primary care and dermatology will be needed to sustain success.

Factors associated with uptake of guideline-recommended cardiovascular implantable electronic device management: a nationwide, retrospective cohort study.

Clinical guidelines recommend device removal for cardiovascular implantable electronic device (CIED) infection management. In this retrospective, nationwide cohort, 60.8% of CIED infections received guideline-concordant care. One-year mortality was higher among those without procedural management (25% vs 16%). Factors associated with receipt of device procedures included pocket infections and positive microbiology.

Engaging patients in antimicrobial stewardship: co-designed educational tool to improve periprocedural care through de-implementation of guideline-discordant antimicrobial use.

Effective de-implementation models often include replacement of an ineffective practice with an alternative. We co-developed patient education materials as a replacement strategy for inappropriate post-procedural antibiotics in cardiac device procedures. Lessons learned and developed materials may be used to promote infection prevention in other periprocedural settings.

Assessing the sustainability of compliance with surgical site infection prophylaxis after discontinuation of mandatory active reporting: study protocol.

BACKGROUND: Surgical site infections are common. Risk can be reduced substantially with appropriate preoperative antimicrobial administration. In 2005, the VA implemented the Surgical Care Improvement Project (SCIP) in the setting of high rates of non-compliance with antimicrobial prophylaxis guidelines. SCIP included public reporting of evidenced-based antimicrobial guideline compliance metrics in high-risk surgeries. SCIP was highly successful and led to high rates of adoption of preoperative antimicrobials and early discontinuation of postoperative antimicrobials (>95%). The program was retired in 2015, as the manual measurement and reporting process was costly with limited expected additional benefit. To our knowledge, no studies have assessed whether the gains achieved by SCIP were sustained since active support for the program was discontinued. Furthermore, there has been no investigation of the spread of antimicrobial prophylaxis guideline adoption beyond the limited set of procedures that were included in the program. METHODS: Using a mixed methods sequential exploratory approach, this study will (1) quantitatively measure compliance with SCIP metrics over time and across all procedures in the five major surgical specialties targeted by SCIP and (2) collect qualitative data from stakeholders to identify strategies that were effective for sustaining compliance. Diffusion of Innovation Theory will guide assessment of whether improvements achieved spread to procedures not included under the umbrella of the program. Electronic algorithms to measure SCIP antimicrobial use will be adapted from previously developed methodology. These highly novel data mining algorithms leverage the rich VA electronic health record and capture structured and text data and represent a substantial technological advancement over resource-intensive manual chart review or incomplete electronic surveillance based on pharmacy data. An interrupted time series analysis will be used to assess whether SCIP compliance was sustained following program discontinuation. Generalized linear models will be used to assess whether compliance with appropriate prophylaxis increased in all SCIP targeted and non-targeted procedures by specialty over the duration the program's active reporting. The Dynamic Sustainability Framework will guide the qualitative methods to assess intervention, provider, facility, specialty, and contextual factors associated with sustainability over time. Barriers and facilitators to sustainability will be mapped to implementation strategies and the study will yield an implementation playbook to guide future sustainment efforts. RELEVANCE: Sustainability of practice change has been described as one of the most important, but least studied areas of clinical medicine. Learning how practices spread is also a critically important area of investigation. This study will use novel informatics strategies to evaluate factors associated with sustainability following removal of active policy surveillance and advance our understanding about these important, yet understudied, areas.

Promoting de-implementation of inappropriate antimicrobial use in cardiac device procedures by expanding audit and feedback: protocol for hybrid III type effectiveness/implementation quasi-experimental study.

BACKGROUND: Despite a strong evidence base and clinical guidelines specifically recommending against prolonged post-procedural antimicrobial use, studies indicate that the practice is common following cardiac device procedures. Formative evaluations conducted by the study team suggest that inappropriate antimicrobial use may be driven by information silos that drive provider belief that antimicrobials are not harmful, in part due to lack of complete feedback about all types of clinical outcomes. De-implementation is recognized as an important area of research that can lead to reductions in unnecessary, wasteful, or harmful practices, such as excess antimicrobial use following cardiac device procedures; however, investigations into strategies that lead to successful de-implementation are limited. The overarching hypothesis to be tested in this trial is that a bundle of implementation strategies that includes audit and feedback about direct patient harms caused by inappropriate prescribing can lead to successful de-implementation of guideline-discordant care. METHODS: We propose a hybrid type III effectiveness-implementation stepped-wedge intervention trial at three high-volume, high-complexity VA medical centers. The main study intervention (an informatics-based, real-time audit-and-feedback tool) was developed based on learning/unlearning theory and formative evaluations and guided by the integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) Framework. Elements of the bundled and multifaceted implementation strategy to promote appropriate prescribing will include audit-and-feedback reports that include information about antibiotic harms, stakeholder engagement, patient and provider education, identification of local champions, and blended facilitation. The primary study outcome is adoption of evidence-based practice (de-implementation of inappropriate antimicrobial use). Clinical outcomes (cardiac device infections, acute kidney injuries and Clostridioides difficile infections) are secondary. Qualitative interviews will assess relevant implementation outcomes (acceptability, adoption, fidelity, feasibility). DISCUSSION: De-implementation theory suggests that factors that may have a particularly strong influence on de-implementation include strength of the underlying evidence, the complexity of the intervention, and patient and provider anxiety and fear about changing an established practice. This study will assess whether a multifaceted intervention mapped to identified de-implementation barriers leads to measurable improvements in provision of guideline-concordant antimicrobial use. Findings will improve understanding about factors that impact successful or unsuccessful de-implementation of harmful or wasteful healthcare practices. TRIAL REGISTRATION: ClinicalTrials.gov NCT05020418.

Veterans Perceptions of Satisfaction and Convenience with Anticoagulants for Atrial Fibrillation: Warfarin versus Direct Oral Anticoagulants.

BACKGROUND: Atrial fibrillation (AFib) is associated with high morbidity and mortality. Traditionally, AFib was treated with warfarin, yet recent evidence suggests patients may favor direct oral anticoagulants (DOACs). Variation in preferences is common and we explored patients' perceptions of satisfaction and convenience of DOACs versus warfarin within the Veterans Health Administration (VA). PATIENTS AND METHODS: We administered a cross-sectional survey, the Perception of Anticoagulant Treatment Questionnaire 2 (PACT-Q2), to Veterans residing in New England, age ≥65, diagnosed with AFib, and actively taking anticoagulant medication in fiscal year 2018. Survey recipients were randomly selected among patients on warfarin (n=200) or DOACs (n=200). A selection of survey respondents agreed to a follow-up semi-structured interview (n=16) to further investigate perceptions of satisfaction and convenience. RESULTS: Of 400 patients, 187 completed the PACT-Q2 survey (49% on DOACs; 51% on warfarin). DOACs received significantly higher convenience ratings than warfarin (87.6, SD 13.5 vs 81.1, SD 18.8; p=0.007); there was no difference in satisfaction (64.2, SD 20.5 SD, warfarin vs, 67.3, SD 19.4, DOACs). Interview results showed that participants perceived their treatment to be convenient. However, participants expressed challenges related to the convenience of taking warfarin or DOACs, such as warfarin users having to follow dietary recommendations or DOAC users desiring some additional monitoring to answer questions or concerns. Overall, warfarin and DOAC users reported satisfaction with ongoing monitoring methods, although a few DOAC users expressed uncertainties with the frequency of monitoring. For most participants, concerns about side effects did not differ by anticoagulant type nor affect satisfaction. CONCLUSION: Our survey and interview results showed variable patient satisfaction and perceptions of convenience with both DOACs and warfarin. Although DOACs are increasingly prescribed for AFib, some Veterans felt that regular follow-up on warfarin was advantageous. Our findings demonstrate the importance of patient-centered decision-making in AFib treatment in the VA patient population.

Veterans Health Administration and Medicare outpatient health care utilization by older rural and urban New England veterans.

CONTEXT: Older veterans often use both the Veterans Health Administration (VHA) and Medicare to obtain health care services. PURPOSE: The authors sought to compare outpatient medical service utilization of Medicare-enrolled rural veterans with their urban counterparts in New England. METHODS: The authors combined VHA and Medicare databases and identified veterans who were age 65 and older and enrolled in Medicare fee-for-service plans, and they obtained records of all their VHA services in New England between 1997 and 1999. The authors used ZIP codes to designate rural or urban residence and categorized outpatient utilization into primary care, individual mental health care, non-mental health specialty care, or emergency room care. FINDINGS: Compared with their urban counterparts, veterans living in rural settings used significantly fewer VHA and Medicare-funded primary care, specialist care, and mental health care visits in all 3 years examined (P<.001 for all). Compared with urban veterans, veterans living in rural settings used fewer VHA emergency department services in 1998 and 1999 but more Medicare-funded emergency department visits in 1997. The authors found some evidence of substitution of Medicare for VHA emergency visits in rural veterans, but no other evidence of like-service substitution. Rural veterans were more reliant on Medicare for primary care and on VHA services for specialty and mental health care. CONCLUSIONS: These findings suggest that rural access to federally funded health care is restricted relative to urban access. Older veterans may choose different systems of care for different health care services. With poor access to primary care, rural veterans may substitute emergency room visits for routine care.

Accuracy of a technology-assisted eye exam in evaluation of referable diabetic retinopathy and concomitant ocular diseases.

BACKGROUND/AIMS: Digital retinal imaging using store-and-forward technology is used to screen for diabetic retinopathy (DR). Its usefulness in detecting non-diabetic eye diseases is uncertain. We determined the level of agreement between teleretinal imaging supplemented with visual acuity and intraocular pressure (IOP) measurements (ie, technology-assisted eye (TAE) exam) and a comprehensive eye exam in evaluation for DR and non-diabetic ocular conditions. METHODS: We conducted a prospective, observational study with two parallel evaluations. Patients with diabetes (n=317) had a TAE exam and a comprehensive eye exam on the same day. A subset of participants with normal baseline exams (n=72) had follow-up exams 1 year later. We measured the level of agreement for referable ocular findings. RESULTS: Agreement for referable ocular findings was moderate (n=389, agreement: 77%; κ: 0.55), due in part to ungradable exams (22%). However, about half of the ungradable exams had findings that warranted referral. There was substantial agreement for follow-up exams (n=72, agreement: 93%; κ: 0.63). Among all gradable exams (n=303), the TAE exam had 86% sensitivity and 84% specificity for referable ocular findings, with high agreement (≥94%) for DR and other major ocular diagnoses. CONCLUSIONS: There was moderate-to-substantial agreement between a TAE exam and a comprehensive eye exam for referable ocular findings in patients with diabetes. Ungradable exams were a frequent marker of ocular pathology. Teleretinal imaging may be a useful evaluation for both diabetic and non-diabetic ocular conditions.