The Perils of a "My Work Here is Done" perspective: a mixed methods evaluation of sustainment of an evidence-based intervention for transient ischemic attack.

BACKGROUND: To evaluate quality improvement sustainment for Transient Ischemic Attack (TIA) and identify factors influencing sustainment, which is a challenge for Learning Healthcare Systems. METHODS: Mixed methods were used to assess changes in care quality across periods (baseline, implementation, sustainment) and identify factors promoting or hindering sustainment of care quality. PREVENT was a stepped-wedge trial at six US Department of Veterans Affairs implementation sites and 36 control sites (August 2015-September 2019). Quality of care was measured by the without-fail rate: proportion of TIA patients who received all of the care for which they were eligible among brain imaging, carotid artery imaging, neurology consultation, hypertension control, anticoagulation for atrial fibrillation, antithrombotics, and high/moderate potency statins. Key informant interviews were used to identify factors associated with sustainment. RESULTS: The without-fail rate at PREVENT sites improved from 36.7% (baseline, 58/158) to 54.0% (implementation, 95/176) and settled at 48.3% (sustainment, 56/116). At control sites, the without-fail rate improved from 38.6% (baseline, 345/893) to 41.8% (implementation, 363/869) and remained at 43.0% (sustainment, 293/681). After adjustment, no statistically significant difference in sustainment quality between intervention and control sites was identified. Among PREVENT facilities, the without-fail rate improved ≥2% at 3 sites, declined ≥2% at two sites, and remained unchanged at one site during sustainment. Factors promoting sustainment were planning, motivation to sustain, integration of processes into routine practice, leadership engagement, and establishing systems for reflecting and evaluating on performance data. The only factor that was sufficient for improving quality of care during sustainment was the presence of a champion with plans for sustainment. Challenges during sustainment included competing demands, low volume, and potential problems with medical coding impairing use of performance data. Four factors were sufficient for declining quality of care during sustainment: low motivation, champion inactivity, no reflecting and evaluating on performance data, and absence of leadership engagement. CONCLUSIONS: Although the intervention improved care quality during implementation; performance during sustainment was heterogeneous across intervention sites and not different from control sites. Learning Healthcare Systems seeking to sustain evidence-based practices should embed processes within routine care and establish systems for reviewing and reflecting upon performance. TRIAL REGISTRATION: Clinicaltrials.gov ( NCT02769338 ).

Quality of Care for Veterans With Transient Ischemic Attack and Minor Stroke.

Importance: The timely delivery of guideline-concordant care may reduce the risk of recurrent vascular events for patients with transient ischemic attack (TIA) and minor stroke. Although many health care organizations measure stroke care quality, few evaluate performance for patients with TIA or minor stroke, and most include only a limited subset of guideline-recommended processes. Objective: To assess the quality of guideline-recommended TIA and minor stroke care across the Veterans Health Administration (VHA) system nationwide. Design, Setting, and Participants: This cohort study included 8201 patients with TIA or minor stroke cared for in any VHA emergency department (ED) or inpatient setting during federal fiscal year 2014 (October 1, 2013, through September 31, 2014). Patients with length of stay longer than 6 days, ventilator use, feeding tube use, coma, intensive care unit stay, inpatient rehabilitation stay before discharge, or receipt of thrombolysis were excluded. Outlier facilities for each process of care were identified by constructing 95% CIs around the facility pass rate and national pass rate sites when the 95% CIs did not overlap. Data analysis occurred from January 16, 2016, through June 30, 2017. Main Outcomes and Measures: Ten elements of care were assessed using validated electronic quality measures. Results: In the 8201 patients included in the study (mean [SD] age, 68.8 [11.4] years; 7877 [96.0%] male; 4856 [59.2%] white), performance varied across elements of care: brain imaging by day 2 (6720/7563 [88.9%]; 95% CI, 88.2%-89.6%), antithrombotic use by day 2 (6265/7477 [83.8%]; 95% CI, 83.0%-84.6%), hemoglobin A1c measurement by discharge or within the preceding 120 days (2859/3464 [82.5%]; 95% CI, 81.2%-83.8%), anticoagulation for atrial fibrillation by day 7 after discharge (1003/1222 [82.1%]; 95% CI, 80.0%-84.2%), deep vein thrombosis prophylaxis by day 2 (3253/4346 [74.9%]; 95% CI, 73.6%-76.2%), hypertension control by day 90 after discharge (4292/5979 [71.8%]; 95% CI, 70.7%-72.9%), neurology consultation by day 1 (5521/7823 [70.6%]; 95% CI, 69.6%-71.6%), electrocardiography by day 2 or within 1 day prior (5073/7570 [67.0%]; 95% CI, 65.9%-68.1%), carotid artery imaging by day 2 or within 6 months prior (4923/7685 [64.1%]; 95% CI, 63.0%-65.2%), and moderate- to high-potency statin prescription by day 7 after discharge (3329/7054 [47.2%]; 95% CI, 46.0%-48.4%). Performance varied substantially across facilities (eg, neurology consultation had a facility outlier rate of 53.0%). Performance was higher for admitted patients than for patients cared for only in EDs with the greatest disparity for carotid artery imaging (4478/5927 [75.6%] vs 445/1758 [25.3%]; P < .001). Conclusions and Relevance: This national study of VHA system quality of care for patients with TIA or minor stroke identified opportunities to improve care quality, particularly for patients who were discharged from the ED. Health care systems should engage in ongoing TIA care performance assessment to complement existing stroke performance measurement.

Development and Validation of Electronic Quality Measures to Assess Care for Patients With Transient Ischemic Attack and Minor Ischemic Stroke.

BACKGROUND: Despite interest in using electronic health record (EHR) data to assess quality of care, the accuracy of such data is largely unknown. We sought to develop and validate transient ischemic attack and minor ischemic stroke electronic quality measures (eQMs) using EHR data. METHODS AND RESULTS: A random sample of patients with transient ischemic attack or minor ischemic stroke, cared for in Veterans Health Administration facilities (fiscal year 2011), was identified. We constructed 31 eQMs based on existing quality measures. Chart review was the criterion standard for validating the eQMs. To evaluate eQMs in terms of eligibility, we calculated the proportion of patients who were genuinely not eligible to receive a process (based on chart review) and who were correctly identified as not eligible by the EHR data (specificity). To assess eQMs about classification of whether patients received a process, we calculated the proportion of patients who actually received the process (based on chart review) and who were classified correctly by the EHR data as passing (sensitivity). Seven hundred sixty-three patients were included. About eligibility, specificity varied from 25% (brain imaging; carotid imaging) to 99% (anticoagulation quality). About pass rates, sensitivity varied from 30% (antihypertensive class) to 100% (coronary risk assessment; international normalized ratio measured). The 16 eQMs with ≥70% specificity in eligibility and ≥70% sensitivity in pass rates included coronary risk assessment, international normalized ratio measured, HbA1c measurement, speech language pathology consultation, anticoagulation for atrial fibrillation, discharge on statin, lipid management, neurology consultation, Holter, deep vein thrombosis prophylaxis, oral hypoglycemic intensification, cholesterol medication intensification, antihypertensive intensification, antihypertensive class, carotid stenosis intervention, and substance abuse referral for alcohol. CONCLUSIONS: It is feasible to construct valid eQMs for processes of transient ischemic attack and minor ischemic stroke care. Healthcare systems with EHRs should consider using electronic data to evaluate care for their patients with transient ischemic attack and to complement and expand quality measurement programs currently focused on patients with stroke.