Core implementation strategies for improving cirrhosis care in the Veterans Health Administration.

BACKGROUND AND AIMS: The Veterans Health Administration (VHA) provides care for more than 80,000 veterans with cirrhosis. This longitudinal, multimethod evaluation of a cirrhosis care quality improvement program aimed to (1) identify implementation strategies associated with evidence-based, guideline-concordant cirrhosis care over time, and (2) use qualitative interviews to operationalize strategies for a manualized intervention. APPROACH AND RESULTS: VHA providers were surveyed annually about the use of 73 implementation strategies to improve cirrhosis care in fiscal years 2018 (FY18) and 2019 (FY19). Implementation strategies linked to guideline-concordant cirrhosis care were identified using bivariate statistics and comparative configurational methods. Semistructured interviews were conducted with 12 facilities in the highest quartile of cirrhosis care to specify the successful implementation strategies and their mechanisms of change. A total of 106 VHA facilities (82%) responded at least once over the 2-year period (FY18, n = 63; FY19, n = 100). Facilities reported using a median of 12 (interquartile range [IQR] 20) implementation strategies in FY18 and 10 (IQR 19) in FY19. Of the 73 strategies, 35 (48%) were positively correlated with provision of evidence-based cirrhosis care. Configurational analysis identified multiple strategy pathways directly linked to more guideline-concordant cirrhosis care. Across both methods, a subset of eight strategies was determined to be core to cirrhosis care improvement and specified using qualitative interviews. CONCLUSIONS: In a national cirrhosis care improvement initiative, a multimethod approach identified a core subset of successful implementation strategy combinations. This process of empirically identifying and specifying implementation strategies may be applicable to other implementation challenges in hepatology.

The impact of the COVID-19 pandemic on blood pressure control after a stroke or transient ischemic attack among patients at VA medical centers.

OBJECTIVE: To study factors associated with systolic blood pressure(SBP) control for patients post-discharge from an ischemic stroke or transient ischemic attack(TIA) during the early months of the COVID-19 pandemic compared to pre-pandemic periods within the Veterans Health Administration(VHA). MATERIALS AND METHODS: We analyzed retrospective data from patients discharged from Emergency Departments or inpatient admissions after an ischemic stroke or TIA. Cohorts consisted of 2,816 patients during March-September 2020 and 11,900 during the same months in 2017-2019. Outcomes included primary care or neurology clinic visits, recorded blood pressure readings and average blood pressure control in the 90-days post-discharge. Random effect logit models were used to compare clinical characteristics of the cohorts and relationships between patient characteristics and outcomes. RESULTS: The majority (73%) of patients with recorded readings during the COVID-19 period had a mean post-discharge SBP within goal (<140 mmHg); this was slightly lower than the pre-COVID-19 period (78%; p=0.001). Only 38% of the COVID-19 cohort had a recorded SBP in the 90-days post-discharge compared with 83% of patients during the pre-pandemic period (p=0.001). During the pandemic period, 29% did not have follow-up primary care or neurologist visits, and 33% had a phone or video visit without a recorded SBP reading. CONCLUSIONS: Patients with an acute cerebrovascular event during the initial COVID-19 period were less likely to have outpatient visits or blood pressure measurements than during the pre-pandemic period; patients with uncontrolled SBP should be targeted for follow-up hypertension management.

Variation in statin prescription among veterans with HIV and known atherosclerotic cardiovascular disease.

BACKGROUND: People with HIV have increased atherosclerotic cardiovascular disease (ASCVD) risk, worse outcomes following incident ASCVD, and experience gaps in cardiovascular care, highlighting the need to improve delivery of preventive therapies in this population. OBJECTIVE: Assess patient-level correlates and inter-facility variations in statin prescription among Veterans with HIV and known ASCVD. METHODS: We studied Veterans with HIV and existing ASCVD, ie, coronary artery disease (CAD), ischemic cerebrovascular disease (ICVD), and peripheral arterial disease (PAD), who received care across 130 VA medical centers for the years 2018-2019. We assessed correlates of statin prescription using two-level hierarchical multivariable logistic regression. Median odds ratios (MORs) were used to quantify inter-facility variation in statin prescription. RESULTS: Nine thousand six hundred eight Veterans with HIV and known ASCVD (mean age 64.3 ± 8.9 years, 97% male, 48% Black) were included. Only 68% of the participants were prescribed any-statin. Substantially higher statin prescription was observed for those with diabetes (adjusted odds ratio [OR] = 2.3, 95% confidence interval [CI], 2.0-2.6), history of coronary revascularization (OR = 4.0, CI, 3.2-5.0), and receiving antiretroviral therapy (OR = 3.0, CI, 2.7-3.4). Blacks (OR = 0.7, CI, 0.6-0.9), those with non-coronary ASCVD, ie, ICVD and/or PAD only, (OR 0.53, 95% CI: 0.48-0.57), and those with history of illicit substance use (OR=0.7, CI, 0.6-0.9) were less likely to be prescribed statins. There was significant variation in statin prescription across VA facilities (10th, 90th centile: 55%, 78%), with an estimated 20% higher likelihood of difference in statin prescription practice for two clinically similar individuals treated at two comparable facilities (adjusted MOR = 1.21, CI, 1.18-1.24), and a greater variation observed for Blacks or those with non-coronary ASCVD or history of illicit drug use. CONCLUSION: In an analysis of large-scale VA data, we found suboptimal statin prescription and significant interfacility variation in statin prescription among Veterans with HIV and known ASCVD, particularly among Blacks and those with a history of non-coronary ASCVD.

An observational study of workflows to support fecal testing for colorectal cancer screening in primary care practices serving Medicaid enrollees.

BACKGROUND: Screening supports early detection and treatment of colorectal cancer (CRC). Provision of fecal immunochemical tests/fecal occult blood tests (FIT/FOBT) in primary care can increase CRC screening, particularly in populations experiencing health disparities. This study was conducted to describe clinical workflows for FIT/FOBT in Oregon primary care practices and to identify specific workflow processes that might be associated (alone or in combination) with higher (versus lower) CRC screening rates. METHODS: Primary care practices were rank ordered by CRC screening rates in Oregon Medicaid enrollees who turned age 50 years from January 2013 to June 2014 (i.e., newly age-eligible). Practices were recruited via purposive sampling based on organizational characteristics and CRC screening rates. Data collected were from surveys, observation visits, and informal interviews, and used to create practice-level CRC screening workflow reports. Data were analyzed using descriptive statistics, qualitative data analysis using an immersion-crystallization process, and a matrix analysis approach. RESULTS: All participating primary care practices (N=9) used visit-based workflows, and four higher performing and two lower performing used population outreach workflows to deliver FIT/FOBTs. However, higher performing practices (n=5) had more established workflows and staff to support activities. Visit-based strategies in higher performing practices included having dedicated staff identify patients due for CRC screening and training medical assistants to review FIT/FOBT instructions with patients. Population outreach strategies included having clinic staff generate lists and check them for accuracy prior to direct mailing of kits to patients. For both workflow types, higher performing clinics routinely utilized systems for patient reminders and follow-up after FIT/FOBT distribution. CONCLUSIONS: Primary care practices with higher CRC screening rates among newly age-eligible Medicaid enrollees had more established visit-based and population outreach workflows to support identifying patients due for screening, FIT/FOBT distribution, reminders, and follow up. Key to practices with higher CRC screening was having medical assistants discuss and review FIT/FOBT screening and instructions with patients. Findings present important workflow processes for primary care practices and may facilitate the implementation of evidence-based interventions into real-world, clinical settings.

Clinic Factors Associated With Mailed Fecal Immunochemical Test (FIT) Completion: The Difference-Making Role of Support Staff.

PURPOSE: Mailed fecal immunochemical test (FIT) programs can facilitate colorectal cancer (CRC) screening. We sought to identify modifiable, clinic-level factors that distinguish primary care clinics with higher vs lower FIT completion rates in response to a centralized mailed FIT program. METHODS: We used baseline observational data from 15 clinics within a single urban federally qualified health center participating in a pragmatic trial to optimize a mailed FIT program. Clinic-level data included interviews with leadership using a guide informed by the Consolidated Framework for Implementation Research (CFIR) and FIT completion rates. We used template analysis to identify explanatory factors and configurational comparative methods to identify specific combinations of clinic-level conditions that uniquely distinguished clinics with higher and lower FIT completion rates. RESULTS: We interviewed 39 clinic leaders and identified 58 potential explanatory factors representing clinic workflows and the CFIR inner setting domain. Clinic-level FIT completion rates ranged from 30% to 56%. The configurational model for clinics with higher rates (≥37%) featured any 1 of the following 3 factors related to support staff: (1) adding back- or front-office staff in past 12 months, (2) having staff help patients resolve barriers to CRC screening, and (3) having staff hand out FITs/educate patients. The model for clinics with lower rates involved the combined absence of these same 3 factors. CONCLUSIONS: Three factors related to support staff differentiated clinics with higher and lower FIT completion rates. Adding nonphysician support staff and having those staff provide enabling services might help clinics optimize mailed FIT screening programs.

How education and racial segregation intersect in neighborhoods with persistently low COVID-19 vaccination rates in Philadelphia.

BACKGROUND: COVID-19 infection has disproportionately affected socially disadvantaged neighborhoods. Despite this disproportionate burden of infection, these neighborhoods have also lagged in COVID-19 vaccinations. To date, we have little understanding of the ways that various types of social conditions intersect to explain the complex causes of lower COVID-19 vaccination rates in neighborhoods. METHODS: We used configurational comparative methods (CCMs) to study COVID-19 vaccination rates in Philadelphia by neighborhood (proxied by zip code tabulation areas). Specifically, we identified neighborhoods where COVID-19 vaccination rates (per 10,000) were persistently low from March 2021 - May 2021. We then assessed how different combinations of social conditions (pathways) uniquely distinguished neighborhoods with persistently low vaccination rates from the other neighborhoods in the city. Social conditions included measures of economic inequities, racial segregation, education, overcrowding, service employment, public transit use, health insurance and limited English proficiency. RESULTS: Two factors consistently distinguished neighborhoods with persistently low COVID-19 vaccination rates from the others: college education and concentrated racial privilege. Two factor values together - low college education AND low/medium concentrated racial privilege - identified persistently low COVID-19 vaccination rates in neighborhoods, with high consistency (0.92) and high coverage (0.86). Different values for education and concentrated racial privilege - medium/high college education OR high concentrated racial privilege - were each sufficient by themselves to explain neighborhoods where COVID-19 vaccination rates were not persistently low, likewise with high consistency (0.93) and high coverage (0.97). CONCLUSIONS: Pairing CCMs with geospatial mapping can help identify complex relationships between social conditions linked to low COVID-19 vaccination rates. Understanding how neighborhood conditions combine to create inequities in communities could inform the design of interventions tailored to address COVID-19 vaccination disparities.

The Perils of a "My Work Here is Done" perspective: a mixed methods evaluation of sustainment of an evidence-based intervention for transient ischemic attack.

BACKGROUND: To evaluate quality improvement sustainment for Transient Ischemic Attack (TIA) and identify factors influencing sustainment, which is a challenge for Learning Healthcare Systems. METHODS: Mixed methods were used to assess changes in care quality across periods (baseline, implementation, sustainment) and identify factors promoting or hindering sustainment of care quality. PREVENT was a stepped-wedge trial at six US Department of Veterans Affairs implementation sites and 36 control sites (August 2015-September 2019). Quality of care was measured by the without-fail rate: proportion of TIA patients who received all of the care for which they were eligible among brain imaging, carotid artery imaging, neurology consultation, hypertension control, anticoagulation for atrial fibrillation, antithrombotics, and high/moderate potency statins. Key informant interviews were used to identify factors associated with sustainment. RESULTS: The without-fail rate at PREVENT sites improved from 36.7% (baseline, 58/158) to 54.0% (implementation, 95/176) and settled at 48.3% (sustainment, 56/116). At control sites, the without-fail rate improved from 38.6% (baseline, 345/893) to 41.8% (implementation, 363/869) and remained at 43.0% (sustainment, 293/681). After adjustment, no statistically significant difference in sustainment quality between intervention and control sites was identified. Among PREVENT facilities, the without-fail rate improved ≥2% at 3 sites, declined ≥2% at two sites, and remained unchanged at one site during sustainment. Factors promoting sustainment were planning, motivation to sustain, integration of processes into routine practice, leadership engagement, and establishing systems for reflecting and evaluating on performance data. The only factor that was sufficient for improving quality of care during sustainment was the presence of a champion with plans for sustainment. Challenges during sustainment included competing demands, low volume, and potential problems with medical coding impairing use of performance data. Four factors were sufficient for declining quality of care during sustainment: low motivation, champion inactivity, no reflecting and evaluating on performance data, and absence of leadership engagement. CONCLUSIONS: Although the intervention improved care quality during implementation; performance during sustainment was heterogeneous across intervention sites and not different from control sites. Learning Healthcare Systems seeking to sustain evidence-based practices should embed processes within routine care and establish systems for reviewing and reflecting upon performance. TRIAL REGISTRATION: Clinicaltrials.gov ( NCT02769338 ).

Defining optimal implementation packages for delivering community-wide mass drug administration for soil-transmitted helminths with high coverage.

BACKGROUND: Recent evidence suggests that community-wide mass drug administration (MDA) may interrupt the transmission of soil-transmitted helminths (STH), a group of intestinal worms that infect 1.5 billion individuals globally. Although current operational guidelines provide best practices for effective MDA delivery, they do not describe which activities are most essential for achieving high coverage or how they work together to produce effective intervention delivery. We aimed to identify the various packages of influential intervention delivery activities that result in high coverage of community-wide MDA for STH in Benin, India, and Malawi. METHODS: We applied coincidence analysis (CNA), a novel cross-case analytical method, to process mapping data as part of the implementation science research of the DeWorm3 Project, a Hybrid Type 1 cluster randomized controlled trial assessing the feasibility of interrupting the transmission of STH using bi-annual community-wide MDA in Benin, India, and Malawi. Our analysis aimed to identify any necessary and/or sufficient combinations of intervention delivery activities (i.e., implementation pathways) that resulted in high MDA coverage. Activities were related to drug supply chain, implementer training, community sensitization strategy, intervention duration, and implementation context. We used pooled implementation data from three sites and six intervention rounds, with study clusters serving as analytical cases (N = 360). Secondary analyses assessed differences in pathways across sites and over intervention rounds. RESULTS: Across all three sites and six intervention rounds, efficient duration of MDA delivery (within ten days) singularly emerged as a common and fundamental component for achieving high MDA coverage when combined with other particular activities, including a conducive implementation context, early arrival of albendazole before the planned start of MDA, or a flexible community sensitization strategy. No individual activity proved sufficient by itself for producing high MDA coverage. We observed four possible overall models that could explain effective MDA delivery strategies, all which included efficient duration of MDA delivery as an integral component. CONCLUSION: Efficient duration of MDA delivery uniquely stood out as a highly influential implementation activity for producing high coverage of community-wide MDA for STH. Effective MDA delivery can be achieved with flexible implementation strategies that include various combinations of influential intervention components.

Scaling Interventions to Manage Chronic Disease: Innovative Methods at the Intersection of Health Policy Research and Implementation Science.

Policy implementation is a key component of scaling effective chronic disease prevention and management interventions. Policy can support scale-up by mandating or incentivizing intervention adoption, but enacting a policy is only the first step. Fully implementing a policy designed to facilitate implementation of health interventions often requires a range of accompanying implementation structures, like health IT systems, and implementation strategies, like training. Decision makers need to know what policies can support intervention adoption and how to implement those policies, but to date research on policy implementation is limited and innovative methodological approaches are needed. In December 2021, the Johns Hopkins ALACRITY Center for Health and Longevity in Mental Illness and the Johns Hopkins Center for Mental Health and Addiction Policy convened a forum of research experts to discuss approaches for studying policy implementation. In this report, we summarize the ideas that came out of the forum. First, we describe a motivating example focused on an Affordable Care Act Medicaid health home waiver policy used by some US states to support scale-up of an evidence-based integrated care model shown in clinical trials to improve cardiovascular care for people with serious mental illness. Second, we define key policy implementation components including structures, strategies, and outcomes. Third, we provide an overview of descriptive, predictive and associational, and causal approaches that can be used to study policy implementation. We conclude with discussion of priorities for methodological innovations in policy implementation research, with three key areas identified by forum experts: effect modification methods for making causal inferences about how policies' effects on outcomes vary based on implementation structures/strategies; causal mediation approaches for studying policy implementation mechanisms; and characterizing uncertainty in systems science models. We conclude with discussion of overarching methods considerations for studying policy implementation, including measurement of policy implementation, strategies for studying the role of context in policy implementation, and the importance of considering when establishing causality is the goal of policy implementation research.

Factors influencing primary care organization commitment to technical assistance for pharmacist clinical services integration.

BACKGROUND: While technical assistance (TA) has been utilized by primary care organizations (PCOs) for electronic health record installation and medical home recognition, little is known about PCOs' use of TA to optimize pharmacist clinical services and integration in team-based care or population health programs. In 2019, the Connecticut Office of Health Strategy's State Innovation Model Program funded a no-cost TA initiative for 9 PCOs to initiate and/or advance pharmacist clinical services. OBJECTIVE: To assess organizational, operational, and pharmacist factors that influenced PCO commitment to the TA program. METHODS: During the TA program, data were collected from multiple sources including PCO demographic data; discussions and meetings with PCO medical, pharmacy, and administrative leaders; on-site workflow observations; and pharmacist coaching sessions. Configurational comparative methods were applied using the data collected during the TA program. Candidate factors were identified and calibrated on the basis of the researchers' knowledge of the TA program, organizational readiness for change models, implementation science frameworks, and published literature. Each candidate factor was iteratively assessed until 13 factors were selected and calibrated by independently assigning each factor a dichotomous value across PCOs. Calibration differences between the researchers were discussed until consensus was reached. Solutions were modeled using the Coincidence Analysis (cna) package in R and RStudio (RStudio, PBC). RESULTS: Of the 9 PCOs, 4 committed to participating in the TA program. Only 1 factor, the presence of a hired pharmacist, consistently distinguished PCOs that committed from those that did not, with 100% coverage and 80% consistency. CONCLUSION: PCO commitment to participate in the TA program was best explained by the factor of already having hired a pharmacist. These results can inform future efforts to engage PCOs in TA, primary care policy initiatives, and future research to understand factors influencing PCO success with pharmacist clinical services integration.

Seeding Structures for a Community of Practice Focused on Transient Ischemic Attack (TIA): Implementing Across Disciplines and Waves.

BACKGROUND: The Community of Practice (CoP) model represents one approach to address knowledge management to support effective implementation of best practices. OBJECTIVE: We sought to identify CoP developmental strategies within the context of a national quality improvement project focused on improving the quality for patients receiving acute transient ischemic attack (TIA) care. DESIGN: Stepped wedge trial. PARTICIPANTS: Multidisciplinary staff at six Veterans Affairs medical facilities. INTERVENTIONS: To encourage site implementation of a multi-component quality improvement intervention, the trial included strategies to improve the development of a CoP: site kickoff meetings, CoP conference calls, and an interactive website (the "Hub"). APPROACH: Mixed-methods evaluation included data collected through a CoP attendance log; semi-structured interviews with site participants at 6 months (n = 32) and 12 months (n = 30), and CoP call facilitators (n = 2); and 22 CoP call debriefings. KEY RESULTS: The critical seeding structures that supported the cultivation of the CoP were the kickoffs which fostered relationships (key to the community element of CoPs) and provided the evidence base relevant to TIA care (key to the domain element of CoPs). The Hub provided the forum for sharing quality improvement plans and other tools which were further highlighted during the CoP calls (key to the practice element of CoPs). CoP calls were curated to create a positive context around participants' work by recognizing team successes. In addition to improving care at their local facilities, the community created a shared set of tools which built on their collective knowledge and could be shared within and outside the group. CONCLUSIONS: The PREVENT CoP advanced the mission of the learning healthcare system by successfully providing a forum for shared learning. The CoP was grown through seeding structures that included kickoffs, CoP calls, and the Hub. A CoP expands upon the learning collaborative implementation strategy as an effective implementation practice.

Improving Smoking and Blood Pressure Outcomes: The Interplay Between Operational Changes and Local Context.

PURPOSE: We undertook a study to identify conditions and operational changes linked to improvements in smoking and blood pressure (BP) outcomes in primary care. METHODS: We purposively sampled and interviewed practice staff (eg, office managers, clinicians) from a subset of 104 practices participating in EvidenceNOW-a multisite cardiovascular disease prevention initiative. We calculated Clinical Quality Measure improvements, with targets of 10-point or greater absolute improvements in the proportion of patients with smoking screening and, if relevant, counseling and in the proportion of hypertensive patients with adequately controlled BP. We analyzed interview data to identify operational changes, transforming these into numeric data. We used Configurational Comparative Methods to assess the joint effects of multiple factors on outcomes. RESULTS: In clinician-owned practices, implementing a workflow to routinely screen, counsel, and connect patients to smoking cessation resources, or implementing a documentation change or a referral to a resource alone led to an improvement of at least 10 points in the smoking outcome with a moderate level of facilitation support. These patterns did not manifest in health- or hospital system-owned practices or in Federally Qualified Health Centers, however. The BP outcome improved by at least 10 points among solo practices after medical assistants were trained to take an accurate BP. Among larger, clinician-owned practices, BP outcomes improved when practices implemented a second BP measurement when the first was elevated, and when staff learned where to document this information in the electronic health record. With 50 hours or more of facilitation, BP outcomes improved among larger and health- and hospital system-owned practices that implemented these operational changes. CONCLUSIONS: There was no magic bullet for improving smoking or BP outcomes. Multiple combinations of operational changes led to improvements, but only in specific contexts of practice size and ownership, or dose of external facilitation.

Facility-level conditions leading to higher reach: a configurational analysis of national VA weight management programming.

BACKGROUND: While the Veterans Health Administration (VHA) MOVE! weight management program is effective in helping patients lose weight and is available at every VHA medical center across the United States, reaching patients to engage them in treatment remains a challenge. Facility-based MOVE! programs vary in structures, processes of programming, and levels of reach, with no single factor explaining variation in reach. Configurational analysis, based on Boolean algebra and set theory, represents a mathematical approach to data analysis well-suited for discerning how conditions interact and identifying multiple pathways leading to the same outcome. We applied configurational analysis to identify facility-level obesity treatment program arrangements that directly linked to higher reach. METHODS: A national survey was fielded in March 2017 to elicit information about more than 75 different components of obesity treatment programming in all VHA medical centers. This survey data was linked to reach scores available through administrative data. Reach scores were calculated by dividing the total number of Veterans who are candidates for obesity treatment by the number of "new" MOVE! visits in 2017 for each program and then multiplied by 1000. Programs with the top 40 % highest reach scores (n = 51) were compared to those in the lowest 40 % (n = 51). Configurational analysis was applied to identify specific combinations of conditions linked to reach rates. RESULTS: One hundred twenty-seven MOVE! program representatives responded to the survey and had complete reach data. The final solution consisted of 5 distinct pathways comprising combinations of program components related to pharmacotherapy, bariatric surgery, and comprehensive lifestyle intervention; 3 of the 5 pathways depended on the size/complexity of medical center. The 5 pathways explained 78 % (40/51) of the facilities in the higher-reach group with 85 % consistency (40/47). CONCLUSIONS: Specific combinations of facility-level conditions identified through configurational analysis uniquely distinguished facilities with higher reach from those with lower reach. Solutions demonstrated the importance of how local context plus specific program components linked together to account for a key implementation outcome. These findings will guide system recommendations about optimal program structures to maximize reach to patients who would benefit from obesity treatment such as the MOVE!

Acceptability of a complex team-based quality improvement intervention for transient ischemic attack: a mixed-methods study.

BACKGROUND: The Protocol-guided Rapid Evaluation of Veterans Experiencing New Transient Neurologic Symptoms (PREVENT) program was a complex quality improvement (QI) intervention targeting transient ischemic attack (TIA) evidence-based care. The aim of this study was to evaluate program acceptability among the QI teams and factors associated with degrees of acceptability. METHODS: QI teams from six Veterans Administration facilities participated in active implementation for a one-year period. We employed a mixed methods study to evaluate program acceptability. Multiple data sources were collected over implementation phases and triangulated for this evaluation. First, we conducted 30 onsite, semi-structured interviews during active implementation with 35 participants at 6 months; 27 interviews with 28 participants at 12 months; and 19 participants during program sustainment. Second, we conducted debriefing meetings after onsite visits and monthly virtual collaborative calls. All interviews and debriefings were audiotaped, transcribed, and de-identified. De-identified files were qualitatively coded and analyzed for common themes and acceptability patterns. We conducted mixed-methods matrix analyses comparing acceptability by satisfaction ratings and by the Theoretical Framework of Acceptability (TFA). RESULTS: Overall, the QI teams reported the PREVENT program was acceptable. The clinical champions reported high acceptability of the PREVENT program. At pre-implementation phase, reviewing quality data, team brainstorming solutions and development of action plans were rated as most useful during the team kickoff meetings. Program acceptability perceptions varied over time across active implementation and after teams accomplished actions plans and moved into sustainment. We observed team acceptability growth over a year of active implementation in concert with the QI team's self-efficacy to improve quality of care. Guided by the TFA, the QI teams' acceptability was represented by the respective seven components of the multifaceted acceptability construct. CONCLUSIONS: Program acceptability varied by time, by champion role on QI team, by team self-efficacy, and by perceived effectiveness to improve quality of care aligned with the TFA. A complex quality improvement program that fostered flexibility in local adaptation and supported users with access to data, resources, and implementation strategies was deemed acceptable and appropriate by front-line clinicians implementing practice changes in a large, national healthcare organization. TRIAL REGISTRATION: clinicaltrials.gov : NCT02769338 .

Building cohesion in distributed telemedicine teams: findings from the Department of Veterans Affairs National Telestroke Program.

BACKGROUND: As telemedicine adoption increases, so does the importance of building cohesion among physicians in telemedicine teams. For example, in acute telestroke services, stroke specialists provide rapid remote stroke assessment and treatment to patients at hospitals without stroke specialty care. In the National Telestroke Program (NTSP) of the U.S. Department of Veterans Affairs, a virtual (distributed) hub of stroke specialists throughout the country provides 24/7 consultations nationwide. We examined how these specialists adapted to distributed teamwork, and we identified cohesion-related factors in program development and support. METHODS: We studied the virtual hub of stroke specialists employed by the NTSP. Semi-structured, confidential interviews with stroke specialists in the virtual hub were recorded and transcribed. We explored the extent to which these specialists had developed a sense of shared identity and team cohesion, and we identified factors in this development. Using a qualitative approach with constant comparison methods, two researchers coded each interview transcript independently using a shared codebook. We used matrix displays to identify themes, with special attention to team cohesion, communication, trust, and satisfaction. RESULTS: Of 13 specialists with at least 8 months of NTSP practice, 12 completed interviews; 7 had previously practiced in telestroke programs in other healthcare systems. Interviewees reported high levels of trust and team cohesion, sometimes even more with their virtual colleagues than with co-located colleagues. Factors facilitating perceived team cohesion included a weekly case conference call, a sense of transparency in discussing challenges, engagement in NTSP development tasks, and support from the NTSP leadership. Although lack of in-person contact was associated with lower cohesion, annual in-person NTSP meetings helped mitigate this issue. Despite technical challenges in establishing a new telehealth system within existing national infrastructure, providers reported high levels of satisfaction with the NTSP. CONCLUSION: A virtual telestroke hub can provide a sense of team cohesion among stroke specialists at a level comparable with a standard co-located practice. Engaging in transparent discussion of challenging cases, reviewing new clinical evidence, and contributing to program improvements may promote cohesion in distributed telemedicine teams.

Strategy Configurations Directly Linked to Higher Hepatitis C Virus Treatment Starts: An Applied Use of Configurational Comparative Methods.

BACKGROUND: The Department of Veterans Affairs (VA) cares for more patients with hepatitis C virus (HCV) than any other US health care system. We tracked the implementation strategies that VA sites used to implement highly effective new treatments for HCV with the aim of uncovering how combinations of implementation strategies influenced the uptake of the HCV treatment innovation. We applied Configurational Comparative Methods (CCMs) to uncover causal dependencies and identify difference-making strategy configurations, and to distinguish higher from lower HCV treating sites. METHODS: We surveyed providers to assess VA sites' use of 73 implementation strategies to promote HCV treatment in the fiscal year 2015. CCMs were used to identify strategy configurations that uniquely distinguished higher HCV from lower HCV treating sites. RESULTS: From the 73 possible implementation strategies, CCMs identified 5 distinct strategy configurations, or "solution paths." These were comprised of 10 individual strategies that collectively explained 80% of the sites with higher HCV treatment starts with 100% consistency. Using any one of the following 5 solution paths was sufficient to produce higher treatment starts: (1) technical assistance; (2) engaging in a learning collaborative AND designating leaders; (3) site visits AND outreach to patients to promote uptake and adherence; (4) developing resource sharing agreements AND an implementation blueprint; OR (5) creating new clinical teams AND sharing quality improvement knowledge with other sites AND engaging patients. There was equifinality in that the presence of any one of the 5 solution paths was sufficient for higher treatment starts. CONCLUSIONS: Five strategy configurations distinguished higher HCV from lower HCV treating sites with 100% consistency. CCMs represent a methodological advancement that can help inform high-yield implementation strategy selection and increase the efficiency and effectiveness of future implementation efforts.

Factors Influencing Implementation of a Colorectal Cancer Screening Improvement Program in Community Health Centers: an Applied Use of Configurational Comparative Methods.

BACKGROUND: Evidence-based programs such as mailed fecal immunochemical test (FIT) outreach can only affect health outcomes if they can be successfully implemented. However, attempts to implement programs are often limited by organizational-level factors. OBJECTIVES: As part of the Strategies and Opportunities to Stop Colon Cancer in Priority Populations (STOP CRC) pragmatic trial, we evaluated how organizational factors impacted the extent to which health centers implemented a mailed FIT outreach program. DESIGN: Eight health centers participated in STOP CRC. The intervention consisted of customized electronic health record tools and clinical staff training to facilitate mailing of an introduction letter, FIT kit, and reminder letter. Health centers had flexibility in how they delivered the program. MAIN MEASURES: We categorized the health centers' level of implementation based on the proportion of eligible patients who were mailed a FIT kit, and applied configurational comparative methods to identify combinations of relevant organizational-level and program-level factors that distinguished among high, medium, and low implementing health centers. The factors were categorized according to the Consolidated Framework for Implementation Research model. KEY RESULTS: FIT tests were mailed to 21.0-81.7% of eligible participants at each health center. We identified a two-factor solution that distinguished among levels of implementation with 100% consistency and 100% coverage. The factors were having a centralized implementation team (inner setting) and mailing the introduction letter in advance of the FIT kit (intervention characteristics). Health centers with high levels of implementation had the joint presence of both factors. In health centers with medium levels of implementation, only one factor was present. Health centers with low levels of implementation had neither factor present. CONCLUSIONS: Full implementation of the STOP CRC intervention relied on a centralized implementation team with dedicated staffing time, and the advance mailing of an introduction letter. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT01742065 Registered 05 December 2012-Prospectively registered.

Empowering Implementation Teams with a Learning Health System Approach: Leveraging Data to Improve Quality of Care for Transient Ischemic Attack.

BACKGROUND: Questions persist about how learning healthcare systems should integrate audit and feedback (A&F) into quality improvement (QI) projects to support clinical teams' use of performance data to improve care quality. OBJECTIVE: To identify how a virtual "Hub" dashboard that provided performance data for patients with transient ischemic attack (TIA), a resource library, and a forum for sharing QI plans and tools supported QI activities among newly formed multidisciplinary clinical teams at six Department of Veterans Affairs (VA) medical centers. DESIGN: An observational, qualitative evaluation of how team members used a web-based Hub. PARTICIPANTS: External facilitators and multidisciplinary team members at VA facilities engaged in QI to improve the quality of TIA care. APPROACH: Qualitative implementation process and summative evaluation of observational Hub data (interviews with Hub users, structured field notes) to identify emergent, contextual themes and patterns of Hub usage. KEY RESULTS: The Hub supported newly formed multidisciplinary teams in implementing QI plans in three main ways: as an information interface for integrated monitoring of TIA performance; as a repository used by local teams and facility champions; and as a tool for team activation. The Hub enabled access to data that were previously inaccessible and unavailable and integrated that data with benchmark and scientific evidence to serve as a common data infrastructure. Led by champions, each implementation team used the Hub differently: local adoption of the staff and patient education materials; benchmarking facility performance against national rates and peer facilities; and positive reinforcement for QI plan development and monitoring. External facilitators used the Hub to help teams leverage data to target areas of improvement and disseminate local adaptations to promote resource sharing across teams. CONCLUSIONS: As a dynamic platform for A&F operating within learning health systems, hubs represent a promising strategy to support local implementation of QI programs by newly formed, multidisciplinary teams.

Evaluating the feasibility of implementing a Telesleep pilot program using two-tiered external facilitation.

BACKGROUND: Obstructive sleep apnea (OSA) can negatively impact patients' health status and outcomes. Positive airway pressure (PAP) reverses airway obstruction and may reduce the risk of adverse outcomes. Remote monitoring of PAP (as opposed to in-person visits) may improve access to sleep medicine services. This study aimed to evaluate the feasibility of implementing a clinical program that delivers treatment for OSA through PAP remote monitoring using external facilitation as an implementation strategy. METHODS: Participants included patients with OSA at a Veteran Affairs Medical Center (VAMC). PAP adherence and clinical disease severity on treatment (measured by the apnea hypopnea index [AHI]) were the preliminary effectiveness outcomes across two delivery models: usual care (in-person) and Telehealth nurse-delivered remote monitoring. We also assessed visit duration and travel distance. A prospective, mixed-methods evaluation examined the two-tiered external facilitation implementation strategy. RESULTS: The pilot project included N = 52 usual care patients and N = 38 Telehealth nurse-delivered remote monitoring patients. PAP adherence and disease severity were similar across the delivery modalities. However, remote monitoring visits were 50% shorter than in-person visits and saved a mean of 72 miles of travel (median = 45.6, SD = 59.0, mode = 17.8, range 5.4-220). A total of 62 interviews were conducted during implementation with a purposive sample of 12 clinical staff involved in program implementation. Weekly external facilitation delivered to both front-line staff and supervisory physicians was necessary to ensure patient enrollment and treatment. Synchronized, "two-tiered" facilitation at the executive and coordinator levels proved crucial to developing the clinical and administrative infrastructure to support a PAP remote monitoring program and to overcome implementation barriers. CONCLUSIONS: Remote PAP monitoring had similar efficacy to in-person PAP services in this Veteran population. Although external facilitation is a widely-recognized implementation strategy in quality improvement projects, less is known about how multiple facilitators work together to help implement complex programs. Two-tiered facilitation offers a model well-suited to programs where innovations span disciplines, disrupt professional hierarchies (such as those between service chiefs, clinicians, and technicians) and bring together providers who do not know each other, yet must collaborate to improve access to care.

Interorganizational Context When Implementing Multisector Partnered Programs: A Qualitative Analysis of Veteran Directed Care.

As the number of Veterans enrolled in the Veterans Health Administration (VHA) and at risk for needing Long Term Services and Supports increases, VHA is shifting from institutional to Home and Community Based Services, such as the Veteran-Directed Care (VDC) program. VDC is a multi-sector program implemented as a collaboration between individual VHA medical centers (VAMCs) and Aging and Disability Network Agencies (ADNAs), entities that sit outside the VHA. Factors that affect establishment of effective multi-sector programs such as VDC are poorly understood, limiting ability to effectively deliver and scale programs. We conducted a qualitative study to describe factors affecting the interorganizational implementation context of VDC. Using constructs from the Consolidated Framework for Implementation Research (CFIR), we interviewed VDC coordinators from seven different VAMC-ADNA partnerships that initiated the VDC program between 2017 and 2018. We identified eight CFIR determinants which manifested similarly for the VAMCs and ADNAs: evidence strength and quality, relative advantage, adaptability, tension for change, access to knowledge and information, self-efficacy; engaging, and champions. We identified three CFIR determinants that varied dramatically across VAMCs and ADNAs: available resources, implementation climate, and relative priority. Our results suggest that interorganizational context plays a critical and dynamic role within multi-sector collaborations.