Building a sharable literature collection to advance the science and practice of implementation facilitation.

Background: Implementation science seeks to produce generalizable knowledge on strategies that promote the adoption and sustained use of evidence-based innovations. Literature reviews on specific implementation strategies can help us understand how they are conceptualized and applied, synthesize findings, and identify knowledge gaps. Although rigorous literature reviews can advance scientific knowledge and facilitate theory development, they are time-consuming and costly to produce. Improving the efficiency of literature review processes and reducing redundancy of effort is especially important for this rapidly developing field. We sought to amass relevant literature on one increasingly used evidence-based strategy, implementation facilitation (IF), as a publicly available resource. Methods: We conducted a rigorous systematic search of PubMed, CINAHL, and Web of Science citation databases for peer-reviewed, English-language articles with "facilitation" and a combination of other terms published from January 1996 to December 2021. We searched bibliographies of articles published from 1996 to 2015 and identified articles during the full text review that reported on the same study. Two authors screened 3,168 abstracts. After establishing inter-rater reliability, they individually conducted full-text review of 786 relevant articles. A multidisciplinary team of investigators provided recommendations for preparing and disseminating the literature collection. Findings: The literature collection is comprised of 510 articles. It includes 277 empirical studies of IF and 77 other articles, including conceptual/theoretical articles, literature reviews, debate papers and descriptions of large-scale clinical initiatives. Over half of the articles were published between 2017 and 2021. The collection is publicly available as an Excel file and as an xml file that can be imported into reference management software. Conclusion: We created a publicly accessible collection of literature about the application of IF to implement evidence-based innovations in healthcare. The comprehensiveness of this collection has the potential to maximize efficiency and minimize redundancy in scientific inquiry about this strategy. Scientists and practitioners can use the collection to more rapidly identify developments in the application of IF and to investigate a wide range of compelling questions on its use within and across different healthcare disciplines/settings, countries, and payer systems. We offer several examples of how this collection has already been used.

Getting to Fidelity: Consensus Development Process to Identify Core Activities of Implementation Facilitation.

Transferring successful implementation strategies from research to practice requires approaches for assessing fidelity to the strategy's core components. Implementation facilitation (IF) is a strategy involving an interactive process of problem-solving, enabling, and supporting individuals in efforts to implement clinical innovations that occurs in the context of a recognized need for improvement and supportive interpersonal relationships. Because IF is a dynamic strategy involving numerous activities, our objective was to conduct a rigorous consensus development process to identify core activities for monitoring fidelity to IF when applied in clinical settings. We first conducted a scoping literature review to identify the range of activities used when IF has been applied in clinical settings, searching multiple citation databases for English-language articles including "facilitation" or other commonly-used terms for the strategy published from 1996-2015. Through multi-stage screening, 135 articles (from 94 studies) were identified for data extraction on IF activities, frequency with which IF activities were identified as 'core' by study authors, and study outcomes. From the literature review, we identified 32 distinct IF activities and developed definitions/examples for each. Next, we conducted a 3-stage, modified-Delphi expert panel consensus development process to identify core IF activities across three implementation phases (i.e., Pre-Implementation, Implementation, Sustainment). The expert panel identified 8 core activities for the Pre-Implementation Phase, 8 core activities for the Implementation Phase, and 4 core activities for the Sustainment Phase. This work provides an important foundation for developing measures/tools to assess use of core IF activities to ensure the strategy is delivered with fidelity.

Feasibility and desirability of web-based mental health screening and individualized education for female OEF/OIF reserve and national guard war veterans.

Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) Reserve and National Guard (RNG) service members have an increased risk for postdeployment mental health (MH) and readjustment problems, yet most do not access needed care. It is unknown if RNG servicewomen experiencing postdeployment readjustment symptoms are aware these may signify treatable MH concerns or if this knowledge activates care-seeking. The aims of this proof-of-concept study were to determine the feasibility of web-based MH screening for postdeployment MH symptoms to inform individualized psychoeducation, and to assess user perceptions about the online instrument and process, MH care access, and VA and other MH care. A midwestern sample (N = 131) of recently deployed (past 24 months) OEF/OIF RNG Army and Air Force servicewomen participated. High rates of combat experiences (95%) and military sexual trauma (50%) were reported. Positive screens for key symptoms of MH problems were prevalent. One third (31%) of satisfaction survey completers indicated online information reduced discomfort with seeking MH care; 42% reported they would subsequently seek MH assessment. Participants interviewed by telephone indicated that stigma and limited knowledge about women-specific services were key reasons servicewomen do not use MH care. This study demonstrated web-based screenings with individualized psychoeducation are implementable and favorable to RNG servicewomen.

Online Screening and Personalized Education to Identify Post-Deployment Mental Health Need and Facilitate Access to Care.

INTRODUCTION: Reserve and National Guard (RNG) service members face increased risks for psychological and behavioral problems and are unlikely to seek mental health (MH) care after returning from military deployments. This article examines an online intervention (Web-Ed) with regard to participation, screening results, satisfaction, and intent to seek follow-up MH care, with comparisons by gender and post-deployment MH care receipt. MATERIALS AND METHODS: This was a cross-sectional study of 414 RNG service members (214 women and 200 men), who returned from deployments to or in support of the Iraq or Afghanistan wars within the prior 36 months. Participants completed Web-Ed, which includes screening, personalized education, and links to Veterans Health Administration health care. RESULTS: Positive post-deployment screening proportions, Web-Ed satisfaction, and intent to seek follow-up care were similar for men and women. Few had received MH care (33% women; 24% men), yet most screened positive on at least one screen (69% women; 72% men). Most indicated that they would recommend Web-Ed to other veterans (71% women; 67% men) and that they received useful information they may not have received otherwise (52% women; 53% men) regardless of gender or prior MH care. Almost half (40% women; 48% men) planned to seek further assessment from a health care provider as a direct result of Web-Ed. CONCLUSIONS: Efforts to facilitate access to MH care among post-deployed RNG veterans should be ongoing, regardless of the length of time since deployment, Veterans Affairs enrollment status, prior MH care receipt, or gender. Online screening and personalized education engage veterans who have not sought MH care and provide new information to those who have.

Testing implementation facilitation for uptake of an evidence-based psychosocial intervention in VA homeless programs: A hybrid type III trial.

BACKGROUND: Healthcare systems face difficulty implementing evidence-based practices, particularly multicomponent interventions. Additional challenges occur in settings serving vulnerable populations such as homeless Veterans, given the population's acuity, multiple service needs, and organizational barriers. Implementation Facilitation (IF) is a strategy to support the uptake of evidence-based practices. This study's aim was to simultaneously examine IF on the uptake of Maintaining Independence and Sobriety Through Systems Integration, Outreach and Networking-Veterans Edition (MISSION-Vet), an evidence-based multicomponent treatment engagement intervention for homeless Veterans with co-occurring mental health and substance abuse, and clinical outcomes among Veterans receiving MISSION-Vet. METHODS: This multi-site hybrid III modified stepped-wedge trial involved seven programs at two Veterans Affairs Medical Centers comparing Implementation as Usual (IU; training and educational materials) to IF (IU + internal and external facilitation). RESULTS: A total of 110 facilitation events averaging 27 minutes were conducted, of which 85% were virtual. Staff (case managers and peer specialists; n = 108) were trained in MISSION-Vet and completed organizational readiness assessments (n = 77). Although both sites reported being willing to innovate and a desire to improve outcomes, implementation climate significantly differed. Following IU, no staff at either site conducted MISSION-Vet. Following IF, there was a significant MISSION-Vet implementation difference between sites (53% vs. 14%, p = .002). Among the 93 Veterans that received any MISSION-Vet services, they received an average of six sessions. Significant positive associations were found between number of MISSION-Vet sessions and outpatient treatment engagement measured by the number of outpatient visits attended. CONCLUSIONS: While staff were interested in improving patient outcomes, MISSION-Vet was not implemented with IU. IF supported MISSION-Vet uptake and increased outpatient service utilization, but MISSION-Vet still proved difficult to implement particularly in the larger healthcare system. Future studies might tailor implementation strategies to organizational readiness. TRIAL REGISTRATION: ClinicalTrials.gov, NCT02942979.

Development and Preliminary Evaluation of an Implementation Facilitation Training Program.

Background: Implementation scientists are identifying evidence-based implementation strategies that support the uptake of evidence-based practices and other clinical innovations. However, there is limited information regarding the development of training methods to educate implementation practitioners on the use of implementation strategies and help them sustain these competencies. Methods: To address this need, we developed, implemented, and evaluated a training program for one strategy, implementation facilitation (IF), that was designed to maximize applicability in diverse clinical settings. Trainees included implementation practitioners, clinical managers, and researchers. From May 2017 to July 2019, we sent trainees an electronic survey via email and asked them to complete the survey at three-time points: approximately 2 weeks before and 2 weeks and 6 months after each training. Participants ranked their knowledge of and confidence in applying IF skills using a 4-point Likert scale. We compared scores at baseline to post-training and at 6 months, as well as post-training to 6 months post-training (nonparametric Wilcoxon signed-rank tests). Results: Of the 102 participants (76 in-person, 26 virtual), there was an increase in perceived knowledge and confidence in applying IF skills across all learning objectives from pre- to post-training (95% response rate) and pre- to 6-month (35% response rate) follow-up. There was no significant difference in results between virtual and in-person trainees. When comparing post-training to 6 months (30% response rate), perceptions of knowledge increase remained unchanged, although participants reported reduced perceived confidence in applying IF skills for half of the learning objectives at 6 months. Conclusions: Findings indicated that we have developed a promising IF training program. Lack of differences in results between virtual and in-person participants indicated the training can be provided to a remote site without loss of knowledge/skills transfer but ongoing support may be needed to help sustain perceived confidence in applying these skills. Plain Language Summary: While implementation scientists are documenting an increasing number of implementation strategies that support the uptake of evidence-based practices and other clinical innovations, little is known about how to transfer this knowledge to those who conduct implementation efforts in the frontline clinical practice settings. We developed, implemented, and conducted a preliminary evaluation of a training program for one strategy, implementation facilitation (IF). The training program targets facilitation practitioners, clinical managers, and researchers. This paper describes the development of the training program, the program components, and the results from an evaluation of IF knowledge and skills reported by a subset of people who participated in the training. Findings from the evaluation indicate that this training program significantly increased trainees' perceived knowledge of and confidence in applying IF skills. Further research is needed to examine whether ongoing mentoring helps trainees retain confidence in applying some IF skills over the longer term.

Time-motion analysis of external facilitation for implementing the Collaborative Chronic Care Model in general mental health clinics: Use of an interval-based data collection approach.

Background: Facilitation is an effective strategy to implement evidence-based practices, often involving external facilitators (EFs) bringing content expertise to implementation sites. Estimating time spent on multifaceted EF activities is complex. Furthermore, collecting continuous time-motion data for facilitation tasks is challenging. However, organizations need this information to allocate implementation resources to sites. Thus, our objectives were to conduct a time-motion analysis of external facilitation, and compare continuous versus noncontinuous approaches to collecting time-motion data. Methods: We analyzed EF time-motion data from six VA mental health clinics implementing the evidence-based Collaborative Chronic Care Model (CCM). We documented EF activities during pre-implementation (4-6 weeks) and implementation (12 months) phases. We collected continuous data during the pre-implementation phase, followed by data collection over a 2-week period (henceforth, "a two-week interval") at each of three time points (beginning/middle/end) during the implementation phase. As a validity check, we assessed how closely interval data represented continuous data collected throughout implementation for two of the sites. Results: EFs spent 21.8 ± 4.5 h/site during pre-implementation off-site, then 27.5 ± 4.6 h/site site-visiting to initiate implementation. Based on the 2-week interval data, EFs spent 2.5 ± 0.8, 1.4 ± 0.6, and 1.2 ± 0.6 h/week toward the implementation's beginning, middle, and end, respectively. Prevalent activities were preparation/planning, process monitoring, program adaptation, problem identification, and problem-solving. Across all activities, 73.6% of EF time involved email, phone, or video communication. For the two continuous data sites, computed weekly time averages toward the implementation's beginning, middle, and end differed from the interval data's averages by 1.0, 0.1, and 0.2 h, respectively. Activities inconsistently captured in the interval data included irregular assessment, stakeholder engagement, and network development. Conclusions: Time-motion analysis of CCM implementation showed initial higher-intensity EF involvement that tapered. The 2-week interval data collection approach, if accounting for its potential underestimation of irregular activities, may be promising/efficient for implementation studies collecting time-motion data.

Implementing a complex psychosocial intervention for unstably housed Veterans: A realist-informed evaluation case study.

Background: Only 7% of individuals with co-occurring mental health and substance use disorder (COD) receive services for both conditions. We implemented and evaluated maintaining independence and sobriety through systems integration, outreach and networking-Veteran's edition (MISSION-Vet), an evidence-based manualized psychosocial intervention for Veterans with CODs. This paper identifies the generative mechanisms that explain "how, for whom, and under what conditions" MISSION-Vet adoption, implementation, and fidelity work when applied in a complex adaptive system with facilitation support. Methods: Within two VA healthcare systems (Sites A and B), a hybrid III trial tested facilitation to implement MISSION-Vet. We conducted a two-site case study based on 42 semi-structured consolidated framework for implementation research (CFIR) guided interviews with site leadership, implementers (social workers, peer specialists), and team members (facilitators, site leads). Interviews were coded and CFIR constructs used to generate "Context + Mechanism = Outcome" configurations to understand the conditions of MISSION-Vet adoption, implementation, and fidelity. Results: Site A was low, and Site B was high in adoption, implementation, and fidelity. Adoption hesitancy/eagerness (outcome) resulted from the interaction of "external policy" (context) dampening/encouraging a "tension for change" (mechanism). Implementation intensity (outcome) was based on how "peer pressure" or practice culture (context) activated staff "self-efficacy" (mechanism) to engage with MISSION-Vet and appraise its "relative advantage" over current practices (mechanism). Fidelity relied on how "staffing structure and availability" (context) activated/muted "facilitation" (mechanism) to result in strategy and intervention adaptation (outcome). Conclusions: We delineated how specific contexts activated certain mechanisms to drive the different stages of implementation of a multi-faceted COD treatment intervention. Trial registration: ClinicalTrials.gov, NCT02942979. Plain language abstract: Implementation is inherently dynamic and influenced by interdependent factors operating at the individual, organizational, and system levels. This is especially true for complex interventions addressing co-occurring mental health and substance use disorders because such interventions involve multiple treatment modalities delivered simultaneously, in busy practice settings, with challenging populations. This paper pairs consolidated framework for implementation research (CFIR) constructs with a realist evaluation approached to generate configurations important to the adoption, implementation, and adaptation stages of a highly complex intervention addressing the behavioural health and housing needs of a vulnerable population. Each configuration describes how contextual factors trigger mechanisms to generate implementation outcomes and answers "what works for whom, in what circumstances and in what respects, and how?" These findings further our understanding of possible mechanisms of change and push us to be more precise about identifying causal relationships among constructs that contribute to the success of implementing complex interventions. This work also moves us to think theoretically and methodologically in a more dynamic fashion, thereby leading to more responsive implementation practice.

Consensus on strategies for implementing high priority mental health care practices within the US Department of Veterans Affairs.

Background: Identifying feasible and effective implementation strategies remains a significant challenge. At present, there is a gap between the number of strategies prospectively included in implementation trials, typically four or fewer, and the number of strategies utilized retrospectively, often 20 or more. This gap points to the need for developing a better understanding of the range of implementation strategies that should be considered in implementation science and practice. Methods: This study elicited expert recommendations to identify which of 73 discrete implementation strategies were considered essential for implementing three mental health care high priority practices (HPPs) in the US Department of Veterans Affairs: depression outcome monitoring in primary care mental health (n = 20), prolonged exposure therapy for treating posttraumatic stress disorder (n = 22), and metabolic safety monitoring for patients taking antipsychotic medications (n = 20). Participants had expertise in implementation science, the specific HPP, or both. A highly structured recommendation process was used to obtain recommendations for each HPP. Results: Majority consensus was identified for 26 or more strategies as absolutely essential; 53 or more strategies were identified as either likely essential or absolutely essential across the three HPPs. Conclusions: The large number of strategies identified as essential starkly contrasts with existing research that largely focuses on application of single strategies to support implementation. Systematic investigation and documentation of multi-strategy implementation initiatives is needed. Plain Language Summary: Most implementation studies focus on the impact of a relatively small number of discrete implementation strategies on the uptake of a practice. However, studies that systematically survey providers find that dozens or more discrete implementation strategies can be identified in the context of the implementation initiative. This study engaged experts in implementation science and clinical practice in a structured recommendation process to identify which of the 73 Expert Recommendations for Implementing Change (ERIC) implementation strategies were considered absolutely essential, likely essential, likely inessential, and absolutely inessential for each of the three distinct mental health care practices: depression outcome monitoring in primary care, prolonged exposure therapy for posttraumatic stress disorder, and metabolic safety monitoring for patients taking antipsychotic medications. The results highlight that experts consider a large number of strategies as absolutely or likely essential for supporting the implementation of mental health care practices. For example, 26 strategies were identified as absolutely essential for all three mental health care practices. Another 27 strategies were identified as either absolutely or likely essential across all three practices. This study points to the need for future studies to document the decision-making process an initiative undergoes to identify which strategies to include and exclude in an implementation effort. In particular, a structured approach to this documentation may be necessary to identify strategies that may be endogenous to a care setting and that may not be otherwise be identified as being "deliberately" used to support a practice or intervention.

Getting a clinical innovation into practice: An introduction to implementation strategies.

Just as there is a robust science that supports development and rigorous testing of clinical innovations, the emerging field of implementation science is developing new theory-based knowledge regarding a growing portfolio of meticulously tested implementation strategies that seek to improve uptake of evidence-based practices by targeting barriers at multiple levels within health care settings. Studying and documenting implementation strategies associated with uptake during the development and trial of a clinical innovation could subsequently position the researcher for a more seamless transition and handoff of the innovation to clinical and operational leaders. The objective of this manuscript is to introduce the concept of implementation strategies: what they are; the rigor with which they are defined and applied to address barriers to clinical innovation adoption; how strategy selection may vary based on contextual, innovation, and recipient factors; how to document the application of strategies over the course of an implementation study; and how testing their effectiveness is the focus of implementation research trials.

Targeting stigma of mental illness among primary care providers: Findings from a pilot feasibility study.

Stigmatizing attitudes among primary care (PC) providers potentially contribute to poor health outcomes for individuals with serious mental illness (SMI). In this pilot study, our primary aim is to test the feasibility, and preliminary implementation of two interventions (contact and education) to help change provider attitudes and behavior. Participants were 39 primary care providers from two Veterans Affairs medical centers with 19 randomized to the contact intervention and 20 to the education intervention. Both interventions were delivered in a group setting face-to-face. Stigmatizing attitudes were measured using Opening Minds Scale for Health Care Providers, Attribution Questionnaire and Social Distance Scale at baseline, one month and three months. Data were analyzed using repeated measures analysis of variance (ANOVA). Most providers were white, female, nurses, and older than age 50. For each of the three measures of stigmatizing attitudes there was no statistically significant treatment-by-time interaction rejecting our hypothesis that contact intervention will result in significantly greater reduction in stigmatizing attitudes. Qualitative analysis suggests that the contact intervention was perceived as much needed. This study informs future research to reduce provider stigma. Our intervention was modeled on interventions designed for the general public; different interventions may be needed for providers.

Creating a Practice-Based Implementation Network: Facilitating Practice Change Across Health Care Systems.

A proof-of-concept practice-based implementation network was developed in the US Departments of Veteran Affairs (VA) and Defense to increase the speed of implementation of mental health practices, derive lessons learned prior to larger-scale implementation, and facilitate organizational learning. One hundred thirty-four clinicians in 18 VA clinics received brief training in the use of the PTSD checklist (PCL) in clinical care. Two implementation strategies, external facilitation and technical assistance, were used to encourage the use of outcomes data to inform treatment decisions and increase discussion of results with patients. There were mixed results for changes in the frequency of PCL administration, but consistent increases in clinician use of data and incorporation into the treatment process via discussion. Programs and clinicians were successfully recruited to participate in a 2-year initiative, suggesting the feasibility of using this organizational structure to facilitate the implementation of new practices in treatment systems.

Nitrate in tile drainage of the semiarid Palouse Basin.

Topographically heterogeneous agricultural landscapes can complicate and accelerate agrochemical contamination of streams due to rapid transport of water and chemicals to poorly drained lower-landscape positions and shallow ground water. In the semiarid Palouse region, large parts of these landscapes have been tile drained to enhance crop yield. From 2000-2004 we monitored the discharge of a tile drain (TD) and a nearby profile of soil water for nitrate concentration ([NO(3)]), electrical conductivity level (EC), and water content to develop a conceptual framework describing soil nitrate occurrence and loss via subsurface pathways. Tile-drain baseflow [NO(3)] was consistently 4 mg N L(-1) and baseflow EC was 200 to 300 microS cm(-1). Each year sudden synoptic increases in TD discharge and [NO(3)] occurred in early winter following approximately 150 mm of fall precipitation, which saturated the soil and mobilized high-[NO(3)] soil water throughout the profile. The greatest TD [NO(3)] (20-30 mg N L(-1)) occurred approximately contemporaneous with greatest TD discharges. The EC decrease each year (to approximately 100 microS cm(-1)) during high discharge, a dilution effect, lagged approximately 1 mo behind the first appearance of high [NO(3)] and was consistent with advective transport of low-EC water from the shallow profile under saturated conditions. Water-budget considerations and temporal [NO(3)] patterns suggest that these processes deliver water to the TD from both lower- and upper-slope positions, the latter via lateral flow during the high-flow season. Management practices that reduce the fall reservoir of soil nitrate might be effective in reducing N loading to streams and shallow ground water in this region.

The role of formative evaluation in implementation research and the QUERI experience.

This article describes the importance and role of 4 stages of formative evaluation in our growing understanding of how to implement research findings into practice in order to improve the quality of clinical care. It reviews limitations of traditional approaches to implementation research and presents a rationale for new thinking and use of new methods. Developmental, implementation-focused, progress-focused, and interpretive evaluations are then defined and illustrated with examples from Veterans Health Administration Quality Enhancement Research Initiative projects. This article also provides methodologic details and highlights challenges encountered in actualizing formative evaluation within implementation research.

Lessons learned about implementing research evidence into clinical practice. Experiences from VA QUERI.

The mission of the Veterans Health Administration's (VHA) quality enhancement research initiative (QUERI) is to enhance the quality of VHA health care by implementing clinical research findings into routine care. This paper presents lessons that QUERI investigators have learned through their initial attempts to pursue the QUERI mission. The lessons in this paper represent those that were common across multiple QUERI projects and were mutually agreed on as having substantial impact on the success of implementation. While the lessons are consistent with commonly recognized ingredients of successful implementation efforts, the examples highlight the fact that, even with a thorough knowledge of the literature and thoughtful planning, unexpected circumstances arise during implementation efforts that require flexibility and adaptability. The findings stress the importance of utilizing formative evaluation techniques to identify barriers to successful implementation and strategies to address these barriers.

Soil organic matter-hydrogen peroxide dynamics in the treatment of contaminated soils and groundwater using catalyzed H2O2 propagations (modified Fenton's reagent).

The interactions between catalyzed H(2)O(2) propagations (CHP-i.e. modified Fenton's reagent) and soil organic matter (SOM) during the treatment of contaminated soils and groundwater was studied in a well-characterized surface soil. The fate of two fractions of SOM, particulate organic matter (POM) and nonparticulate organic matter (NPOM), during CHP reactions was evaluated using concentrations of hydrogen peroxide from 0.5 to 3M catalyzed by soluble iron (III), an iron (III)-ethylenediamine tetraacetic acid (EDTA) chelate, or naturally-occurring soil minerals. The destruction of total SOM in CHP systems was directly proportional to the hydrogen peroxide dosage, and was significantly greater at pH 3 than at neutral pH; furthermore, SOM destruction occurred predominantly in the NPOM fraction. At pH 3, SOM did not affect hydrogen peroxide decomposition rates or hydroxyl radical activity in CHP reactions. However, at neutral pH, increasing the mass of SOM decreased the hydrogen peroxide decomposition rate and increased the rate of hydroxyl radical generation in CHP systems. These results show that, while CHP reactions destroy some of the organic carbon pools, SOM does not have a significant effect on the CHP treatment of soils and groundwater.

Implementation Science Supports Core Clinical Competencies: An Overview and Clinical Example.

OBJECTIVE: Instead of asking clinicians to work faster or longer to improve quality of care, implementation science provides another option. Implementation science is an emerging interdisciplinary field dedicated to studying how evidence-based practice can be adopted into routine clinical care. This article summarizes principles and methods of implementation science, illustrates how they can be applied in a routine clinical setting, and highlights their importance to practicing clinicians as well as clinical trainees. METHOD: A hypothetical clinical case scenario is presented that explains how implementation science improves clinical practice. The case scenario is also embedded within a real-world implementation study to improve metabolic monitoring for individuals prescribed antipsychotics. RESULTS: Context, recipient, and innovation (ie, the evidence-based practice) factors affected improvement of metabolic monitoring. To address these factors, an external facilitator and a local quality improvement team developed an implementation plan involving a multicomponent implementation strategy that included education, performance reports, and clinician follow-up. The clinic remained compliant with recommended metabolic monitoring at 1-year follow up. CONCLUSIONS: Implementation science improves clinical practice by addressing context, recipient, and innovation factors and uses this information to develop and utilize specific strategies that improve clinical practice. It also enriches clinical training, aligning with core competencies by the Accreditation Council for Graduate Medical Education and American Boards of Medical Specialties. By learning how to change clinical practice through implementation strategies, clinicians are more able to adapt in complex systems of practice.

Improving detection of suicidal ideation among depressed patients in primary care.

PURPOSE: Primary care clinicians have difficulty detecting suicidal patients. This report evaluates the effect of 2 primary care interventions on the detection and subsequent referral or treatment of patients with depression and recent suicidal ideation. METHODS: Adult patients in 12 mixed-payer primary care practices and 9 not-for-profit staff model health maintenance organization (HMO) practices were screened for depression. Matched practices were randomized within plan type to intervention or usual care. The intervention for mixed-payer practices entailed brief training of physicians and office nurses to provide care management. The intervention for HMO practices consisted of guided development of quality improvement teams for depression care. A total of 880 enrolled patients met study criteria for depression, 232 of whom met criteria for recent suicidal ideation. Intervention effects on suicide detection and referral to mental health specialty care were evaluated with mixed-effects multilevel models in intent-to-treat analyses. RESULTS: Depressed patients with recent suicidal ideation were detected on 40.7% of index visits in intervention practices, compared with 20.5% in usual care practices (odds ratio = 2.64, 95% confidence interval, 1.45-5.07), with HMO plan type and male sex associated with detection. The interventions had no effect on referral of patients, starting an antidepressant, or suicidal ideation reported at a 6-month follow-up, although power was limited for all 3 analyses. CONCLUSIONS: Primary care interventions to improve depression care can improve detection of recent suicidal ideation. Further work is needed to improve physician response to detection, including referral to specialty care and more aggressive treatment, and to observe the effect on outcomes.

Implementing research findings into practice using clinical opinion leaders: barriers and lessons learned.

BACKGROUND: An opinion leader-driven intervention to improve practice guideline-based medication management for patients with schizophrenia was tested at four Department of Veterans Affairs health care facilities. The concept of using opinion leaders as disseminators of research evidence and internal agents of change has been widely reported. PROJECT OVERVIEW: Each intervention site received an intensive, multicomponent intervention during the course of one year. The project's process evaluation included ongoing brief surveys of physicians' attitudes and behaviors, logs of reports from opinion leader conference calls, and interviews with the opinion leaders toward the end of the implementation period. BARRIERS OR ISSUES AND POTENTIAL SOLUTIONS: Several barriers or problematic issues surfaced: (1) physicians do not always agree on who is an opinion leader; some sites may have no opinion leader; (2) some sites had poorly developed formal and informal social networks among physicians; (3) a focus on physicians only as agents of change; and (4) how much directive should be given to the opinion leaders concerning how to influence attitudes and behaviors? DISCUSSION: Four major problematic issues encountered during the project offer potential solutions for addressing them.

Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study.

BACKGROUND: Poor terminological consistency for core concepts in implementation science has been widely noted as an obstacle to effective meta-analyses. This inconsistency is also a barrier for those seeking guidance from the research literature when developing and planning implementation initiatives. The Expert Recommendations for Implementing Change (ERIC) study aims to address one area of terminological inconsistency: discrete implementation strategies involving one process or action used to support a practice change. The present report is on the second stage of the ERIC project that focuses on providing initial validation of the compilation of 73 implementation strategies that were identified in the first phase. FINDINGS: Purposive sampling was used to recruit a panel of experts in implementation science and clinical practice (N = 35). These key stakeholders used concept mapping sorting and rating activities to place the 73 implementation strategies into similar groups and to rate each strategy's relative importance and feasibility. Multidimensional scaling analysis provided a quantitative representation of the relationships among the strategies, all but one of which were found to be conceptually distinct from the others. Hierarchical cluster analysis supported organizing the 73 strategies into 9 categories. The ratings data reflect those strategies identified as the most important and feasible. CONCLUSIONS: This study provides initial validation of the implementation strategies within the ERIC compilation as being conceptually distinct. The categorization and strategy ratings of importance and feasibility may facilitate the search for, and selection of, strategies that are best suited for implementation efforts in a particular setting.