Misalignment in Community Mental Health Leader and Therapist Ratings of Psychological Safety Climate Predicts Therapist Self-Efficacy with Evidence-Based Practices (EBPs).

Therapist self-efficacy in delivering evidence-based practices (EBPs) is associated with implementation outcomes, including adoption and sustainment in community mental health settings. Inner context organizational climate, including psychological safety, can proximally shape therapist learning experiences within EBP implementation. Psychologically safe environments are conducive to learning behaviors including taking risks, admitting mistakes, and seeking feedback. Organization leaders are instrumental in facilitating psychological safety, but may have differing perspectives of organizational climate than front-line therapists. Discrepant leader and therapist views of psychological safety may have independent associations with therapist EBP learning and implementation outcomes over and above average therapist perceptions of climate. This study examined survey data from 337 therapists and 123 leaders from 49 programs contracted to deliver multiple EBPs within a study examining determinants of sustainment within a large system-driven implementation. Both leaders and therapists completed measures of psychological safety climate and therapists reported on their self-efficacy in delivering multiple EBPs in children's mental health services. Polynomial regression and response surface analysis models were conducted to examine the associations of therapist and leader reports of psychological safety and therapist EBP self-efficacy. Greater discrepancies between leader and therapist reports of psychological safety, in either direction, were associated with lower therapist EBP self-efficacy. Alignment in leader and therapist views of psychological safety climate may impact EBP implementation outcomes. Strategies for improving alignment in perceptions and priorities among organizational members can be included in organizational implementation interventions and may represent unexamined implementation mechanisms of action.

Using the Exploration-Preparation-Implementation-Sustainment (EPIS) Framework to prepare for the implementation of evidence-based practices into adolescent HIV settings.

Despite advances in evidence-based practices (EBP) to support HIV prevention and treatment, youth ages 13-24 experience significant disparities in HIV risk and outcomes. An important factor in this disparity is poor EBP implementation, yet implementation research is limited, particularly in youth-serving settings. This study used the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to guide the implementation of four Motivational Interviewing (MI) and MI-framed interventions into youth-serving HIV prevention and treatment settings. Key stakeholders (n = 153) across 13 sites completed pre-implementation interviews. Stakeholders' comments identified two critical factors for effective implementation: fit with the patient population and provider receptivity, including concerns about scope of practice, buy-in, and time. Stakeholders recommended strategies for structuring training, fidelity monitoring, and facilitating implementation including engaging informal leaders, collaboratively developing the implementation strategy, and site-wide implementation. Results highlight the importance of pre-implementation contextual assessment and strategic planning for identifying provider concerns and developing responsive implementation strategies.

RESUMEN: A pesar de los avances en las prácticas basadas en evidencia (EBP, por sus siglas en inglés) para apoyar la prevención y el tratamiento del VIH, los jóvenes de 13 a 24 años atraviesan disparidades significativas en el riesgo y los desenlaces del VIH. Un factor importante en esta disparidad es la implementación deficiente de las EBP, aunque la investigación sobre la implementación es limitada, particularmente en entornos que atienden a jóvenes. Este estudio utilizó el marco de Exploración, Preparación, Implementación, Mantenimiento (EPIS) para guiar la implementación de cuatro entrevistas motivacionales (MI) e intervenciones enmarcadas en MI en entornos de prevención y tratamiento del VIH que atienden a jóvenes. Las partes interesadas clave (n = 153) en 13 sitios completaron las entrevistas previas a la implementación. Los comentarios de las partes interesadas identificaron dos factores críticos para una implementación efectiva: idoneidad para la población de pacientes y receptividad de los proveedores, incluidas las preocupaciones sobre el alcance de la práctica, la aceptación y el tiempo. Las partes interesadas recomendaron estrategias para estructurar la capacitación, monitorear la fidelidad, y facilitar la implementación, incluyendo la participación de líderes informales, el desarrollo colaborativo de la estrategia de implementación y la implementación en todo el sitio. Los resultados destacan la importancia de la evaluación contextual previa a la implementación y la planificación estratégica para identificar las preocupaciones de los proveedores y desarrollar estrategias de implementación que respondan a ellas.

Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation.

OBJECTIVE: Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. METHODS: The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. RESULTS: The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. DISCUSSION: Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. CONCLUSION: As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.

A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate.

BACKGROUND: This study evaluates the Leadership and Organizational Change for Implementation (LOCI) strategy and its effect on implementation leadership, transformational leadership, and implementation climate. METHODS: A stepped wedge cluster randomized study design enrolling 47 first-level leaders from child- and adult-specialized mental health clinics within Norwegian health trusts across three cohorts. All therapists (n = 790) received training in screening of trauma exposure and posttraumatic stress, and a subgroup of therapists (n = 248) received training in evidence-based treatment methods for posttraumatic stress disorder (PTSD). First-level leaders and therapists completed surveys at baseline, 4, 8-, 12-, 16-, and 20-months assessing leadership and implementation climate. General linear mixed-effects models were used to investigate whether the LOCI strategy would lead to greater therapist-rated scores on implementation leadership, transformational leadership, and implementation climate. RESULTS: After introducing the LOCI strategy, there was a significant increase in therapist-rated implementation and transformational leadership and implementation climate. The increase was sustained at all measurement time points compared to non-LOCI conditions, which demonstrated a steady decrease in scores before LOCI. CONCLUSIONS: The LOCI strategy can develop better transformational and implementation leadership skills and contribute to a more positive implementation climate, which may enhance successful EBP implementation. Thus, LOCI can help leaders create an organizational context conducive for effective EBP implementation. TRIAL REGISTRATION: Retrospectively registered: ClinicalTrials NCT03719651 , 25th of October 2018. The trial protocol can be accessed from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6417075/ .

The comparative effectiveness of Core versus Core+Enhanced implementation strategies in a randomized controlled trial to improve substance use treatment receipt among justice-involved youth.

BACKGROUND: Most justice-involved youth are supervised in community settings, where assessment and linkage to substance use (SU) treatment services are inconsistent and fragmented. Only 1/3 of youth with an identified SU need receive a treatment referral and even fewer initiate services. Thus, improving identification and linkage to treatment requires coordination across juvenile justice (JJ) and behavioral health (BH) agencies. The current study examines the comparative effectiveness of two bundled implementation intervention strategies for improving SU treatment initiation, engagement, and continuing care among justice-involved youth supervised in community settings. Exploration, Preparation, Implementation, Sustainment (EPIS) served as the conceptual framework for study design and selection/timing of implementation intervention components, and the BH Services Cascade served as the conceptual and measurement framework for identifying and addressing gaps in service receipt. METHODS: Part of a larger Juvenile-Justice Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) Cooperative, this study involved a multisite, cluster-randomized control trial where sites were paired then randomly assigned to receive Core (training teams on the BH Services Cascade and data-driven decision making; supporting goal selection) or Core+Enhanced (external facilitation of implementation teams) intervention components. Youth service records were collected from 20 JJ community supervision agencies (in five states) across five study phases (baseline, pre-randomization, early experiment, late experiment, maintenance). Implementation teams comprised of JJ and BH staff collaboratively identified goals along the BH Cascade and used data-driven decision-making to implement change. RESULTS: Results suggest that Core intervention components were effective at increasing service receipt over time relative to baseline, but differences between Core and Core+Enhanced conditions were non-significant. Time to service initiation was shorter among Core+Enhanced sites, and deeper Cascade penetration occurred when external facilitation (of implementation teams) was provided. Wide variation existed in the degree and nature of change across service systems. CONCLUSIONS: Findings demonstrate the criticality of early EPIS phases, demonstrating that strategies provided during the formative exploration and preparation phases produced some improvement in service receipt, whereas implementation-focused activities produced incremental improvement in moving youth farther along the Cascade.

"Change Doesn't Happen by Itself": A Thematic Analysis of First-Level Leaders' Experiences Participating in the Leadership and Organizational Change for Implementation (LOCI) Strategy.

The Leadership and Organizational Change for Implementation (LOCI) strategy is a multifaceted implementation strategy that aims to support successful evidence-based practice (EBP) implementation by fostering effective general leadership, implementation leadership, and implementation climate. How implementation strategies are experienced by participants is important for their utilization and effectiveness in supporting EBP implementation. The current study is the first in-depth qualitative study exploring first-level leaders' experiences of participating in the LOCI strategy. Data were collected as part of a trial where Norwegian child and adult mental health outpatient clinics implemented EBPs for posttraumatic stress disorder (PTSD). Eleven first-level leaders from adult and child clinics participated in semi-structured interviews after completing the LOCI strategy. Data were analyzed through reflexive thematic analysis. The analysis generated four themes related to leaders' experiences of participating in the LOCI strategy: (1) structuring the EBP implementation, (2) taking responsibility for the EBP implementation, (3) interacting with others about the EBP implementation, and (4) becoming aware of EBP implementation and their own leadership. Most participants experienced the LOCI strategy as beneficial for implementing EBPs for PTSD in their clinic. The strategy succeeded in raising awareness of leadership for EBP implementation, and simultaneously provided participants with tools and support for leading the implementation in their clinic. Two participants experienced LOCI as less beneficial than the others. Our results support the strategy's potential to engage and empower first-level leaders to get involved in implementation processes and point to important challenges for future research on implementation strategies.

WHO Participates in Effectiveness Research? A Comparison of Effectiveness Trial Clinicians to National Survey Samples.

Findings from research participants in effectiveness treatment trials (i.e., randomized control trials conducted in community rather than research settings) are considered more generalizable than those from participants in efficacy trials. This is especially true for clinician participants, whose characteristics like attitudes towards evidence-based practices (EBPs) may impact treatment implementation and the generalizability of research findings from effectiveness studies. This study compared background characteristics, attitudes toward EBPs, and attitudes towards measurement-based care (MBC) among clinicians participating in a National Institute of Mental-Health (NIMH) funded effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET), to clinician data from nationally representative U.S. survey samples. Results indicated COMET clinicians were significantly younger, less clinically experienced, and were more likely to have a training background in psychology versus other disciplines compared to national survey samples. After controlling for demographics and professional characteristics, COMET clinicians held more positive attitudes towards EBPs and MBC compared to national survey samples. Implications for implementation efforts are discussed.

The Development of a Brief Version of the Insomnia Severity Index (ISI-3) in Older Adult Veterans with Posttraumatic Stress Disorder.

Objective/Background: The Insomnia Severity Index (ISI) is an insomnia self-report measure used to identify individuals at risk for insomnia disorder. Although the full ISI is only seven questions, a briefer version would allow more efficient and pragmatic administration in routine practice settings. Reliable and valid brief measures can support measurement-based care. The present study was a proof-of-concept study that developed a brief version of the ISI, the ISI-3, in a sample of older adult veterans with posttraumatic stress disorder (PTSD), a group which is at increased risk for insomnia.Patients/Methods: Participants included 86 older veterans with combat- or military-related PTSD. Veterans completed a clinician-administered PTSD diagnostic interview, self-report measures of insomnia and other psychosocial questionnaires, and two neuropsychological assessments. The factor structure of the ISI was examined to reduce the measure into a brief version. The reliability and validity of the ISI-3 were examined.Results: Principal axis factoring yielded a one-factor solution, which reproduced 59% of the item variance. Item reduction procedures resulted in three items, which best represented this factor ("Insomnia Impact;" ISI-3). For the ISI-3, internal consistency was good (α =.89). Convergent validity was demonstrated via moderate to high positive correlations between the ISI-3 and other measures of sleep disturbance. Divergent validity was demonstrated via non-significant correlations between the ISI-3 and unrelated measures and moderate correlations with self-reported depression.Conclusions: The ISI-3 is a psychometrically valid brief version of the ISI. Clinicians can administer the ISI-3 to screen for insomnia and monitor changes in insomnia during treatment.

Cross-cultural adaption and psychometric investigation of the German version of the Evidence Based Practice Attitude Scale (EBPAS-36D).

BACKGROUND: The implementation of evidence-based practice (EBP) in mental health care confers many benefits to patients, and research into factors facilitating the implementation of EBP is needed. As an important factor affecting the implementation of EBP, service providers' attitudes toward EBP emerged. The Evidence-Based Practice Attitude Scale (EBPAS-36) is an instrument with good psychometric characteristics that measures positive and ambivalent attitudes toward EBP. However, a German version is missing. The present study therefore aims to provide a validated German translation of the EBPAS-36. METHODS: The scale was translated and back-translated as recommended by standard procedures. German psychotherapists were recruited to participate in an online survey. They provided demographic and professional information, completed the EBPAS-36, the Implementation Climate Scale (ICS) and the Intention Scale for Providers (ISP). Standard item and reliability analyses were conducted. Construct validity was evaluated with exploratory (EFA) and confirmatory factor analyses (CFA) in two subsamples (random split). Convergent validity was tested by predicting a high positive correlation of the EBPAS-36D with two scores of attitudes of the ISP and an interest in EBP score. It was tested whether the EBPAS-36D predicts the intention to use EBP. RESULTS: N = 599 psychotherapists participated in the study. The item analyses showed a mean item difficulty of pi = 0.64, a mean inter-item correlation of r = 0.18, and a mean item-total correlation of ritc = 0.40. The internal consistency was very good for the total scale (α = 0.89) and ranged from adequate to very good for the subscales (0.65-0.89), indicating high reliability. The original factor structure showed an acceptable model fit (RMSEA = 0.064 (90% CI = 0.059-0.068); SRMR = 0.0922; AIC = 1400.77), confirming the 12-factor structure of the EBPAS-36. However, a second-order factor structure derived by the EFA had an even better model fit (RMSEA = 0.057 (90% CI = 0.052-0.062); SRMR = 0.0822; AIC = 1274.56). When the EBPAS-36D was entered in a hierarchical regression model with the criterion Intention to use EBP, the EBPAS-36D contributed significantly to the prediction (Change in R2 = 0.28, p < 0.001) over and above gender, age and participants' report of ever having worked in a university context. CONCLUSIONS: The present study confirms good psychometric properties and validity of a German version of the EBPAS-36 in a sample of psychotherapists.

Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study.

Autism spectrum disorder (ASD) is a highly prevalent neurodevelopmental disorder. ASD community-based organizations (ASD-CBOs) underutilize or inconsistently utilize evidence-based practices (ASD-EBPs) despite numerous available EBPs to treat ASD. Nonetheless, ASD-CBOs implement changes to practices regularly. Understanding ASD-CBO's implementation-as-usual (IAU) processes may assist to develop strategies to facilitate ASD-EBP adoption, implementation and sustainment. A convergent mixed methods (quan + QUAL) design was utilized. Twenty ASD-CBO agency leaders (ALs) and 26 direct providers (DPs), from 21 ASD-CBOs, completed the Autism Model of Implementation Survey Battery, including demographic and agency IAU process questions. Surveys were analyzed through descriptive and content analyses. A subset of 10 ALs provided qualitative interview data that were analyzed using coding, consensus and comparison methods to allow for a more comprehensive understanding of the IAU process within their ASD-CBOs. Quantitative analyses and qualitative coding were merged utilizing a joint display and compared. Results suggest that the IAU process follows some phases identified in the Exploration, Preparation, Implementation, Sustainment (EPIS) framework but were conducted in an informal manner-lacking specificity, structure and consistency across and within ASD-CBOs. Moreover, data suggest adding a specific adoption decision phase to the framework. Nonetheless, most ALs felt previous implementation efforts were successful. IAU processes were explored to determine whether the implementation process may be an area for intervention to increase ASD-EBP utilization in ASD-CBOs. Developing a systematized implementation process may facilitate broader utilization of high quality ASD-EBPs within usual care settings, and ultimately improve the quality of life for individuals with ASD and their families.

Validation of the Implementation Climate Scale in Nursing.

BACKGROUND: One critical factor in effective implementation of evidence-based practices (EBPs) in nursing is an organizational context that facilitates and supports implementation efforts. Measuring implementation climate can add useful insights on the extent to which the organizational context supports EBP implementation. AIMS: This study cross-validates and examines the psychometric properties of the Implementation Climate Scale (ICS), which measures nurses' perceptions of their unit's climate for EBP implementation. METHODS: This study analyzed ICS data from two cross-sectional studies, including 203 nurses from California and 301 nurses from Florida. Analyses included evaluation of internal consistency, multilevel aggregation statistics, and confirmatory factor analyses. RESULTS: The 18-item ICS demonstrated comparable psychometric properties to the original measure development paper in both samples. Confirmatory factor analyses provided support for the scale's factor structure in both samples. LINKING EVIDENCE TO PRACTICE: The ICS is a pragmatic measure that can be used to assess unit implementation climate in nursing contexts. Results from the ICS from nurses and nurse leaders can provide insights into implementation-specific barriers and facilitators within the organizational context.

Advancing theory on the multilevel role of leadership in the implementation of evidence-based health care practices.

BACKGROUND: Top managers' transformational leadership is associated with significant influence on subordinates. Yet little is known about the extent to which top managers' transformational leadership influences middle managers' implementation leadership and, ultimately, frontline staff delivery of evidence-based health care practices. PURPOSE: To test a multilevel leadership model examining the extent to which top managers' transformational leadership, as mediated by implementation leadership of middle managers (i.e., those who supervise direct clinical services), affects staff attitudes toward evidence-based practices (EBPs) and their implementation. METHODOLOGY/APPROACH: We used data collected in 2013 from 427 employees in 112 addiction health services programs in Los Angeles County, California. We relied on hierarchical linear models with robust standard errors to analyze multilevel data, individuals nested in programs. We conducted two path models to estimate multilevel relationships with two EBPs: contingency management and medication-assisted treatment. RESULTS: Findings partially supported our theory-driven multilevel leadership model. Specifically, results demonstrated that middle managers' implementation leadership mediated the relationship between top managers' transformational leadership and attitudes toward EBPs. At the same time, they showed the mediated relationship for delivery of contingency management treatment was only marginally significant (standardized indirect effect = .006, bootstrap p = .091). We did not find a mediation effect for medication-assisted treatment. DISCUSSION: Findings advance leadership theory in health care, highlighting the importance of middle managers' implementation leadership in transmitting the influence of top managers' transformational leadership on staff attitudes toward EBPs. The full path model shows the extent to which transformational leadership may influence staff implementation of innovative practices as mediated through staff attitudes toward EBPs and middle managers' implementation leadership. PRACTICE IMPLICATIONS: Our findings have implications for developing a multilevel leadership approach to implementation in health care. Leadership development should build on different competencies based on managers' level but align managers' priorities on the same implementation goals.

Characterizing Shared and Unique Implementation Influences in Two Community Services Systems for Autism: Applying the EPIS Framework to Two Large-Scale Autism Intervention Community Effectiveness Trials.

The purpose of this study was to examine common and unique factors influencing implementation process for two evidence-based interventions for children with autism spectrum disorder (ASD) in mental health and education service contexts. This study prospectively collected qualitative data from intervention developers and research staff on the implementation process within the context of two separate ASD intervention effectiveness trials. Results reveal common and unique factors influencing implementation in both study contexts. Implementation leadership and provider attitudes and motivation emerge as key influences on implementation across systems. These findings provide promising targets for modular implementation interventions that can be leveraged within growing, large-scale translation efforts in usual care.

Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review.

A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.

Evaluation of the Implementation Research Institute: Trainees' Publications and Grant Productivity.

With growth in the field of dissemination and implementation (D&I) research, there has been growth in capacity building, with many training opportunities. As such, it is important to continue to evaluate D&I research training programs. This paper reports the results of an evaluation of the Implementation Research Institute (IRI), a R25 funded by the National Institute of Mental Health with additional funding by the Department of Veterans Affairs (VA). The fourth cohort also had a supplement from the National Institute on Drug Abuse. Using bibliometrics data, we report on a quasi-experimental retrospective cohort study assessing whether the rates of scholarly productivity in D&I science of IRI fellows (those who applied and were accepted to the training) were greater than those who applied but were not accepted to IRI. Our findings show that Selected Applicants' odds of publishing in implementation science were higher for earlier alumni, starting at 12% 1 year out and increasing to 94% for those who were 4 years out from starting training. Chances for Non-Selected Applicants remained relatively stable, starting at 47% at 1 year and going to 33% at 4 years since their application, a pattern that was stable even after controlling for demographic characteristics. These results support the hypothesis that IRI is increasing the D&I research productivity of those selected to the program, and that our fellows are advancing the field of D&I compared to those investigators not selected to our institute. Our finding also indicates the importance of a 2-year training.

Improving Substance Use Services for Juvenile Justice-Involved Youth: Complexity of Process Improvement Plans in a Large Scale Multi-site Study.

Despite the high prevalence of substance use disorders among juvenile offenders, most do not receive services. System-level process improvement plans to address unmet service needs can be optimized by combining data-driven decisions and facilitated meetings with behavioral health stakeholders. This paper operationalizes and analyzes the level of specified complexity among process improvement plans evident within 36 juvenile probation and drug courts across 7 states. To inform more effective implementation strategies, this analysis identifies and prioritizes promising courses of agency enhancement toward addressing unmet substance use needs.

EBP Implementation Leadership of Frontline Nurse Managers: Validation of the Implementation Leadership Scale in Acute Care.

BACKGROUND: Frontline nurse managers influence the implementation of evidence-based practices (EBP); however, there is a need for valid and reliable instruments to measure their leadership behaviors for EBP implementation in acute care settings. AIM: The aim of this study was to evaluate the validity and reliability of the Implementation Leadership Scale (ILS) in acute care settings using two unique nurse samples. METHODS: This study is a secondary analysis of ILS data obtained through two distinct multisite cross-sectional studies. Sample 1 included 200 registered nurses from one large Californian health system. Sample 2 was 284 registered nurses from seven Midwest and Northeast U.S. hospitals. Two separate studies by different research teams collected responses using written and electronic questionnaires. We analyzed each sample independently. Descriptive statistics described individual item, total, and subscale scores. We analyzed validity using confirmatory factor analysis and within-unit agreement (awg). We evaluated factorial invariance using multigroup confirmatory factor analyses and evaluating change in chi-square and comparative fit index values. We evaluated reliability using Cronbach's alpha. RESULTS: Confirmatory factor analyses in both samples provided strong support for first- and second-order factor structure of the ILS. The factor structure did not differ between the two samples. Across both samples, internal consistency reliability was strong (Cronbach's alpha: 0.91-0.98), as was within-unit agreement (awg: 0.70-0.80). LINKING EVIDENCE TO ACTION: Frontline manager implementation leadership is a critical contextual factor influencing EBP implementation. This study provides strong evidence supporting the validity and reliability of the ILS to measure implementation leadership behaviors of nursing frontline managers in acute care. The ILS can help clinicians, researchers, and leaders in nursing contexts assess frontline manager implementation leadership, deliver interventions to target areas needing improvement, and improve implementation of EBP.

Implementation research for public sector mental health care scale-up (SMART-DAPPER): a sequential multiple, assignment randomized trial (SMART) of non-specialist-delivered psychotherapy and/or medication for major depressive disorder and posttraumatic stress disorder (DAPPER) integrated with outpatient care clinics at a county hospital in Kenya.

BACKGROUND: Mental disorders are a leading cause of global disability, driven primarily by depression and anxiety. Most of the disease burden is in Low and Middle Income Countries (LMICs), where 75% of adults with mental disorders have no service access. Our research team has worked in western Kenya for nearly ten years. Primary care populations in Kenya have high prevalence of Major Depressive Disorder (MDD) and Posttraumatic Stress Disorder (PTSD). To address these treatment needs with a sustainable, scalable mental health care strategy, we are partnering with local and national mental health stakeholders in Kenya and Uganda to identify 1) evidence-based strategies for first-line and second-line treatment delivered by non-specialists integrated with primary care, 2) investigate presumed mediators of treatment outcome and 3) determine patient-level moderators of treatment effect to inform personalized, resource-efficient, non-specialist treatments and sequencing, with costing analyses. Our implementation approach is guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. METHODS/DESIGN: We will use a Sequential, Multiple Assignment Randomized Trial (SMART) to randomize 2710 patients from the outpatient clinics at Kisumu County Hospital (KCH) who have MDD, PTSD or both to either 12 weekly sessions of non-specialist-delivered Interpersonal Psychotherapy (IPT) or to 6 months of fluoxetine prescribed by a nurse or clinical officer. Participants who are not in remission at the conclusion of treatment will be re-randomized to receive the other treatment (IPT receives fluoxetine and vice versa) or to combination treatment (IPT and fluoxetine). The SMART-DAPPER Implementation Resource Team, (IRT) will drive the application of the EPIS model and adaptations during the course of the study to optimize the relevance of the data for generalizability and scale -up. DISCUSSION: The results of this research will be significant in three ways: 1) they will determine the effectiveness of non-specialist delivered first- and second-line treatment for MDD and/or PTSD, 2) they will investigate key mechanisms of action for each treatment and 3) they will produce tailored adaptive treatment strategies essential for optimal sequencing of treatment for MDD and/or PTSD in low resource settings with associated cost information - a critical gap for addressing a leading global cause of disability. TRIAL REGISTRATION: ClinicalTrials.gov NCT03466346, registered March 15, 2018.

The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation.

BACKGROUND: There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed. DISCUSSION: There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the "Value Equation," provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.

Comparative case studies in integrated care implementation from across the globe: a quest for action.

BACKGROUND: Integrated care is the coordination of general and behavioral health and is a highly promising and practical approach to improving healthcare delivery and patient outcomes. While there is growing interest and investment in integrated care implementation internationally, there are no formal guidelines for integrated care implementation applicable to diverse healthcare systems. Furthermore, there is a complex interplay of factors at multiple levels of influence that are necessary for successful implementation of integrated care in health systems. METHODS: Guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) framework (Aarons et al., 2011), a multiple case study design was used to address two research objectives: 1) To highlight current integrated care implementation efforts through seven international case studies that target a range of healthcare systems, patient populations and implementation strategies and outcomes, and 2) To synthesize the shared and unique challenges and successes across studies using the EPIS framework. RESULTS: The seven reported case studies represent integrated care implementation efforts from five countries and continents (United States, United Kingdom, Vietnam, Israel, and Nigeria), target a range of clinical populations and care settings, and span all phases of the EPIS framework. Qualitative synthesis of these case studies illuminated common outer context, inner context, bridging and innovation factors that were key drivers of implementation. CONCLUSIONS: We propose an agenda that outlines priority goals and related strategies to advance integrated care implementation research. These goals relate to: 1) the role of funding at multiple levels of implementation, 2) meaningful collaboration with stakeholders across phases of implementation and 3) clear communication to stakeholders about integrated care implementation. TRIAL REGISTRATION: Not applicable.