Misalignment in Community Mental Health Leader and Therapist Ratings of Psychological Safety Climate Predicts Therapist Self-Efficacy with Evidence-Based Practices (EBPs).

Therapist self-efficacy in delivering evidence-based practices (EBPs) is associated with implementation outcomes, including adoption and sustainment in community mental health settings. Inner context organizational climate, including psychological safety, can proximally shape therapist learning experiences within EBP implementation. Psychologically safe environments are conducive to learning behaviors including taking risks, admitting mistakes, and seeking feedback. Organization leaders are instrumental in facilitating psychological safety, but may have differing perspectives of organizational climate than front-line therapists. Discrepant leader and therapist views of psychological safety may have independent associations with therapist EBP learning and implementation outcomes over and above average therapist perceptions of climate. This study examined survey data from 337 therapists and 123 leaders from 49 programs contracted to deliver multiple EBPs within a study examining determinants of sustainment within a large system-driven implementation. Both leaders and therapists completed measures of psychological safety climate and therapists reported on their self-efficacy in delivering multiple EBPs in children's mental health services. Polynomial regression and response surface analysis models were conducted to examine the associations of therapist and leader reports of psychological safety and therapist EBP self-efficacy. Greater discrepancies between leader and therapist reports of psychological safety, in either direction, were associated with lower therapist EBP self-efficacy. Alignment in leader and therapist views of psychological safety climate may impact EBP implementation outcomes. Strategies for improving alignment in perceptions and priorities among organizational members can be included in organizational implementation interventions and may represent unexamined implementation mechanisms of action.

Using the Exploration-Preparation-Implementation-Sustainment (EPIS) Framework to prepare for the implementation of evidence-based practices into adolescent HIV settings.

Despite advances in evidence-based practices (EBP) to support HIV prevention and treatment, youth ages 13-24 experience significant disparities in HIV risk and outcomes. An important factor in this disparity is poor EBP implementation, yet implementation research is limited, particularly in youth-serving settings. This study used the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to guide the implementation of four Motivational Interviewing (MI) and MI-framed interventions into youth-serving HIV prevention and treatment settings. Key stakeholders (n = 153) across 13 sites completed pre-implementation interviews. Stakeholders' comments identified two critical factors for effective implementation: fit with the patient population and provider receptivity, including concerns about scope of practice, buy-in, and time. Stakeholders recommended strategies for structuring training, fidelity monitoring, and facilitating implementation including engaging informal leaders, collaboratively developing the implementation strategy, and site-wide implementation. Results highlight the importance of pre-implementation contextual assessment and strategic planning for identifying provider concerns and developing responsive implementation strategies.

RESUMEN: A pesar de los avances en las prácticas basadas en evidencia (EBP, por sus siglas en inglés) para apoyar la prevención y el tratamiento del VIH, los jóvenes de 13 a 24 años atraviesan disparidades significativas en el riesgo y los desenlaces del VIH. Un factor importante en esta disparidad es la implementación deficiente de las EBP, aunque la investigación sobre la implementación es limitada, particularmente en entornos que atienden a jóvenes. Este estudio utilizó el marco de Exploración, Preparación, Implementación, Mantenimiento (EPIS) para guiar la implementación de cuatro entrevistas motivacionales (MI) e intervenciones enmarcadas en MI en entornos de prevención y tratamiento del VIH que atienden a jóvenes. Las partes interesadas clave (n = 153) en 13 sitios completaron las entrevistas previas a la implementación. Los comentarios de las partes interesadas identificaron dos factores críticos para una implementación efectiva: idoneidad para la población de pacientes y receptividad de los proveedores, incluidas las preocupaciones sobre el alcance de la práctica, la aceptación y el tiempo. Las partes interesadas recomendaron estrategias para estructurar la capacitación, monitorear la fidelidad, y facilitar la implementación, incluyendo la participación de líderes informales, el desarrollo colaborativo de la estrategia de implementación y la implementación en todo el sitio. Los resultados destacan la importancia de la evaluación contextual previa a la implementación y la planificación estratégica para identificar las preocupaciones de los proveedores y desarrollar estrategias de implementación que respondan a ellas.

Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation.

OBJECTIVE: Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. METHODS: The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. RESULTS: The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. DISCUSSION: Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. CONCLUSION: As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.

The comparative effectiveness of Core versus Core+Enhanced implementation strategies in a randomized controlled trial to improve substance use treatment receipt among justice-involved youth.

BACKGROUND: Most justice-involved youth are supervised in community settings, where assessment and linkage to substance use (SU) treatment services are inconsistent and fragmented. Only 1/3 of youth with an identified SU need receive a treatment referral and even fewer initiate services. Thus, improving identification and linkage to treatment requires coordination across juvenile justice (JJ) and behavioral health (BH) agencies. The current study examines the comparative effectiveness of two bundled implementation intervention strategies for improving SU treatment initiation, engagement, and continuing care among justice-involved youth supervised in community settings. Exploration, Preparation, Implementation, Sustainment (EPIS) served as the conceptual framework for study design and selection/timing of implementation intervention components, and the BH Services Cascade served as the conceptual and measurement framework for identifying and addressing gaps in service receipt. METHODS: Part of a larger Juvenile-Justice Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) Cooperative, this study involved a multisite, cluster-randomized control trial where sites were paired then randomly assigned to receive Core (training teams on the BH Services Cascade and data-driven decision making; supporting goal selection) or Core+Enhanced (external facilitation of implementation teams) intervention components. Youth service records were collected from 20 JJ community supervision agencies (in five states) across five study phases (baseline, pre-randomization, early experiment, late experiment, maintenance). Implementation teams comprised of JJ and BH staff collaboratively identified goals along the BH Cascade and used data-driven decision-making to implement change. RESULTS: Results suggest that Core intervention components were effective at increasing service receipt over time relative to baseline, but differences between Core and Core+Enhanced conditions were non-significant. Time to service initiation was shorter among Core+Enhanced sites, and deeper Cascade penetration occurred when external facilitation (of implementation teams) was provided. Wide variation existed in the degree and nature of change across service systems. CONCLUSIONS: Findings demonstrate the criticality of early EPIS phases, demonstrating that strategies provided during the formative exploration and preparation phases produced some improvement in service receipt, whereas implementation-focused activities produced incremental improvement in moving youth farther along the Cascade.

A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate.

BACKGROUND: This study evaluates the Leadership and Organizational Change for Implementation (LOCI) strategy and its effect on implementation leadership, transformational leadership, and implementation climate. METHODS: A stepped wedge cluster randomized study design enrolling 47 first-level leaders from child- and adult-specialized mental health clinics within Norwegian health trusts across three cohorts. All therapists (n = 790) received training in screening of trauma exposure and posttraumatic stress, and a subgroup of therapists (n = 248) received training in evidence-based treatment methods for posttraumatic stress disorder (PTSD). First-level leaders and therapists completed surveys at baseline, 4, 8-, 12-, 16-, and 20-months assessing leadership and implementation climate. General linear mixed-effects models were used to investigate whether the LOCI strategy would lead to greater therapist-rated scores on implementation leadership, transformational leadership, and implementation climate. RESULTS: After introducing the LOCI strategy, there was a significant increase in therapist-rated implementation and transformational leadership and implementation climate. The increase was sustained at all measurement time points compared to non-LOCI conditions, which demonstrated a steady decrease in scores before LOCI. CONCLUSIONS: The LOCI strategy can develop better transformational and implementation leadership skills and contribute to a more positive implementation climate, which may enhance successful EBP implementation. Thus, LOCI can help leaders create an organizational context conducive for effective EBP implementation. TRIAL REGISTRATION: Retrospectively registered: ClinicalTrials NCT03719651 , 25th of October 2018. The trial protocol can be accessed from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6417075/ .

"Change Doesn't Happen by Itself": A Thematic Analysis of First-Level Leaders' Experiences Participating in the Leadership and Organizational Change for Implementation (LOCI) Strategy.

The Leadership and Organizational Change for Implementation (LOCI) strategy is a multifaceted implementation strategy that aims to support successful evidence-based practice (EBP) implementation by fostering effective general leadership, implementation leadership, and implementation climate. How implementation strategies are experienced by participants is important for their utilization and effectiveness in supporting EBP implementation. The current study is the first in-depth qualitative study exploring first-level leaders' experiences of participating in the LOCI strategy. Data were collected as part of a trial where Norwegian child and adult mental health outpatient clinics implemented EBPs for posttraumatic stress disorder (PTSD). Eleven first-level leaders from adult and child clinics participated in semi-structured interviews after completing the LOCI strategy. Data were analyzed through reflexive thematic analysis. The analysis generated four themes related to leaders' experiences of participating in the LOCI strategy: (1) structuring the EBP implementation, (2) taking responsibility for the EBP implementation, (3) interacting with others about the EBP implementation, and (4) becoming aware of EBP implementation and their own leadership. Most participants experienced the LOCI strategy as beneficial for implementing EBPs for PTSD in their clinic. The strategy succeeded in raising awareness of leadership for EBP implementation, and simultaneously provided participants with tools and support for leading the implementation in their clinic. Two participants experienced LOCI as less beneficial than the others. Our results support the strategy's potential to engage and empower first-level leaders to get involved in implementation processes and point to important challenges for future research on implementation strategies.

WHO Participates in Effectiveness Research? A Comparison of Effectiveness Trial Clinicians to National Survey Samples.

Findings from research participants in effectiveness treatment trials (i.e., randomized control trials conducted in community rather than research settings) are considered more generalizable than those from participants in efficacy trials. This is especially true for clinician participants, whose characteristics like attitudes towards evidence-based practices (EBPs) may impact treatment implementation and the generalizability of research findings from effectiveness studies. This study compared background characteristics, attitudes toward EBPs, and attitudes towards measurement-based care (MBC) among clinicians participating in a National Institute of Mental-Health (NIMH) funded effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET), to clinician data from nationally representative U.S. survey samples. Results indicated COMET clinicians were significantly younger, less clinically experienced, and were more likely to have a training background in psychology versus other disciplines compared to national survey samples. After controlling for demographics and professional characteristics, COMET clinicians held more positive attitudes towards EBPs and MBC compared to national survey samples. Implications for implementation efforts are discussed.

Hepatitis B infection and risk factors among pregnant women and their male partners in the Baby Shower Programme in Nigeria: a cross-sectional study.

OBJECTIVES: To determine the population prevalence and determinants of hepatitis B (Hep B) status, and status discordance, among pregnant women and their male partners in Nigeria. METHODS: Cross-sectional study assessing the seroprevalence of Hep B virus in a cohort of 16 920 pregnant women and their male partners in northcentral Nigeria. Rapid HBsAg antibody test was used for Hep B diagnosis. Demographic, socio-economic and behavioural information was collected through interviewer-administered questionnaires and evaluated as determinants of Hep B status and couple status discordance using logistic regression. RESULTS: Of 16 920 participants who had a Hep B test result, 6750 couples and 1316 discordant couples were identified. The prevalence of Hep B among all participants was 10.9%, with lower prevalence among pregnant women (10.2%) than their male partners (11.9%), P < 0.001. The prevalence of Hep B sero-discordance among couples was 19.5% (1316/6750). Younger age, prior Hep B testing and a prior positive Hep B test increased the odds of Hep B infection while being a woman decreased the odds of Hep B among all participants, and among couples. Furthermore, polygamy (adjusted odds ratio [AOR]: 1.49, 95% confidence interval [CI]: 1.19-1.87), prior Hep B testing (AOR: 2.38, 95% CI: 1.14-4.97) and a prior positive Hep B test result were significant determinants of status discordance among the participating couples. CONCLUSION: The prevalence of Hep B among pregnant women and their male partners in northcentral Nigeria is high. A large-scale intervention is required to reduce Hep B prevalence in this setting.

OBJECTIFS: Déterminer la prévalence dans la population et les déterminants du statut de l'hépatite B (Hep B) et de la discordance de statut chez les femmes enceintes et leurs partenaires masculins au Nigéria. MÉTHODES: Etude transversale évaluant la séroprévalence du virus Hep B dans une cohorte de 16.920 femmes enceintes et leurs partenaires masculins dans le centre-nord du Nigéria. Un test rapide des anticorps anti-HBsAg a été utilisé pour le diagnostic de l'Hep B. Des informations démographiques, socio-économiques et comportementales ont été recueillies au moyen de questionnaires administrés par les intervieweurs et évaluées en tant que déterminants du statut Hep B et de la discordance du statut de couple à l'aide de la régression logistique. RÉSULTATS: Sur 16.920 participants qui avaient un résultat de dépistage de l'Hep B, 6.750 couples et 1.316 couples discordants ont été identifiés. La prévalence de l'Hep B chez tous les participants était de 10,9%, avec une prévalence plus faible chez les femmes enceintes (10,2%) que chez leurs partenaires masculins (11,9%), p <0,001. La prévalence de la séro-discordance de l'Hep B chez les couples était de 19,5% (1.316/6.750). Un âge plus jeune, un dépistage antérieur de l'Hep B et un test Hep B positif antérieur augmentaient les risques d'infection à l'Hep B alors que le sexe féminin diminuait les risques d'Hep B chez tous les participants et parmi les couples. De plus, la polygamie (rapport de cotes ajusté [AOR]: 1,49, intervalle de confiance [IC] à 95%: 1,19-1,87), un dépistage antérieur de l'Hep B (AOR: 2,38 ; IC95%: 1,14-4,97) et un test hépatique B positif antérieur résultat étaient des déterminants significatifs de la discordance de statut parmi les couples participants. CONCLUSION: La prévalence de l'Hep B chez les femmes enceintes et leurs partenaires masculins dans le centre-nord du Nigéria est élevée. Une intervention à grande échelle est nécessaire pour réduire la prévalence de l'Hep B dans cette région.

The Development of a Brief Version of the Insomnia Severity Index (ISI-3) in Older Adult Veterans with Posttraumatic Stress Disorder.

Objective/Background: The Insomnia Severity Index (ISI) is an insomnia self-report measure used to identify individuals at risk for insomnia disorder. Although the full ISI is only seven questions, a briefer version would allow more efficient and pragmatic administration in routine practice settings. Reliable and valid brief measures can support measurement-based care. The present study was a proof-of-concept study that developed a brief version of the ISI, the ISI-3, in a sample of older adult veterans with posttraumatic stress disorder (PTSD), a group which is at increased risk for insomnia.Patients/Methods: Participants included 86 older veterans with combat- or military-related PTSD. Veterans completed a clinician-administered PTSD diagnostic interview, self-report measures of insomnia and other psychosocial questionnaires, and two neuropsychological assessments. The factor structure of the ISI was examined to reduce the measure into a brief version. The reliability and validity of the ISI-3 were examined.Results: Principal axis factoring yielded a one-factor solution, which reproduced 59% of the item variance. Item reduction procedures resulted in three items, which best represented this factor ("Insomnia Impact;" ISI-3). For the ISI-3, internal consistency was good (α =.89). Convergent validity was demonstrated via moderate to high positive correlations between the ISI-3 and other measures of sleep disturbance. Divergent validity was demonstrated via non-significant correlations between the ISI-3 and unrelated measures and moderate correlations with self-reported depression.Conclusions: The ISI-3 is a psychometrically valid brief version of the ISI. Clinicians can administer the ISI-3 to screen for insomnia and monitor changes in insomnia during treatment.

Cross-cultural adaption and psychometric investigation of the German version of the Evidence Based Practice Attitude Scale (EBPAS-36D).

BACKGROUND: The implementation of evidence-based practice (EBP) in mental health care confers many benefits to patients, and research into factors facilitating the implementation of EBP is needed. As an important factor affecting the implementation of EBP, service providers' attitudes toward EBP emerged. The Evidence-Based Practice Attitude Scale (EBPAS-36) is an instrument with good psychometric characteristics that measures positive and ambivalent attitudes toward EBP. However, a German version is missing. The present study therefore aims to provide a validated German translation of the EBPAS-36. METHODS: The scale was translated and back-translated as recommended by standard procedures. German psychotherapists were recruited to participate in an online survey. They provided demographic and professional information, completed the EBPAS-36, the Implementation Climate Scale (ICS) and the Intention Scale for Providers (ISP). Standard item and reliability analyses were conducted. Construct validity was evaluated with exploratory (EFA) and confirmatory factor analyses (CFA) in two subsamples (random split). Convergent validity was tested by predicting a high positive correlation of the EBPAS-36D with two scores of attitudes of the ISP and an interest in EBP score. It was tested whether the EBPAS-36D predicts the intention to use EBP. RESULTS: N = 599 psychotherapists participated in the study. The item analyses showed a mean item difficulty of pi = 0.64, a mean inter-item correlation of r = 0.18, and a mean item-total correlation of ritc = 0.40. The internal consistency was very good for the total scale (α = 0.89) and ranged from adequate to very good for the subscales (0.65-0.89), indicating high reliability. The original factor structure showed an acceptable model fit (RMSEA = 0.064 (90% CI = 0.059-0.068); SRMR = 0.0922; AIC = 1400.77), confirming the 12-factor structure of the EBPAS-36. However, a second-order factor structure derived by the EFA had an even better model fit (RMSEA = 0.057 (90% CI = 0.052-0.062); SRMR = 0.0822; AIC = 1274.56). When the EBPAS-36D was entered in a hierarchical regression model with the criterion Intention to use EBP, the EBPAS-36D contributed significantly to the prediction (Change in R2 = 0.28, p < 0.001) over and above gender, age and participants' report of ever having worked in a university context. CONCLUSIONS: The present study confirms good psychometric properties and validity of a German version of the EBPAS-36 in a sample of psychotherapists.

Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study.

Autism spectrum disorder (ASD) is a highly prevalent neurodevelopmental disorder. ASD community-based organizations (ASD-CBOs) underutilize or inconsistently utilize evidence-based practices (ASD-EBPs) despite numerous available EBPs to treat ASD. Nonetheless, ASD-CBOs implement changes to practices regularly. Understanding ASD-CBO's implementation-as-usual (IAU) processes may assist to develop strategies to facilitate ASD-EBP adoption, implementation and sustainment. A convergent mixed methods (quan + QUAL) design was utilized. Twenty ASD-CBO agency leaders (ALs) and 26 direct providers (DPs), from 21 ASD-CBOs, completed the Autism Model of Implementation Survey Battery, including demographic and agency IAU process questions. Surveys were analyzed through descriptive and content analyses. A subset of 10 ALs provided qualitative interview data that were analyzed using coding, consensus and comparison methods to allow for a more comprehensive understanding of the IAU process within their ASD-CBOs. Quantitative analyses and qualitative coding were merged utilizing a joint display and compared. Results suggest that the IAU process follows some phases identified in the Exploration, Preparation, Implementation, Sustainment (EPIS) framework but were conducted in an informal manner-lacking specificity, structure and consistency across and within ASD-CBOs. Moreover, data suggest adding a specific adoption decision phase to the framework. Nonetheless, most ALs felt previous implementation efforts were successful. IAU processes were explored to determine whether the implementation process may be an area for intervention to increase ASD-EBP utilization in ASD-CBOs. Developing a systematized implementation process may facilitate broader utilization of high quality ASD-EBPs within usual care settings, and ultimately improve the quality of life for individuals with ASD and their families.

Validation of the Implementation Climate Scale in Nursing.

BACKGROUND: One critical factor in effective implementation of evidence-based practices (EBPs) in nursing is an organizational context that facilitates and supports implementation efforts. Measuring implementation climate can add useful insights on the extent to which the organizational context supports EBP implementation. AIMS: This study cross-validates and examines the psychometric properties of the Implementation Climate Scale (ICS), which measures nurses' perceptions of their unit's climate for EBP implementation. METHODS: This study analyzed ICS data from two cross-sectional studies, including 203 nurses from California and 301 nurses from Florida. Analyses included evaluation of internal consistency, multilevel aggregation statistics, and confirmatory factor analyses. RESULTS: The 18-item ICS demonstrated comparable psychometric properties to the original measure development paper in both samples. Confirmatory factor analyses provided support for the scale's factor structure in both samples. LINKING EVIDENCE TO PRACTICE: The ICS is a pragmatic measure that can be used to assess unit implementation climate in nursing contexts. Results from the ICS from nurses and nurse leaders can provide insights into implementation-specific barriers and facilitators within the organizational context.

Opportunities and challenges to integrating mental health into HIV programs in a low- and middle-income country: insights from the Nigeria implementation science Alliance.

BACKGROUND: In Nigeria, there is an estimated 1.9 million people living with HIV (PLHIV), 53% of whom utilize HIV care and services. With decreasing HIV-related deaths and increasing new infections, HIV with its associated comorbidities continue to be a key public health challenge in Nigeria. Untreated, comorbid mental disorders are a critical but potentially modifiable determinant of optimal HIV treatment outcomes. This study aimed to identify the challenges and opportunities related to integrating mental health care into existing HIV programs in Nigeria. METHOD: Attendees at the Nigeria Implementation Science Alliance (NISA)'s 2019 conference participated in nominal group technique (NGT) exercise informed by the "Exploration, Preparation, Implementation, and Sustainment (EPIS)" framework. The NGT process was conducted among the nominal groups in two major sessions of 30-min phases followed by a 30-min plenary session. Data analysis proceeded in four steps: transcription, collation, theming and content analysis. RESULTS: The two major theoretical themes from the study were - opportunities and challenges of integrating mental health treatment into HIV services. Three sub-themes emerged on opportunities: building on health care facilities for HIV services (screening, counseling, task-sharing monitoring and evaluation frameworks), utilizing existing human resources or workforce in HIV programs (in-service training and including mental health in education curriculum) and the role of social and cultural structures (leveraging existing community, traditional and faith-based infrastructures). Four sub-themes emerged for challenges: double burden of stigma and the problems of early detection (HIV and mental health stigma, lack of awareness), existing policy gaps and structural challenges (fragmented health system), limited human resources for mental health care in Nigeria (knowledge gap and burnout) and dearth of data/evidence for planning and action (research gaps). CONCLUSIONS: Potential for integrating treatments for mental disorders into HIV programs and services exist in Nigeria. These include opportunities for clinicians' training and capacity building as well as community partnerships. Multiple barriers and challenges such as stigma, policy and research gaps would need to be addressed to leverage these opportunities. Our findings serve as a useful guide for government agencies, policy makers and research organizations to address co-morbid mental disorders among PLHIV in Nigeria.

Advancing theory on the multilevel role of leadership in the implementation of evidence-based health care practices.

BACKGROUND: Top managers' transformational leadership is associated with significant influence on subordinates. Yet little is known about the extent to which top managers' transformational leadership influences middle managers' implementation leadership and, ultimately, frontline staff delivery of evidence-based health care practices. PURPOSE: To test a multilevel leadership model examining the extent to which top managers' transformational leadership, as mediated by implementation leadership of middle managers (i.e., those who supervise direct clinical services), affects staff attitudes toward evidence-based practices (EBPs) and their implementation. METHODOLOGY/APPROACH: We used data collected in 2013 from 427 employees in 112 addiction health services programs in Los Angeles County, California. We relied on hierarchical linear models with robust standard errors to analyze multilevel data, individuals nested in programs. We conducted two path models to estimate multilevel relationships with two EBPs: contingency management and medication-assisted treatment. RESULTS: Findings partially supported our theory-driven multilevel leadership model. Specifically, results demonstrated that middle managers' implementation leadership mediated the relationship between top managers' transformational leadership and attitudes toward EBPs. At the same time, they showed the mediated relationship for delivery of contingency management treatment was only marginally significant (standardized indirect effect = .006, bootstrap p = .091). We did not find a mediation effect for medication-assisted treatment. DISCUSSION: Findings advance leadership theory in health care, highlighting the importance of middle managers' implementation leadership in transmitting the influence of top managers' transformational leadership on staff attitudes toward EBPs. The full path model shows the extent to which transformational leadership may influence staff implementation of innovative practices as mediated through staff attitudes toward EBPs and middle managers' implementation leadership. PRACTICE IMPLICATIONS: Our findings have implications for developing a multilevel leadership approach to implementation in health care. Leadership development should build on different competencies based on managers' level but align managers' priorities on the same implementation goals.

Characterizing Shared and Unique Implementation Influences in Two Community Services Systems for Autism: Applying the EPIS Framework to Two Large-Scale Autism Intervention Community Effectiveness Trials.

The purpose of this study was to examine common and unique factors influencing implementation process for two evidence-based interventions for children with autism spectrum disorder (ASD) in mental health and education service contexts. This study prospectively collected qualitative data from intervention developers and research staff on the implementation process within the context of two separate ASD intervention effectiveness trials. Results reveal common and unique factors influencing implementation in both study contexts. Implementation leadership and provider attitudes and motivation emerge as key influences on implementation across systems. These findings provide promising targets for modular implementation interventions that can be leveraged within growing, large-scale translation efforts in usual care.

Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review.

A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.

Evaluation of the Implementation Research Institute: Trainees' Publications and Grant Productivity.

With growth in the field of dissemination and implementation (D&I) research, there has been growth in capacity building, with many training opportunities. As such, it is important to continue to evaluate D&I research training programs. This paper reports the results of an evaluation of the Implementation Research Institute (IRI), a R25 funded by the National Institute of Mental Health with additional funding by the Department of Veterans Affairs (VA). The fourth cohort also had a supplement from the National Institute on Drug Abuse. Using bibliometrics data, we report on a quasi-experimental retrospective cohort study assessing whether the rates of scholarly productivity in D&I science of IRI fellows (those who applied and were accepted to the training) were greater than those who applied but were not accepted to IRI. Our findings show that Selected Applicants' odds of publishing in implementation science were higher for earlier alumni, starting at 12% 1 year out and increasing to 94% for those who were 4 years out from starting training. Chances for Non-Selected Applicants remained relatively stable, starting at 47% at 1 year and going to 33% at 4 years since their application, a pattern that was stable even after controlling for demographic characteristics. These results support the hypothesis that IRI is increasing the D&I research productivity of those selected to the program, and that our fellows are advancing the field of D&I compared to those investigators not selected to our institute. Our finding also indicates the importance of a 2-year training.

Improving Substance Use Services for Juvenile Justice-Involved Youth: Complexity of Process Improvement Plans in a Large Scale Multi-site Study.

Despite the high prevalence of substance use disorders among juvenile offenders, most do not receive services. System-level process improvement plans to address unmet service needs can be optimized by combining data-driven decisions and facilitated meetings with behavioral health stakeholders. This paper operationalizes and analyzes the level of specified complexity among process improvement plans evident within 36 juvenile probation and drug courts across 7 states. To inform more effective implementation strategies, this analysis identifies and prioritizes promising courses of agency enhancement toward addressing unmet substance use needs.

EBP Implementation Leadership of Frontline Nurse Managers: Validation of the Implementation Leadership Scale in Acute Care.

BACKGROUND: Frontline nurse managers influence the implementation of evidence-based practices (EBP); however, there is a need for valid and reliable instruments to measure their leadership behaviors for EBP implementation in acute care settings. AIM: The aim of this study was to evaluate the validity and reliability of the Implementation Leadership Scale (ILS) in acute care settings using two unique nurse samples. METHODS: This study is a secondary analysis of ILS data obtained through two distinct multisite cross-sectional studies. Sample 1 included 200 registered nurses from one large Californian health system. Sample 2 was 284 registered nurses from seven Midwest and Northeast U.S. hospitals. Two separate studies by different research teams collected responses using written and electronic questionnaires. We analyzed each sample independently. Descriptive statistics described individual item, total, and subscale scores. We analyzed validity using confirmatory factor analysis and within-unit agreement (awg). We evaluated factorial invariance using multigroup confirmatory factor analyses and evaluating change in chi-square and comparative fit index values. We evaluated reliability using Cronbach's alpha. RESULTS: Confirmatory factor analyses in both samples provided strong support for first- and second-order factor structure of the ILS. The factor structure did not differ between the two samples. Across both samples, internal consistency reliability was strong (Cronbach's alpha: 0.91-0.98), as was within-unit agreement (awg: 0.70-0.80). LINKING EVIDENCE TO ACTION: Frontline manager implementation leadership is a critical contextual factor influencing EBP implementation. This study provides strong evidence supporting the validity and reliability of the ILS to measure implementation leadership behaviors of nursing frontline managers in acute care. The ILS can help clinicians, researchers, and leaders in nursing contexts assess frontline manager implementation leadership, deliver interventions to target areas needing improvement, and improve implementation of EBP.

Implementation research for public sector mental health care scale-up (SMART-DAPPER): a sequential multiple, assignment randomized trial (SMART) of non-specialist-delivered psychotherapy and/or medication for major depressive disorder and posttraumatic stress disorder (DAPPER) integrated with outpatient care clinics at a county hospital in Kenya.

BACKGROUND: Mental disorders are a leading cause of global disability, driven primarily by depression and anxiety. Most of the disease burden is in Low and Middle Income Countries (LMICs), where 75% of adults with mental disorders have no service access. Our research team has worked in western Kenya for nearly ten years. Primary care populations in Kenya have high prevalence of Major Depressive Disorder (MDD) and Posttraumatic Stress Disorder (PTSD). To address these treatment needs with a sustainable, scalable mental health care strategy, we are partnering with local and national mental health stakeholders in Kenya and Uganda to identify 1) evidence-based strategies for first-line and second-line treatment delivered by non-specialists integrated with primary care, 2) investigate presumed mediators of treatment outcome and 3) determine patient-level moderators of treatment effect to inform personalized, resource-efficient, non-specialist treatments and sequencing, with costing analyses. Our implementation approach is guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. METHODS/DESIGN: We will use a Sequential, Multiple Assignment Randomized Trial (SMART) to randomize 2710 patients from the outpatient clinics at Kisumu County Hospital (KCH) who have MDD, PTSD or both to either 12 weekly sessions of non-specialist-delivered Interpersonal Psychotherapy (IPT) or to 6 months of fluoxetine prescribed by a nurse or clinical officer. Participants who are not in remission at the conclusion of treatment will be re-randomized to receive the other treatment (IPT receives fluoxetine and vice versa) or to combination treatment (IPT and fluoxetine). The SMART-DAPPER Implementation Resource Team, (IRT) will drive the application of the EPIS model and adaptations during the course of the study to optimize the relevance of the data for generalizability and scale -up. DISCUSSION: The results of this research will be significant in three ways: 1) they will determine the effectiveness of non-specialist delivered first- and second-line treatment for MDD and/or PTSD, 2) they will investigate key mechanisms of action for each treatment and 3) they will produce tailored adaptive treatment strategies essential for optimal sequencing of treatment for MDD and/or PTSD in low resource settings with associated cost information - a critical gap for addressing a leading global cause of disability. TRIAL REGISTRATION: ClinicalTrials.gov NCT03466346, registered March 15, 2018.