Measuring implementation climate: psychometric properties of the Implementation Climate Scale (ICS) in Norwegian mental health care services.

BackgroundEmployees' perceptions of organizational climate for implementation of new methods are important in assessing and planning for implementation efforts. More specifically, feedback from employees' points to which implementation strategies to select, adopt, and tailor in building positive climate for implementation of new evidence-based practices within the organization. Implementation climate can be measured with the Implementation Climate Scale (ICS). The purpose of this study was to investigate the psychometric properties of the Norwegian version of the ICS in outpatient mental health clinics.MethodsThe ICS was administered to 383 clinicians within 47 different child and adult mental health clinics across the country. We conducted confirmatory factor analysis to assess the psychometric functioning of the ICS. Cronbach's alpha was examined to assess internal consistency. We also examined criterion related validity of the scale by comparing it with an alternative measure of implementation climate (concurrent validity) and by examining correlations with clinicians' intentions to use evidence-based practices.ResultsResults supported the 6-factor structure and the internal consistency reliability of the ICS. One exception was poor functioning of the Reward scale. Concurrent validity was stronger at the group than at the individual level, and assessment of associations with clinicians' intentions to use evidence- based practices showed positive correlations.ConclusionsThe Norwegian version of the ICS is a promising tool for assessing implementation climate which can provide organizations with specific feedback concerning which aspects of the implementation climate to attend to. Due to poor functioning of the Reward scale, adaptations and further testing of this is recommended.

A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate.

BACKGROUND: This study evaluates the Leadership and Organizational Change for Implementation (LOCI) strategy and its effect on implementation leadership, transformational leadership, and implementation climate. METHODS: A stepped wedge cluster randomized study design enrolling 47 first-level leaders from child- and adult-specialized mental health clinics within Norwegian health trusts across three cohorts. All therapists (n = 790) received training in screening of trauma exposure and posttraumatic stress, and a subgroup of therapists (n = 248) received training in evidence-based treatment methods for posttraumatic stress disorder (PTSD). First-level leaders and therapists completed surveys at baseline, 4, 8-, 12-, 16-, and 20-months assessing leadership and implementation climate. General linear mixed-effects models were used to investigate whether the LOCI strategy would lead to greater therapist-rated scores on implementation leadership, transformational leadership, and implementation climate. RESULTS: After introducing the LOCI strategy, there was a significant increase in therapist-rated implementation and transformational leadership and implementation climate. The increase was sustained at all measurement time points compared to non-LOCI conditions, which demonstrated a steady decrease in scores before LOCI. CONCLUSIONS: The LOCI strategy can develop better transformational and implementation leadership skills and contribute to a more positive implementation climate, which may enhance successful EBP implementation. Thus, LOCI can help leaders create an organizational context conducive for effective EBP implementation. TRIAL REGISTRATION: Retrospectively registered: ClinicalTrials NCT03719651 , 25th of October 2018. The trial protocol can be accessed from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6417075/ .

Individual-level associations between implementation leadership, climate, and anticipated outcomes: a time-lagged mediation analysis.

BACKGROUND: Leaders can improve implementation outcomes by developing an organizational climate conducive to the implementation of evidence-based practices (EBP). This study tested the lagged associations between individual-level perceptions of implementation leadership, implementation climate, and three anticipated implementation outcomes, that is EBP acceptability, appropriateness, and feasibility. METHODS: Screening tools and treatment methods for posttraumatic stress disorder were implemented in 43 Norwegian mental health services. A sample of 494 child and adult mental health care professionals (M = 43 years, 78% female) completed surveys addressing perceptions of first-level leaders' (n = 47) implementation leadership and their clinics' implementation climate. Single-level structural equation models estimating both direct, indirect, and total effects were used to investigate whether perceived implementation climate mediated the association between perceived implementation leadership and perceived acceptability, appropriateness, and feasibility of screening tools and treatment methods. RESULTS: Regarding the treatment methods, implementation leadership was associated with therapists' perceptions of acceptability, appropriateness, and feasibility. Implementation climate also mediated between implementation leadership and the outcomes. Regarding the screening tools, implementation leadership was not associated with the outcomes. However, implementation climate mediated between implementation leadership and therapists' perceptions of acceptability and feasibility, but not appropriateness. Analyses with the implementation climate subscales showed stronger associations for therapists' perceptions of the treatment methods than of screening tools. CONCLUSIONS: Leaders may promote positive implementation outcomes, both directly and through implementation climate. With regard to the effect sizes and explained variance, results indicated that both implementation leadership and implementation climate were more strongly associated with the therapists' perceptions of the treatment methods, implemented by one group of therapists, than the screening tools, implemented by all therapists. This may imply that implementation leadership and climate may have stronger effects for smaller implementation teams within a larger system than for system-wide implementations or when the clinical interventions being implemented are more complex rather than simple ones. TRIAL REGISTRATION: ClinicalTrials NCT03719651, 25 October 2018.

Implementation of evidence-based treatment for PTSD in Norway: clinical outcomes and impact of probable complex PTSD.

Background: Posttraumatic stress disorder (PTSD) is a long-lasting and debilitating psychological disorder that affects a large portion of the population. Treatments such as Cognitive therapy for PTSD (CT-PTSD) and Eye movement desensitization and reprocessing (EMDR) have been shown to be effective and cost-efficient in clinical trials, but uptake and evidence of positive outcomes in real-world clinical services are limited. Implementation efforts have been hampered by providers' concerns about the feasibility of trauma-focused treatments in more complex presentations (i.e. Complex PTSD). Objective: To evaluate the effectiveness of CT-PTSD and EMDR in a real-world setting, as implemented in Norwegian outpatient mental health clinics for adults, and investigate the impact of probable Complex PTSD status on treatment outcomes. Methods: Clinicians from 15 different outpatient clinics received training and supervision in EMDR or CT-PTSD as part of a national implementation project. 104 clinicians recruited and treated 196 participants with PTSD. Symptoms of PTSD, depression and anxiety were assessed session-by-session and used to estimate pre-post effect sizes. Mixed-models were employed to investigate the impact of complex PTSD. Results: Both EMDR and CT-PTSD were associated with significant reductions in PTSD symptoms, with large effect sizes. Probable Complex PTSD was associated with higher levels of symptoms before and after treatment but did not significantly impact the effectiveness of treatment. Conclusion: The use of evidence-based treatments for PTSD in routine clinical service is associated with good treatment outcomes, also for patients with Complex PTSD.

Antecedentes: El trastorno de estrés postraumático (TEPT) es un trastorno psicológico duradero y debilitante que afecta a una gran parte de la población. Se ha mostrado que los tratamientos como la Terapia cognitiva para el TEPT (CT-PTSD en su sigla en inglés) y la Desensibilización y Reprocesamiento por Movimiento ocular (EMDR en su sigla en inglés) son efectivos y rentables en ensayos clínicos, pero la uso y la evidencia de resultados positivos en los servicios clínicos del mundo real son limitadas. Los esfuerzos de implementación se han visto obstaculizados por las preocupaciones de los proveedores sobre la viabilidad de los tratamientos centrados en el trauma en presentaciones más complejas (es decir, TEPT complejo).Objetivo: Evaluar la efectividad de CT-PTSD y EMDR en un entorno del mundo real, tal como se implementa en las clínicas noruegas de salud mental ambulatorias para adultos, e investigar el impacto del probable TEPT complejo en los resultados del tratamiento.Métodos: Los clínicos de 15 clínicas ambulatorias diferentes recibieron capacitación y supervisión en EMDR o CT-PTSD como parte de un proyecto de implementación nacional. 104 clínicos reclutaron y trataron a 196 participantes con TEPT. Los síntomas de TEPT, depresión y ansiedad se evaluaron sesión a sesión y se usaron para estimar los tamaños del efecto antes y después. Se emplearon modelos mixtos para investigar el impacto del TEPT complejo.Resultados: Tanto EMDR como CT-PTSD se asociaron con reducciones significativas en los síntomas de TEPT, con tamaño de los efectos de gran magnitud. El TEPT complejo probable se asoció con niveles más altos de síntomas antes y después del tratamiento, pero no tuvo un impacto significativo en la efectividad del tratamiento.Conclusión: El uso de tratamientos basados ⁣⁣en la evidencia para el TEPT en el servicio clínico de rutina se asocia con buenos resultados del tratamiento, también para pacientes con TEPT complejo.