A cluster randomised controlled trial to assess the effectiveness of a multi-strategy sustainability intervention on teachers' sustained implementation of classroom physical activity breaks (energisers): study protocol.

BACKGROUND: Governments internationally have invested hugely in the implementation and scale-up of school-based physical activity interventions, but have little evidence of how to best sustain these interventions once active implementation support ceases. This study will assess the effectiveness of a multi-strategy sustainability intervention on classroom teachers' sustainment of energisers (short 3-5 min physical activity breaks during class-time) scheduled across the school day from baseline to 12 and 24-month follow-up. METHODS: A cluster randomised controlled trial will be conducted in 50 primary schools within the Hunter New England, Illawarra Shoalhaven, Murrumbidgee and Northern New South Wales (NSW) Local Health Districts of NSW Australia. Schools will be randomly allocated to receive either usual support or the multi-strategy sustainability intervention that includes: centralised technical assistance from a trained project officer; formal commitment and mandated change obtained from school principals; training in-school champions; reminders for teachers; educational materials provided to teachers; capturing and sharing local knowledge; and engagement of parents, carers and the wider school community. The primary trial outcome will be measured via a teacher logbook to determine the between-group difference in the change in mean minutes of energisers scheduled across the school day at 12 and 24-month follow-up compared to baseline. Analyses will be performed using an intention to treat framework. Linear mixed models will be used to assess intervention effects on the primary outcome at both follow-up periods. DISCUSSION: This study will be one of the first randomised controlled trials to examine the impact of a multi-strategy sustainability intervention to support schools' sustainment of a physical activity intervention. The proposed research will generate new evidence needed for the partnering organisations to protect their considerable investments to date in physical activity promotion in this setting and will provide seminal evidence for the field globally. TRIAL REGISTRATION: ACTRN12620000372987 version 1 registered 17th March 2020. Version 3 (current version) updated 4th August 2023.

What matters in development and sustainment of community dementia friendly initiatives and why? A realist multiple case study.

BACKGROUND: Dementia friendly communities (DFCs) are seen as key to participation of people with dementia and carers. Dementia-friendly initiatives (DFI) are important building blocks for the growth of DFCs. Therefore, it is essential to understand how DFIs are developed and sustained to secure the growth of DFCs. This study identifies contextual factors and mechanisms that influence the development and sustainment of Dutch DFIs. It also explains how these contextual factors and mechanisms are interrelated and the outcomes to which they lead. METHODS: Mixed methods, namely interviews, observations, documentation and focus groups, were used for this realist multiple case study. Participants were professionals (n = 46), volunteers (n = 20), people with dementia (n = 1) and carers (n = 2) who were involved in development and sustainment of DFIs in four Dutch DFCs. RESULTS: This study revealed three middle-range program theories as final outcomes: development of a support base, collaboration, and participation in DFIs by people with dementia and carers. These theories address institutional, organisational, interpersonal and individual levels in the community that are essential in development and sustainment of DFIs. CONCLUSIONS: The development and sustainment of DFIs requires the development of a support base, collaboration, and participation in DFIs by people with dementia and their carers.

Study Protocol: Multi-level Determinants of Implementation and Sustainment in the Education Sector.

Evidence-based programs (EBPs) delivered in elementary schools show great promise in reducing risk for emotional and behavioral disorders (EBDs). However, efforts to sustain EBPs in school face barriers. Improving EBP sustainment thus represents a priority, but little research exists to inform the development of sustainment strategies. To address this gap, the Sustaining Evidenced-Based Innovations through Multi-level Implementation Constructs (SEISMIC) project will: (a) Determine if malleable individual, intervention, and organizational factors predict EBP treatment fidelity and modifications during implementation, sustainment, or both; (b) Assess the impact of EBP fidelity and modifications on child outcomes during implementation and sustainment; and (c) Explore the mechanisms through which individual, intervention, and organizational factors influence sustainment outcomes. This protocol paper describes SEISMIC, which builds upon a federally-funded RCT evaluating BEST in CLASS, a teacher-delivered program for K-3rd grade children at risk for EBDs. The sample will include 96 teachers, 384 children, and 12 elementary schools. A multi-level, interrupted time series design will be used to examine the relationship between baseline factors, treatment fidelity, modifications, and child outcomes, followed by a mixed-method approach to elucidate the mechanisms that influence sustainment outcomes. Findings will be used to create a strategy to improve EBP sustainment in schools.

Applying the Theoretical Domains Framework to Develop an Intervention to 'Re-implement' Parent-Child Interaction Therapy (PCIT).

Parent-Child Interaction Therapy (PCIT) is an empirically supported treatment for childhood conduct problems, with increasing numbers of clinicians being trained in Aotearoa/New Zealand. However, ensuring sustained delivery of effective treatments by trained clinicians in routine care environments is notoriously challenging. The aims of this qualitative study were to (1) systematically examine and prioritise PCIT implementation barriers and facilitators, and (2) develop a well specified and theory-driven 're-implementation' intervention to support already-trained clinicians to resume or increase their implementation of PCIT. To triangulate and refine existing understanding of PCIT implementation determinants from an earlier cross-sectional survey, we integrated previously unanalysed qualitative survey data (54 respondents; response rate 60%) with qualitative data from six new focus groups with 15 PCIT-trained clinicians and managers in Aotearoa/New Zealand. We deductively coded data, using a directed content analysis process and the Theoretical Domains Framework, resulting in the identification of salient theoretical domains and belief statements within these. We then used the Theory and Techniques Tool to identify behaviour change techniques, possible intervention components, and their hypothesised mechanisms of action. Eight of the 14 theoretical domains were identified as influential on PCIT-trained clinician implementation behaviour (Knowledge; Social/Professional Role and Identity; Beliefs about Capabilities; Beliefs about Consequences; Memory, Attention and Decision Processes; Environmental Context and Resources; Social Influences; Emotion). Two of these appeared to be particularly salient: (1) 'Environmental Context and Resources', specifically lacking suitable PCIT equipment, with (lack of) access to a well-equipped clinic room appearing to influence implementation behaviour in several ways. (2) 'Social/Professional Role and Identity', with beliefs relating to a perception that colleagues view time-out as harmful to children, concerns that internationally-developed PCIT is not suitable for non-Maori clinicians to deliver to Indigenous Maori families, and clinicians feeling obligated yet isolated in their advocacy for PCIT delivery. In conclusion, where initial implementation has stalled or languished, re-implementation may be possible, and makes good sense, both fiscally and practically. This study suggests that re-implementation of PCIT in Aotearoa/New Zealand may be facilitated by intervention components such as ensuring access to a colleague or co-worker who is supportive of PCIT delivery, access to suitable equipment (particularly a time-out room), and targeted additional training for clinicians relating to the safety of time-out for children. The feasibility and acceptability of these intervention components will be tested in a future clinical trial.

Leadership perspectives on facilitators and barriers to sustaining evidence-based prevention interventions in the United States Military.

The U.S. Department of Defense (DoD) aims to prevent suicide, harassment, sexual assault, and partner and child maltreatment by implementing evidence-based behavioral health interventions (EBIs). However, sustaining EBI implementation over time and with fidelity to result in meaningful impacts is a tremendous challenge. We interviewed 35 military leaders in positions to observe, and possibly hinder, the erosions of EBI implementations to learn what distinguishes EBIs that sustain in the military from those that fade away. Thematic analysis identified barriers and supports to EBI sustainment consistent with the Consolidated Framework for Implementation Research, reflecting the domains: outer setting, inner setting, individuals, and innovation. Participants described how factors at different levels of the social ecology interact with each other and emphasized how aspects of military culture (e.g., hierarchical structure, frequent moves, mission focus) can both support and challenge implementing and sustaining behavioral-health EBIs. EBI implementation in the military differs from most civilian settings in that service member participation in certain preventative programs is mandated. The results indicate how policy and practice can strengthen sustained EBI implementation to reduce harm and support service members.

School-level factors associated with the sustainment of weekly physical activity scheduled in Australian elementary schools: an observational study.

BACKGROUND: We aimed to: (1) identify school-level factors associated with the sustainment of weekly physical activity (PA) scheduled in elementary schools following withdrawal of effective implementation support; and (2) determine teacher's perceived usefulness of suggested strategies for sustaining the scheduling of weekly PA. METHODS: A secondary exploratory analysis was employed of data from the intervention arm (n = 31 schools) of a randomised controlled trial. Self-report survey data from 134 classroom teachers in New South Wales, Australia, collected following withdrawal of initial implementation support (follow-up T1) and six-months following completion of support (follow-up T2) were used. The outcomes of sustainment of weekly overall PA and energisers (short classroom PA breaks) scheduled were measured via teachers' completion of a daily activity logbook, with results presented as the difference in mean minutes of PA and energisers scheduled at T1 and T2. An adapted version of the Program Sustainability Assessment Tool (PSAT) was used to measure capacity for program sustainability across seven key domains at follow-up T2. Linear mixed regressions were conducted to evaluate associations between school-level sociodemographic characteristics (e.g., school size, remoteness, and type), teacher-reported school factors (i.e., seven adapted PSAT domains) and the sustainment of PA and energisers scheduled across the school week. Perceived usefulness of 14 proposed sustainability strategies was measured via the teacher survey at follow-up T2 and reported descriptively. RESULTS: No school-level factor was statistically associated with the sustainment of overall weekly PA or energisers scheduled. Teacher-reported factors in two PSAT domains - 'strategic planning' and 'program evaluation' were statistically negatively associated with the sustainment of weekly energisers scheduled (- 6.74, 95% CI: - 13.02; - 0.47, p = 0.036 and - 6.65, 95% CI: - 12.17; - 1.12, p = 0.019 respectively). The proposed support sustainability strategy - 'provision of PA equipment packs that enable energisers or integrated lessons' was perceived useful by the most teachers (85%). CONCLUSIONS: Further research is required to explore additional contextual-specific, and end-user appropriate factors associated with schools' sustainment of weekly PA scheduled. This will help accurately inform the development of strategies to address these determinants and support the sustainment and long-term benefits of school-based health interventions more broadly.

The Perils of a "My Work Here is Done" perspective: a mixed methods evaluation of sustainment of an evidence-based intervention for transient ischemic attack.

BACKGROUND: To evaluate quality improvement sustainment for Transient Ischemic Attack (TIA) and identify factors influencing sustainment, which is a challenge for Learning Healthcare Systems. METHODS: Mixed methods were used to assess changes in care quality across periods (baseline, implementation, sustainment) and identify factors promoting or hindering sustainment of care quality. PREVENT was a stepped-wedge trial at six US Department of Veterans Affairs implementation sites and 36 control sites (August 2015-September 2019). Quality of care was measured by the without-fail rate: proportion of TIA patients who received all of the care for which they were eligible among brain imaging, carotid artery imaging, neurology consultation, hypertension control, anticoagulation for atrial fibrillation, antithrombotics, and high/moderate potency statins. Key informant interviews were used to identify factors associated with sustainment. RESULTS: The without-fail rate at PREVENT sites improved from 36.7% (baseline, 58/158) to 54.0% (implementation, 95/176) and settled at 48.3% (sustainment, 56/116). At control sites, the without-fail rate improved from 38.6% (baseline, 345/893) to 41.8% (implementation, 363/869) and remained at 43.0% (sustainment, 293/681). After adjustment, no statistically significant difference in sustainment quality between intervention and control sites was identified. Among PREVENT facilities, the without-fail rate improved ≥2% at 3 sites, declined ≥2% at two sites, and remained unchanged at one site during sustainment. Factors promoting sustainment were planning, motivation to sustain, integration of processes into routine practice, leadership engagement, and establishing systems for reflecting and evaluating on performance data. The only factor that was sufficient for improving quality of care during sustainment was the presence of a champion with plans for sustainment. Challenges during sustainment included competing demands, low volume, and potential problems with medical coding impairing use of performance data. Four factors were sufficient for declining quality of care during sustainment: low motivation, champion inactivity, no reflecting and evaluating on performance data, and absence of leadership engagement. CONCLUSIONS: Although the intervention improved care quality during implementation; performance during sustainment was heterogeneous across intervention sites and not different from control sites. Learning Healthcare Systems seeking to sustain evidence-based practices should embed processes within routine care and establish systems for reviewing and reflecting upon performance. TRIAL REGISTRATION: Clinicaltrials.gov ( NCT02769338 ).

Sustainability of evidence-based practices in the management of infants with bronchiolitis in hospital settings - a PREDICT study protocol.

BACKGROUND: Understanding how and why de-implementation of low-value practices is sustained remains unclear. The Paediatric Research in Emergency Departments International CollaboraTive (PREDICT) Bronchiolitis Knowledge Translation (KT) Study was a cluster randomised controlled trial conducted in 26 Australian and New Zealand hospitals (May-November 2017). Results showed targeted, theory-informed interventions (clinical leads, stakeholder meetings, train-the-trainer workshop, targeted educational package, audit/feedback) were effective at reducing use of five low-value practices for bronchiolitis (salbutamol, glucocorticoids, antibiotics, adrenaline and chest x-ray) by 14.1% in acute care settings. The primary aim of this study is to determine the sustainability (continued receipt of benefits) of these outcomes at intervention hospitals two-years after the removal of study supports. Secondary aims are to determine sustainability at one-year after removal of study support at intervention hospitals; improvements one-and-two years at control hospitals; and explore factors that influence sustainability at intervention hospitals and contribute to improvements at control hospitals. METHODS: A mixed-methods study design. The quantitative component is a retrospective medical record audit of bronchiolitis management within 24 hours of emergency department (ED) presentations at 26 Australian (n = 20) and New Zealand (n = 6) hospitals, which participated in the PREDICT Bronchiolitis KT Study. Data for a total of 1800 infants from intervention and control sites (up to 150 per site) will be collected to determine if improvements (i.e., no use of all five low-value practices) were sustained two- years (2019) post-trial (primary outcome; composite score); and a further 1800 infants from intervention and control sites will be collected to determine sustained improvements one- year (2018) post-trial (secondary outcome). An a priori definition of sustainability will be used. The qualitative component will consist of semi-structured interviews with three to five key emergency department and paediatric inpatient medical and nursing staff per site (total n = 78-130). Factors that may have contributed to sustaining outcomes and/or interventions will be explored and mapped to an established sustainability framework. DISCUSSION: This study will improve our understanding of the sustainability of evidence-based bronchiolitis management in infants. Results will also advance implementation science research by informing future de-implementation strategies to reduce low-value practices and sustain practice change in paediatric acute care. TRIAL REGISTRATION: Australian and New Zealand Clinical Trials Registry No: ACTRN12621001287820.

Sustainment stories: a qualitative analysis of barriers to sustainment of the National Rural Transitions of Care Nurse Program.

BACKGROUND: Understanding how to successfully sustain evidence-based care coordination interventions across diverse settings is critical to ensure that patients continue to receive high quality care even after grant funding ends. The Transitions Nurse Program (TNP) is a national intervention in the Veterans Administration (VA) that coordinates care for high risk veterans transitioning from acute care VA medical centers (VAMCs) to home. As part of TNP, a VA facility receives funding for a full-time nurse to implement TNP, however, this funding ends after implementation. In this qualitative study we describe which elements of TNP sites planned to sustain as funding concluded, as well as perceived barriers to sustainment. METHODS: TNP was implemented between 2016 and 2020 at eleven VA medical centers. Three years of funding was provided to each site to support hiring of staff, implementation and evaluation of the program. At the conclusion of funding, each site determined if they would sustain components or the entirety of the program. Prior to the end of funding at each site, we conducted midline and exit interviews with Transitions nurses and site champions to assess plans for sustainment and perceived barriers to sustainment. Interviews were analyzed using iterative, team-based inductive deductive content analysis to identify themes related to planned sustainment and perceived barriers to sustainment. RESULTS: None of the 11 sites planned to sustain TNP in its original format, though many of the medical centers anticipated offering components of the program, such as follow up calls after discharge to rural areas, documented warm hand off to PACT team, and designating a team member as responsible for patient rural discharge follow up. We identified three themes related to perceived sustainability. These included: 1) Program outcomes that address leadership priorities are necessary for sustainment.; 2) Local perceptions of the need for TNP or redundancy of TNP impacted perceived sustainability; and 3) Lack of leadership buy-in, changing leadership priorities, and leadership turnover are perceived barriers to sustainment. CONCLUSIONS: Understanding perceived sustainability is critical to continuing high quality care coordination interventions after funding ends. Our findings suggest that sustainment of care coordination interventions requires an in-depth understanding of the facility needs and local leadership priorities, and that building adaptable programs that continually engage key stakeholders is essential.

Gender differences in the intention to withhold life-sustaining treatments involving severe dementia for self and on behalf of parent or spouse.

BACKGROUND: Few studies have explored gender differences in the attitudes toward advanced care planning and the intention to withhold life-sustaining treatments (LSTs) involving severe dementia in Asian countries. We examined gender differences in the attitude toward the Patient Autonomy Act (PAA) in Taiwan and how the gender differences in these attitudes affect the intention to withhold LSTs for severe dementia. We also investigated self-other differences in the intention to withhold LSTs between genders. METHODS: Between March and October 2019, a structured questionnaire was distributed to hospitalized patients' family members through face-to-face contact in an academic medical center. Exploratory factor analysis and independent and paired-sample t-tests were used to describe gender differences. Mediation analyses controlled for age, marital status, and education level were conducted to examine whether the attitude toward the PAA mediates the gender effect on the intention to withhold LSTs for severe dementia. RESULTS: Eighty respondents filled out the questionnaire. Exploratory factor analysis of the attitude toward the PAA revealed three key domains: regarding the PAA as (1) promoting a sense of abandonment, (2) supporting patient autonomy, and (3) contributing to the collective good. Relative to the men, the women had lower average scores for promoting a sense of abandonment (7.48 vs. 8.94, p = 0.030), higher scores for supporting patient autonomy (8.74 vs. 7.94, p = 0.006), and higher scores for contributing to the collective good (8.64 vs. 7.47, p = 0.001). Compared with the women, the men were less likely to withhold LSTs for severe dementia (15.84 vs. 18.88, p = 0.01). Mediation analysis revealed that the attitude toward the PAA fully mediated the gender differences in the intention to withhold LSTs for severe dementia. Both men and women were more likely to withhold LSTs for themselves than for their parents. Compared with the women, the men were more likely to withhold resuscitation for themselves than for their parents (p = 0.05). Women were more likely to agree to enteral tube feeding and a tracheotomy for their husbands than for themselves; men made consistent decisions for themselves and their wives in those LST scenarios. CONCLUSION: Gender influences the attitude toward advanced care planning and consequently affects the intention to withhold LSTs, indicating that there may be a difference in how men and women perceive EOL decision-making for severe dementia in Taiwan. Further studies are warranted.

Sustaining acute speech-language therapists' implementation of recommended aphasia practices: A mixed methods follow-up evaluation of a cluster RCT.

BACKGROUND: While implementation studies in aphasia management have shown promising improvements to clinical practice, it is currently unknown if aphasia implementation outcomes are sustained and what factors may influence clinical sustainability. AIMS: To evaluate the sustainment (i.e., sustained improvement of aphasia management practices and domains influencing clinicians' practice) and sustainability (i.e., factors influencing sustainability) outcomes of the Acute Aphasia IMplementation Study (AAIMS). METHODS & PROCEDURES: A convergent interactive mixed-methods sustainability evaluation was conducted on two previously delivered implementation interventions (AAIMS). The AAIMS interventions were targeted at improving either written aphasia-friendly information provision (Intervention A) or collaborative goal-setting (Intervention B). Outcomes were collected 2 and 3 years post-implementation, addressing the research questions of sustainment (e.g., medical record audits and behavioural constructs questionnaires) and sustainability (e.g., post-study focus groups and organizational readiness surveys). Quantitative sustainability data were compared with post-implementation data, allowing for sustainment to be determined. Clinicians' perspectives on sustainability outcomes and challenges were analysed using framework analysis and integrated with the quantitative findings. OUTCOMES & RESULTS: A total of 35 speech-language therapists (SLTs) from four hospitals participated. The medical records of 79 patients were audited in the sustainability period compared with the 107 medical records audited during AAIMS. Overall, there was variable sustainment of the target behaviours; implementation for Intervention A was not sustained at either sustainability time point (2018 = 47.8% decrease; 2019 = 22.78% decrease), but implementation for Intervention B was sustained at both time points (2018 = 7.78% increase; 2019 = 18.1% increase). There was a pattern of sustained change in the behaviour change domains targeted by the implementation interventions, where scores of the targeted domains increased over time (0.13, 95% confidence interval (CI) = -0.05 to 0.30) and scores of the non-targeted domains declined (-0.03, 95% CI = -0.11 to 0.04). Factors influencing sustainability were mainly related to 'processes', 'the inner context' and 'SLT characteristics', and these interacted dynamically to account for variation between teams. CONCLUSIONS & IMPLICATIONS: Implementation outcomes (i.e., practice changes) were not sustained to the same level for three of the four participating SLT teams, with variable or partial sustainment most common. While the factors influencing sustainability differed depending on the context and individuals involved, the most important factor influencing outcomes seemed to be the level to which behaviour-change processes and strategies were embedded within the SLT department. Future implementation studies should incorporate sustainability measures from the onset and include follow-ups and monitoring systems to help support sustained change in the long term. WHAT THIS PAPER ADDS: What is already known on the subject In post-stroke aphasia management, there are few examples of long-term sustainability of implementation outcomes. It is therefore unknown what factors are potentially important to sustain implementation of best-practice recommendations in aphasia services. What this paper adds to existing knowledge There is potential for implementation outcomes to be sustained long term, but sustainment is impacted by a range of factors. Ongoing facilitation or follow-up after initial implementation may to useful to promote sustainment, but is not essential if processes are sufficiently embedded. Gradual implementation into practice may lead to better sustainment than rapid change that is quickly forgotten. What are the potential or actual clinical implications of this work? Future implementation efforts should incorporate sustainability measures from the onset. Applying a sustainability framework was useful to guide evaluations and explore factors influencing the sustainment outcomes and is recommended for those interested in sustainability. Results from our evaluation can be used to guide refinement and support future development of sustainable implementation interventions.

Implementation of the Wolverine Mental Health Program, Part 3: Sustainment Phase.

Sustaining the implementation of an evidence-based practice (EBP) is the ultimate goal of often years of significant personnel and financial investment. Some conceptualize sustainment as a distinct phase following an active implementation period where the contextual factors, processes, and supports are bolstered to ensure continued EBP delivery. This study provides an overview of the sustainment strategies deployed to embed cognitive-behavioral therapy (CBT) in a Midwestern residential treatment facility serving youth with complex mental health needs. Seven key strategies and their outcomes are described: use of CBT teams, new hire orientation plans, monthly campaigns, change in job descriptions and performance evaluations, development of a behavioral reinforcement system for youth, and a pathway to CBT certification. This study provides a window into how one might sustain an EBP by addressing barriers unique to this phase of work.

Integrated knowledge translation to advance noncommunicable disease policy and practice in South Africa: application of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework.

BACKGROUND: In response to the "know-do" gap, several initiatives have been implemented to enhance evidence-informed decision-making (EIDM). These include individual training, organizational culture change management, and legislative changes. The importance of relationships and stakeholder engagement in EIDM has led to an evolution of models and approaches including integrated knowledge translation (IKT). IKT has emerged as a key strategy for ensuring that engagement is equitable, demand-driven, and responsive. As a result, the African-German Collaboration for Evidence-Based Healthcare and Public Health in Africa (CEBHA+) incorporated an IKT approach to influence noncommunicable diseases (NCD) policy and practice. We documented the phased process of developing, implementing, and monitoring the IKT approach in South Africa; and explored the appropriateness of using the exploration, preparation, implementation, and sustainment (EPIS) framework for this purpose. METHODS: We mapped the South Africa IKT approach onto the EPIS framework using a framework analysis approach. Notes of team meetings, stakeholder matrices, and engagement strategies were analysed and purposefully plotted against the four phases of the framework in order to populate the different constructs. We discussed and finalized the analysis in a series of online iterations until consensus was reached. RESULTS: The mapping exercise revealed an IKT approach that was much more iterative, dynamic, and engaging than initially thought. Several constructs (phase-agnostic) remained important and stable across EPIS phases: stable and supportive funding; committed and competent leadership; skilled and dedicated IKT champions; diverse and established personal networks; a conducive and enabling policy environment; and boundary-spanning intermediaries. Constructs such as "innovations" constantly evolved and adapted to the changing inner and outer contexts (phase-specific). CONCLUSIONS: Using the EPIS framework to interrogate, reflect on, and document our IKT experiences proved extremely relevant and useful. Phase-agnostic constructs proved critical to ensure resilience and agility of NCD deliberations and policies in the face of highly dynamic and changing local contexts, particularly in view of the current coronavirus disease 2019 (COVID-19) pandemic. Bridging IKT with a framework from implementation science helps to reflect on this process and can guide the development and planning of similar interventions and strategies.

Recidivism Treatment for Justice-Involved Veterans: Evaluating Adoption and Sustainment of Moral Reconation Therapy in the US Veterans Health Administration.

Moral Reconation Therapy (MRT), an evidence-based intervention to reduce risk for criminal recidivism among justice-involved adults, was developed and primarily tested in correctional settings. Therefore, a better understanding of the implementation potential of MRT within non-correctional settings is needed. To address this gap in the literature, we evaluated the adoption and sustainment of MRT in the US Veterans Health Administration (VHA) following a national training initiative in fiscal years 2016 and 2017. In February 2019, surveys with 66 of the 78 VHA facilities that participated in the training were used to estimate the prevalence of MRT adoption and sustainment, and qualitative interviews with key informants from 20 facilities were used to identify factors associated with sustainment of MRT groups. Of the 66 facilities surveyed, the majority reported adopting (n = 52; 79%) and sustaining their MRT group until the time of the survey (n = 38; 58%). MRT sustainment was facilitated by strong intra-facility (e.g., between veterans justice and behavioral health services) and inter-agency collaborations (e.g., between VHA and criminal justice system stakeholders), which provided a reliable referral source to MRT groups, external incentives for patient engagement, and sufficient staffing to maintain groups. Additional facilitators of MRT sustainment were adaptations to the content and delivery of MRT for patients and screening of referrals to the groups. The findings provide guidance to clinics and healthcare systems that are seeking to implement MRT with justice-involved patient populations, and inform development of implementation strategies to be formally tested in future trials.

Exploration, Preparation, and Implementation of Standardized Assessment in a Multi-agency School Behavioral Health Network.

School mental health treatment services offer broad public health impact and could benefit from more widespread implementation and sustainment of standardized assessments (SA). This demonstration study describes one approach to increase SA use in a large school behavioral health network using the Exploration, Preparation, Implementation and Sustainment (EPIS) framework. Mental health administrator interviews with four participating agencies and a multidisciplinary planning team informed SA measure selection and implementation supports. The SA initiative was implemented during one school year, including system-wide training and ongoing implementation supports for 95 clinicians. Linear mixed effect models revealed improvements in clinician attitudes about the SA for clinical utility and treatment planning immediately following the half-day training (N = 95, p < .001). Clinicians self-reported a significant increase in use of SA for new clients during intakes (p < .001) over time and 71.4% of expected SA data were submitted. Qualitative feedback, including recommendations to offer more SA choices and beginning new SA data collection earlier in the school year, was integrated to inform quality improvements and future sustainment efforts.

Advancing Evidence-Based Practice Through Implementation Science: Critical Contributions of Doctor of Nursing Practice- and Doctor of Philosophy-Prepared Nurses.

PURPOSE: Describe the evolution of implementation science and the roles and potential collaborations of doctorally prepared nurses to advance implementation science in practice settings. METHODS: Review of academic preparation and areas of expertise for doctorally prepared nurses as it relates to implementation science and evidence-based practice (EBP). FINDINGS: There have been substantial gains in the number of academic programs in healthcare that include content on EBP, resulting in healthcare teams that are motivated to align practices with best evidence. Unfortunately, many EBP initiatives stall during early stages of implementation, resulting in fragmented practices and persistent gaps between evidence and practice. Implementation science aims to bridge this gap and provides a structured, science-based approach to implementation. Few healthcare teams are familiar with implementation science, and many do not incorporate knowledge from the field when implementing EBPs. Doctorally prepared nurses are in a unique position to serve as leaders in EBP implementation due to the breadth and depth of academic preparation and their pivotal roles across practice settings. CONCLUSIONS: Collaboratively aligning existing strengths of PhD and DNP prepared nurses with knowledge of implementation science can advance implementation of EBP across practice settings to effectively incorporate and sustain meaningful change to improve outcomes. LINKING EVIDENCE TO ACTION SECTION: Doctorally prepared nurses are in a unique position to advance and apply the science of implementation in practice settings. Nurse scientists can generate evidence on effective strategies and outcomes among healthcare teams to successfully integrate evidence based practices into routine care. Nurse leaders and educators can apply these findings and use an implementation science approach when leading clinical teams in evidence-based practice changes.

When Do Therapists Stop Using Evidence-Based Practices? Findings from a Mixed Method Study on System-Driven Implementation of Multiple EBPs for Children.

Therapist discontinuation of delivering an evidence-based practice (EBP) is a critical outcome in the community implementation of EBPs. This mixed methods study examined factors associated with therapist discontinuation within a large reimbursement-driven implementation of multiple EBPs in public children's mental health services. The study integrated quantitative survey data from 748 therapists across 65 agencies, and qualitative interviews from a subset of 79 therapists across 14 agencies. Therapists adopted, on average, 2.41 EBPs (SD = 1.05, range = 1-5), and nearly half (n = 355, 47.5%) reported discontinuing at least one EBP. Multi-level models were used to predict the binary outcome of discontinuation, and qualitative analyses were used to expand upon quantitative findings. Quantitative models revealed that therapist factors, including fewer direct service hours per week, a greater number of EBPs adopted, higher emotional exhaustion, and more negative attitudes toward EBPs in general were associated with discontinuation. In addition, EBP-specific factors including more negative perceptions of the particular EBP and lower self-efficacy for delivering the specific EBP predicted discontinuation. Themes from interview responses highlighted the importance of fit of the EBP with the agency's client base, as well as therapist perceptions of adequate EBP training supports, and the alignment of an EBP with therapists' professional goals. Together, the findings suggest the need for strategic sustainment planning interventions that target EBP fit (i.e., fit between adopted EBPs and agency target population, fit between EBP and therapist preferences and career goals) and support therapist self-efficacy in delivering EBPs.

Improving Substance Use Services for Juvenile Justice-Involved Youth: Complexity of Process Improvement Plans in a Large Scale Multi-site Study.

Despite the high prevalence of substance use disorders among juvenile offenders, most do not receive services. System-level process improvement plans to address unmet service needs can be optimized by combining data-driven decisions and facilitated meetings with behavioral health stakeholders. This paper operationalizes and analyzes the level of specified complexity among process improvement plans evident within 36 juvenile probation and drug courts across 7 states. To inform more effective implementation strategies, this analysis identifies and prioritizes promising courses of agency enhancement toward addressing unmet substance use needs.

The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation.

BACKGROUND: There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed. DISCUSSION: There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the "Value Equation," provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.

Using normalisation process theory to evaluate the implementation of a complex intervention to embed the surgical safety checklist.

BACKGROUND: The surgical Safety Checklist (SSC) was introduced in 2008 to improve teamwork and reduce the mortality and morbidity associated with surgery. Although mandated in many health care institutions around the world, challenges in implementation of the SSC continue. To use Normalisation Process Theory (NPT) to help understand how/why implementation of a complex intervention coined Pass The Baton (PTB) could help explain what facets of the Surgical Safety Checklist use led to its' integration in practice, while others were not. METHODS: A longitudinal multi-method study using survey and interviews was undertaken. Implementation of PTB involved; change champions, audit and feedback, education and prompts. Following implementation, surgical teams were surveyed using the NOrmalization MeAsure Development (NoMAD) and subsequently interviewed to explore the impact of PTB on their use of the checklist at 6 and 12 months respectively. Respondents' self-reported perceptions of implementation of PTB was explained using the four NPT constructs; coherence, cognitive participation, collective action, and reflexive monitoring. Survey data were analysed using descriptive statistics. Interview data were coded inductively and content analysed using a framework derived from NPT. RESULTS: The NoMAD survey response rate was 59/150 (39.3%). Many (45/59, 77.6%) survey respondents saw the value in PTB, while 50/59 (86.2%) would continue to use it; 45/59 (77.6%) believed that PTB could easily be integrated into existing workflows, and 48/59 (82.8%) thought that feedback could improve PTB in the future. A total of 8 interviews were completed with 26 surgical team members. Nurses and physicians held mixed views towards coherence while buy-in and participation relied on individuals' investment in the implementation process and the ability to modify PTB. Participants generally recognised the benefit and value of using PTB in the ongoing implementation the checklist. CONCLUSIONS: Workarounds and flexible co-construction in implementation designed to improve team communications in surgery may facilitate their normalisation in practice.