Swimming Against the Current: Addressing Community Needs and Establishing Partnerships for the Prevention of Opioid and Methamphetamine use Among Parents.

The opioid and methamphetamine crises in Oregon have a consequential impact on young families, as an increasing number of parents experience substance use disorder (SUD). As parental substance use escalates, the child welfare system (CWS) becomes overwrought with families who have complex needs. The burden placed on families and on the CWS indicates a need for prevention and treatment interventions for parental SUDs. In response to the worst statewide opioid and methamphetamine epidemics in the USA, a Hybrid Type 2 trial of PRE-FAIR-a prevention intervention for parents-is being implemented in five Oregon counties. Establishing strong partnerships within the communities helped identify the need to implement the evidence-based FAIR treatment model alongside PRE-FAIR. A strong focus on implementation includes meeting the needs of communities and establishing the infrastructure necessary for sustainment of the FAIR programs at the provider agencies. Despite implementation efforts to direct toward PRE-FAIR referrals, parents in need of treatment are being referred at a disproportionate rate, as are older parents who fall outside of study-eligibility. Both challenges have delayed the ability to enroll a sufficient number of participants for the prevention trial. This commentary describes the impact of the opioid and methamphetamine epidemics in Oregon as the crises relate to implementing prevention versus treatment interventions-highlighting the importance of addressing community needs and establishing strong partnerships, which has allowed creative strategies to increase PRE-FAIR recruitment.

Barriers and facilitators to implementing evidence-based interventions in the context of a randomized clinical trial in the United States: a qualitative study.

BACKGROUND: Evidence-based interventions, which are typically supported by data from randomized controlled trials (RCTs), are highly valued by providers of human services like child welfare. However, implementing such interventions in the context of a randomized clinical trial is a complex process, as conducting an RCT adds extra tasks for providers and complicating factors for provider organizations. Utilizing the Exploration, Preparation, Implementation, and Sustainment Framework, this study examines factors that facilitate or impede success in the implementation of evidence-based interventions in the context of a largescale trial of SafeCare,® a child maltreatment intervention. METHODS: Qualitative data were obtained as part of a larger mixed-methods study involving a cluster randomized trial comparing SafeCare to usual services for caregivers within nine child welfare agencies across four states. Between May and October 2017, individual interviews were conducted with a purposive sample of 21 child welfare administrators and 24 supervisors, and 19 focus groups were conducted with 84 providers. Data were coded iteratively and grouped into themes. RESULTS: Several interconnected themes centered on facilitators and barriers to SafeCare implementation in the context of a randomized clinical trial. Facilitators included: (1) Benefits afforded through RCT participation; (2) Shared vision and sustained buy-in across system and organizational levels; and (3) Ongoing leadership support for SafeCare and the RCT. Barriers that hindered SafeCare were: (1) Insufficient preparation to incorporate SafeCare into services; (2) Perceived lack of fit, leading to mixed support for SafeCare and the RCT; and (3) Requirements of RCT participation at the provider level. CONCLUSIONS: These data yield insight into an array of stakeholder perspectives on the experience of implementing a new intervention in the context of a largescale trial. This research also sheds light on how the dynamics of conducting an RCT may affect efforts to implement interventions in complex and high-pressure contexts. Findings highlight the importance of aligning knowledge and expectations among researchers, administrators of organizations, and supervisors and providers. Researchers should work to alleviate the burdens of study involvement and promote buy-in among frontline staff not only for the program but also for the research itself.

Study Protocol: Multi-level Determinants of Implementation and Sustainment in the Education Sector.

Evidence-based programs (EBPs) delivered in elementary schools show great promise in reducing risk for emotional and behavioral disorders (EBDs). However, efforts to sustain EBPs in school face barriers. Improving EBP sustainment thus represents a priority, but little research exists to inform the development of sustainment strategies. To address this gap, the Sustaining Evidenced-Based Innovations through Multi-level Implementation Constructs (SEISMIC) project will: (a) Determine if malleable individual, intervention, and organizational factors predict EBP treatment fidelity and modifications during implementation, sustainment, or both; (b) Assess the impact of EBP fidelity and modifications on child outcomes during implementation and sustainment; and (c) Explore the mechanisms through which individual, intervention, and organizational factors influence sustainment outcomes. This protocol paper describes SEISMIC, which builds upon a federally-funded RCT evaluating BEST in CLASS, a teacher-delivered program for K-3rd grade children at risk for EBDs. The sample will include 96 teachers, 384 children, and 12 elementary schools. A multi-level, interrupted time series design will be used to examine the relationship between baseline factors, treatment fidelity, modifications, and child outcomes, followed by a mixed-method approach to elucidate the mechanisms that influence sustainment outcomes. Findings will be used to create a strategy to improve EBP sustainment in schools.

Wait No Longer: Reducing Medication Wait-Times for Individuals with Co-Occurring Disorders.

Objective: Community addiction treatment agencies have utilized Network for the Improvement of Addiction Treatment (NIATx), a proven implementation strategy, to reduce appointment wait-times. However, its effectiveness at reducing medication access wait-times has not been explored. Thus, we conducted an exploratory analysis to evaluate the impact of the NIATx implementation strategies on reduced wait-times to addiction, psychotropic or both medications for individuals with co-occurring disorders (COD). Methods: In a cluster-randomized waitlist control group design, community addiction treatment agencies (n = 49) were randomized to receive the NIATx strategy (Cohort 1, n = 25) or to a Waitlist control (Cohort 2, n = 24). All agencies had a 12-month active intervention period. The primary outcome was the medication encounter wait-time. A univariate general linear model analysis utilizing a logarithmic (log10) transformation examined medication wait-times improvements. Results: The intent-to-treat analysis for psychotropic medications and both medications (reflecting integrated treatment) showed significant main effects for intervention and time, especially comparing Baseline and Year 1 to Year 2. Conversely, only the main effect for time was significant for addiction medications. Wait-time reductions in Cohort 1 agencies was delayed and occurred in the sustainment phase. Wait-times to a psychotropic, addiction, or both medications encounter declined by 3 days, 4.9 days, and 6.8 days, respectively. For Cohort 2 agencies, reduced wait-times were seen for psychotropic (3.4 days), addiction (6 days), and both medications (4.9 days) during their active implementation period. Same- or next-day medication access also improved. Conclusions: NIATx implementation strategies reduced medication encounter wait-times but timing of agency improvements varied. Despite a significant improvement, a three-week wait-time to receive integrated pharmacological interventions is clinically suboptimal for individuals with a COD in need of immediate intervention. Community addiction treatment agencies should identify barriers and implement changes to improve medication access so that their patients "wait no longer" to receive integrated treatment and medications for their COD.

Collaborating to offer HPV vaccinations in jails: results from a pre-implementation study in four states.

BACKGROUND: Correctional facilities are an underutilized venue for reaching young adults who have not vaccinated for human papillomavirus (HPV). The objective of this study was to identify factors that are associated with jail and local health department (LHD) interest in partnering to offer HPV vaccinations to young adults in jail. METHODS: Consolidated framework for implementation research (CFIR)-guided surveys were conducted with jail administrators in Iowa, Kansas, Missouri, and Nebraska, September 2017-October 2018. Jail survey data were analyzed using chi square distribution and relative risk regression. Using data from sister surveys conducted with LHD administrators in the same counties (results previously reported), we identified characteristics of counties in which both the jail and LHD indicated interest in collaborating to offer HPV vaccinations in the jail. RESULTS: Jail survey response was 192/347 (55.3%). Surveys with LHDs yielded 237/344 (68.9%) responses. Eleven communities were identified where both the jail and LHD expressed interest. Only "any vaccines provided in jail" predicted shared interest (RR: 5.36; CI: 2.52-11.40; p < .01). For jail administrators, offering other vaccines was 3 times (CI:1.49-6.01; p < .01) and employing a nurse 1.65 times more likely (CI: 1.20-2.28; p < .01) to predict interest in collaborating to offer HPV vaccination. Open-ended responses indicated that managing linkages and stakeholder investment were areas of emphasis where collaborations to provide vaccinations in the jails had been previously implemented. CONCLUSIONS: Interest in jail-LHD partnerships to provide HPV vaccinations in jails exists in the Midwest but will require building-out existing programs and linkages and identifying and strengthening shared values, goals, and benefits at all levels.

Scaling Implementation of Collaborative Care for Depression: Adaptation of the Stages of Implementation Completion (SIC).

Tools to monitor implementation progress could facilitate scale-up of effective treatments. Most treatment for depression, a common and disabling condition, is provided in primary care settings. Collaborative Care Management (CoCM) is an evidence-based model for treating common mental health conditions, including depression, in this setting; yet, it is not widely implemented. The Stages of Implementation Completion (SIC) was adapted for CoCM and piloted in eight rural primary care clinics serving adults challenged by low-income status. The CoCM-SIC accurately assessed implementation effectiveness and detected site variations in performance, suggesting key implementation activities to aid future scale-ups of CoCM for diverse populations.

Burnout and Mental Health Stigma Among Juvenile Probation Officers: The Moderating Effect of Participatory Atmosphere.

Despite high rates of mental health problems among juvenile justice-involved youth, mental health stigma among juvenile probation officers (JPOs) is under-studied. This cross-sectional study examined effects of job burnout and workplace participatory atmosphere on mental health stigma among JPOs across Indiana (n = 226). Participatory atmosphere moderated the relationship between JPO burnout-related cynicism and mental health stigma (interaction ß = - 0.14, p = .04); burnout was related to greater mental health stigma at low levels of participatory atmosphere. Findings suggest participatory atmosphere mitigates effects of burnout on mental health stigma among JPOs. Organizational-level interventions might help to reduce mental health stigma and combat negative effects from burnout among JPOs.

Long-Term Economic Benefit of Treatment Foster Care Oregon (TFCO) for Adolescent Females Referred to Congregate Care for Delinquency.

Treatment Foster Care Oregon (TFCO) is an alternative to congregate care, for youth involved in the juvenile justice and/or child welfare systems. Though demonstrated as clinically-and cost-effective across multiple rigorous trials, the long-term cost benefit of TFCO has not been considered. This study follows n = 166 females from adolescence to young adulthood, who were involved in both systems and referred for out-of-home-care. Records of arrest, court, incarceration (juvenile, jail, and prison), monitoring (parole and probation) and child-welfare services were included in a long-term cost-benefit analysis. Outcomes highlight ongoing benefit of the TFCO intervention, nearly 10 years post-intervention.

A Longitudinal Examination of Service Utilization and Trauma Symptoms among Young Women with Prior Foster Care and Juvenile Justice System Involvement.

We investigated the prediction of young adult service utilization and trauma symptoms from adverse childhood experiences (ACEs) and adolescent mental health symptoms in young women with dual child welfare and juvenile justice system involvement. A sample of 166 females (ages 13 to 17) was followed to examine the transition to young adulthood. Path models indicated that more ACEs were associated with poorer adolescent mental health. Adolescent mental health symptoms were associated with more young adult trauma symptoms and service utilization. Implications for service providers and policy-makers are discussed.

Use of Research Evidence and Implementation of Evidence-Based Practices in Youth-Serving Systems.

Although the effectiveness of interventions for prevention and treatment of mental health and behavioral problems in abused and neglected youth is demonstrated through the accumulation of evidence through rigorous and systematic research, it is uncertain whether use of research evidence (URE) by child-serving systems leaders increases the likelihood of evidence- based practice (EBP) implementation and sustainment. Information on URE was collected from 151 directors and senior administrators of child welfare, mental health and juvenile justice systems in 40 California and 11 Ohio counties participating in an RCT of the use of community development teams (CDTs) to scale up implementation of Treatment Foster Care Oregon over a 3 year period (2010-12). Separate multivariate models were used to assess independent effects of evidence acquisition (input), evaluation (process), application (output), and URE in general (SIEU Total) on two measures of EBP implementation, highest stage reached and proportion of activities completed at pre-implementation, implementation and sustainment phases. Stage of implementation and proportion of activities completed in the implementation and sustainment phases were independently associated with acquisition of evidence and URE in general. Participation in CDTs was significantly associated with URE in general and acquisition of research evidence in particular. Implementation of EBPs for treatment of abused and neglected youth does appear to be associated with use of research evidence, especially during the later phases.

A Supervisor-Targeted Implementation Approach to Promote System Change: The R3 Model.

Opportunities to evaluate strategies to create system-wide change in the child welfare system (CWS) and the resulting public health impact are rare. Leveraging a real-world, system-initiated effort to infuse the use of evidence-based principles throughout a CWS workforce, a pilot of the R3 model and supervisor-targeted implementation approach is described. The development of R3 and its associated fidelity monitoring was a collaboration between the CWS and model developers. Outcomes demonstrate implementation feasibility, strong fidelity scale measurement properties, improved supervisor fidelity over time, and the acceptability and perception of positive change by agency leadership. The value of system-initiated collaborations is discussed.

An Integrated Intervention to Address the Comorbid Needs of Families Referred to Child Welfare for Substance Use Disorders and Child Neglect: FAIR Pilot Outcomes.

Despite repeated calls for evidence-based practice to address the co-occurring needs of families referred to the child welfare system for parental substance use disorders and child neglect, limited attention has been given to the rigorous evaluation of such interventions. This paper describes the initial testing of an intervention developed to meet the complex needs of such families. The Families Actively Improving Relationships (FAIR) program and preliminary outcomes are described. The need for integrated interventions is highlighted.

Incremental Net Benefit of Early Intervention for Preschool-Aged Children with Emotional and Behavioral Problems in Foster Care.

Of 1 million cases of child maltreatment identified every year in the United States, one-fifth result in foster care. Many of these children suffer from significant emotional and behavioral conditions. Decision-makers must allocate highly constrained budgets to serve these children. Recent evidence suggests that Multidimensional Treatment Foster Care for Preschoolers can reduce negative outcomes for these children, but the relative benefits and costs of the program have not been evaluated. The objective of this study was to assess net benefit, over 24 months, of Multidimensional Treatment Foster Care for Preschoolers compared to regular foster care. Data were from a randomized controlled trial of 117 young children entering a new foster placement. A subsample exhibited placement instability (n = 52). Intervention services including parent training, lasted 9-12 months. Multidimensional Treatment Foster Care for Preschoolers significantly increased permanent placements for the placement instability sample. Average total cost for the new intervention sample was significantly less than for regular foster care (full sample: $27,204 vs. $30,090; P = .004; placement instability sample: $29,595 vs. $36,061; P = .045). Incremental average net benefit was positive at all levels of willingness to pay of zero or greater, indicating that the value of benefits exceeded costs. Multidimensional Treatment Foster Care for Preschoolers has significant benefit for preschool children in foster care with emotional and behavioral disorders compared to regular foster care services. At even modest levels of willingness to pay, benefits exceed costs indicating a strong likeliness that this program is an efficient choice for improving outcomes for young children with emotional and behavioral disorders in foster care.

The Cost of Implementing New Strategies (COINS): A Method for Mapping Implementation Resources Using the Stages of Implementation Completion.

OBJECTIVE: Illustrate the value of a strategy used for measuring the costs and resources used in the implementation process over and above the costs of the intervention itself in the context of a two-arm randomized controlled trial. METHODS: Counties in California and Ohio (sites) were invited to implement Multidimensional Treatment Foster Care (MTFC), an alternative to congregate care for youth. Participating sites (n=53) were randomized to one of two implementation = sites share information and move through the implementation process as a cohort facilitated by an MTFC purveyor or (2) Individual Implementation (IND: "as usual") where sites work individually with the MTFC purveyor. The implementations were monitored using the Stages of Implementation Completion (SIC) measure of a number of observable activities, developed as part of the trial to segment the implementation process into 8 stages of implementation. Resource data gathered from the implementation purveyors and site participants were used to map costs onto each of the 8 stages to generate total cost measures stratified by type of resource and stage of implementation for each of the study arms. RESULTS: The SIC provided a feasible costing template to map costs onto observable activities and to enable the examination of important differences in implementation strategies for an evidence-based practice. The average total implementation cost prior to program start-up of CDT was $133,106; IND cost $118,699. While CDT cost more in a number of stages, it resulted in fewer county staff hours being used and shorter mean times to implementation than IND. In cases where rapidity of implementation of reducing staff time required for implementation is valued, then CDT would be the preferable implementation approach. CONCLUSIONS: The SIC is a useful tool for determining implementation resources needed for new evidence-based practice programs for youth and particularly for comparing different implementation strategies that might be tried in pilot programs.

Cost calculator methods for estimating casework time in child welfare services: A promising approach for use in implementation of evidence-based practices and other service innovations.

Estimating costs in child welfare services is critical as new service models are incorporated into routine practice. This paper describes a unit costing estimation system developed in England (cost calculator) together with a pilot test of its utility in the United States where unit costs are routinely available for health services but not for child welfare services. The cost calculator approach uses a unified conceptual model that focuses on eight core child welfare processes. Comparison of these core processes in England and in four counties in the United States suggests that the underlying child welfare processes generated from England were perceived as very similar by child welfare staff in California county systems with some exceptions in the review and legal processes. Overall, the adaptation of the cost calculator for use in the United States child welfare systems appears promising. The paper also compares the cost calculator approach to the workload approach widely used in the United States and concludes that there are distinct differences between the two approaches with some possible advantages to the use of the cost calculator approach, especially in the use of this method for estimating child welfare costs in relation to the incorporation of evidence-based interventions into routine practice.

Advancing a mission of translational intervention science: Comment on premature implementation.

Replies to comments made by Kenneth E. Freedland et al. (see record 2024-89430-002) on Rinad S. Beida, Lisa Saldana, and Rachel C. Shelton's original article (see record 2023-46817-001). In reading Freedland et al.'s (2024) commentary, it appears that their lens prioritizes internal validity and more explanatory and mechanistic work. While we also value these scientific goals and concur that the approaches they identify are clearly methodologically rigorous, we do not think the approaches will substantially reduce the unacceptable translation gap or address the fundamental issues of context. Our approach recognizes that there is tremendous value in cocreating solutions and interventions with patients, clinicians, and community members in the settings where we are seeking to promote health and address health inequities, and questions traditional assumptions and paradigms that scientists "know best" have effective solutions or should hold all of the power and knowledge (Brownson et al., 2022; Sanchez et al., 2023; Shelton, Adsul, & Oh, 2021; Shelton, Adsul, Oh, et al., 2021). We believe it is critical that we expand the pathways through which we advance intervention science in a meaningful and impactful way, and with more explicit attention to issues of context, equity, engagement, and external validity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Using policy codesign to achieve multi-sector alignment in adolescent behavioral health: a study protocol.

BACKGROUND: Policymaking is quickly gaining focus in the field of implementation science as a potential opportunity for aligning cross-sector systems and introducing incentives to promote population health, including substance use disorders (SUD) and their prevention in adolescents. Policymakers are seen as holding the necessary levers for realigning service infrastructure to more rapidly and effectively address adolescent behavioral health across the continuum of need (prevention through crisis care, mental health, and SUD) and in multiple locations (schools, primary care, community settings). The difficulty of aligning policy intent, policy design, and successful policy implementation is a well-known challenge in the broader public policy and public administration literature that also affects local behavioral health policymaking. This study will examine a blended approach of coproduction and codesign (i.e., Policy Codesign), iteratively developed over multiple years to address problems in policy formation that often lead to poor implementation outcomes. The current study evaluates this scalable approach using reproducible measures to grow the knowledge base in this field of study. METHODS: This is a single-arm, longitudinal, staggered implementation study to examine the acceptability and short-term impacts of Policy Codesign in resolving critical challenges in behavioral health policy formation. The aims are to (1) examine the acceptability, feasibility, and reach of Policy Codesign within two geographically distinct counties in Washington state, USA; (2) examine the impact of Policy Codesign on multisector policy development within these counties using social network analysis; and (3) assess the perceived replicability of Policy Codesign among leaders and other staff of policy-oriented state behavioral health intermediary organizations across the USA. DISCUSSION: This study will assess the feasibility of a specific approach to collaborative policy development, Policy Codesign, in two diverse regions. Results will inform a subsequent multi-state study measuring the impact and effectiveness of this approach for achieving multi-sector and evidence informed policy development in adolescent SUD prevention and treatment.

Specifying cross-system collaboration strategies for implementation: a multi-site qualitative study with child welfare and behavioral health organizations.

BACKGROUND: Cross-system interventions that integrate health, behavioral health, and social services can improve client outcomes and expand community impact. Successful implementation of these interventions depends on the extent to which service partners can align frontline services and organizational operations. However, collaboration strategies linking multiple implementation contexts have received limited empirical attention. This study identifies, describes, and specifies multi-level collaboration strategies used during the implementation of Ohio Sobriety Treatment and Reducing Trauma (Ohio START), a cross-system intervention that integrates services across two systems (child welfare and evidence-based behavioral health services) for families that are affected by co-occurring child maltreatment and parental substance use disorders. METHODS: In phase 1, we used a multi-site qualitative design with 17 counties that implemented Ohio START. Qualitative data were gathered from 104 staff from child welfare agencies, behavioral health treatment organizations, and regional behavioral health boards involved in implementation via 48 small group interviews about collaborative approaches to implementation. To examine cross-system collaboration strategies, qualitative data were analyzed using an iterative template approach and content analysis. In phase 2, a 16-member expert panel met to validate and specify the cross-system collaboration strategies identified in the interviews. The panel was comprised of key child welfare and behavioral health partners and scholars. RESULTS: In phase 1, we identified seven cross-system collaboration strategies used for implementation. Three strategies were used to staff the program: (1) contract for expertise, (2) provide joint supervision, and (3) co-locate staff. Two strategies were used to promote service access: (4) referral protocols and (5) expedited access agreements. Two strategies were used to align case plans: (6) shared decision-making meetings, and (7) sharing data. In phase 2, expert panelists specified operational details of the cross-system collaboration strategies, and explained the processes by which strategies were perceived to improve implementation and service system outcomes. CONCLUSIONS: We identified a range of cross-system collaboration strategies that show promise for improving staffing, service access, and case planning. Leaders, supervisors, and frontline staff used these strategies during all phases of implementation. These findings lay the foundation for future experimental and quasi-experimental studies that test the effectiveness of cross-system collaboration strategies.