Applying after-action reviews to child and family teams to improve mental health service linkage within child welfare services: a study protocol.

BACKGROUND: Half of child-welfare-involved children and adolescents meet the criteria for at least one mental health diagnosis. This project proposes to improve successful mental health service linkage in child welfare services (CWS) by adapting and testing the after-action review (AAR) team effectiveness intervention to augment the child and family team (CFT) services' intervention. Despite being both required and a collaborative approach to service planning, CFT meetings are implemented with questionable fidelity and consistency, rarely including the voice of children and families as intended. METHODS: Using a parallel group trial design, with non-equivalent comparison groups, and qualitative and quantitative methodology, this study will tailor and assess the impact of the AAR on enhancing CFT outcomes. The authors will conduct a qualitative needs assessment targeting the ongoing implementation of the CFT services intervention in a large, publicly funded, CWS system. A qualitative inquiry consisting of interviews and focus groups with key stakeholders will result in the preparation of an action plan to address identified gaps between the current and desired CFT services intervention outcomes. The AAR implementation strategy will be adapted and tailored to address the CFT services' intervention needs. To test the effectiveness of the AAR on improving outcomes associated with the CFT services intervention, we will utilize blocked randomization of four CWS caseworkers from two CWS system regions to either the intervention condition (CFT + AAR) or standard implementation (CFT as usual). The authors will collect data from the CWS caseworkers and additional CFT members via web-based surveys. Mechanisms of the AAR team effectiveness intervention for CFT implementation will be assessed. DISCUSSION: By inclusion of child and family voice, the AAR-enhanced CFT should lead to increased fidelity to the CFT intervention and greater levels of parental satisfaction with the service and shared decision-making, thus resulting in enhanced follow-through with service plans and linkage to mental health treatment services for children. The knowledge gained by this randomized clinical trial has the potential to benefit service delivery and integration for CWS leaders, caseworkers, formal and informal CFT member support persons, parents/caregivers, and children with open cases. Improving intervention effectiveness, both at the system and family levels, is crucial for practice efficiencies and improved child and family outcomes. TRIAL REGISTRATION: NCT05629013. Approval date: November 28, 2022 (version 1). TRIAL SPONSOR: University of California, San Diego. RESPONSIBLE PARTY: Danielle Fettes.

Enacting competition, capacity, and collaboration: performing neoliberalism in the U.S. in the era of evidence-based interventions.

Funders increasingly encourage social and health service organizations to strengthen their impact on public health through the implementation of evidence-based interventions (EBIs). Local governments in the U.S. often utilize market-based contracting to facilitate EBI delivery via formal relationships with non-governmental community-based organizations (CBOs). We sought to understand how the discourses embedded within contracting to compete and perform influence how CBOs represent and accomplish their work. We draw on qualitative interviews conducted with government administrators (N=16) overseeing contracts for one child welfare EBI, SafeCare® and the leaders (N=25) of organizations contracted to implement this program. Participants endorsed competition, capacity, and collaboration as ideals within marketized contracting. Yet they expressed doubt about marketplace meritocracy and described the costs incurred in building the necessary organizational infrastructure to deliver EBIs and compete for contracts. We discuss the implications of marketized EBI contracting for CBOs and the limitations it poses for evidence-based public health, especially in socially marginalized communities.

Racial and Ethnic Differences in Depressive Profiles of Child Welfare-Involved Families Receiving Home Visitation Services.

OBJECTIVE: Profiles of depressive symptoms were identified among Hispanic, Black, and White parents involved in the child welfare service system, including changes in symptoms over time. METHODS: Participants (N=2,109) were parents receiving SafeCare, a home visitation intervention provided in a large, diverse child welfare system. Depressive symptoms were assessed with the Centers for Epidemiological Studies Depression Scale at baseline and at approximately every sixth home visit, up to a total of four times. Univariate tests examined the relationship between baseline symptoms, race-ethnicity, and service participation. Latent class growth analyses identified trajectories of depressive symptoms during participation in child welfare services. RESULTS: Participation in services was affected by depressive symptoms. Forty percent of parents did not remain long enough in the program to complete a second CES-D assessment, and those who reported more symptoms at baseline were significantly less likely to do so. Among parents who engaged in services, distinct profiles of depressive symptoms emerged that differed by race-ethnicity. For non-Hispanic Black parents, no changes in depressive symptoms over time were noted, regardless of level of severity at baseline. Parents with the highest levels of symptoms did not improve over time. CONCLUSIONS: Despite receipt of supportive and recovery-oriented services specifically focused on empowering child welfare-involved parents, many experienced elevated depressive symptoms. Integration of child welfare and community mental health systems may improve both service engagement and mental health among child welfare-involved families.

Implementation of a trauma-informed, evidence-informed intervention for Latinx families experiencing interpersonal violence and child maltreatment: protocol for a pilot randomized control trial of SafeCare+®.

BACKGROUND: A consistently demonstrated overlap exists between the occurrence of domestic violence and child maltreatment, yet these issues are historically addressed by distinct systems and programming. The randomized control trial pilot study presented in this article adapts, implements, and tests a new approach for addressing family violence for Latinx families with co-occurring risk for domestic violence and child maltreatment. In doing so, this pilot study addresses the clear need for collaboration between the two fields and focuses on Latinx families, who often face specific challenges regarding seeking and receiving needed services. The primary aim of the current study is a pilot implementation of SafeCare+®, an evidence-based parenting curriculum (SafeCare®) augmented with a healthy relationships curriculum (SafeCare+®). The objectives are a reduction of family violence, improved communication, and a healthy home environment for children in Latinx families with co-occurring domestic violence and child maltreatment. METHODS: This protocol outlines a feasibility, randomized control trial to examine the potential efficacy of SafeCare+. The pilot study is divided into two phases. Components of phase one involve developing a detailed implementation and evaluation plan, including a community needs assessment, determining screening and outcome measures, and assuring all components are culturally appropriate for the target population. Phase two implements the randomization of parents, who are involved in the child welfare system and referred for in-home parenting services, into SafeCare+ or SafeCare as usual. Participants complete assessments regarding mental health, provider-parent relationship, interpersonal violence experiences, and fidelity to the intervention. Analyses will focus on improvement on target outcomes for the intervention group, as well as comparison to the control group. DISCUSSION: This study will provide evidence on the feasibility and potential effectiveness of an early intervention program aimed at improving communication skills and mental health and reducing incidents of violence for Latinx parents who are involved with the child welfare service system. The findings of the study will inform the decision to progress to a full scale, definitive randomized control trial to test the effectiveness of an intervention, delivered as part of home visitation, for improving outcomes for families with histories of domestic violence. TRIAL REGISTRATION: ClinicalTrials.gov, NCT03041558; registered 2 February, 2017-retrospectively registered.

Parent And Caregiver Active Participation Toolkit (PACT): Adaptation for a Home Visitation Program.

OBJECTIVES: Parent engagement poses a persistent challenge to home visitation (HV) programs. Previous work on parent engagement in HV has focused primarily on enrollment, attendance, and retention, with less attention on participation. The purpose of this study was to adapt an engagement toolkit originally developed for child mental health treatment settings, the Parent And Caregiver Active Participation Toolkit (PACT), and test the adapted toolkit in a HV program, SafeCare® (SC), with a focus on parent participation. METHODS: Toolkit adaptation was informed by interviews/focus groups with parents and home visitors. Next, home visitors (n = 6) were trained to use adapted PACT for SC as part of SC delivery to 18 parents. A comparison group included 24 parents who received SC one year prior to this study. Analyses compared PACT for SC participants to the comparison group on parent participation and home visitor fidelity to assignment of homework. Qualitative and quantitative data from parents, home visitors, and supervisors (n = 4) assessed the acceptability, utility, appropriateness, and feasibility of PACT for SC. RESULTS: Parents receiving PACT for SC had higher participation and reported greater home visitor fidelity to homework assignment than comparison parents. Parents found PACT for SC acceptable and useful as part of SC. Home visitors and supervisors identified some limitations in PACT for SC's utility but generally found it to be a positive, feasible addition to HV services. CONCLUSIONS: Results suggest that enhancing HV programs with an engagement toolkit may improve parents' participation in services and providers' assignment of homework between sessions.

"Creative Financing": Funding Evidence-Based Interventions in Human Service Systems.

Implementation and sustainment of evidence-based interventions (EBIs) is influenced by outer (e.g., broader environments in which organizations operate) and inner (e.g., organizations, their administrators, and staff) contexts. One important outer-context element that shapes the inner context is funding, which is complex and unpredictable. There is a dearth of knowledge on how funding arrangements affect sustainment of EBIs in human service systems and the organizations delivering them, including child welfare and behavioral health agencies. This study uses qualitative interview and focus group data with stakeholders at the system, organizational, and provider levels from 11 human service systems in two states to examine how stakeholders strategically negotiate diverse and shifting funding arrangements over time. Study findings indicate that, while diverse funding streams may contribute to flexibility of organizations and possible transformations in the human service delivery environment, a dedicated funding source for EBIs is crucial to their successful implementation and sustainment.

The good coach: implementation and sustainment factors that affect coaching as evidence-based intervention fidelity support.

PURPOSE: Evidence-based interventions (EBIs) for human services unfold within complicated social and organizational circumstances and are influenced by the attitudes and behaviors of diverse stakeholders situated within these environments. Coaching is commonly regarded as an effective strategy to support service providers in delivering EBIs and attaining high levels of fidelity over time. The purpose of this paper is to address a lacuna in research examining the factors influencing coaching, an important EBI support component. METHODOLOGY: The authors use the Exploration, Preparation, Implementation, and Sustainment framework to consider inner- and outer-context factors that affect coaching over time. This case study of coaching draws from a larger qualitative data set from three iterative investigations of implementation and sustainment of a home visitation program, SafeCare®. SafeCare is an EBI designed to reduce child neglect. FINDINGS: The authors elaborate on six major categories of findings derived from an iterative data coding and analysis process: perceptions of "good" and "bad" coaches by system sustainment status; coach as peer; in-house coaching capacity; intervention developer requirements vs other outer-context needs; outer- context support; and inner-context support. PRACTICAL IMPLICATIONS: Coaching is considered a key component for effective implementation of EBIs in public-sector systems, yet is under-studied. Understanding inner- and outer-context factors illuminates the ways they affect the capacity of coaches to support service delivery. ORIGINALITY: This paper demonstrates that coaching can accomplish more than provision of EBI fidelity support. Stakeholders characterized coaches as operating as boundary spanners who link inner and outer contexts to enable EBI implementation and sustainment.

Research-Supported Intervention and Discretion Among Frontline Workers Implementing Home Visitation Services.

OBJECTIVE: We examine how frontline workers and supervisors delivering a research supported intervention (RSI) to reduce child neglect negotiated system-related challenges, the pragmatics of RSI implementation, and their professional identities and relationships with clients. METHODS: We conducted semi-structured interviews, small group discussions, and focus groups with frontline workers and supervisors in one large county over two time periods. We used iterative coding to analyze qualitative data. RESULTS: Frontline workers navigated several aspects of RSI implementation and sustainment: (1) contract requirements and information dissemination, (2) fidelity, (3) competing demands and crises, (4) structure versus creativity, and (5) relationships with clients. CONCLUSIONS: Workers dynamically negotiated multiple system- and provider-level (or outer- and inner-contextual) demands influencing RSI provision for clients with complex service needs. Results affirm the need to attend to the unintended consequences of implementing new contract, reimbursement, and other system organizational processes and to address the "committed work" supporting RSI delivery.

EBT Fidelity Trajectories Across Training Cohorts Using the Interagency Collaborative Team Strategy.

The Interdisciplinary Collaborative Team (ICT) strategy uses front-line providers as adaptation, training and quality control agents for multi-agency EBT implementation. This study tests whether an ICT transmits fidelity to subsequent provider cohorts. SafeCare was implemented by home visitors from multiple community-based agencies contracting with child welfare. Client-reported fidelity trajectories for 5,769 visits, 957 clients and 45 providers were compared using three-level growth models. Provider cohorts trained and live-coached by the ICT attained benchmark fidelity after 12 weeks, and this was sustained. Hispanic clients reported high cultural competency, supporting a cultural adaptation crafted by the ICT.

Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice.

Implementation and scale-up of evidence-based practices (EBPs) is often portrayed as involving multiple stakeholders collaborating harmoniously in the service of a shared vision. In practice, however, collaboration is a more complex process that may involve shared and competing interests and agendas, and negotiation. The present study examined the scale-up of an EBP across an entire service system using the Interagency Collaborative Team approach. Participants were key stakeholders in a large-scale county-wide implementation of an EBP to reduce child neglect, SafeCare. Semistructured interviews and/or focus groups were conducted with 54 individuals representing diverse constituents in the service system, followed by an iterative approach to coding and analysis of transcripts. The study was conceptualized using the Exploration, Preparation, Implementation, and Sustainment framework. Although community stakeholders eventually coalesced around implementation of SafeCare, several challenges affected the implementation process. These challenges included differing organizational cultures, strategies, and approaches to collaboration; competing priorities across levels of leadership; power struggles; and role ambiguity. Each of the factors identified influenced how stakeholders approached the EBP implementation process. System-wide scale-up of EBPs involves multiple stakeholders operating in a nexus of differing agendas, priorities, leadership styles, and negotiation strategies. The term collaboration may oversimplify the multifaceted nature of the scale-up process. Implementation efforts should openly acknowledge and consider this nexus when individual stakeholders and organizations enter into EBP implementation through collaborative processes.

Consistency with evidence-based treatments and perceived effectiveness of children's community-based care.

This study examined whether delivery of psychotherapeutic strategies consistent with common elements of evidence-based (EB) treatments for child disruptive behavior problems was associated with parents' report of treatment effectiveness. The intensity of delivery of practice elements consistent with EB treatments was coded from a random sample of 538 videotaped psychotherapy sessions with 157 children/families and 75 therapists from six community-based clinics. Multilevel regression analyses tested whether intensity of EB practice elements was associated with parents' report of treatment effectiveness after 4 months, controlling for intensity of other practice elements. Results indicate parents reported greater perceived treatment effectiveness when community-based treatment included more intensive delivery of practice elements consistent with EB treatments to children. These findings may reassure providers about the acceptability of EB practice elements and may motivate efforts to integrate EB practice elements more intensively into community-based care.

Interagency Collaborative Team Model for Capacity Building to Scale-Up Evidence-Based Practice.

BACKGROUND: System-wide scale up of evidence-based practice (EBP) is a complex process. Yet, few strategic approaches exist to support EBP implementation and sustainment across a service system. Building on the Exploration, Preparation, Implementation, and Sustainment (EPIS) implementation framework, we developed and are testing the Interagency Collaborative Team (ICT) process model to implement an evidence-based child neglect intervention (i.e., SafeCare®) within a large children's service system. The ICT model emphasizes the role of local agency collaborations in creating structural supports for successful implementation. METHODS: We describe the ICT model and present preliminary qualitative results from use of the implementation model in one large scale EBP implementation. Qualitative interviews were conducted to assess challenges in building system, organization, and home visitor collaboration and capacity to implement the EBP. Data collection and analysis centered on EBP implementation issues, as well as the experiences of home visitors under the ICT model. RESULTS: Six notable issues relating to implementation process emerged from participant interviews, including: (a) initial commitment and collaboration among stakeholders, (b) leadership, (c) communication, (d) practice fit with local context, (e) ongoing negotiation and problem solving, and (f) early successes. These issues highlight strengths and areas for development in the ICT model. CONCLUSIONS: Use of the ICT model led to sustained and widespread use of SafeCare in one large county. Although some aspects of the implementation model may benefit from enhancement, qualitative findings suggest that the ICT process generates strong structural supports for implementation and creates conditions in which tensions between EBP structure and local contextual variations can be resolved in ways that support the expansion and maintenance of an EBP while preserving potential for public health benefit.

Higher rates of adolescent substance use in child welfare versus community populations in the United States.

OBJECTIVE: Youth substance use exacts costly consequences for a variety of important health outcomes. We examined and compared prevalence rates and a common set of psychosocial factors of lifetime and current substance use among child welfare-involved youths and community youths from two nationally representative data sets. METHOD: Using the National Survey of Child and Adolescent Well-Being and the National Longitudinal Study of Adolescent Health, we compared prevalence rates and conducted logistic regression models for eight binary outcome measures of substance use: lifetime and current use of alcohol, inhalant, marijuana, and other illicit drugs to examine predictors of substance involvement in the two samples. RESULTS: Substance use prevalence was higher among child welfare-involved youths than community youths for lifetime marijuana use, lifetime and current inhalant use, and lifetime and current other illicit drug use. Among both child welfare-involved and community youths, delinquency was the factor most strongly associated with all lifetime substance use outcomes. Notably, family structure and parental closeness were important protective factors against current substance use among child welfare-involved youths. For community youths, poorer emotional health was the strongest indicator of current substance use. CONCLUSIONS: Substance use among all adolescents is a critical public health concern. Given the heightened vulnerability of child welfare-involved youths, it is particularly important to focus prevention and early intervention efforts on this population. Further research should explore additional factors associated with substance use among these youths so that child welfare and behavioral health systems may jointly target prevention and intervention efforts.

A concept mapping approach to guide and understand dissemination and implementation.

Many efforts to implement evidence-based programs do not reach their full potential or fail due to the variety of challenges inherent in dissemination and implementation. This article describes the use of concept mapping-a mixed method strategy-to study implementation of behavioral health innovations and evidence-based practice (EBP). The application of concept mapping to implementation research represents a practical and concise way to identify and quantify factors affecting implementation, develop conceptual models of implementation, target areas to address as part of implementation readiness and active implementation, and foster communication among stakeholders. Concept mapping is described and a case example is provided to illustrate its use in an implementation study. Implications for the use of concept mapping methods in both research and applied settings towards the dissemination and implementation of behavioral health services are discussed.

Therapist Focus on Parent Involvement in Community-Based Youth Psychotherapy.

Parent involvement in the treatment of childhood disruptive behavior problems is a critical component of effective care. Yet little is known about the amount of time therapists are involving parents in treatment and factors that predict therapists' efforts to involve parents in routine care. The purpose of this study is to examine therapists' within-session involvement of parents in community-based outpatient mental health treatment. The data are from a larger longitudinal observational study of psychotherapy for children ages 4-13 with disruptive behavior problems and include videotaped psychotherapy sessions coded for the therapeutic strategies delivered as well as measures of child, parent/family, and therapist characteristics at baseline. Parent involvement is defined as the proportion of time in the session that therapists direct treatment strategies towards parents. Results indicated that therapists directed treatment strategies towards parents an average of 44% of the time within a session. Multilevel modeling was used to examine client-level (child, parent, and family functioning) and provider-level (therapist experience and background) predictors of parent involvement. Therapists involved parents more when the child had higher levels of behavior problems, when the parent reported higher levels of internalized caregiver strain, and when the therapist was more experienced. The results highlight potential areas to target in efforts to increase parent involvement, including training less experienced therapists to increase their focus on directing strategies towards parents.

Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services.

Many public sector service systems and provider organizations are in some phase of learning about or implementing evidence-based interventions. Child welfare service systems represent a context where implementation spans system, management, and organizational concerns. Research utilizing mixed methods that combine qualitative and quantitative design, data collection, and analytic approaches are particularly well suited to understanding both the process and outcomes of dissemination and implementation efforts in child welfare systems. This article describes the process of using mixed methods in implementation research and provides an applied example of an examination of factors impacting staff retention during an evidence-based intervention implementation in a statewide child welfare system. The authors integrate qualitative data with previously published quantitative analyses of job autonomy and staff turnover during this statewide implementation project in order to illustrate the utility of mixed method approaches in providing a more comprehensive understanding of opportunities and challenges in implementation research.

Smoking behavior of US youths: a comparison between child welfare system and community populations.

OBJECTIVES: We compared rates of smoking for 2 groups of youths aged 12 to 14 years: those involved in the child welfare system (CW) and their counterparts in the community population. We then investigated factors associated with smoking for each group. METHODS: We drew data from 2 national-level US sources: the National Survey of Child and Adolescent Well-Being and the National Longitudinal Study of Adolescent Health. We estimated logistic regression models for 3 binary outcome measures of smoking behavior: lifetime, current, and regular smoking. RESULTS: CW-involved youths had significantly higher rates of lifetime smoking (43% vs 32%) and current smoking (23% vs 18%) than did youths in the community population. For CW-involved youths, delinquency and smoking were strongly linked. Among youths in the community population, multiple factors, including youth demographics and emotional and behavioral health, affected smoking behavior. CONCLUSIONS: Smoking prevalence was notably higher among CW-involved youths than among the community population. In light of the persistent public health impact of smoking, more attention should be focused on identification of risk factors for prevention and early intervention efforts among the CW-involved population.

Prevalence of maltreatment among youths in public sectors of care.

Few studies have investigated the prevalence of maltreatment among youths in public sectors of care despite the critical public health concern and the burden of suffering on such youths. The current study examined the prevalence of multiple types of maltreatment across five public sectors of care. Youths aged 11-18 (n = 1,135) enrolled in one of five public sectors of care reported on their maltreatment history using the Childhood Trauma Questionnaire. Across all sectors, 78% of youth reported experiencing at least moderate levels of maltreatment with the majority (58%) reporting multiple types of maltreatment. The prevalence of maltreatment was highest for youths involved in the alcohol/drug (86%) and child welfare (85%) sectors, and lowest in the serious emotional disturbance sector (72%). Logistic regressions were conducted to examine differences in the likelihood of multiple types of maltreatment by sector affiliation, controlling for the effects of gender, race/ethnicity, and age. The results indicate that rates of maltreatment across sectors do not differ greatly from those in child welfare. The high incidence of maltreatment across all sectors, not solely child welfare, indicates that all youth in public sectors of care should be screened for a history of maltreatment when they enter into care.

Implementing evidence-based practice in community mental health agencies: a multiple stakeholder analysis.

OBJECTIVES: We sought to identify factors believed to facilitate or hinder evidence-based practice (EBP) implementation in public mental health service systems as a step in developing theory to be tested in future studies. METHODS: Focusing across levels of an entire large public sector mental health service system for youths, we engaged participants from 6 stakeholder groups: county officials, agency directors, program managers, clinical staff, administrative staff, and consumers. RESULTS: Participants generated 105 unique statements identifying implementation barriers and facilitators. Participants rated each statement on importance and changeability (i.e., the degree to which each barrier or facilitator is considered changeable). Data analyses distilled statements into 14 factors or dimensions. Descriptive analyses suggest that perceptions of importance and changeability varied across stakeholder groups. CONCLUSIONS: Implementation of EBP is a complex process. Cross-system-level approaches are needed to bring divergent and convergent perspectives to light. Examples include agency and program directors facilitating EBP implementation by supporting staff, actively sharing information with policymakers and administrators about EBP effectiveness and fit with clients' needs and preferences, and helping clinicians to present and deliver EBPs and address consumer concerns.

Evidence-based practice implementation and staff emotional exhaustion in children's services.

Understanding the implementation of evidence-based practice (EBP) in community service settings is critical for the successful translation of research to practice. However, we have limited research evidence about the impact of EBP implementation on the mental health and social service workforce. In a previous study we demonstrated reduced staff turnover where an EBP was implemented with fidelity monitoring in the form of supportive ongoing supervision and consultation. Other research has shown that staff burnout and emotional exhaustion in particular is associated with poor quality of care and increased staff turnover intentions and turnover. Current research, however, has focused less on the effects that EBP implementation may have on staff emotional exhaustion. The present study investigates the association of EBP implementation and fidelity monitoring with staff emotional exhaustion in a statewide EBP implementation study. The 21 case-management teams in this study were randomized in a 2 (EBP vs. services as usual [SAU]) by 2 (monitoring vs. no monitoring) design. The EBP in this study was SafeCare, a home-based intervention that aims to reduce child neglect in at-risk families. SafeCare was developed from a behavior analysis approach and is based in cognitive behavioral principles. In keeping with our previous research, we hypothesized that providers implementing SafeCare with monitoring would have the lowest levels of emotional exhaustion and those receiving additional monitoring not in the context of EBP implementation would have higher emotional exhaustion relative to the other groups. Results supported our hypotheses in that we found lower emotional exhaustion for staff implementing the EBP but higher emotional exhaustion for staff receiving only fidelity monitoring and providing SAU. Together, these results suggest a potential staff and organizational benefit to EBP implementation and we discuss implications of the findings relative to EBPs and to fidelity monitoring.