Development of an Online Training Platform and Implementation Strategy for School-Based Mental Health Professionals in Rural Elementary Schools: A Mixed-Methods Study.

Children in rural settings are less likely to receive mental health services than their urban and suburban counterparts and even less likely to receive evidence-based care. Rural schools could address the need for mental health interventions by using evidence-based practices within a tiered system of supports such as positive behavioral interventions and supports. However, very few school professionals, with or without mental health training, have received training on evidence-based practices. Rural schools need implementation strategies focused on training to prepare school personnel for the implementation of interventions with fidelity. Little is known about training strategies that are feasible and appropriate for the rural school context. User-centered design is an appropriate framework for the development of training strategies for professionals in rural schools because of its participatory approach and the development of products that fit the context where they are going to be used. The purpose of the study was to develop and assess components of an online training platform and implementation strategy based on the user-centered design. Quantitative and qualitative data from 25 participants from an equal number of schools in rural areas of Pennsylvania were used in the study. A mixed-methods design utilizing complementary descriptive statistics and theme analyses indicated that the training platform and implementation strategy were perceived as highly acceptable, appropriate, feasible and usable by school professionals. The resulting training platform and implementation strategy will fill a void in the training literature in rural schools.

Development and evaluation of a remote training strategy for the implementation of mental health evidence-based practices in rural schools: pilot study protocol.

BACKGROUND: An increasing number of schools in rural settings are implementing multi-tier positive behavioral interventions and supports (PBIS) to address school-climate problems. PBIS can be used to provide the framework for the implementation of evidence-based practices (EBPs) to address children's mental health concerns. Given the large service disparities for children in rural areas, offering EBPs through PBIS can improve access and lead to better long-term outcomes. A key challenge is that school personnel need technical assistance in order to implement EBPs with fidelity and clinical effectiveness. Providing ongoing on-site support is not feasible or sustainable in the majority of rural schools, due to their remote physical location. For this reason, remote training technology has been recommended for providing technical assistance to behavioral health staff (BHS) in under-served rural communities. OBJECTIVES: The purpose of this study is to use the user-centered design, guided by an iterative process (rapid prototyping), to develop and evaluate the appropriateness, feasibility, acceptability, usability, and preliminary student outcomes of two online training strategies for the implementation of EBPs at PBIS Tier 2. METHODS: The study will employ a pragmatic design comprised of a mixed-methods approach for the development of the training platform, and a hybrid type 2, pilot randomized controlled trial to examine the implementation and student outcomes of two training strategies: Remote Video vs. Remote Video plus Coaching. DISCUSSION: There is a clear need for well-designed remote training studies focused on training in non-traditional settings. Given the lack of well-trained mental health professionals in rural settings and the stark disparities in access to services, the development and pilot-testing of a remote training strategy for BHS in under-served rural schools could have a significant public health impact. ETHICS AND DISSEMINATION: The project was reviewed and approved by the institutional review board. Results will be submitted to ClinicalTrials.gov and disseminated to community partners and participants, peer-reviewed journals, and academic conferences. TRIAL REGISTRATION: ClinicialTrials.gov, NCT05034198 and NCT05039164.

Study protocol: cluster randomized trial of consultation strategies for the sustainment of mental health interventions in under-resourced urban schools: rationale, design, and methods.

BACKGROUND: The school is a key setting for the provision of mental health services to children, particularly those underserved through traditional service delivery systems. School-wide Positive Behavioral Interventions and Supports (PBIS) is a tiered approach to service delivery based on the public health model that schools use to implement universal (Tier 1) supports to improve school climate and safety. As our prior research has demonstrated, PBIS is a useful vehicle for implementing mental and behavioral health evidence-based practices (EBPs) at Tier 2 for children with, or at risk for, mental health disorders. Very little research has been conducted regarding the use of mental health EBPs at Tier 2 or how to sustain implementation in schools. METHODS/DESIGN: The main aim of the study is to compare fidelity, penetration, cost-effectiveness, and student outcomes of Tier 2 mental health interventions across 2 sustainment approaches for school implementers in 12 K-8 schools. The study uses a 2-arm, cluster randomized controlled trial design. The two arms are: (a) Preparing for Sustainment (PS)-a consultation strategy implemented by school district coaches who receive support from external consultants, and (b) Sustainment as Usual (SAU)-a consultation strategy implemented by school district coaches alone. Participants will be 60 implementers and 360 students at risk for externalizing and anxiety disorders. The interventions implemented by school personnel are: Coping Power Program (CPP) for externalizing disorders, CBT for Anxiety Treatment in Schools (CATS) for anxiety disorders, and Check-in/Check-out (CICO) for externalizing and internalizing disorders. The Interactive Systems Framework (ISF) for Dissemination and Implementation guides the training and support procedures for implementers. DISCUSSION: We expect that this study will result in a feasible, effective, and cost-effective strategy for sustaining mental health EBPs that is embedded within a multi-tiered system of support. Results from this study conducted in a large urban school district would likely generalize to other large, urban districts and have an impact on population-level child mental health. Trial registration ClinicalTrials.gov identifier number NCT04869657. Registered May 3, 2021.

Implementation of targeted mental health interventions in urban schools: Preliminary findings for impact of training strategy on program fidelity.

School-based mental health programs are increasingly recognized as methods by which to improve children's access to evidence-based practices (EBPs), particularly in urban under resourced communities. School-wide positive behavior interventions and supports (PBIS) is one approach to integrating mental health services into school-based programming; however, school providers require training and support to implement programs as intended. We have conducted a randomized controlled trial to compare two models for training school-based personnel to deliver group EBPs to children at high risk of developing internalizing or externalizing problems. School personnel (N = 24) from 6 schools in a large urban school district were trained with either a basic training and consultation strategy, or an enhanced training and consultation strategy. Preliminary findings show that the enhanced strategy resulted in 9% higher content fidelity than the basic strategy. School personnel who were switched to the basic strategy had slightly lower content fidelity for the last two years of the trial and school personnel who continued to receive basic consultation during the step-down phase saw their fidelity decline. The two conditions did not differ with regard to process fidelity.

Pilot Study for the Fidelity, Acceptability and Effectiveness of a PBIS Program plus Mental Health Supports in Under-resourced Urban Schools.

This paper describes implementation (fidelity, perceived acceptability) and tier 1 and tier 2 outcomes of a school-wide positive behavior interventions and supports approach (PBIS) including mental health supports at tier 2 in two K-8 urban schools. Interventions for tier 2 consisted of three manualized group cognitive behavioral therapy (GCBT) protocols for externalizing behavior problems, depression and anxiety. tier 1 and tier 2 interventions were implemented with fidelity but program feasibility for tier 2 was in question because school personnel needed a great deal of external support in order to implement the interventions. tier 1 interventions were associated with a decrease in office discipline referrals. Students participating in GCBT showed a significant decrease in mental health diagnostic severity at post-treatment. A discussion of perceived and actual implementation barriers and how they were addressed is provided. Implications for practice in low-income urban schools are discussed.

Group CBT for Externalizing Disorders in Urban Schools: Effect of Training Strategy on Treatment Fidelity and Child Outcomes.

Public schools are an ideal setting for the delivery of mental health services to children. Unfortunately, services provided in schools, and more so in urban schools, have been found to lead to little or no significant clinical improvements. Studies with urban school children seldom report on the effects of clinician training on treatment fidelity and child outcomes. This study examines the differential effects of two levels of school-based counselor training: training workshop with basic consultation (C) vs. training workshop plus enhanced consultation (C+) on treatment fidelity and child outcomes. Fourteen school staff members (counselors) were randomly assigned to C or C+. Counselors implemented a group cognitive behavioral therapy protocol (Coping Power Program, CPP) for children with or at risk for externalizing behavior disorders. Independent coders coded each CPP session for content and process fidelity. Changes in outcomes from pre to post were assessed via a parent psychiatric interview and interviewer-rated severity of illness and global impairment. Counselors in C+ delivered CPP with significantly higher levels of content and process fidelity compared to counselors in C. Both C and C+ resulted in significant improvement in interviewer-rated impairment; the conditions did not differ from each other with regard to impairment. Groups did not differ with regard to pre- to- posttreatment changes in diagnostic severity level. School-based behavioral health staff in urban schools are able to implement interventions with fidelity and clinical effectiveness when provided with ongoing consultation. Enhanced consultation resulted in higher fidelity. Enhanced consultation did not result in better student outcomes compared to basic consultation. Implications for resource allocation decisions with staff training in EBP are discussed.

Examining Effectiveness of Group Cognitive-Behavioral Therapy for Externalizing and Internalizing Disorders in Urban Schools.

This article presents outcome data of the implementation of three group cognitive-behavioral therapy (GCBT) interventions for children with externalizing behavior problems, anxiety, and depression. School counselors and graduate students co-led the groups in two low-income urban schools. Data were analyzed to assess pre-treatment to post-treatment changes in diagnostic severity level. Results of the exploratory study indicated that all three GCBT protocols were effective at reducing diagnostic severity level for children who had a primary diagnosis of an externalizing disorder, anxiety disorder, or depressive disorder at the clinical or intermediate (at-risk) level. All three GCBT protocols were implemented with relatively high levels of fidelity. Data on the effectiveness of the interventions for reducing diagnostic severity level for externalizing and internalizing spectrum disorders and for specific disorders are presented. A discussion of implementation of mental health evidence-based interventions in urban schools is provided.

A cluster randomized trial to evaluate external support for the implementation of positive behavioral interventions and supports by school personnel.

BACKGROUND: Urban schools lag behind non-urban schools in attending to the behavioral health needs of their students. This is especially evident with regard to the level of use of evidence-based interventions with school children. Increased used of evidence-based interventions in urban schools would contribute to reducing mental health services disparities in low-income communities. School-wide positive behavioral interventions and supports (SWPBIS) is a service delivery framework that can be used to deliver universal preventive interventions and evidence-based behavioral health treatments, such as group cognitive behavioral therapy. In this article, we describe our ongoing research on creating internal capacity for program implementation. We also examine the cost-effectiveness and resulting school climate when two different levels of external support are provided to personnel as they implement a two-tier SWPBIS program. METHODS/DESIGN: The study follows six K - 8 schools in the School District of Philadelphia randomly assigned to consultation support or consultation-plus-coaching support. Participants are: approximately 48 leadership team members, 180 school staff and 3,900 students in Tier 1, and 12 counselors, and 306 child participants in Tier 2. Children who meet inclusion criteria for Tier 2 will participate in group cognitive behavioral therapy for externalizing or anxiety disorders. The study has three phases, baseline/training, implementation, and sustainability. We will measure implementation outcomes, service outcomes, child outcomes, and cost. DISCUSSION: Findings from this study will provide evidence as to the appropriateness of school-wide prevention and treatment service delivery models for addressing services disparities in schools. The effectiveness and cost-effectiveness analyses of the two levels of training and consultation should help urban school districts and policymakers with the planning and deployment of cost-effective strategies for the implementation of evidence-based interventions for some of the most common behavioral health problems in school children. TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT01941069.