Examining utility and impact of social, emotional, and behavioral screening to identify and address needs.

Along with increased attention to universal screening for identifying social, emotional, and behavioral (SEB) concerns is the need to ensure the psychometric adequacy of tools available. Nearly all extant tests of universal SEB screening validity focus on traditional inferential forms with little to no study of the consequences of actions following those inferences, or consequential validity proposed under Messick's unified validity theory. This study examines one facet of consequential validity (i.e., utility) of results from one popular screening tool in six elementary schools in one large U.S. district. The schools identified students who were receiving SEB supports on a monthly form throughout one school year. Screening identified 991 students with SEB risk, of which 91 (9%) were receiving intervention prior to screening. After screening, schools provided intervention to an additional 66 students (7%). Unaddressed SEB risk remained after screening for 84% of screener-identified students. Latent profile analyses detected five patterns of risk with those students demonstrating the most risk and predominately externalizing concerns being most likely to receive intervention after screening. Study schools also provided intervention to students with elevated low risk after screening, but this profile was the largest group leaving 708 students with unaddressed SEB risk after screening. Results provide evidence of universal SEB screening interpretation to identify unaddressed SEB risk but insufficient use to provide intervention services at a rate that substantially reduced unaddressed SEB risk. Future research and practice directions for advancing the consequential validity of universal SEB screening are recommended and measurement limitations discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A randomized controlled trial on the interconnected systems framework for school mental health and PBIS: Focus on proximal variables and school discipline.

This study reviews findings for the first randomized controlled trial (RCT) on the Interconnected Systems Framework (ISF) for school mental health (SMH) and Positive Behavioral Interventions and Supports (PBIS). Since its development in the late 2000s, the ISF has been supported by federally funded centers for SMH and PBIS, and, guided by a national workgroup, is being implemented in >50 communities in the United States. This experimental evaluation of the ISF involved an RCT implemented in 24 schools in two southeastern states, with the ISF implemented in eight schools, PBIS alone implemented in eight schools, and typically co-located PBIS+SMH implemented in eight schools. Related to very poor implementation, documented by two sources of fidelity data, two ISF schools were dropped from major analyses; hence, the study used a treatment on the treated (ToT; Rubin, 1974) as compared to a more traditional Intent-to-Treat approach (ITT; Lachin, 2000). This is the first paper from this large study, with emphasis here on proximal variables and school discipline. Within schools' multi-tiered systems of support (MTSS), ISF schools delivered more Tier 2 (early intervention) and Tier 3 (treatment) interventions to a greater proportion of students than the other two conditions by the second year of the intervention. There was also a dramatic difference in the provision of interventions by community mental health clinicians in ISF schools (almost half of interventions delivered) as compared to PBIS+SMH schools (around 3% of interventions delivered), underscoring the critical role of the ISF in integrating clinicians into MTSS teams and core school functions in SMH. As compared to the other two conditions, ISF schools also had reduced office discipline referrals (ODRs) and in-school suspensions, as well as reduced ODRs and out-of-school suspensions for African American students. Findings are discussed in relation to future directions of education-mental health system partnerships in improving the delivery and impact of SMH programs and services, demonstrated in the ISF.

Using readiness to understand implementation challenges in school mental health research.

Schools and research partners are increasingly implementing complex, multicomponent interventions and school-wide frameworks to better meet students' social, emotional, behavioral, and academic needs; however, in the research and real-world contexts, implementation is often fraught with many challenges and barriers to success. This study explores implementation barriers encountered during a randomized controlled trial testing effects of one complex intervention strategy-the Interconnected Systems Framework-from the lens of a practical model for conceptualizing organizational readiness-the Interactive Systems Framework for Dissemination and Implementation. Implementation of the Interconnected Systems Framework was explored via focus group and key informant interviews with school and mental health professionals, and research team members responsible for implementing the intervention in randomly assigned study schools. Results from inductive thematic analysis of verbatim transcripts identified three primary implementation challenges: staff turnover, inadequate leadership buy-in, and insufficient time for training/planning. Each challenge is explored from interview participants' perspectives and the extant literature, then connected to recommendations from implementation science to help others avoid similar challenges in their well-intentioned efforts to address the mounting concern for students' wellbeing.

Between-teacher variance of students' teacher-rated risk for emotional, behavioral, and adaptive functioning.

As schools increasingly adopt universal social, emotional, and behavioral screening, more research is needed to examine the effects of between-teacher differences due to error and bias on students' teacher-rated screening scores. The current study examined predictors of between-teacher differences in students' teacher-rated risk across one global and three narrow domains of behavioral functioning. Participants included 2450 students (52.1% male, 54.2% White) and 160 teachers (92.1% female, 80.3% White) from four elementary schools in one Southeastern U.S. school district. Teachers rated student behavior on the Behavior Assessment System for Children (Third Edition) Behavioral and Emotional Screening System (BESS)-Teacher Form and completed a survey about their training and perspectives of common behavior problems. Results of multilevel linear regression found between-teacher effects to be greater for internalizing risk scores (intraclass correlation = 0.23) than for externalizing risk scores (intraclass correlation = 0.12) or adaptive behavior scores (intraclass correlation = 0.14). Statistically significant student predictors in most models included student grade, gender, race and/or ethnicity, office discipline referrals, and course grades. We also detected effects of several teacher-level variables in one or more of the models, including teacher gender, teacher ratings of problem severity and concern for hypothetical children displaying behavior problems, and the covariance of random teacher intercept and teacher random slopes for students' office discipline referrals. Although these factors explained some teacher-level variance in students' risk scores, a notable amount of variance between teachers remains unexplained. Future research is needed to fully understand, reduce, and account for differences between teacher ratings due to error and bias.

Preliminary development and validation of the Interconnected Systems Framework-Implementation Inventory (ISF-II).

As schools increasingly implement multitiered systems of support, there is a pressing need to develop psychometrically sound implementation fidelity measures. The interconnected systems framework (ISF) is a multitiered model blending systems of positive behavioral interventions and supports with promotion, prevention, and intervention strategies of school mental health. The ISF is being implemented in communities across the United States with ongoing evaluation in several randomized controlled trials. The ISF-Implementation Inventory (ISF-II) was developed to measure fidelity of the ISF within a school building. We conducted a national validation study including completion of the ISF-II by 398 educators in 49 schools, 16 school districts, and 9 states. Results indicate the ISF-II produces scores that are internally consistent and structurally valid when items are organized into a three-tiered model. Additionally, the ISF-II was rated as feasible, acceptable, and beneficial. Limitations of the study, including the need for additional psychometric testing, are discussed in light of these results that suggest educators and researchers, alike, should feel confident in using the ISF-II as a measure of ISF implementation quality. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Student, teacher, and classroom predictors of between-teacher variance of students' teacher-rated behavior.

The current study examined between-teacher variance in teacher ratings of student behavioral and emotional risk to identify student, teacher and classroom characteristics that predict such differences and can be considered in future research and practice. Data were taken from seven elementary schools in one school district implementing universal screening, including 1,241 students rated by 68 teachers. Students were mostly African America (68.5%) with equal gender (female 50.1%) and grade-level distributions. Teachers, mostly White (76.5%) and female (89.7%), completed both a background survey regarding their professional experiences and demographic characteristics and the Behavior Assessment System for Children (Second Edition) Behavioral and Emotional Screening System-Teacher Form for all students in their class, rating an average of 17.69 students each. Extant student data were provided by the district. Analyses followed multilevel linear model stepwise model-building procedures. We detected a significant amount of variance in teachers' ratings of students' behavioral and emotional risk at both student and teacher/classroom levels with student predictors explaining about 39% of student-level variance and teacher/classroom predictors explaining about 20% of between-teacher differences. The final model fit the data (Akaike information criterion = 8,687.709; pseudo-R2 = 0.544) significantly better than the null model (Akaike information criterion = 9,457.160). Significant predictors included student gender, race ethnicity, academic performance and disciplinary incidents, teacher gender, student-teacher gender interaction, teacher professional development in behavior screening, and classroom academic performance. Future research and practice should interpret teacher-rated universal screening of students' behavioral and emotional risk with consideration of the between-teacher variance unrelated to student behavior detected. (PsycINFO Database Record

Exploring the impact of a pre-service interprofessional educational intervention for school mental health trainees.

With collaborative interprofessional teams integral to school mental health (SMH) service delivery, pre-service educational strategies are needed to promote interprofessional collaboration among SMH trainees. The current study evaluated the effectiveness, feasibility, and acceptability of a pre-service, interprofessional SMH educational intervention focused on promoting the cross-disciplinary competencies essential for SMH practice. Eight SMH trainees participated in the study. Using a mixed-method design, quantitative pre/post competency data were collected via trainee self-report. Qualitative data were collected through a focus group and reflection journals. Results indicate that the intervention promoted competency in all areas, with significant growth in the provision of learning supports to youth. Key factors influencing intervention feasibility included time/scheduling, changing school team composition, and project coordination. Trainees' perceptions of the educational intervention were related to buy-in, clinical experience, and role flexibility. Implications for the design of pre-service interprofessional SMH education strategies are discussed.