Universal screening for social-emotional and behavioral risk: Differential item functioning on the SAEBRS.

Universal screening for social-emotional and behavioral (SEB) risk is one strategy for schools to proactively identify students in need of additional supports and services. As schools serve an increasing number of children from racially and culturally diverse backgrounds, further research is needed to examine the differential functioning of brief behavior rating scales. The present study examined differential item functioning (DIF) on the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS)-Teacher Rating Scale. Participants included 11,496 kindergartens through 12th-grade students. DIF analyses were conducted by race/ethnicity, grade level, and biological sex. Results indicated small-to-large effects of DIF for teacher ratings of Black students compared to their non-Black peers on each item resulting in a moderate effect at the test level (Total Behavior [TB] expected test score standardized difference [ETSSD] = -0.67). There was a small-to-moderate effect of DIF for teacher ratings of White students compared to their non-White peers at the test level (TB ETSSD = 0.43). There was a small-to-moderate effect of DIF by biological sex, with teachers rating males differentially with high risk (TB ETSSD = -0.47). There were no significant effects at the test level for differences in ratings by grade level. Future research is needed to identify the factors influencing the interaction between the rater, the student, and the rating scale that could lead to resulting differential functioning. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A roadmap to equitable school mental health screening.

Youth in the United States are experiencing mental health concerns at alarming rates. Considering the nation's legacy of racism and growing recognition of the impact of social determinants of health on educational and mental health inequities, it is imperative to re-envision how we approach mental health screening in schools to center equity. A focus on mental health screening for the sole purpose of identifying individual at-risk students ignores key contextual considerations, is ineffective in addressing health and educational inequities, and has the potential to perpetuate oppressive practices in schools. Equity-focused mental health screening requires a shift from individual- and deficit-focused approaches to systems- and holistic-focused approaches that (a) identify strengths and stressors among individuals, groups, and communities; (b) dismantle structural forms of oppression; and (c) promote positive mental health outcomes for minoritized youth. Integrating recommendations from the educational equity literature and critical school mental health frameworks, this paper identifies core considerations for equitable school mental health screening and provides guiding principles for each phase of the screening process, from screening readiness to execution to follow up. To implement these recommendations and transform school-based mental health care, schools should (a) incorporate multiple perspectives; (b) prioritize student, family, and community voices; and (c) build collaborative partnerships to co-construct a vision for equitable school mental health.

Intervention selection profile-function: An examination of decisional accuracy relative to traditional FBA data.

The purpose of this study was to examine the accuracy of function-based decisions made in consideration of scores from the Intervention Selection Profile-Function (ISP-Function), a tool founded upon direct behavior rating (DBR) methodology. The ISP-Function is designed to be a brief measure, given the need for efficient and low-resource assessments in schools. Data from a previous investigation were used to create data reports for each of 34 elementary students with a history of exhibiting disruptive behavior in the classroom. The first report summarized ISP-Function data that the student's classroom teacher collected. The second report was representative of more typical functional behavior assessment (FBA), summarizing data collected via a functional assessment interview with the teacher, as well as systematic direct observation data. Nine school psychologists conducted blind reviews of these reports and derived decisions regarding the function of each student's behavior (e.g., adult attention or escape/avoidance). Gwet's agreement coefficients were statistically significant and suggested fair to almost perfect correspondence between ISP-Function and FBA reports. Limitations and implications for practice are discussed herein. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Development and validation of the Intervention Skills Profile-Skills: A brief measure of student social-emotional and academic enabling skills.

The purpose of this study was to support the development and initial validation of the Intervention Selection Profile (ISP)-Skills, a brief 14-item teacher rating scale intended to inform the selection and delivery of instructional interventions at Tier 2. Teacher participants (n = 196) rated five students from their classroom across four measures (total student n = 877). These measures included the ISP-Skills and three criterion tools: Social Skills Improvement System (SSIS), Devereux Student Strengths Assessment (DESSA), and Academic Competence Evaluation Scales (ACES). Diagnostic classification modeling (DCM) suggested an expert-created Q-matrix, which specified relations between ISP-Skills items and hypothesized latent attributes, provided good fit to item data. DCM also indicated ISP-Skills items functioned as intended, with the magnitude of item ratings corresponding to the model-implied probability of attribute mastery. DCM was then used to generate skill profiles for each student, which included scores representing the probability of students mastering each of eight skills. Correlational analyses revealed large convergent relations between ISP-Skills probability scores and theoretically-aligned subscales from the criterion measures. Discriminant validity was not supported, as ISP-Skills scores were also highly related to all other criterion subscales. Receiver operating characteristic (ROC) curve analyses informed the selection of cut scores from each ISP-Skills scale. Review of classification accuracy statistics associated with these cut scores (e.g., sensitivity and specificity) suggested they reliably differentiated students with below average, average, and above average skills. Implications for practice and directions for future research are discussed, including those related to the examination of ISP-Skills treatment utility.

The landscape of advocacy in public schools: The role of school psychologists.

Advocacy has been a core function and expectation of school psychologists for over 40 years. However, there is little empirical research and guidance around the role and function of a school psychologist as an advocate within public schools. Advocacy can include speaking up on matters that promote student well-being at both the individual student level and the broader systems level. The current article seeks to provide guidance to school psychologists as to the various levels of advocacy and how school psychologists can promote both individual- and systems-level advocacy. This includes a careful examination of relevant case studies to address barriers in order to help public service professionals increase advocacy efforts. Finally, calls to action are provided to inspire and strengthen school psychologists who want to impact change at the student and systems level. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Reliability, validity, and accuracy of the intervention selection profile-Function: A brief functional assessment tool.

The purpose of this study was to evaluate the reliability, validity, and accuracy of scores from the Intervention Selection Profile-Function (ISP-Function): a brief functional assessment tool founded upon Direct Behavior Rating (DBR) methodology. Participants included 34 teacher-student dyads. Using the ISP-Function, teachers rated the extent to which students exhibited disruptive behavior, as well as the frequency with which disruptions were met with four consequences. Ratings were completed across three 10-min sessions, during which a research assistant also collected systematic direct observation (SDO) data regarding the same behavior and consequences. Results indicated adequate temporal reliability (≥.70) was attained for the adult attention and peer attention targets across the three ratings; in contrast, up to 8-18 data points would be needed to achieve adequate reliability across the remaining targets. Findings further suggested that while ISP-Function ratings of disruptive behavior, adult attention, and peer attention were moderately to highly correlated with SDO data, correlations were in the low range for the access to items/activities and escape/avoidance targets. Finally, analysis of difference scores showed that on average, mean ISP-Function scores fell within only 0.33 to 1.81 points of mean SDO scores (on the 0-10 DBR scale). Agreement coefficients indicative of exact score agreement were less consistent, suggesting accuracy ranged from poor to substantial. Results are promising, but future research is necessary to support applied ISP-Function use. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Co-occurrence of academic and behavioral risk within elementary schools: Implications for universal screening practices.

The purposes of this study were twofold. The first was to use latent class analysis to identify groupings of students defined by the presence or absence of academic or behavioral risk. The second was to determine whether these groups differed across various dichotomous academic and behavioral outcomes (e.g., suspensions, office discipline referrals, statewide achievement test failure). Students (N = 1,488) were sampled from Grades 3-5. All students were screened for academic risk using AIMSweb Reading Curriculum-Based Measure and AIMSweb Mathematics Computation, and behavioral risk using the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS). Latent class analyses supported the fit of a three-class model, with resulting student classes defined as low-risk academic and behavior (Class 1), at-risk academic and high-risk behavior (Class 2), and at-risk math and behavior (Class 3). Logistic regression analyses indicated the classes demonstrated statistically significant differences statewide achievement scores, as well as suspensions. Further analysis indicated that the odds of all considered negative outcomes were higher for both groups characterized by risk (i.e., Classes 2 and 3). Negative outcomes were particularly likely for Class 2, with the odds of negative behavioral and academic outcomes being 6-15 and 112-169 times more likely, respectively. Results were taken to support an integrated approach to universal screening in schools, defined by the evaluation of both academic and behavioral risk. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Influence of teacher burnout and self-efficacy on teacher-related variance in social-emotional and behavioral screening scores.

Universal screening is useful in the early identification of behavioral and emotional concerns, but teacher-related variance can potentially influence screening scores and resulting decisions. The current study examined the extent to which burnout and self-efficacy as teacher-level variables accounted for variance in universal screening scores. The study participants included 1,314 K-6 students and 56 elementary school teachers. Teachers completed the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) for each student in their classroom, while also completing rating scales regarding their personal self-efficacy and levels of burnout. Hierarchical linear modeling was employed to estimate the extent of teacher-related variance and whether burnout and self-efficacy accounted for this variance. Unconditional models indicated 12-30% of variance in screening scores was between teachers. Conditional models indicated teacher self-efficacy and the depersonalization component of teacher burnout were statistically significant predictors of Emotional Behavior and Total Behavior scores on the SAEBRS. Results further suggested that when combined, burnout and self-efficacy variables accounted for 7-30% of between-teacher variance in screening scores. Implications for practice and future research are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Evidence for the interpretation of Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) scores: An argument-based approach to screener validation.

In accordance with an argument-based approach to validation, the purpose of the current study was to yield evidence relating to Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) score interpretation. Bifactor item response theory analyses were performed to examine SAEBRS item functioning. Structural equation modeling (SEM) was used to simultaneously evaluate intra- and inter-scale relationships, expressed through (a) a measurement model specifying a bifactor structure to SAEBRS items, and (b) a structural model specifying convergent and discriminant relations with an outcome measure (i.e., Behavioral and Emotional Screening System [BESS]). Finally, hierarchical omega coefficients were calculated in evaluating the model-based internal reliability of each SAEBRS scale. IRT analyses supported the adequate fit of the bifactor model, indicating items adequately discriminated moderate and high-risk students. SEM results further supported the fit of the latent bifactor measurement model, yielding superior fit relative to alternative models (i.e., unidimensional and correlated factors). SEM analyses also indicated the latent SAEBRS-Total Behavior factor was a statistically significant predictor of all BESS subscales, the SAEBRS-Academic Behavior predicted BESS Adaptive Skills subscales, and the SAEBRS-Emotional Behavior predicted the BESS Internalizing Problems subscale. Hierarchical omega coefficients indicated the SAEBRS-Total Behavior factor was associated with adequate reliability. In contrast, after accounting for the total scale, each of the SAEBRS subscales was associated with somewhat limited reliability, suggesting variability in these scores is largely driven by the Total Behavior scale. Implications for practice and future research are discussed.

A systematic review of trauma screening measures for children and adolescents.

Traumatized youth are at an increased risk of a host of negative academic and psychoeducational outcomes. Screening and identification of students who experience potentially traumatic events may help schools provide support to at-risk students. In light of this, the current study examines the availability and use of trauma screening measures to detect early indicators of risk among youth in schools. A systematic review was conducted to identify measures available to screen children and youth for trauma exposure and/or symptoms, as well as the associated psychometric properties to support each instrument's applied use in schools. Eighteen measures met inclusion criteria, which consisted primarily of student self-report rating scales and clinical interviews. While many instruments measure the symptomology or exposure to trauma among children and youth, very little psychometric evidence was available to support the use of these measures in schools. Additional research is needed to endorse and expand the use of trauma screening measures in schools. (PsycINFO Database Record

Concurrent validity and sensitivity to change of Direct Behavior Rating Single-Item Scales (DBR-SIS) within an elementary sample.

The purpose of this study was to evaluate the concurrent validity, sensitivity to change, and teacher acceptability of Direct Behavior Rating single-item scales (DBR-SIS), a brief progress monitoring measure designed to assess student behavioral change in response to intervention. Twenty-four elementary teacher-student dyads implemented a daily report card intervention to promote positive student behavior during prespecified classroom activities. During both baseline and intervention, teachers completed DBR-SIS ratings of 2 target behaviors (i.e., Academic Engagement, Disruptive Behavior) whereas research assistants collected systematic direct observation (SDO) data in relation to the same behaviors. Five change metrics (i.e., absolute change, percent of change from baseline, improvement rate difference, Tau-U, and standardized mean difference; Gresham, 2005) were calculated for both DBR-SIS and SDO data, yielding estimates of the change in student behavior in response to intervention. Mean DBR-SIS scores were predominantly moderately to highly correlated with SDO data within both baseline and intervention, demonstrating evidence of the former's concurrent validity. DBR-SIS change metrics were also significantly correlated with SDO change metrics for both Disruptive Behavior and Academic Engagement, yielding evidence of the former's sensitivity to change. In addition, teacher Usage Rating Profile-Assessment (URP-A) ratings indicated they found DBR-SIS to be acceptable and usable. Implications for practice, study limitations, and areas of future research are discussed. (PsycINFO Database Record

Measurement equivalence: A non-technical primer on categorical multi-group confirmatory factor analysis in school psychology.

Evidence-based interventions (EBIs) have become a central component of school psychology research and practice, but EBIs are dependent upon the availability and use of evidence-based assessments (EBAs) with diverse student populations. Multi-group confirmatory factor analysis (MG-CFA) is an analytical tool that can be used to examine the validity and measurement equivalence/invariance of scores across diverse groups. The objective of this article is to provide a conceptual and procedural overview of categorical MG-CFA, as well as an illustrated example based on data from the Social and Academic Behavior Risk Screener (SABRS) - a tool designed for use in school-based interventions. This article serves as a non-technical primer on the topic of MG-CFA with ordinal (rating scale) data and does so through the framework of examining equivalence of measures used for EBIs within multi-tiered models - an understudied topic. To go along with the illustrated example, we have provided supplementary files that include sample data, Mplus input code, and an annotated guide for understanding the input code (http://dx.doi.org/10.1016/j.jsp.2016.11.002). Data needed to reproduce analyses in this article are available as supplemental materials (online only) in the Appendix of this article.

Use of universal screening scores to predict distal academic and behavioral outcomes: A multilevel approach.

Initial research suggests screening for behavioral and emotional risk has been found to predict important behavioral and academic outcomes. The current study seeks to investigate the predictive validity of a novel screening measure, the Social, Academic, and Emotional Behavior Risk Screener-Teacher Rating Scale (SAEBRS-TRS). Although the SAEBRS-TRS has demonstrated initial evidence of strong psychometric properties (including reliability and validity), less is known about the SAEBRS-TRS's prediction of important student academic and behavioral outcomes. Hierarchical linear modeling (HLM) was employed due to the nested nature of the data of screening school-age children within classrooms. Results revealed that fall behavior screening data significantly and positively predicted spring reading scores, office disciplinary referrals, and student absences. Very little variance in the current model was due to differences between classrooms. Results suggest screening may be an important tool for school personnel seeking to use preventative methods for addressing student barriers to learning. (PsycINFO Database Record

Authoritative school climate, number of parents at home, and academic achievement.

School climate is widely recognized as an important factor in promoting student academic achievement. The current study investigated the hypothesis that a demanding and supportive school climate, based on authoritative school climate theory, would serve as a protective factor for students living with 1 or no parents at home. Using a statewide sample of 56,508 middle school students from 415 public schools in 1 state, results indicated that student perceptions of disciplinary structure, academic demandingness, and student support all had positive associations with student self-reported grade point average (GPA). In addition, findings showed that academic expectations and student support were more highly associated with GPA for students not living with any parent. Implications for policy and practice are discussed. (PsycINFO Database Record

Psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) Teacher Rating Scale and multiple gating procedure within elementary and middle school samples.

The primary purposes of this investigation were to (a) continue a line of research examining the psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener - Teacher Rating Scale (SAEBRS-TRS), and (b) develop and preliminarily evaluate the diagnostic accuracy of a novel multiple gating procedure based on teacher nomination and the SAEBRS-TRS. Two studies were conducted with elementary and middle school student samples across two separate geographic locations. Study 1 (n=864 students) results supported SAEBRS-TRS defensibility, revealing acceptable to optimal levels of internal consistency reliability, concurrent validity, and diagnostic accuracy. Findings were promising for a combined multiple gating procedure, which demonstrated acceptable levels of sensitivity and specificity. Study 2 (n=1534 students), which replicated Study 1 procedures, further supported the SAEBRS-TRS' psychometric defensibility in terms of reliability, validity, and diagnostic accuracy. Despite the incorporation of revisions intended to promote sensitivity levels, the combined multiple gating procedure's diagnostic accuracy was similar to that found in Study 1. Taken together, results build upon prior research in support of the applied use of the SAEBRS-TRS, as well as justify future research regarding a SAEBRS-based multiple gating procedure. Implications for practice and study limitations are discussed.

Evaluating the applied use of a mental health screener: Structural validity of the Social, Academic, and Emotional Behavior Risk Screener.

Universal screening for mental health has gained prominence in schools with the adoption of multitiered systems of support. However, there is a general lack of brief, psychometrically defensible instruments that assess emotional and behavioral risk. This study employed a multilevel, confirmatory bifactor analysis to evaluate the factor structure of a novel screening instrument-the Social, Academic, and Emotional Behavioral Risk Screener (SAEBRS; Kilgus & von der Embse, 2014)-examining the structure at the student (within) and teacher or rater (between) levels. Item response theory (IRT) analyses were then used to examine the functioning of 2 existing factors, social risk and academic risk, in addition to a newly introduced third factor, emotional risk, within a sample of 834 elementary and middle school students. Results indicated good fit of a bifactor model including the addition of the new Emotional Behavior subscale. IRT analyses suggested strong item-level discriminative properties (a > 1.0) for 17 of the 19 SAEBRS items and indicated that scale precision was greatest within the low to moderate range of each respective dimension (social, academic, and behavioral risk). Overall, the findings provide support for the use of the SAEBRS as a screener for mental health-related concerns. Implications for model interpretation and model use are discussed. (PsycINFO Database Record

School climate, family structure, and academic achievement: a study of moderation effects.

School climate has been lauded for its relationship to a host of desirable academic, behavioral, and social-emotional outcomes for youth. The present study tested the hypothesis that school climate counteracts youths' home-school risk by examining the moderating effects of students' school climate perceptions on the relationship between family structure (i.e., two-parent, one-parent, foster-care, and homeless households), and academic performance (i.e., self-reported [grade point average] GPA). The present sample consisted of 902 California public high schools, including responses from over 490,000 students in Grades 9 and 11. Results indicated that, regardless of family structure, students with more positive school climate perceptions self-reported higher GPAs. Youths with two-parent, one-parent, and homeless family structures displayed stepwise, linear improvements in self-reported GPA as perceptions of climate improved. Foster-care students' positive school climate perceptions had a weaker effect on their self-reported GPA compared with students living in other family structures. A unique curvilinear trend was found for homeless students, as the relationship between their school climate perceptions and self-reported GPA was stronger at lower levels. Overall, the moderation effect of positive school climate perceptions on self-reported GPA was strongest for homeless youth and youth from one-parent homes, suggesting that school climate has a protective effect for students living in these family structures. A protective effect was not found for youth in foster-care. Implications for research and practice are discussed.

Identifying emotional and behavioral risk among gifted and nongifted children: A multi-gate, multi-informant approach.

The purpose of the current investigation was to compare 1,206 gifted and nongifted elementary students on the identification of emotional and behavioral risk (EBR) as rated by teachers and parents using a multigate, multi-informant approach to assessment. The Parent and Teacher Behavioral Assessment System for Children, Second Edition (BASC-2) and the Behavioral and Emotional Screening System were used to assess behavioral functioning as rated by teachers and parents. There were significant differences between the number of gifted and nongifted children demonstrating emotional and behavioral risk, with parents and teachers identifying a higher number of boys and nongifted children as at risk. Among children demonstrating EBR, gifted children demonstrated elevated internalizing behaviors as rated by parents. Gifted students demonstrated higher academic performance regardless of risk level, suggesting higher cognitive abilities may be one of several protective factors that serve to attenuate the development of other social, emotional, or behavioral concerns. Implications for practice and future research needs are discussed.