Identifying profiles of school climate in high schools.

This cross-sectional study analyzed data from 364,143 students in 492 high schools who completed the Georgia School Climate Survey during the 2017-2018 school year. Through latent profile analysis, we identified that student perceptions of school climate could be classified into three distinct profiles, including positive, moderate, and negative climate. Using multinomial logistic regression, we then identified school and student characteristics that predicted student classification in the student profiles using the total sample and subsamples by race/ethnicity. Among the key results, we found that most of the school characteristics (e.g., percent of students receiving free or reduced lunch, schools with higher percentages of minoritized students) predicting classification in the negative and positive school climate profiles were different for White students compared to minoritized students. For example, Black students in primarily non-White schools were more likely to view school climate positively, whereas the opposite was the case for White students. We also found that Black and Other (e.g., multiracial) students were more likely to be classified in the negative school climate profile and less likely to be classified in the positive school climate profile compared to White students. In contrast, Latino/a/e students were more likely to be classified in the positive school climate profile and less likely to be classified in the negative school climate profile. Implications for research and practice are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Implications of bias in automated writing quality scores for fair and equitable assessment decisions.

Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to implementing unfair practices with negative consequences on student learning. The goal of this study was to investigate score bias of writeAlizer, a free and open-source automated writing evaluation program. For 421 students in Grades 4 and 7 who completed a state writing exam that included composition and multiple choice revising and editing questions, writeAlizer was used to generate automated writing quality scores for the composition section. Then, we used multiple regression models to investigate whether writeAlizer scores demonstrated differential predictions of the composition and overall scores on the state-mandated writing exam for students from different racial or ethnic groups. No evidence of bias for automated scores was observed. However, after controlling for automated scores in Grade 4, we found statistically significant group differences in regression models predicting overall state test scores 3 years later but not the essay composition scores. We hypothesize that the multiple choice revising and editing sections, rather than the scoring approach used for the essay portion, introduced construct-irrelevant variance and might lead to differential performance among groups. Implications for assessment development and score use are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Potential scoring and predictive bias in interim and summative writing assessments.

Interim and summative assessments often are used to make decisions about student writing skills and needs for instruction, but the extent to which different raters and score types might introduce bias for some groups of students is largely unknown. To evaluate this possibility, we analyzed interim writing assessments and state summative test data for 2,621 students in Grades 3-11. Both teachers familiar with students and researchers unaware of students' identifying characteristics evaluated the interim assessments with analytic rubrics. Teachers assigned higher scores on the interim assessments than researchers. Female students had higher scores than males, and English learners (ELs), students eligible for free or reduced-price school lunch (FRL), and students eligible for special education (SPED) had lower scores than other students. These differences were smaller with researcher compared to teacher ratings. Across grade levels, interim assessment scores were similarly predictive of state rubric scores, scale scores, and proficiency designations across student groups. However, students identified as Hispanic, FRL, EL, or SPED had lower scale scores and a lower likelihood of reaching proficiency on the state exam. For this reason, these students' risk of unsuccessful performance on the state exam would be greater than predicted when based on interim assessment scores. These findings highlight the potential importance of masking student identities when evaluating writing to reduce scoring bias and suggest that the written composition portions of high-stakes writing examinations may be less biased against historically marginalized groups than the multiple choice portions of these exams. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Effects of Social Stories on Increasing Social Interaction and Engagement of Deaf and Hard of Hearing Students with Autism Spectrum Disorder in Inclusive Settings.

d/Deaf or hard of hearing (d/Dhh) students with autism spectrum disorder (ASD) may require specific approaches to promote social inclusion. The purpose of this study was to investigate the effects of reading social stories with American Sign Language vocabulary to students who are d/Dhh with ASD (d/Dhh-ASD) and their peers in inclusive settings, using a non-concurrent multiple baseline design across participants. To examine the effectiveness of the intervention, the frequency of four communicative social behaviors and the duration of social engagement with peers were recorded for each participant during lunchtime and recess. The results did not show an immediate effect across all participants. Implications for promoting social inclusion for students who are d/Dhh-ASD in general education classrooms are discussed.

Cost analysis and cost-effectiveness of hand-scored and automated approaches to writing screening.

Although researchers have investigated technical adequacy and usability of written-expression curriculum-based measures (WE-CBM), the economic implications of different scoring approaches have largely been ignored. The absence of such knowledge can undermine the effective allocation of resources and lead to the adoption of suboptimal measures for the identification of students at risk for poor writing outcomes. Therefore, we used the Ingredients Method to compare implementation costs and cost-effectiveness of hand-calculated and automated scoring approaches. Data analyses were conducted on secondary data from a study that evaluated predictive validity and diagnostic accuracy of quantitative approaches for scoring WE-CBM samples. Findings showed that automated approaches offered more economic solutions than hand-calculated methods; for automated scores, the effects were stronger when the free writeAlizer R package was employed, whereas for hand-calculated scores, simpler WE-CBM metrics were less costly than more complex metrics. Sensitivity analyses confirmed the relative advantage of automated scores when the number of classrooms, students, and assessment occasions per school year increased; again, writeAlizer was less sensitive to the changes in the ingredients than the other approaches. Finally, the visualization of the cost-effectiveness ratio illustrated that writeAlizer offered the optimal balance between implementation costs and diagnostic accuracy, followed by complex hand-calculated metrics and a proprietary automated program. Implications for the use of hand-calculated and automated scores for the universal screening of written expression with elementary students are discussed.

Development and Validation of a Measure Assessing Sustainability of Tier 2 and 3 Behavior Support Systems.

To identify the most effective strategies for implementing and sustaining Tier 2 and 3 behavior support systems, a measure of general and tier-specific factors hypothesized to predict sustained implementation is needed. To address this need, we conducted two studies examining the construct validity of the Advanced Level Tier Interventions Treatment Utilization and Durability Evaluation (ALTITUDE) measure: one assessing the content aspects of construct validity (Study 1) and one assessing the structural and external aspects of construct validity (Study 2). In Study 1, participants included an expert panel of 26 members who provided iterative feedback during measure development. The results showed strong content representativeness (content validity index = .93) for assessing elements indicating sustainability. In Study 2, participants were school personnel from 646 schools who completed the measure. The results showed model fit was good for both a three-factor correlated model (CFI = .98, RMSEA = .06, SRMR = .05) and Bifactor S-1 model with correlated Tier 2 and Tier 3 specific residual factors (CFI = .98, RMSEA = .06, SRMR = .05). In addition, ALTITUDE latent factors were found to have both convergent and discriminant evidence in relation to concurrent fidelity of school-wide positive behavioral interventions and supports (SWPBIS) implementation at Tiers 1, 2, and 3. This construct validity evidence will support the use of the ALTITUDE in identifying the strongest tier-general and tier-specific predictors of sustained implementation of Tier 2 and 3 behavior support systems.

Effects of a Universal School-Based Mental Health Program on the Self-concept, Coping Skills, and Perceptions of Social Support of Students with Developmental Disabilities.

In a cluster randomized control trial, a school-based mental health program combining mental health literacy and dialectical behavior skills was implemented by teachers to determine effects on protective factors related to resilience for students in 3rd-12th grade. As part of a larger study, a subsample of 113 students with developmental disabilities attending 37 classrooms participated. Student-reported measures of self-concept, coping skills, and social support were collected three times in the year. Results indicated large effect sizes for the program on all measures, which pertain to time × group interactions (g = 1.53, 1.91, and 0.86 for self-concept, coping, and social support respectively). Follow-up analyses indicated that gains for the intervention schools primarily occurred between the first two assessment periods when the majority of program content was delivered. Implications for universal school-based mental health programming for students with developmental disabilities are discussed.

Young Children's Theory of Mind Predicts More Sharing With Friends Over Time.

Children (predominantly white and middle class) between 3 and 6 years (M = 55.12 months, N = 145 at Time 1, N = 102 at Time 2) participated in the prosocial choice test at two time points approximately 10 months apart. Children could share with strangers, close friends, nonfriends, and in a control, no recipient condition. Children shared more rewards with friends over time. Age interacted with recipient type such that older children had a higher probability of prosocial allocations toward friends and strangers compared to younger children. Theory of mind (ToM) predicted more prosocial allocations to friends over time, and the youngest children with higher ToM scores showed the largest increase in sharing with friends over time.

Moderators of the Relations Between Mothers' and Fathers' Parenting Practices and Children's Prosocial Behavior.

Using multilevel modeling, we separately examined the relations between mothers' and fathers' parenting practices and children's prosocial behavior, as well as the moderating roles of child sex, age, and ethnicity. Participants included a diverse community sample of 129 cohabiting couples with a child aged 6-17. Results indicated that paternal positivity and corporal punishment were significantly related to girls', but not boys', prosocial behavior, and paternal involvement was related to prosocial behavior in school-aged children but not adolescents. Greater levels of positivity in both parents were related to more prosocial behavior in Caucasian children and less in African American children. Overall, the findings suggest that fathers' parenting is important and may differentially influence children of different sexes and ages, underscoring the importance of examining both mothers' and fathers' parenting in relation to child outcomes and with diverse samples. Findings also highlight the need for culturally appropriate measures of parenting.

Identifying and Predicting Distinct Patterns of Implementation in a School-Wide Behavior Support Framework.

The purpose of this study was to examine the extent to which distinct patterns of fidelity of implementation emerged for 5331 schools over a 5-year course of implementing school-wide positive behavioral interventions and supports (SWPBIS). We used latent class analysis to classify schools based on their likelihood of implementing SWPBIS with fidelity each year, then assessed school and district predictors of classifications. A four-class solution fit the model well, with two patterns of sustained implementation (Sustainers and Slow Starters) and two patterns of practice abandonment (Late Abandoners and Rapid Abandoners). Significant predictors of group membership included grade levels served, enrollment, proportion of schools implementing SWPBIS in the district ("critical mass"), and size of the implementation cohort ("community of practice"). Elementary schools, larger schools, schools in districts with more schools already implementing SWPBIS, and those starting within a larger initial district cohort were more likely to be in the sustaining classes. Results are discussed in terms of understanding patterns of implementation in schools to enhance sustained implementation of school practices.

Generalizability theory reliability of written expression curriculum-based measurement in universal screening.

The purpose of this study was to examine the reliability of written expression curriculum-based measurement (WE-CBM) in the context of universal screening from a generalizability theory framework. Students in second through fifth grade (n = 145) participated in the study. The sample included 54% female students, 49% White students, 23% African American students, 17% Hispanic students, 8% Asian students, and 3% of students identified as 2 or more races. Of the sample, 8% were English Language Learners and 6% were students receiving special education. Three WE-CBM probes were administered for 7 min each at 3 time points across 1 year. Writing samples were scored for commonly used WE-CBM metrics (e.g., correct minus incorrect word sequences; CIWS). Results suggest that nearly half the variance in WE-CBM is related to unsystematic error and that conventional screening procedures (i.e., the use of one 3-min sample) do not yield scores with adequate reliability for relative or absolute decisions about student performance. In most grades, three 3-min writing samples (or 2 longer duration samples) were required for adequate reliability for relative decisions, and three 7-min writing samples would not yield adequate reliability for relative decisions about within-year student growth. Implications and recommendations are discussed. (PsycINFO Database Record

Measuring annual growth using written expression curriculum-based measurement: An examination of seasonal and gender differences.

The purpose of this study was to examine annual growth patterns and gender differences in written expression curriculum-based measurement (WE-CBM) when used in the context of universal screening. Students in second through fifth grade (n = 672) from 2 elementary schools that used WE-CBM as a universal screener participated in the study. Student writing samples were scored for production-dependent, production-independent, and accurate-production indicators. Results of latent growth models indicate that for most WE-CBM outcome indicators across most grade levels, average growth was curvilinear, with increasing curvilinearity on all indicators as grade level increased. Evidence of gender differences was mixed with girls having higher initial scores on all WE-CBM indicators except for total words written (second and third grades), correct minus incorrect writing sequences (fourth grade only), and percent correct writing sequences (second-fourth grades) where differences were not statistically significant. Despite differences in initial level, there were few gender differences in growth and limited overall between-student variability in linear slope. The results of this study extend research on annual patterns of growth and gender differences in WE-CBM by analyzing all 3 types of WE-CBM indicators, including upper elementary grades, and assessing skills more frequently (i.e., 4 to 5 times in 1 year) than in prior research on annual growth. The findings have implications for universal screening in WE-CBM and for understanding gender differences in writing performance.

Loud versus quiet praise: a direct behavioral comparison in secondary classrooms.

The purpose of the present study was to compare the effects of teacher public (i.e., loud) and private (i.e., quiet) praise on students' appropriately engaged behavior (AEB) and disruptive behaviors (DB). Employing a combined multiple-baseline withdrawal design, the effects of loud and quiet praise were assessed across two pairs of secondary classrooms. Each classroom's mean percentage of observed intervals of AEB and DB across loud and quiet praise intervention phases was assessed and compared. Overall, visual analysis of the data, multilevel modeling, and effect sizes showed that both loud and quiet praises were more effective than no treatment at increasing AEB and decreasing DB. In addition, there were no statistical or clinically significant differences between the loud and quiet praise interventions. The results are discussed in light of appropriate practices and controversies in the literature.

Measurement invariance of an instrument assessing sustainability of school-based universal behavior practices.

The purpose of the study was to examine the extent to which the School-Wide Universal Behavior Sustainability Index: School Teams (SUBSIST; McIntosh, Doolittle, Vincent, Horner, & Ervin, 2009), a measure of school and district contextual factors that promote the sustainability of school practices, demonstrated measurement invariance across groups of schools that differed in length of time implementing school-wide Positive Behavioral Interventions and Supports (PBIS; Sugai & Horner, 2009), student ethnic composition, and student socioeconomic status (SES). School PBIS team members and district coaches representing 860 schools in 14 U.S. states completed the SUBSIST. Findings supported strong measurement invariance, for all items except 1, of a model with two school-level factors (School Priority and Team Use of Data) and 2 district-level factors (District Priority and Capacity Building) across groups of schools at initial implementation, institutionalization, and sustainability phases of PBIS implementation. Schools in the sustainability phase were rated significantly higher on School Priority and Team Use of Data than schools in initial implementation. Strong measurement invariance held across groups of schools that differed in student ethnicity and SES. The findings regarding measurement invariance are important for future longitudinal investigations of factors that may promote the sustained implementation of school practices.

The psychology of spite and the measurement of spitefulness.

Spite is an understudied construct that has been virtually ignored within the personality, social, and clinical psychology literatures. This study introduces a self-report Spitefulness Scale to assess individual differences in spitefulness. The scale was initially tested on a large sample of 946 college students and cross-validated on a national sample of 297 adults. The scale was internally consistent in both samples. Factor analysis supported a 1-factor solution for the initial pool of 31 items. Item response theory analysis was used to identify the best performing of the original 31 items in the university sample and reduce the scale to 17 items. Tests of measurement invariance indicated that the items functioned similarly across both university and national samples, across both men and women, and across both ethnic majority and minority groups. Men reported higher levels of spitefulness than women, younger people were more spiteful than older people, and ethnic minority members reported higher levels of spitefulness than ethnic majority members. Across both samples, spitefulness was positively associated with aggression, psychopathy, Machiavellianism, narcissism, and guilt-free shame, and negatively correlated with self-esteem, guilt-proneness, agreeableness, and conscientiousness. Ideally, this Spitefulness Scale will be able to predict behavior in both laboratory settings (e.g., ultimatum games, aggression paradigms) and everyday life, contribute to the diagnosis of personality disorders and oppositional defiant disorder, and encourage further study of this neglected, often destructive, trait.

A unified model exploring parenting practices as mediators of marital conflict and children's adjustment.

We examined positive and negative parenting practices and psychological control as mediators of the relations between constructive and destructive marital conflict and children's internalizing and externalizing problems in a unified model. Married mothers of 121 children between the ages of 6 and 12 completed questionnaires measuring marital conflict, parenting practices, and child adjustment. Analyses revealed significant direct paths from destructive marital conflict to negative parenting practices, psychological control, and both children's internalizing and externalizing behavior. In addition, psychological control was found to partially mediate relations between destructive marital conflict and children's internalizing and externalizing behavior.

Criterion-related validity of curriculum-based measurement in writing with narrative and expository prompts relative to passage copying speed in 10th grade students.

We investigated the criterion-related validity of four indicators of curriculum-based measurement in writing (WCBM) when using expository versus narrative writing prompts as compared to the validity of passage copying speed. Specifically, we compared criterion-related validity of production-dependent (total words written, correct word sequences), accurate-production (correct minus incorrect word sequences [CIWS]), and production-independent (percent of correct word sequences [%CWS]) scoring methods on narrative and expository writing probes in relation to a state-mandated writing assessment. Participants included all tenth grade students (N=163) from a rural high school in the Midwest. Results indicated that the more complex indicators of writing, %CWS (when taking into account passage copying speed), and CIWS (when passage copying speed was not considered) on narrative probes explained the greatest amount of variance in the criterion measure. None of the WCBM indicators, alone or in combination with passage copying speed, explained more than 25% of the variance in the state writing assessment, suggesting that WCBM may have limitations as a universal screening measure for high school students.

The impact of baseline trend control on visual analysis of single-case data.

The impact of baseline trend control on visual analyses of AB intervention graphs was examined with simulated data at various values of baseline trend, autocorrelation, and effect size. Participants included 202 undergraduate students with minimal training in visual analysis and 10 graduate students and faculty with more training and experience in visual analysis. In general, results were similar across both groups of participants. Without statistical adjustments to correct for baseline trend, Type I errors greatly increased as baseline trend increased. With corrections for baseline trend, fewer Type I errors were made. As trend increased, participants made fewer Type II errors on the unadjusted graphs as compared to the graphs with baseline trend control. The greater Type II error rate on adjusted graphs could be an artifact of study design (i.e., participants did not know if baseline trend control had been applied), and the impact of MASAJ on Type II errors needs to be explored in detail prior to more widespread use of the method. Implications for future use of baseline trend control techniques by educational professionals are discussed.

The impact of probe variability on brief experimental analysis of reading skills.

The purpose of this study was to examine the impact of probe variability on the ability to replicate results in brief experimental analysis (BEA) of reading. In the first phase of the study, 41 first- and second- grade students completed 16 oral reading fluency probes. Calculations of probe difficulty were used to identify Low and High Variability probe sets. In the second phase of the study, the performance of 40 second- through fifth-grade students during two reading interventions was compared. The best-performing intervention for each student in the initial trial was replicated during a second trial for only 43% of students regardless of probe variability. The best-performing intervention was replicated for 60% of students when average performance across two trials was compared. Rules for determining the best-performing intervention in academic BEA should consider the standard error of measurement (SEM) for the probe set to be used, the reliability for absolute decisions using the probe set, and the number of replications relative to SEM needed to adequately demonstrate experimental control.

Development and initial validation of the inventory of Microaggressions Against Black Individuals.

The present article describes the development and initial validation of the Inventory of Microaggressions Against Black Individuals (IMABI) using a sample of 385 undergraduates who self-identified as Black or African American. The IMABI is a 14-item, unidimensional measure of racial microaggressions that captures both microinsults and microinvalidations. The present findings support the IMABI as a reliable and valid measure of microaggressions that was associated with general distress and perceived stress. Importantly, the association between the IMABI and psychological adjustment persisted even when social desirability and another measure of race-related stress were included in the analyses. Discussion focuses on the potential implications of the IMABI for understanding the daily experiences and psychological adjustment of Black individuals.