Reliability, validity, and accuracy of the intervention selection profile-Function: A brief functional assessment tool.

The purpose of this study was to evaluate the reliability, validity, and accuracy of scores from the Intervention Selection Profile-Function (ISP-Function): a brief functional assessment tool founded upon Direct Behavior Rating (DBR) methodology. Participants included 34 teacher-student dyads. Using the ISP-Function, teachers rated the extent to which students exhibited disruptive behavior, as well as the frequency with which disruptions were met with four consequences. Ratings were completed across three 10-min sessions, during which a research assistant also collected systematic direct observation (SDO) data regarding the same behavior and consequences. Results indicated adequate temporal reliability (≥.70) was attained for the adult attention and peer attention targets across the three ratings; in contrast, up to 8-18 data points would be needed to achieve adequate reliability across the remaining targets. Findings further suggested that while ISP-Function ratings of disruptive behavior, adult attention, and peer attention were moderately to highly correlated with SDO data, correlations were in the low range for the access to items/activities and escape/avoidance targets. Finally, analysis of difference scores showed that on average, mean ISP-Function scores fell within only 0.33 to 1.81 points of mean SDO scores (on the 0-10 DBR scale). Agreement coefficients indicative of exact score agreement were less consistent, suggesting accuracy ranged from poor to substantial. Results are promising, but future research is necessary to support applied ISP-Function use. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Comparing the effects of incremental rehearsal and traditional drill on retention of mathematics facts and predicting the effects with memory.

The purpose of this study was to examine the effects of Incremental Rehearsal (IR) and traditional drill (TD) on retention of multiplication facts with 29 students in third and fourth grades with low mathematical skills. Results indicated that IR led to significantly more facts being retained, and was essentially equal to TD for efficiency as measured by number of facts retained per instructional minute. Memory scores accounted for 34% of the variance beyond mathematics calculation scores in retention of multiplication facts for the TD condition, but only 2% of the variance for the IR condition. Thus, retention of multiplication facts seems largely influenced by a student's memory skills when using less effective instructional techniques such as TD, while approaches like IR are likely effective regardless of memory skills. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Co-occurrence of academic and behavioral risk within elementary schools: Implications for universal screening practices.

The purposes of this study were twofold. The first was to use latent class analysis to identify groupings of students defined by the presence or absence of academic or behavioral risk. The second was to determine whether these groups differed across various dichotomous academic and behavioral outcomes (e.g., suspensions, office discipline referrals, statewide achievement test failure). Students (N = 1,488) were sampled from Grades 3-5. All students were screened for academic risk using AIMSweb Reading Curriculum-Based Measure and AIMSweb Mathematics Computation, and behavioral risk using the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS). Latent class analyses supported the fit of a three-class model, with resulting student classes defined as low-risk academic and behavior (Class 1), at-risk academic and high-risk behavior (Class 2), and at-risk math and behavior (Class 3). Logistic regression analyses indicated the classes demonstrated statistically significant differences statewide achievement scores, as well as suspensions. Further analysis indicated that the odds of all considered negative outcomes were higher for both groups characterized by risk (i.e., Classes 2 and 3). Negative outcomes were particularly likely for Class 2, with the odds of negative behavioral and academic outcomes being 6-15 and 112-169 times more likely, respectively. Results were taken to support an integrated approach to universal screening in schools, defined by the evaluation of both academic and behavioral risk. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Diagnostic accuracy of a universal screening multiple gating procedure: A replication study.

The purpose of this diagnostic accuracy study was to evaluate the sensitivity and specificity (among other indicators) of three universal screening approaches, including the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS), a SAEBRS-based teacher nomination tool, and a multiple gating procedure (MGP). Each screening approach was compared to the BASC-2 Behavioral and Emotional Screening System (BESS), which served as a criterion indicator of student social-emotional and behavioral risk. All data were collected in a concurrent fashion. Participants included 704 students (47.7% female) from four elementary schools within the Midwestern United States (21.6% were at risk per the BESS). Findings yielded support for the SAEBRS, with sensitivity = .93 (95% confidence interval [.89-.97]), specificity = .91 (.89-.93), and correct classification = .92. Findings further supported the MGP, which yielded sensitivity = .81 (.74-.87), specificity = .93 (.91-.95), and correct classification = .91. In contrast, the teacher nomination tool yielded questionable levels of diagnostic accuracy (sensitivity = .86 [.80-.91], specificity = .74 [.70-.78], and correct classification = .76). Overall, findings were particularly supportive of SAEBRS diagnostic accuracy, suggesting the MGP might also serve as an acceptable approach to universal screening. Other implications for practice and directions for future research are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Screening for behavioral risk: Identification of high risk cut scores within the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS).

The purpose of this study was to support the identification of Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) cut scores that could be used to detect high-risk students. Teachers rated students across two time points (Time 1 n = 1,242 students; Time 2 n = 704) using the SAEBRS and the Behavioral and Emotional Screening System (BESS), the latter of which served as the criterion measure. Exploratory receiver operating characteristic (ROC) curve analyses of Time 1 data detected cut scores evidencing optimal levels of specificity and borderline-to-optimal levels of sensitivity. Cross-validation analyses of Time 2 data confirmed the performance of these cut scores, with all but one scale evidencing similar performance. Findings are considered particularly promising for the SAEBRS Total Behavior scale in detecting high-risk students. (PsycINFO Database Record

Meta-analysis of the effects of academic interventions and modifications on student behavior outcomes.

The current study examined the effect of academic interventions and modifications on behavioral outcomes in a meta-analysis of 32 single-case design studies. Academic interventions included modifying task difficulty, providing instruction in reading, mathematics, or writing, and contingent reinforcement for academic performance. There was an overall small to moderate effect (ϕ = .56) on behavioral outcomes, with a stronger effect on increasing time on task (ϕ = .64) than on decreasing disruptive behavior (ϕ = .42). There was a small effect for using a performance-based contingent reinforcer (ϕ = .48). Interventions completed in an individual setting resulted in a moderate to large effects on behavior outcomes. Results of the current meta-analysis suggest that academic interventions can offer both positive academic and behavioral outcomes. Practical implications and suggestions for future research are included. (PsycINFO Database Record

Use of direct behavior ratings to collect functional assessment data.

The purpose of this investigation was to evaluate the utility of Direct Behavior Rating Single Item Scale (DBR-SIS) methodology in collecting functional behavior assessment data. Specific questions of interest pertained to the evaluation of the accuracy of brief DBR-SIS ratings of behavioral consequences and determination of the type of training necessary to support such accuracy. Undergraduate student participants (N = 213; 62.0% male; 62.4% White) viewed video clips of students in a classroom setting, and then rated both disruptive behavior and 4 consequences of that behavior (i.e., adult attention, peer attention, escape/avoidance, and access to tangibles/activities). Results indicated training with performance feedback was necessary to support the generation of accurate disruptive behavior and consequence ratings. Participants receiving such support outperformed students in training-only, pretest-posttest, and posttest-only groups for disruptive behavior and all 4 DBR-SIS consequence targets. Future directions for research and implications for practice are discussed, including how teacher ratings may be collected along with other forms of assessment (e.g., progress monitoring) within an efficient Tier 2 assessment model. (PsycINFO Database Record

Psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) Teacher Rating Scale and multiple gating procedure within elementary and middle school samples.

The primary purposes of this investigation were to (a) continue a line of research examining the psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener - Teacher Rating Scale (SAEBRS-TRS), and (b) develop and preliminarily evaluate the diagnostic accuracy of a novel multiple gating procedure based on teacher nomination and the SAEBRS-TRS. Two studies were conducted with elementary and middle school student samples across two separate geographic locations. Study 1 (n=864 students) results supported SAEBRS-TRS defensibility, revealing acceptable to optimal levels of internal consistency reliability, concurrent validity, and diagnostic accuracy. Findings were promising for a combined multiple gating procedure, which demonstrated acceptable levels of sensitivity and specificity. Study 2 (n=1534 students), which replicated Study 1 procedures, further supported the SAEBRS-TRS' psychometric defensibility in terms of reliability, validity, and diagnostic accuracy. Despite the incorporation of revisions intended to promote sensitivity levels, the combined multiple gating procedure's diagnostic accuracy was similar to that found in Study 1. Taken together, results build upon prior research in support of the applied use of the SAEBRS-TRS, as well as justify future research regarding a SAEBRS-based multiple gating procedure. Implications for practice and study limitations are discussed.

Factors affecting sensitivity to frequency change in school-age children and adults.

PURPOSE: The factors affecting frequency discrimination in school-age children are poorly understood. The goal of the present study was to evaluate developmental effects related to memory for pitch and the utilization of temporal fine structure. METHOD: Listeners were 5.1- to 13.6-year-olds and adults, all with normal hearing. A subgroup of children had musical training. The task was a 3-alternative forced choice in which listeners identified the interval with the higher frequency tone or the tone characterized by frequency modulation (FM). The standard was 500 or 5000 Hz, and the FM rate was either 2 or 20 Hz. RESULTS: Thresholds tended to be higher for younger children than for older children and adults for all conditions, although this age effect was smaller for FM detection than for pure-tone frequency discrimination. Neither standard frequency nor modulation rate affected the child/adult difference FM thresholds. Children with musical training performed better than their peers on pure-tone frequency discrimination at 500 Hz. CONCLUSIONS: Testing frequency discrimination using a low-rate FM detection task may minimize effects related to cognitive factors like memory for pitch or training effects. Maturation of frequency discrimination does not appear to differ across conditions in which listeners are hypothesized to rely on temporal cues and place cues.