Effectiveness of accelerated reader on children's reading outcomes: A meta-analytic review.

Accelerated reader (AR) is a computerized reading program commonly used in schools. The program aims to enhance students' reading achievement and encourage students to read more through goal setting and frequent reading practice. A meta-analytic review of the AR was conducted to analyse its effectiveness as an evidence-based intervention for improving student reading achievement, attitude, and motivation. This study investigated potential moderating variables, including publication type, participant, and study characteristics that impact student reading outcomes. A total of 44 studies from peer-reviewed journal articles and dissertations met the inclusion criteria. Participants included 16,653 students enrolled in elementary, middle, and high school. Hedges' g effect sizes measures suggest pretest-posttest one-group AR studies have moderate effects (g = 0.541) while comparison group AR studies have marginal effects (g = 0.278). A meta-regression model of six potential categorical moderators of comparison group studies indicted no significant moderators. Implications and the need for further research regarding evidence-based and culturally appropriate reading interventions are discussed.

A Pilot Study of Stress System Activation in Children Enrolled in a Targeted Prevention Program: Implications for Personalization.

Empirically validated interventions addressing childhood psychological problems are now readily available, but success likely depends in part on accurately identifying which children will benefit from which intervention. This pilot study examined the stress activation and response system, first as a way to differentiate high versus low-risk children, and second to explore indicators of the stress system associated with favorable intervention response. METHOD: Participants (N = 43, 58% male) were school-aged children who qualified for inclusion in the Early Risers "Skills for Success" Prevention Program based on their elevated levels of aggressive and/or socially withdrawn behavior and a normally developing comparison group. Compared to the normally developing group, children who were participants in the intervention exhibited a more blunted cortisol response to the stress paradigm. However, for the children in the intervention group, elevated cortisol levels at the start of the stress paradigm were concurrently associated with internalizing problems and predictive of improvement in internalizing problems over time. These findings provide preliminary evidence that hypothalamic pituitary adrenal (HPA) axis biological variables may be helpful tools for identifying children who would benefit from intervention and personalizing interventions.

Effects of portable interventions on school psychologists' graph-rating inconsistency.

The visual analysis of data presented in time-series graphs are common in single-case design (SCD) research and applied practice in school psychology. A growing body of research suggests that visual analysts' ratings are often influenced by construct-irrelevant features including Y-axis truncation and compression of the number of data points per X- to Y-axis ratio. We developed and tested two brief interventions, based on the research in cognitive and visual science, to reduce visual analysts' inconsistency when viewing unstandardized graphs. Two hundred practicing school psychologists visually analyzed data presented on standardized graphs and the same data again on unstandardized graphs. Across all conditions, participants were more willing to identify meaningful effects on unstandardized graphs and rated the data as showing significantly larger effects than on the corresponding standardized graphs. However, participants who answered additional (task-relevant) questions about the level or trend of graphed data showed greater rating consistency across the types of graphs in comparison to participants who answered task-irrelevant but challenging questions or control participants. Our results replicated prior research demonstrating the impact of SCD graph construction on practicing school psychologists' interpretations and provide initial support for an intervention to minimize the impact of construct-irrelevant factors. Limitations and future directions for research are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Between-case standardized mean differences: Flexible methods for single-case designs.

Single-case designs (SCDs) are a class of research methods for evaluating the effects of academic and behavioral interventions in educational and clinical settings. Although visual analysis is typically the first and main method for analysis of data from SCDs, quantitative methods are useful for synthesizing results and drawing systematic generalizations across bodies of single-case research. Researchers who are interested in synthesizing findings across SCDs and between-group designs might consider using the between-case standardized mean difference (BC-SMD) effect size, which aims to put results from both types of studies into a common metric. Currently available BC-SMD methods are limited to treatment reversal designs with replication across participants and across-participant multiple baseline designs, yet more complex designs are sometimes used in practice. In this study, we extend available BC-SMD methods to several variations of the multiple baseline design, including the replicated multiple baseline across behaviors or settings, the clustered multiple baseline design, and the multivariate multiple baseline across participants. For each variation, we describe methods for estimating BC-SMD effect sizes and illustrate our proposed approach by re-analyzing data from a published SCD study.

A cost-effectiveness analysis of four approaches to universal screening for reading risk in upper elementary and middle school.

Research on universal screening in reading has primarily focused on the psychometric adequacy of screening procedures without critically considering costs and value. Educators in upper elementary and middle school have access to a great deal of extant student achievement data, which makes the evaluation of the costs associated with collecting new data for screening purposes paramount. We conducted a retrospective analysis of four approaches to reading screening using cost-effectiveness analysis. Universal screening (i.e., aimswebPlus reading) and statewide reading test data were collected in a midsize school district in Texas for 19,417 students in Grades 4-8. We analyzed the total cost, the classification accuracy based on local cut-scores derived using receiver operating characteristic analysis, and the cost-effectiveness of each approach. Full implementation of the fall administration of aimswebPlus reading cost the district $55,199 in upper elementary and $76,832 in middle school. Both the use of prior-year state achievement test data alone (which represented no additional costs for screening) and the multivariate model (i.e., prior-year state achievement test data plus aimswebPlus) met typical recommendations for classification accuracy. A multiple-gate model that used prior-year state test data and fall aimswebPlus reading on a low-achieving subset of students produced the lowest cost-effectiveness ratio at $156 per additional student accurately classified in upper elementary and $181 in middle school, but this model also led to the highest number of false negatives. The use of aimswebPlus alone resulted in the highest costs and lowest classification accuracy. The results suggest that the use of prior-year statewide achievement test data alone in Grades 4-8 is an efficient approach to universal screening for reading risk that may allow schools to shift resources from screening to other educational priorities.

A cluster randomized controlled trial of brief follow-up practice sessions on intervention maintenance.

Despite considerable knowledge of the factors that influence initial intervention response, little is known about how to sustain successful intervention response over time. The current study examined spring literacy outcomes for kindergarten (n = 177), second (n = 149), and third grade students (n = 204) who successfully exited an evidence-based tutoring program during the fall semester. Successful responders in kindergarten, second, and third grade were randomly assigned by school to receive either no follow-up support or access to a once-weekly oral practice session. Results were mixed across grades and outcomes, but in kindergarten and third grade, treatment corresponded to an approximately 15% increased likelihood of meeting year-end benchmarks on targeted literacy skills. Findings are discussed in the context of suggestions for higher-quality longitudinal research designs of educational interventions.

Universal screening in grades K-2: A systematic review and meta-analysis of early reading curriculum-based measures.

In reading, several curriculum-based measures (CBM) are used for universal screening in Grades K-2. This study summarized the criterion-related validity of early reading CBM tools used in the context of universal screening. After the application of the inclusion and exclusion criteria, 54 studies (53 documents across 34 articles, 16 dissertations, and 3 technical reports) were identified through a systematic review of the literature through December 2018. Forty-eight studies (47 documents across 31 articles, 15 dissertations, and 2 technical reports) were included in the meta-analysis, representing 47,168 students in the US who were enrolled in Grades K, 1, or 2 when they completed the screening measure. A random effects meta-analysis with robust variance estimation was conducted separately for concurrent and predictive correlations to estimate the average effect size between each early reading CBM and the reading outcome measures. Aggregated concurrent Pearson correlation coefficients (r) ranged from 0.343 (phoneme segmenting CBM predicting more complex reading skills) to 0.750 (nonsense words CBM predicting oral reading skills). Aggregated correlations were similar in magnitude for predictive validity. For some measures, correlations were moderated by administration lag. Findings have implications for research and practice regarding the use of universal reading screeners in the early elementary grades.

Considerations for school psychology to realize its promise: Commentary on the special issue from early career school psychologists.

As early career scholars, we have benefitted from the recommendations made by Conoley and Gutkin nearly 25 years ago. Our training and applied experiences were closely aligned with Conoley and Gutkin's view of school psychology practice. Namely, the content of our courses and our practice of psychology in practicum and internship were reflective of an applied ecological orientation within a prevention framework rather than focused solely on individual level services. As we reflected on the articles in the special issue, and the state of the field moving forward, we identified 2 broad recommendations we believe are integral to realizing the promise of school psychology, the applied use of an implementation science lens and the explicit centering of equity and social justice in school psychology. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

School Psychology reflections on COVID-19, antiracism, and gender and racial disparities in publishing.

School Psychology is an outlet for research on children, youth, educators, and families that has scientific, practice, and policy implications. The novel coronavirus 2019 (COVID-19) pandemic has significantly disrupted K-12 schooling as well as university training, impacting educational attainment and highlighting longstanding inequality. Furthermore, the killing of Breonna Taylor and George Floyd has precipitated worldwide protests against antiblack racism, white supremacy, and police brutality. In this editorial, we highlight the potential impacts to our field, including prioritizing research related to educational equity, identifying new research questions related to technology, and utilizing new research methods. We also consider the impact of gender and racial disparities in publications during this time. Finally, given these events, we discuss how best our editorial team can serve the field. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Interval likelihood ratios: Applications for gated screening in schools.

Educational researchers have traditionally evaluated universal screening performance by dichotomizing continuous test scores to classify students as at-risk or not at-risk. This is pragmatic for decision making, but dichotomization results in a loss of critical information regarding the magnitude of risk. Another approach, which is common in medical research, is to evaluate screening test performance by dividing scores into ordinal categories for which interval likelihood ratios can be estimated. Interval likelihood ratios have yet to be applied to academic screening research. We reanalyzed data from a math screening study in middle school to evaluate differences in screening accuracy and efficiency when dichotomous or interval likelihood ratios were used to interpret screening performance within a gated screening model. Student performance on the prior year statewide achievement test was used as the first gate, followed by six different permutations of student performance on two math curriculum-based measures and the Measures of Academic Progress. Each model was used to predict student proficiency on the subsequent statewide achievement test in math. Treating screening performance as an ordinal variable yielded wider ranges between likelihood ratios than when screening scores were dichotomized. After applying a threshold decision-making model to interpret post-test probability of risk, the minimum number of tests required to classify all students as at-risk or not at-risk ranged between two and three (depending on grade and method of estimating likelihood ratios). The diagnostic accuracy results were similar when interval likelihood ratios or dichotomized results were used to interpret screening scores. Although replication of these findings is needed, one potential benefit of using interval likelihood ratios may be the reduction of the number of students who required additional screening after the first gate.

Evaluating Tau-U With Oral Reading Fluency Data and the Impact of Measurement Error.

Recently, researchers have argued that using quantitative effect sizes in single-case design (SCD) research may facilitate the identification evidence-based practices. Indices to quantify nonoverlap are among the most common methods for quantifying treatment effects in SCD research. Tau-U represents a family of effect size indices that were developed to address criticisms of previously developed measures of nonoverlap. However, more research is necessary to determine the extent to which Tau-U successfully addresses proposed limitations of other nonoverlap methods. This study evaluated Tau-U effect sizes, derived from multiple-baseline designs, where researchers used curriculum-based measures of reading (CBM-R) to measure reading fluency. Specifically, we evaluated the distribution of the summary Tau-U statistic when applied to a large set of CBM-R data and assessed how the variability inherent in CBM-R data may influence the obtained Tau-U values. Findings suggest that the summary Tau-U statistic may be susceptible to ceiling effects. Moreover, the results provide initial evidence that error inherent in CBM-R scores may have a small but meaningful influence on the obtained effect sizes. Implications and recommendations for research and practice are discussed.

Mindfulness-based interventions for teachers: A meta-analysis of the emerging evidence base.

Teachers report high levels of occupational stress, which is associated with teacher turnover and potential negative consequences for students. Mindfulness-based interventions (MBIs) may improve the protective factors that buffer educators against occupational stress. Although previous meta-analytic reviews synthesized the effects of MBIs for healthy and clinical samples of adults, this study was the first to synthesize the effects of MBIs for teachers (grades pre-K through 12). A total of 347 effect sizes from 29 studies (N = 1,493) were synthesized using metaregression with robust variance estimation. Overall, MBIs had a medium treatment effect on teacher outcomes (g = .601, SE = .089). Visual and statistical evidence of publication bias suggested this estimate may be positively biased. Three potential study-level moderators for overall effects were also examined, but none were statistically significant. MBIs were associated with small-to-medium positive effects on therapeutic processes and therapeutic outcomes. MBIs had the smallest effects on measures of classroom climate and instructional practices. Overall, findings were similar to other meta-analytic reviews of MBIs for nonclinical adult populations and working professionals. The literature on MBIs for teachers appears to have similar gaps as research on MBIs for adults (e.g., Davidson & Kaszniak, 2015), including the primary use of self-report measures, the lack of active treatment comparisons, and rare reporting of treatment fidelity data. Directions for future research and implications are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Single measure and gated screening approaches for identifying students at-risk for academic problems: Implications for sensitivity and specificity.

Educators need recommendations to improve screening practices without limiting students' instructional opportunities. Repurposing previous years' state test scores has shown promise in identifying at-risk students within multitiered systems of support. However, researchers have not directly compared the diagnostic accuracy of previous years' state test scores with data collected during fall screening periods to identify at-risk students. In addition, the benefit of using previous state test scores in conjunction with data from a separate measure to identify at-risk students has not been explored. The diagnostic accuracy of 3 types of screening approaches were tested to predict proficiency on end-of-year high-stakes assessments: state test data obtained during the previous year, data from a different measure administered in the fall, and both measures combined (i.e., a gated model). Extant reading and math data (N = 2,996) from 10 schools in the Midwest were analyzed. When used alone, both measures yielded similar sensitivity and specificity values. The gated model yielded superior specificity values compared with using either measure alone, at the expense of sensitivity. Implications, limitations, and ideas for future research are discussed. (PsycINFO Database Record

Mindfulness-based interventions with youth: A comprehensive meta-analysis of group-design studies.

The treatment effects of Mindfulness-Based Interventions (MBIs) with youth were synthesized from 76 studies involving 6121 participants. A total of 885 effect sizes were aggregated using meta-regression with robust variance estimation. Overall, MBIs were associated with small treatment effects in studies using pre-post (g=0.305, SE=0.039) and controlled designs (g=0.322, SE=0.040). Treatment effects were measured after a follow-up period in 24 studies (n=1963). Results demonstrated that treatment effects were larger at follow-up than post-treatment in pre-post (g=0.462, SE=0.118) and controlled designs (g=0.402, SE=0.081). Moderator analyses indicated that intervention setting and intervention dosage were not meaningfully related to outcomes after controlling for study design quality. With that said, the between-study heterogeneity in the intercept-only models was consistently small, thus limiting the amount of variance for the moderators to explain. A series of exploratory analyses were used to investigate the differential effectiveness of MBIs across four therapeutic process domains and seven therapeutic outcome domains. Small, positive results were generally observed across the process and outcome domains. Notably, MBIs were associated with moderate effects on the process variable of mindfulness in controlled studies (n=1108, g=0.510). Limitations and directions for future research and practice are discussed.

Suicide Prevention Public Service Announcements Impact Help-Seeking Attitudes: The Message Makes a Difference.

Suicide continues to be one of the most serious public health challenges. Public service announcements (PSAs) are frequently used to address this challenge, but are rarely sufficiently evaluated to determine if they meet the intended goals, or are associated with potential iatrogenic effects. Although it is challenging to assess the relative impact of different PSA modalities, our group previously noted that one billboard message failed to show the same benefits as one TV ad [e.g., Klimes-Dougan and Lee (1)]. The purpose of this study was to extend these findings to test critical aspects of suicide prevention billboard messaging. Although both simulated billboard messages presented had identical supporting messages, we predicted that the more personal billboard message, focused on saving one's life, would cause more favorable help-seeking attitudes than the message focused on suicide. Young adult university students (N = 785) were randomly assigned to one of three conditions; one of two billboard simulations or a TV ad simulation. Help-seeking attitudes, maladaptive coping, and reports of concern and distress were evaluated. The results of this study suggest some relative benefits in endorsement of favorable help-seeking attitudes for one of the billboard conditions - stop depression from taking another life. Although further research is needed to determine what methods will alter the risk for suicide in the population, the results of this study provide a useful first step showing that some billboard messaging may favorably influence help-seeking attitudes.

Attitudes and Perceptions of Suicide and Suicide Prevention Messages for Asian Americans.

Understanding the context of suicidal behaviors is critical for effective suicide prevention strategies. Although suicide is an important topic for Asian Americans, there is limited information about what Asian Americans' attitudes are towards suicide and their perceptions about the effectiveness of prevention efforts. These questions are critical to examine to provide foundational knowledge for determining how best to intervene. In this study, Asian American (n = 87) and White (n = 87) participants completed self-report indexes on their knowledge of depression and suicide (e.g., estimates of suicide rates), coping attitudes (e.g., help-seeking) and suicide prevention attitudes (e.g., usefulness of PSAs). The results indicate that in comparison to Whites, Asian Americans perceived suicidal behavior to be more common, perceived a stronger link between depression and suicide, less frequently endorsed help-seeking strategies, and reported more concern or distress after viewing a suicide prevention PSA. These preliminary results also suggest the possibility of cultural differences in perceptions of suicide prevention messages. The implications of these findings are discussed with a focus on providing recommendations for exploring suicide prevention efforts for Asian Americans.

The impact of universal suicide-prevention programs on the help-seeking attitudes and behaviors of youths.

BACKGROUND: While the ultimate goal of adolescent suicide-prevention efforts is to decrease the incidence of death by suicide, a critical intermediary goal is directing youths toward effective sources of assistance. AIM: To comprehensively review the universal prevention literature and examine the effects of universal prevention programs on student's attitudes and behaviors related to help-seeking. METHOD: We systematically reviewed studies that assessed help-seeking outcomes including prevention efforts utilizing (1) psychoeducational curricula, (2) gatekeeper training, and (3) public service messaging directed at youths. Of the studies reviewed, 17 studies evaluated the help-seeking outcomes. These studies were identified through a range of sources (e.g., searching online databases, examining references of published articles on suicide prevention). RESULTS: The results of this review suggest that suicide-prevention programming has a limited impact on help-seeking behavior. Although there was some evidence that suicide-prevention programs had a positive impact on students' help-seeking attitudes and behaviors, there was also evidence of no effects or iatrogenic effects. Sex and risk status were moderators of program effects on students help-seeking. CONCLUSIONS: Caution is warranted when considering which suicidal prevention interventions best optimize the intended goals. The impact on adolescents' help-seeking behavior is a key concern for educators and mental-health professionals.

A systematic review and summarization of the recommendations and research surrounding Curriculum-Based Measurement of oral reading fluency (CBM-R) decision rules.

Research and policy have established that data are necessary to guide decisions within education. Many of these decisions are made within problem solving and response to intervention frameworks for service delivery. Curriculum-Based Measurement in Reading (CBM-R) is a widely used data collection procedure within those models of service delivery. Although the evidence for CBM-R as a screening and benchmarking procedure has been summarized multiple times in the literature, there is no comprehensive review of the evidence for its application to monitor and evaluate individual student progress. The purpose of this study was to identify and summarize the psychometric and empirical evidence for CBM-R as it is used to monitor and evaluate student progress. There was an emphasis on the recommended number of data points collected during progress monitoring and interpretive guidelines. The review identified 171 journal articles, chapters, and instructional manuals using online search engines and research databases. Recommendations and evidence from 102 documents that met the study criteria were evaluated and summarized. Results indicate that most decision-making practices are based on expert opinion and that there is very limited psychometric or empirical support for such practices. There is a lack of published evidence to support program evaluation and progress monitoring with CBM-R. More research is required to inform data collection procedures and interpretive guidelines.