Evaluating a gated screening approach for identifying risk in kindergarten mathematics.

The purpose of the present study was to examine the diagnostic accuracy of different universal screening approaches for identifying mathematics difficulties in kindergarteners. We used extant data from 2,010 kindergarten students from 23 schools across two states. First, we identified the diagnostic accuracy of two individual screeners: (a) a set of three curriculum-based measures (CBM) and (b) a diagnostic measure, the Number Sense Brief (NSB). Then, we determined the diagnostic accuracy of a gated screening approach considering both the CBM and NSB. The criterion measure was a norm-referenced mathematics achievement test. The results indicated that area under the curve values met or exceeded .80 for both individual screeners; however, the number of false positives was high. The gated screening approach yielded fewer false positives at the expense of increasing false negatives. Directions for future research and the practical implications of the results for screening in kindergarten mathematics are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

An interdisciplinary perspective on the strengths and weaknesses of the International Dyslexia Association definition of dyslexia.

This commentary article describes the results of a Delphi Method discussion between an interdisciplinary team of state dyslexia policy implementers. The authors argue that the International Dyslexia Association (IDA) definition of dyslexia from 2001 skews toward the perspectives of the research community, inadvertently creating implementation challenges for school practice. The article describes how the authors reached this determination; why they believe Vaughn et al.'s (Annals of Dyslexia, 2024) proposed definition marks an improvement over the 2001 IDA definition; and the need for continued support in the dyslexia policy implementation process, including knowledge dissemination efforts and updates to other relevant policy documents. This collaboration between policymakers, educators, and researchers contributes to the special issue by considering how the definition of dyslexia is situated in policy and practice. In so doing, it addresses a longstanding gap in academic research on how policy implementers understand and use the IDA definition.

Examining Interactions Across Instructional Tiers: Do Features of Tier 1 Predict Student Responsiveness to Tier 2 Mathematics Intervention?

High-quality Tier 1 instruction is frequently conceptualized as the "foundation" for other tiers of intervention within multitiered systems of support (MTSS) models. However, the vast majority of Tier 2 intervention studies do not account for Tier 1 variables when examining intervention effectiveness. The purpose of this study was to examine Tier 1 predictors, or "quality indicators," of differential responsiveness to Tier 2 mathematics intervention. Data were drawn from a large-scale data set where all teachers taught the Early Learning in Mathematics (Tier 1) core program across the academic year, and a subset of students were selected for the ROOTS (Tier 2) mathematics intervention. We examined the following Tier 1 variables: (a) classroom-level mathematics gains, (b) Tier 1 fidelity of implementation, (c) Tier 1 classroom management and instructional support, and (d) class size. Response to Tier 2 intervention was not significantly predicted by any of the Tier 1 variables examined; however, the pattern of Hedges' g effect sizes suggested that students with higher quality of Tier 1 instruction tended to benefit less from the Tier 2 ROOTS intervention. Results are discussed in the context of implications for research and practice.

A realist review of dyslexia pilot project research.

We conducted a realist review of state-authorized dyslexia pilot projects to understand how they have been implemented and evaluated, and the extent to which they adhere to best practice recommendations. We found that states have piloted broadly similar policy programs minimally consisting of professional development, universal screening, and instructional intervention. However, none of the pilot report documents we reviewed included explicit logic models or theories of action, which makes it difficult to understand the pilot projects and their results. Officially, most of the pilot project evaluations sought to establish the effectiveness of their programs. However, only two states used evaluation designs that are well-suited to making causal inferences about program effects, which complicates the interpretation of pilot project results. To make future pilot projects more useful to evidence-based policymaking, we make recommendations to improve their design, implementation, and evaluation.

Proficiency With Number Concepts and Operations: Replicating the Efficacy of a First-Grade Mathematics Intervention.

Conceptual replications are part and parcel of education science. Methodologically rigorous conceptual replication studies permit researchers to test and strengthen the generalizability of a study's initial findings. The current conceptual replication sought to replicate the efficacy of a small-group, first-grade mathematics intervention with 240 first-grade students with mathematics difficulties in a new geographical region. Participating students were randomized into one of three conditions: (a) 2:1 mathematics intervention group, (b) 5:1 mathematics intervention group, or (c) business-as-usual instruction. Relative to the original study, findings from the replication varied. When comparing the treatment groups to the control, results suggested positive effects on all outcome measures, including a follow-up assessment administered one year later. However, differences between the two treatment groups based on group size were not found in the mathematics outcome measures. Both groups also received commensurate levels of observed instructional interactions. Implications for unpacking contextual differences between original research and their replications as well as using future research to explore the quantity and quality of instructional interactions as ways to explain variation in findings of group size are discussed.

Using Direct Observation to Document "Practice-Based Evidence" of Evidence-Based Mathematics Instruction.

Implementation of evidence-based practices (EBPs) is paramount to students' development of mathematics proficiency. This study investigated "practice-based evidence" of interventionists' actual use of explicit mathematics instruction, a well-established EBP. Specifically, this study analyzed direct observation data collected in a federally funded efficacy trial involving a Tier 2 first-grade mathematics intervention to examine whether the quantity and quality of explicit mathematics instruction was associated with the mathematics outcomes of 470 first-grade students with or at risk for mathematics learning disabilities. Associations between group-level pretreatment skill levels and the quality and quantity of explicit mathematics instructional practices used in the intervention were also explored. Findings suggested significant associations between positive gains in student mathematics outcomes and (a) lower rates of incorrectly answered mathematics-focused questions, and (b) the rate in which interventionists delivered group-level practice opportunities and offered academic feedback. Significant associations were also found between initial student mathematics performance and rates of student errors and the quality of explicit instruction. Implications for using direct observation to document enacted EBPs are discussed.

Exploring the utility of assessing early mathematics intervention response via embedded assessment.

The provision of high-quality early mathematics instruction and intervention is critical to ensure that all students are on track for academic success. Given this, identifying and utilizing assessments that can enable the detection of nonresponse to mathematics instruction is a critical aspect of early intervention. To this end, the current study explored the extent to which there were distinct patterns of performance on embedded assessments for intervention participants within the context of a large-scale randomized control trial of the ROOTS intervention. This study also examined how performance on embedded assessments was associated with pretest mathematics scores and residual gains on mathematics measures, and how those associations differed based on (a) the point in the intervention when students demonstrated difficulty, and (b) intervention intensity. Findings from this study suggest that participants fell into 4 distinct performance categories and performance classifications were associated with pretest measures and gains in mathematics achievement. Study results also highlight the potential relevance of instructional intensity and timely monitoring of student performance. Implications for intervention and instructional planning in the context of tiered instructional delivery models are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).