A Systematic Review of CBM Content in Practitioner-Focused Journals: Do We Talk About Instructional Decision-Making?

Data-based decision-making (DBDM) using curriculum-based measurement (CBM) data has demonstrated effectiveness in improving academic achievement for students with or at risk for learning disability. Despite substantial evidence supporting DBDM, its use is not common practice for many educators, even those who regularly collect CBM data. One explanation for its lack of widespread use is that educators may not receive adequate training in the DBDM aspects of CBM. Espin et al. examined the extent to which DBDM is represented in CBM professional development (PD) materials and found that the topic was significantly underrepresented (12% to 14% of CBM PD material content) compared with other CBM topics. The purpose of this study was to conduct a conceptual replication of the Espin et al. systematic review through an analysis of CBM content in practitioner journal articles. The present review includes 29 practitioner articles coded to the four CBM categories used in the Espin et al. study: (a) general CBM information, (b) conducting CBM, (c) data-based decision-making, and (d) other. Results revealed a pattern similar to the one found by Espin et al. with approximately 18% of the content of practitioner articles on CBM devoted to the topic of decision-making. These findings strengthen the recommendation from Espin et al. for increased attention to DBDM in CBM training materials.

International Perspectives on Understanding and Improving Teachers' Data-Based Instruction and Decision Making: Introduction to the Special Series.

This article serves as an introduction to the special series, Data-Based Instruction and Decision-Making: An International Perspective. In this series, we bring together international researchers from both special and general education to address teachers' use (or non-use) of data for instructional decision making. Via this special series, we aim to increase understanding of the challenges involved in teachers' data-based instructional decision making for students with or at-risk for learning disabilities, and to further the development of approaches for improving teachers' ability to plan, adjust, and adapt instruction in response to data.

A Systematic Review of CBM Professional Development Materials: Are Teachers Receiving Sufficient Instruction in Data-Based Decision-Making?

The purpose of this study was to examine the amount of attention devoted to data-based decision-making in Curriculum-Based Measurement (CBM) professional development materials. Sixty-nine CBM instructional sources were reviewed, including 45 presentations, 22 manuals, and two books. The content of the presentations and manuals/books was coded into one of four categories: (a) general CBM information, (b) conducting CBM, (c) data-based decision-making, and (d) other. Results revealed that only a small proportion of information in the CBM instructional materials was devoted to data-based decision-making (12% for presentations and 14% for manuals/books), and that this proportion was significantly smaller than (a) that devoted to other instructional topics, (b) that expected were information to be equally distributed across major instructional topics, and (c) that recommended by experienced CBM trainers. Results suggest a need for increased attention to data-based decision-making in CBM professional development.

Improving Teachers' Comprehension of Curriculum-Based Measurement Progress-Monitoring Graphs.

The authors examined three instructional approaches for improving teachers' curriculum-based measurement (CBM) graph comprehension, each differing in the extent to which reading the data, interpreting the data, and linking the data to instruction were emphasized. Participants were 164 elementary school teachers who were randomly assigned to one of three CBM instructional approaches or a control condition. Instruction was delivered via videos. Prior to and after receiving instruction, teachers completed a CBM graph-comprehension task. They also evaluated the instructional videos. Teachers in the three instructional groups improved more in CBM graph comprehension than control teachers. Improvements were seen primarily in interpreting and linking the data to instruction, two important but difficult aspects of CBM graph comprehension. Differences between the instructional groups were found for interpreting the data. Teachers evaluated the videos positively. Results indicate that teachers' CBM graph comprehension can be improved via video instruction. Implications for teaching teachers to implement CBM are discussed.

CBM maze-scores as indicators of reading level and growth for seventh-grade students.

The technical adequacy of CBM maze-scores as indicators of reading level and growth for seventh-grade secondary-school students was examined. Participants were 452 Dutch students who completed weekly maze measures over a period of 23 weeks. Criterion measures were school level, dyslexia status, scores and growth on a standardized reading test. Results supported the technical adequacy of maze scores as indicators of reading level and growth. Alternate-form reliability coefficients were significant and intermediate to high. Mean maze scores showed significant increase over time, students' growth trajectories differed, and students' initial performance levels (intercepts) and growth rates (slopes) were not correlated. Maze reading level and growth were related to reading level and/or growth on criterion measures. A nonlinear model provided a better fit for the data than a linear model. Implications for use of CBM maze-scores for data-based decision-making are discussed.

Curriculum-Based Measurement progress data: Effects of graph pattern on ease of interpretation.

Curriculum-Based Measurement (CBM) is a system for monitoring the progress of and evaluating instructional program effectiveness for students with learning difficulties. Although a large amount of research has been conducted on CBM, little has focused on the interpretation and use of the data for instructional decision-making, despite the fact that it is data use that leads to performance gains. In this study, we examine factors affecting the interpretation of CBM data. Specifically, we examine the effect of CBM graph patterns on ease of graph interpretation. Thirty college/university students completed a two-part study in which they viewed various slope-to-goal and slope-to-slope patterns of CBM-graphed data and answered decision-making questions. Response times and accuracy were measured. Results revealed that graph patterns differed in terms of ease of interpretation. Differences depended on the type of question. Implications for interpretation and use of CBM data for decision-making are discussed.

History as narrative: the nature and quality of historical understanding for students with LD.

In this study, we examine the nature and quality of students' comprehension of history. Specifically, we explore whether cognitive-psychological theories developed to capture the comprehension of narrative text can be used to capture the comprehension of history. Participants were 36 students with learning disabilities who had taken part in an earlier study designed to investigate the effects of an interactive instructional intervention in history. The results of the original study supported the effectiveness of the intervention in terms of amount recalled. The results of the present study reveal that historical understanding can be characterized as the construction of meaning through the creation of a causal network of events. The study of history within a causal network framework has implications for understanding the nature and quality of students' learning of history, and for potentially identifying sources of failure in learning.

Curriculum-based measurement in the content areas: vocabulary matching as an indicator of progress in social studies learning.

The purpose of this study was to examine the reliability and validity of curriculum-based measures as indicator of growth in content-area learning. Participants were 58 students in 2 seventh-grade social studies classes. CBM measures were student- and administrator-read vocabulary-matching probes. Criterion measures were performance on a knowledge test, the social studies subtest of the Iowa Test of Basic Skills (ITBS), and student grades. Both the student- and examiner-read measures reflected change in performance; however, only the student-read measure resulted in interindividual differences in growth rates. Significant relations were found between the growth rates generated by the student-read vocabulary measure and student course grades, ITBS scores, and growth on the knowledge test. These results support the validity of a vocabulary-matching measure as an indicator of student learning in the content areas. The results are discussed in terms of the use of CBM as a system for monitoring performance and evaluating interventions for students with learning disabilities in content-area classrooms.

Assessing the reliability of Curriculum-Based Measurement: an application of Latent Growth Modeling.

The purpose of this study was to demonstrate the use of Latent Growth Modeling (LGM) as a method for estimating reliability of Curriculum-Based Measurement (CBM) progress-monitoring data. The LGM approach permits the error associated with each measure to differ at each time point, thus providing an alternative method for examining of the reliability of CBM reading aloud data over repeated measurements. The analysis revealed that the reliability of CBM data was not a fixed property of the measure, but it changed with time. The study demonstrates the need to consider reliability in new ways with respect to the use of CBM data as repeated measures.