Statistical methods and reporting practices in the study of dyslexia.

This report presents findings from a review of the journals Dyslexia and Annals of Dyslexia over a 10-year period from 2005 to 2014. Three hundred articles were reviewed to examine statistical methodology and reporting practices. Articles were coded according to their reported covariates, effect sizes, and statistical methods. In addition, trends were examined in relation to the 2008 release of the What Works Clearinghouse Procedures and Standards Handbook from the Institute of Education Sciences in order to evaluate any potential impact of recommended practices. We found an increase in prevalence of specific statistical methods as well as increases in reporting of effect sizes following publication of the handbook. The reporting of effect sizes statistically significantly increased following publication of the manual (55% prepublication vs. 72% post-publication). The use of analysis of variance increased post-publication, whereas articles using no statistical methods or descriptives only decreased. Approximately one third of articles included covariates in their analysis; inclusion of covariates was consistent from prepublication to post-publication. Findings indicate that over the past 10 years, articles are becoming increasingly rigorous in methodology and reporting practices.

Factors Related to Data-Based Decision-Making: Examining Experience, Professional Development, and the Mediating Effect of Confidence on Teacher Graph Literacy.

In tiered instructional systems (Response to Intervention [RTI]/Multitier System of Supports [MTSS]) that rely on ongoing assessment of students at risk of experiencing academic difficulties, the ability to make informed decisions using student data is critical for student learning. Prior research has demonstrated that, on average, teachers have difficulty analyzing and interpreting student progress-monitoring (PM) data presented graphically (i.e., graph literacy). This study examines the impact that teacher training, experience, and confidence have on teacher graph literacy, using structural equation modeling. Data were gathered from a nationally representative sample of 309 teachers and included latent variables related to their experience (e.g., years teaching, years working with RTI), training (e.g., hours of data-based decision-making [DBDM] professional development), and confidence (e.g., confidence in interpreting data, confidence in determining student response) as well as data-based decision-making skills on a graph literacy assessment. Findings indicate that latent experience and confidence factors predicted graph literacy but training did not. Furthermore, training increased teacher confidence but experience did not. Finally, confidence did not mediate the effect of experience or training on graph literacy.

External evaluations for dyslexia: do the data support parent concerns?

A grassroots movement of parents who fear that their children's reading struggles are going unrecognized at school has led to dyslexia laws in all but three states in the U.S. The current study was undertaken to provide data relevant to this topic by characterizing the reading profiles of 71 children referred for testing at a center specializing in the assessment of reading disabilities. These children were receiving instruction and intervention in reading across the tiers of instructional support in general and special education within their schools. On average, the children demonstrated equivalent deficits in print literacy skills on norm-referenced assessments regardless of the intensity of their reading support, and the majority of children who were only receiving tier 1 instruction exhibited characteristics of dyslexia. Moreover, 69% of children only receiving tier 1 instruction, and all remaining children, performed below benchmark expectations on a curriculum-based measure of oral reading fluency. While these data are not an evaluation of the implementation of the state's dyslexia laws or the statewide implementation of RTI, they provide data characterizing the real struggles and lack of identification of children whose parents seek an external evaluation of their children's reading skills. However, they are set in the context of a state in which 66% of public-school children cannot read proficiently by the end of the third grade. The reading struggles highlighted in this clinic referral sample are unexceptional in the larger state context.

Characteristics of Students Identified With Dyslexia Within the Context of State Legislation.

All but seven U.S. states have laws that govern some aspects of dyslexia screening, intervention, or teacher training in public schools. However, in the three states that mandate child-level reporting, data indicate lower than expected rates of dyslexia identification when compared with commonly accepted dyslexia prevalence rates. To better understand this apparent mismatch, this study explores factors that might predict the school-assigned identification of individuals with dyslexia. Deidentified data on 7,947 second-grade students in 126 schools from one U.S. state included a universal screening measure of literacy skills indicative of dyslexia (i.e., reading and spelling), school-assigned dyslexia classification, and demographic characteristics. As expected, behavioral characteristics of dyslexia from universal screening were associated with school-assigned dyslexia classification. However, dyslexia classification was less likely for minority students and individuals attending schools with a higher percentage of minority students. Students who showed behavioral characteristics of dyslexia and attended schools with a higher proportion of other students with similar poor literacy skills were more likely not to receive a school-assigned dyslexia classification. The findings suggest systematic demographic differences in whether a student is identified with dyslexia by schools even when using universal screening.

Characterizing the knowledge of educators receiving training in systematic literacy instruction.

Addressing the needs of students with dyslexia requires an in-depth knowledge of various components of a multi-dimensional approach to reading intervention, which is supported by an understanding of the structure of the language being taught. The current study explored the association between teacher knowledge of the English language and different stages of training provided through 2-year courses that meet the objectives of the International Dyslexia Association (IDA) standards of teacher knowledge and practice. It included 347 K-12 licensed teachers who were at various stages of training when they completed a test of knowledge in the areas of Phonological Sensitivity, Phonemic Awareness, Decoding, Spelling, and Morphology. The level of terminal degree (i.e., BA or MA) held by participating teachers and their amount of teaching experience did not predict performance on the test. In contrast, participating teachers differed in their level of knowledge as a function of how much training they had received as part of a 2-year course. Increased training was associated with elevated levels of knowledge. Moreover, teachers who completed the 2-year training program and went on to obtain certification through a national certifying organization had reliably greater knowledge than those who had not. Additionally, the weakest domains of knowledge across all teachers were in spelling and morphology, suggesting a need for improved training in these domains, given that they are identified deficiencies for persistently poor responders to reading intervention and in children presenting with late emerging forms of reading disability.

A Review of Middle School Vocabulary Interventions: Five Research-Based Recommendations for Practice.

Purpose The purpose of this tutorial is to explain key concepts about vocabulary acquisition and instruction and to translate research from middle school vocabulary interventions into practice recommendations for practitioners. In this tutorial, we consider the relationship between vocabulary and reading comprehension, describe vocabulary acquisition including the development of semantic networks, provide a review of high-quality middle school vocabulary studies, and make recommendations for practice. Method We reviewed the experimental and quasi-experimental literature examining the impact of vocabulary instruction on the vocabulary and reading comprehension development of middle school students. We searched multiple electronic databases (e.g., PsycInfo, ERIC, Scopus, Google Scholar) using combinations of specific search terms (i.e., vocabulary, intervention, instruction, middle school, adolescent), searched reviews of vocabulary research, and conducted bibliographic searches of included studies. We then extracted information from each included study about the intervention, participants, and outcomes. Results We identified 17 studies meeting our inclusion criteria. The majority of studies were conducted with students from low socioeconomic status backgrounds. Only 1 study focused exclusively on students with learning disabilities, language impairments, or reading disabilities, highlighting the need for more vocabulary experimental research studies with special populations of students in middle school. Conclusion After reviewing the middle school studies, we make 5 recommendations based on the literature: (a) teach vocabulary intentionally, (b) teach independent word-learning strategies (morphological analysis), (c) focus on developing semantic networks, (d) increase opportunities to use new words in discussion and writing, and (e) provide a motivating and language-rich learning environment.

Predictive Validity of Curriculum-Embedded Measures on Outcomes of Kindergarteners Identified as At Risk for Reading Difficulty.

This study examined the predictive validity of formative assessments embedded in a Tier 2 intervention curriculum for kindergarten students identified as at risk for reading difficulty. We examined when (i.e., months during the school year) measures could predict reading outcomes gathered at the end of kindergarten and whether the predictive validity of measures changed across the kindergarten year. Participants consisted of 137 kindergarten students whose reading development was assessed four times from October to February. Measures aligned with content taught in the curriculum and assessed a range of phonologic, alphabetic, and word-reading skills. Results from structural equation modeling indicate that 36.3% to 65.2% of the variance was explained on the latent decoding outcome and 62.0% to 86.8% on the latent phonological outcome across the four time points. Furthermore, the predictive validity of specific skills increased over the kindergarten year, with more complicated tasks (e.g., word segmentation) becoming more predictive at subsequent measurement occasions. Results suggest that curriculum-embedded measures may be viable tools for assessing and predicting reading performance.

Examining the effects of linking student performance and progression in a tier 2 kindergarten reading intervention.

Despite the emerging evidence base on response to intervention, there is limited research regarding how to effectively use progress-monitoring data to adjust instruction for students in Tier 2 intervention. In this study, we analyzed extant data from a series of randomized experimental studies of a kindergarten supplemental reading intervention to determine whether linking performance on formative assessments to curriculum progression improved kindergarten reading outcomes over standard implementation. We were interested in whether specific progression adjustments would enhance the effects of supplemental reading intervention. Growth-mixture modeling using data from kindergarteners (n = 136) whose intervention progression (e.g. repeat lessons, skip lessons) was adjusted every 4 weeks based on mastery data identified four latent classes characterized by unique profiles of curriculum progression adjustments. Multilevel analyses comparing the performance of students in the four classes with that of propensity matched groups whose intervention was not adjusted (n = 101) indicated positive effects of curriculum progression for (a) students whose formative assessment performance exceeded 90% and received early and sustained lesson acceleration and (b) students who initially performed below 70% on assessments and who repeated early lessons and progressed to conventional implementation. Effects of curriculum adjustments for the two smallest groups were less clear.

Assessing spelling in kindergarten: further comparison of scoring metrics and their relation to reading skills.

Early reading and spelling development share foundational skills, yet spelling assessment is underutilized in evaluating early reading. This study extended research comparing the degree to which methods for scoring spelling skills at the end of kindergarten were associated with reading skills measured at the same time as well as at the end of first grade. Five strategies for scoring spelling responses were compared: totaling the number of words spelled correctly, totaling the number of correct letter sounds, totaling the number of correct letter sequences, using a rubric for scoring invented spellings, and calculating the Spelling Sensitivity Score (Masterson & Apel, 2010b). Students (N=287) who were identified at kindergarten entry as at risk for reading difficulty and who had received supplemental reading intervention were administered a standardized spelling assessment in the spring of kindergarten, and measures of phonological awareness, decoding, word recognition, and reading fluency were administered concurrently and at the end of first grade. The five spelling scoring metrics were similar in their strong relations with factors summarizing reading subskills (phonological awareness, decoding, and word reading) on a concurrent basis. Furthermore, when predicting first-grade reading skills based on spring-of-kindergarten performance, spelling scores from all five metrics explained unique variance over the autoregressive effects of kindergarten word identification. The practical advantages of using a brief spelling assessment for early reading evaluation and the relative tradeoffs of each scoring metric are discussed.