What We Know and Need to Know about Literacy Interventions for Elementary Students with Reading Difficulties and Disabilities, including Dyslexia.

The purpose of this paper is to describe what we know and what we still need to learn about literacy intervention for children who experience significant difficulties learning to read. We reviewed 14 meta-analyses and systematic reviews of experimental and quasi-experimental studies published in the last decade that examined the effects of reading and writing interventions in the elementary grades, including research focused on students with reading difficulties and disabilities, including dyslexia. We attended to moderator analyses, when available, to further refine what we know and need to learn about interventions. Findings from these reviews indicate that explicit and systematic intervention focusing on the code and meaning dimensions of reading and writing, and delivered one-to-one or in small groups, are likely to improve foundational code-based reading skills, and to a lesser extent, meaning-based skills, across elementary grade levels. Findings, at least in the upper elementary grades, indicate that some intervention features including standardized protocols, multiple components, and longer duration can yield stronger effects. And, integrating reading and writing interventions shows promise. We still need to learn more about specific instructional routines and components that provide more robust effects on students' ability to comprehend and individual differences in response to interventions. We discuss limitations of this review of reviews and suggest directions for future research to optimize implementation, particularly to understand for whom and under what conditions literacy interventions work best.

Data Envelopment Analysis (DEA) in the Educational Sciences.

Many of the analytical models commonly used in educational research often aim to maximize explained variance and identify variable importance within models. These models are useful for understanding general ideas and trends, but give limited insight into the individuals within said models. Data envelopment analysis (DEA), is a method rooted in organizational management that makes such insights possible. Unlike models alluded to above, DEA does not explain variance. Instead, it explains how efficiently an individual utilizes their inputs to produce outputs, and identifies which input is not being utilized optimally. This paper provides a history and usages of DEA from fields outside of education, and describes the math and processes behind it. This paper then extends DEA's usage into the educational field using a study on child reading ability. Using students from the Project KIDS dataset (n=1987), DEA is demonstrated using a simple view of reading framework, identifying individual efficiency levels in using reading-based skills to achieve reading comprehension, determining which skills are being underutilized, and classifying new subsets of readers. New subsets of readers were identified using this method, with implications for more targeted interventions.

A Study of the Factor Structure, Profiles, and Concurrent Validity of the Mindset Assessment Profile Tool for Elementary Students.

This study explored the underlying latent structure of items on the Mindset Assessment Profile (MAP) tool, explore whether subgroups of students exist based on the latent structure of MAP items, and test whether subgroups were differentiated on standardized measures of reading comprehension, vocabulary, and word reading. Participants included 431 fourth grade students. Confirmatory factor analysis revealed that a three-factor model provided the most parsimonious fit to the data. Results of exploratory finite mixture model analysis with auxiliary regression suggested five classes of students with the students categorized as Growth Mindset - High Effort profile, having the highest, observed reading comprehension (M = 451.98, SD = 38.88) and vocabulary (M = 454.37, SD = 34.74) scores. By contrast, students categorized as Fixed Mindset - Higher Effort had the lowest observed reading comprehension and vocabulary scores. Limitations and directions for future research, and implications for using MAP assessment to inform intervention are discussed.

Linguistic Predictors of Single-Word Spelling in First Grade Students with Speech and/or Language Impairments.

The purpose of this study was (a) to compare the single-word spelling performance of first graders across four groups that varied by speech and language status; and (b) to determine the linguistic predictors of first-grade spelling for children with speech and/or language impairment compared to children with typical development. First grade children (N = 529) completed measures of spelling, early word reading, expressive vocabulary, phonological awareness, and morphosyntactic knowledge. Children with language impairment, with or without speech impairments, demonstrated lower spelling performance than children with typical development; children with speech impairment only did not differ from children with typical development. Additionally, early word reading and phonological awareness predicted spelling performance, regardless of group. Study findings indicate that language status, but not speech status, is a risk factor for low spelling performance in first grade, and that first grade spelling instruction should focus on developing early word reading and phonological awareness.

Advanced Reading Comprehension Expectations in Secondary School: Considerations for Students with Emotional or Behavior Disorders.

The debate around recent implementation of the Common Core Standards (CCSS) has perplexed many policy makers, practitioners, and researchers; yet there remains broad agreement for the need to improve reading outcomes and college and career readiness for all students, including students with disabilities. One of the most vulnerable populations with disabilities in terms of college and career readiness is students with emotional disorders (ED). A considerable percentage of students with ED encounter unfavorable academic and long-term outcomes, often due to reading difficulties and behavioral variables that impede learning. To date, the impact of rising expectations in reading on the education of students with ED has been absent from this conversation about CCSS. In this article, we consider the implications of new reading expectations in the critical period of Grades 6-12 for students with ED. First, we summarize grade level expectations of the standards. Then, we describe the characteristics and underachievement of students with ED. Next, we evaluate challenges in meeting the expectations based on extant research, and provide recommendations for practice based on the intervention literature. We conclude by prioritizing a research and policy agenda that advocates for increasing the likelihood of success in reading for students with ED in middle school and high school.

Towards an understanding of dimensions, predictors, and gender gap in written composition.

We had three aims in the present study: (1) to examine the dimensionality of various evaluative approaches to scoring writing samples (e.g., quality, productivity, and curriculum based writing [CBM]) , (2) to investigate unique language and cognitive predictors of the identified dimensions, and (3) to examine gender gap in the identified dimensions of writing. These questions were addressed using data from second and third grade students (N = 494). Data were analyzed using confirmatory factor analysis and multilevel modeling. Results showed that writing quality, productivity, and CBM scoring were dissociable constructs, but that writing quality and CBM scoring were highly related (r = .82). Language and cognitive predictors differed among the writing outcomes. Boys had lower writing scores than girls even after accounting for language, reading, attention, spelling, handwriting automaticity, and rapid automatized naming. Results are discussed in light of writing evaluation and a developmental model of writing.

Kindergarten Predictors of Third Grade Writing.

The primary goal of the present study was to examine the relations of kindergarten transcription, oral language, word reading, and attention skills to writing skills in third grade. Children (N = 157) were assessed on their letter writing automaticity, spelling, oral language, word reading, and attention in kindergarten. Then, they were assessed on writing in third grade using three writing tasks - one narrative and two expository prompts. Children's written compositions were evaluated in terms of writing quality (the extent to which ideas were developed and presented in an organized manner). Structural equation modeling showed that kindergarten oral language and lexical literacy skills (i.e., word reading and spelling) were independently predicted third grade narrative writing quality, and kindergarten literacy skill uniquely predicted third grade expository writing quality. In contrast, attention and letter writing automaticity were not directly related to writing quality in either narrative or expository genre. These results are discussed in light of theoretical and practical implications.

To Wait in Tier 1 or Intervene Immediately: A Randomized Experiment Examining First Grade Response to Intervention (RTI) in Reading.

This randomized controlled experiment compared the efficacy of two Response to Intervention (RTI) models - Typical RTI and Dynamic RTI - and included 34 first-grade classrooms (n = 522 students) across 10 socio-economically and culturally diverse schools. Typical RTI was designed to follow the two-stage RTI decision rules that wait to assess response to Tier 1 in many districts, whereas Dynamic RTI provided Tier 2 or Tier 3 interventions immediately according to students' initial screening results. Interventions were identical across conditions except for when intervention began. Reading assessments included letter-sound, word, and passage reading, and teacher-reported severity of reading difficulties. An intent-to-treat analysis using multi-level modeling indicated an overall effect favoring the Dynamic RTI condition (d = .36); growth curve analyses demonstrated that students in Dynamic RTI showed an immediate score advantage, and effects accumulated across the year. Analyses of standard score outcomes confirmed that students in the Dynamic condition who received Tier 2 and Tier 3 ended the study with significantly higher reading performance than students in the Typical condition. Implications for RTI implementation practice and for future research are discussed.

"Waiting to Fail" Redux: Understanding Inadequate Response to Intervention.

This introduction to the special issue provides an overview of the promise, but also the ongoing challenges, related to Response to Intervention (RTI) as a means of both prevention and identification of reading disabilities. We conclude by describing the articles in this special issue and considering their implications for future research.

The Relationship of Print Reading in Tier I Instruction and Reading Achievement for Kindergarten Students At-Risk for Reading Difficulties.

For many students at risk for reading difficulties, effective, early reading instruction can improve reading outcomes and set them on a positive reading trajectory. Thus, response-to-intervention models include a focus on a student's Tier I reading instruction as one element for preventing reading difficulties and identifying students with a learning disability. The purpose of this study was to examine the amount of time kindergarten students at risk for reading difficulties actively engaged in reading print during Tier I reading instruction, and the extent to which time in reading print was related to end-of-year reading achievement. Findings revealed the amount of time students were engaged in reading print predicted end-of-year reading achievement, although time engaged in reading print during Tier I was limited overall. Student and teacher level factors and their relationship to the amount of time students engage in reading print is also examined.

Understanding Inadequate Response to First Grade Multi-Tier Intervention: Nomothetic and Idiographic Perspectives.

The purpose of this study was to use a mixed methods approach to learn about inadequate response to a year-long multi-tier RTI model that allowed first-grade students to move up and down tiers. Participants were 156 students who received supplemental intervention services during a larger multi-tier RTI study involving classrooms and 522 students across 10 schools. Findings from an all-subset regression indicate letter word reading, the fluency composite, and blending words explained the most variance (15%) in response among initial skills. Adding additional teacher ratings of behavior and academics, accounted for a small amount of additional variance (3%) in group membership. The ROC curve analysis indicated 87.5% of students were correctly classified, yielding a sensitivity of 85.3 and a specificity of 65.0. Findings from qualitative observations of intervention sessions suggest inadequate responders demonstrated physical and verbal task avoidance and displayed emotions of hopelessness and shame. Implications for practice are discussed.

A longitudinal cluster-randomized controlled study on the accumulating effects of individualized literacy instruction on students' reading from first through third grade.

Using a longitudinal cluster-randomized controlled design, we examined whether students' reading outcomes differed when they received 1, 2, or 3 years of individualized reading instruction from first through third grade, compared with a treated control group. More than 45% of students came from families living in poverty. Following students, we randomly assigned their teachers each year to deliver individualized reading instruction or a treated control condition intervention focused on mathematics. Students who received individualized reading instruction in all three grades showed the strongest reading skills by the end of third grade compared with those who received fewer years of such instruction. There was inconsistent evidence supporting a sustained first-grade treatment effect: Individualized instruction in first grade was necessary but not sufficient for stronger third-grade reading outcomes. These effects were achieved by regular classroom teachers who received professional development, which indicates that policies that support the use of evidence-based reading instruction and teacher training can yield increased student achievement.

Oral Reading Fluency Development for Children with Emotional Disturbance or Learning Disabilities.

This study used a large state-wide database to examine the oral reading fluency development of second and third grade students with emotional disturbance or learning disabilities and their general education peers. Oral reading fluency measures were administered to 185,367 students without disabilities (general education), 2,146 students identified with an emotional disturbance, and 10,339 students with a learning disability. Student status and growth trends were examined in a piecewise model at each grade level for the full sample as well as for a subsample with reading difficulties. Data suggested students with disabilities performed significantly below students without disabilities in initial status and growth. Gender was also examined as a moderator of outcomes for each of the study groups.

Effects of a Virtually Delivered Reading and Embedded Mindset Intervention on Reading Performance for Fourth-Grader Struggling Readers.

The purpose of this study was to examine the effects of a virtual intensive reading intervention embedded with mindset training compared to typical reading instruction in a business-as-usual (BAU) condition delivered to fourth grade students with or at-risk for reading disabilities. After screening, the 59 participants were stratified and assigned randomly to condition. Highly trained interventionists delivered the intervention one-to-one with high fidelity and student engagement during the intensive intervention. Classroom teachers delivered the BAU. We examined the effects of the intervention on a variety of standardized timed and untimed measures of word reading and decoding, reading fluency, comprehension, and mindset. We addressed two research questions: What are the effects of intensive virtual reading intervention embedded with mindset training relative to a business-as-usual comparison (BAU) on the reading outcomes of fourth grade students with or at-risk for reading disabilities? Was initial mindset related to student response to intervention? Data analyses examined the main effect and moderation using linear mixed effects models. Significant differences in reading favored the virtual treatment condition for letter and word identification (g = 0.38). No other significant effects were observed. We note limitations in our study and offer directions for future research, including the need to explore additional moderators.

Measuring kindergarteners' motivational beliefs about writing: a mixed-methods exploration of alternate assessment formats.

There have been a handful of studies on kindergarteners' motivational beliefs about writing, yet measuring these beliefs in young children continues to pose a set of challenges. The purpose of this exploratory, mixed-methods study was to examine how kindergarteners understand and respond to different assessment formats designed to capture their motivational beliefs about writing. Across two studies, we administered four assessment formats - a 4-point Likert-type scale survey, a binary choice survey, a challenge preference task, and a semi-structured interview - to a sample of 114 kindergarteners engaged in a larger writing intervention study. Our overall goals were to examine the benefits and challenges of using these assessment formats to capture kindergarteners' motivational beliefs and to gain insight on future directions for studying these beliefs in this young age group. Many participants had a difficult time responding to the 4-point Likert-type scale survey, due to challenges with the response format and the way the items were worded. However, more simplified assessment formats, including the binary choice survey and challenge preference task, may not have fully captured the nuances and complexities of participants' motivational beliefs. The semi-structured interview leveraged participants' voices and highlighted details that were overlooked in the other assessment formats. Participants' interview responses were deeply intertwined with their local, everyday experiences and pushed back on common assumptions of what constitutes negatively oriented motivational beliefs about writing. Overall, our results suggest that kindergarteners' motivational beliefs appear to be multifaceted, contextually grounded, and hard to quantify. Additional research is needed to further understand how motivational beliefs are shaped during kindergarten. We argue that motivational beliefs must be studied in context rather than in a vacuum, in order to work toward a fair and meaningful understanding of motivational beliefs about writing that can be applied to school settings.

Assessing Measurement Invariance Across Multiple Groups: When Is Fit Good Enough?

Complex research questions often need large samples to obtain accurate estimates of parameters and adequate power. Combining extant data sets into a large, pooled data set is one way this can be accomplished without expending resources. Measurement invariance (MI) modeling is an established approach to ensure participant scores are on the same scale. There are two major problems when combining independent data sets through MI. First, sample sizes will often be large leading to small differences becoming noninvariant. Second, not all data sets may include the same combination of measures. In this article, we present a method that can deal with both these problems and is user friendly. It is a combination of generating random normal deviates for variables missing completely in combination with assessing model fit using the root mean square error of approximation good enough principle, based on the hypothesis that the difference between groups is not zero but small. We demonstrate the method by examining MI across eight independent data sets and compare the MI decisions of the traditional and good enough approach. Our results show the approach has potential in combining educational data.

Exploring Individual Differences in Response to Reading Intervention: Data from Project KIDS (Kids and Individual Differences in Schools).

This manuscript provides information on datasets pertaining to Project KIDS. Datasets include behavioral and achievement data for over 4,000 students between five and twelve years old participating in nine randomized control trials of reading instruction and intervention between 2005-2011, and information on home environments of a subset of 442 students collected via parent survey in 2013. All data is currently stored on an online data repository and freely available. Data might be of interest to researchers interested in individual differences in reading development and response to instruction and intervention, as well as to instructors of data analytic methods such as hierarchical linear modeling and psychometrics.

Predicting First Grade Reading Performance from Kindergarten Response to Tier 1 Instruction.

Many schools are beginning to implement multi-tier response to intervention (RTI) models for the prevention of reading difficulties and to assist in the identification of students with learning disabilities (LD). The present study was part of our larger ongoing longitudinal RTI investigation within the Florida Learning Disabilities Center grant. This study used a longitudinal correlational design, conducted in 7 ethnically and socio-economically diverse schools. We observed reading instruction in 20 classrooms, examined response rates to kindergarten Tier 1 instruction, and predicted students' first grade reading performance based upon kindergarten growth and end of year reading performance (n = 203). Teachers followed an explicit core reading program and overall, classroom instruction was rated as effective. Results indicate that controlling for students' end of kindergarten reading, their growth across kindergarten on a variety of language and literacy measures suppressed predictions of first grade performance. Specifically, the steeper the students' trajectory to a satisfactory outcome, the less likely they were to demonstrate good performance in first grade. Implications for future research and RTI implementation are discussed.

Componential skills of beginning writing: An exploratory study.

The present study examined the components of end of kindergarten writing, using data from 242 kindergartners. Specifically of interest was the importance of spelling, letter writing fluency, reading, and word- and syntax-level oral language skills in writing. The results from structural equation modeling revealed that oral language, spelling, and letter writing fluency were positively and uniquely related to writing skill after accounting for reading skills. Reading skill was not uniquely related to writing once oral language, spelling, and letter writing fluency were taken into account. These findings are discussed from a developmental perspective.

Assessment Data-Informed Guidance to Individualize Kindergarten Reading Instruction: Findings from a Cluster-Randomized Control Field Trial.

The purpose of this cluster-randomized control field trial was to was to examine the extent to which kindergarten teachers could learn a promising instructional strategy, wherein kindergarten reading instruction was differentiated based upon students' ongoing assessments of language and literacy skills and documented child characteristic by instruction (CXI) interactions; and to test the efficacy of this differentiated reading instruction on the reading outcomes of students from culturally diverse backgrounds. The study involved 14 schools and included 23 treatment (n = 305 students) and 21 contrast teacher (n = 251 students). Teachers in the contrast condition received only a baseline professional development that included a researcher-delivered summer day-long workshop on individualized instruction. Data sources included parent surveys, individually administered child assessments of language, cognitive, and reading skills and videotapes of classroom instruction. Using Hierarchical Multivariate Linear Modeling (HMLM), we found students in treatment classrooms outperformed students in the contrast classrooms on a latent measure of reading skills, comprised of letter-word reading, decoding, alphabetic knowledge, and phonological awareness (ES = .52). Teachers in both conditions provided small group instruction, but teachers in the treatment condition provided significantly more individualized instruction. Our findings extend research on the efficacy of teachers using Individualized Student Instruction to individualize instruction based upon students' language and literacy skills in first through third grade. Findings are discussed regarding the value of professional development related to differentiating core reading instruction and the challenges of using Response to Intervention approaches to address students' needs in the areas of reading in general education contexts.