Investigating the Reading Profiles of Middle School Emergent Bilinguals with Significant Reading Comprehension Difficulties.

Purpose: This study investigated the reading profiles of middle school Spanish-speaking emergent bilinguals (EBs) with significantly below grade level reading comprehension and whether these profiles varied in their reading comprehension performance over time. Method: Latent profile analyses were used to classify Grade 6 and 7 Hispanic EBs (n = 340; 39% female) into subgroups based on their word reading and vocabulary knowledge. Growth models were then fit within each profile to evaluate reading comprehension performance over time. Results: Analyses revealed four latent profiles emerged: (a) very low word reading and low vocabulary (10%), (b) low word reading and low vocabulary (71%), (c) average word reading and low vocabulary (16%), and (d) high word reading and low vocabulary (3%). Subgroups varied in their reading comprehension initially and over one year. Students in the subgroup marked by very low word reading and low vocabulary showed the lowest reading comprehension performance initially; however, they also showed the greatest growth over one year. Conclusion: These findings suggest there is heterogeneity in the reading skill profiles of Spanish-speaking EBs with reading comprehension difficulties. They also underscore the prevalence of word reading difficulties among these students. These may be important factors to consider when developing interventions to prevent and remediate these difficulties.

Contextualized, Multicomponent Language Instruction: From Theory to Randomized Controlled Trial.

PURPOSE: Clinicians address a wide range of oral language skills when working with school-age students with language and literacy difficulties (LLDs). Therefore, there is a critical need for carefully designed, rigorously tested, multicomponent contextualized language interventions (CLIs) that have a high likelihood of successful implementation and measurable academic impacts. This clinical focus article summarizes the development and testing of a CLI entitled Supporting Knowledge in Language and Literacy (SKILL), which is a supplementary narrative intervention program for elementary school-age children. Our aims are to (a) to review the foundational theoretical models that are the foundation of SKILL; (b) describe the iterative process used to develop the phases, lessons, procedures, materials, and progress monitoring tool; (c) summarize recent findings of the randomized controlled trial that was conducted to test its efficacy; and (d) discuss factors that may contribute to successful implementation of multicomponent language interventions. METHOD: A total of 357 students in Grades 1-4 with LLDs were randomized to a treatment group or to a business-as-usual control group. The treatment group received the SKILL curriculum in small groups during 30-min lessons by trained speech-language pathologists, teachers, and special educators. RESULTS: Students who received SKILL significantly outperformed those who did not on oral and written measures of storytelling and comprehension immediately after treatment and after 5-months at follow-up. Gains were similar among students with different levels of language ability (at-risk, language impaired) and language status (monolingual, bilingual) at pretest. CONCLUSIONS: There is growing support for the use of multicomponent CLIs to bring about educationally relevant outcomes for students with LLDs. The authors present this review of how SKILL was designed, manualized, and rigorously tested by a team of researchers and practitioners with the hope that this approach will serve as a springboard for the development of future multicomponent CLIs that may meaningfully improve communicative and educational outcomes for students with LLDs.

Understanding the relation between reading and anxiety among upper elementary students with reading difficulties.

This study examined the relations between reading anxiety, general anxiety, and test anxiety in a sample of students with reading difficulties (n = 536). It also tested if dimensions of anxiety were differentially related to word reading accuracy and fluency, text reading fluency, or reading comprehension. The results indicated that the three anxiety measures were significantly related (r = 0.51 to 0.56, p < .001). Additionally, higher reading anxiety was related to poorer word reading fluency, text reading fluency, and comprehension outcomes. Further analyses indicated that these relations existed in students who fell in the middle and upper quantiles for reading, but not the lowest quantile. This pattern of findings suggests that the relation is complex and varies depending on severity of reading difficulty. Results may help to inform future efforts to support students with reading difficulties, including students with dyslexia.

Evaluating the Efficacy of a Narrative Language Intervention for Bilingual Students.

PURPOSE: This study examines the narrative language and reading outcomes of monolingual and bilingual students who received instruction with the Supporting Knowledge in Language and Literacy (SKILL) program, a narrative language intervention. METHOD: The main effects of the SKILL program were evaluated in a randomized controlled trial in which students (N = 355) who were at risk for English language and literacy difficulties were randomized to the SKILL intervention or a business-as-usual instruction. This article reports secondary analyses examining the efficacy of SKILL for bilingual (n = 148) and monolingual (n = 207) students who completed measures of oral and written narrative language and reading comprehension in English. RESULTS: Moderation results showed that the effects of SKILL did not differ for monolinguals and bilinguals across most narrative language measures and did not vary for monolinguals or bilinguals based on their pre-intervention language performance. CONCLUSION: These findings that suggest a language-based approach to improving narrative production and comprehension yielded similar results for monolinguals and bilinguals and that neither monolinguals nor bilinguals in this study needed to meet a certain threshold of English language proficiency to benefit from the intervention.

Examining fidelity reporting within studies of foundational reading interventions for elementary students with or at risk for dyslexia.

Early access to evidence-based reading intervention improves outcomes for students with or at risk for reading difficulties. Additionally, teacher implementation of reading interventions plays a key role in the efficacy of reading interventions. Previous research suggests the influence of intervention implementation fidelity on student language and literacy outcomes is more significant for lower-performing students and students with disabilities, such as dyslexia. However, recent syntheses have suggested that less than half of reading intervention studies report treatment fidelity data. This meta-analysis examined fidelity reporting within reading intervention studies for students with or at risk for dyslexia in Grades K-5. We aimed to record the frequency and extent of fidelity reporting, explore associations between study or intervention features and fidelity reporting, and compare mean intervention effect sizes for studies reporting fidelity and those that did not. A total of 51 studies were included. Results indicated that 75% of studies reported fidelity data. Studies reporting fidelity primarily focused on adherence and dosage data with little to no information reported for other dimensions of fidelity (i.e., quality, responsiveness, differentiation). Suggestions for improving reporting of treatment fidelity data are discussed.

When Treatment Adherence Matters: Interactions Among Treatment Adherence, Instructional Quality, and Student Characteristics on Reading Outcomes.

In this study, we examined the extent to which teachers' treatment adherence, instructional quality, and the interaction of these variables influenced eighth-grade students' content knowledge and reading comprehension. We examined treatment fidelity for students (n = 775) in classes randomly assigned to receive an evidence-based content area reading program called Promoting Adolescents' Comprehension of Text. Results indicate that teachers' instructional quality was a statistically significant, positive predictor of student content knowledge and reading comprehension performance, whereas teachers' treatment adherence was not. Statistically significant interactions between treatment adherence and instructional quality were present, such that teachers' treatment adherence had a stronger impact on student learning outcomes when their overall instructional quality was low. Moderator analyses also revealed that students' pretest performance and English learner status influenced the effects of treatment adherence and instructional quality on student outcomes. These findings help elucidate the conditions under which Promoting Adolescents' Comprehension of Text leads to improved outcomes, and more broadly, underscore the importance of carefully examining dimensions of treatment fidelity when testing the effects of treatment programs.

A meta-analysis of the effects of academic interventions on academic achievement and academic anxiety outcomes in elementary school children.

Research has shown that academic anxiety can affect academic performance and emotional well-being. Despite previous research emphasizing the importance of understanding academic anxiety and indicating a strong association between academic performance and academic anxiety, no systematic reviews or meta-analyses have examined the effects of academic interventions on academic and anxiety outcomes. This article reports on a meta-analysis of studies examining academic interventions conducted with elementary students (kindergarten to Grade 6), in which both academic achievement and academic anxiety outcomes were reported. The systematic search yielded 13 studies comprising 1545 participants and revealed statistically significant differences favoring academic treatments over the control for academic achievement outcomes (g = 0.63, k = 11) but no statistically significant benefits for academic anxiety outcomes (g = -0.06, k = 11). The authors caution against drawing strong conclusions due to the heterogeneity in effects and the small number of studies in the extant literature.

Understanding the nature and severity of reading difficulties among students with language and reading comprehension difficulties.

This study investigated the presence of word reading difficulties in a sample of students in Grades 1-4 (n = 357) identified with language and reading comprehension difficulties. This study also examined whether distinct word reading and listening comprehension profiles emerged within this sample and the extent to which these groups varied in performance on cognitive and demographic variables. Findings showed that the majority of students (51%) with language and reading comprehension difficulties demonstrated significant risk in word reading (more than 1 SD below the mean), even though the participant screening procedures did not examine word reading directly. Three latent profiles emerged when students were classified into subgroups based on their performance in listening comprehension (LC) and word reading (WR): (1) severe difficulties in LC and moderate difficulties in WR (11%), (2) mild difficulties in both LC and WR (50%), and (3) moderate difficulties in LC and mild difficulties in WR (39%). Of note, even though students were identified for participation on the basis of poor oral language and reading comprehension abilities, all profiles demonstrated some degree of word reading difficulties. Findings revealed there were differences in age and performance on measures of working memory, nonverbal reasoning, and reading comprehension performance between profiles. Implications for educators providing instruction to students with or at risk for dyslexia and developmental language disorders were discussed.

Online Administration of the Test of Narrative Language-Second Edition: Psychometrics and Considerations for Remote Assessment.

PURPOSE: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language-Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online. METHOD: The TNL-2 was administered to 357 school-age children at risk for language and literacy difficulties as part of a randomized controlled trial, across three annual cohorts, at three time points (pretest, posttest, and 5-month follow-up). Cohort 3 students were tested using an online format at posttest and at follow-up. We compared the Cronbach's alpha internal consistency reliability of the TNL-2 online testing scores with in-person scores from TNL-2 normative data and Cohort 3 in-person testing at pretest, and interrater reliability for Cohort 3 across test points. In addition, we examined measurement invariance across test occasions and the criterion validity of the TNL-2, the latter based on its correlations with narrative sample measures (Mean Length of Utterance in words and the Monitoring Indicators of Scholarly Language rubric). RESULTS: Internal consistency reliability, interrater reliability, and measurement invariance analyses of the online and in-person administration of the TNL-2 yielded similar outcomes. The criterion validity of the TNL-2 was found to be good. CONCLUSIONS: TNL-2 psychometric properties from online administration were generally in the good range and were not significantly different from in-person testing. When administered online using standardized procedures, the TNL-2 is valid and reliable for use in assessing narrative language proficiency in school-age children at risk for language and learning difficulties.

Examining the Effects of Integrating Anxiety Management Instruction Within a Reading Intervention for Upper Elementary Students With Reading Difficulties.

We present findings from the first cohort of third- and fourth-grade students with reading difficulties (128 students from 31 classrooms) who participated in a 2-year intervention examining the effects of a reading intervention with and without anxiety management. Using a randomized controlled trial, students were assigned to one of three conditions: (a) small-group reading intervention with anxiety management instruction (RANX), (b) small-group reading intervention with math fact practice (RMATH), and (c) business-as-usual (BAU) comparison condition (no researcher provided treatment). Personnel from the research team provided participants in the RANX and RMATH the same reading intervention with the variation in the two treatments being whether the same amount of time per lesson was allocated to anxiety management (RANX) or practicing math facts (RMATH). Students in the RANX significantly outperformed students in the BAU on reading comprehension (effect size [ES] = 1.22) and students in the RMATH outperformed BAU on reading comprehension (ES = 0.77). Groups did not differ significantly on other reading outcomes. Reading anxiety moderated the main effect of the RANX intervention on the Test of Word Reading Efficiency (TOWRE) word reading when contrasted against the BAU group, indicating a significant difference favoring RANX where treatment's effect decreased by 0.94 units (about 1 point on the outcome) on word reading for each additional point increase in reading anxiety.

Examining the Reading and Cognitive Profiles of Students With Significant Reading Comprehension Difficulties.

This study investigated the word reading and listening comprehension difficulties of fourth-grade students with significant reading comprehension deficits and the cognitive difficulties that underlie these weaknesses. Latent profile analysis was used to classify a sample of fourth-grade students (n = 446) who scored below the 16th percentile on a measure of reading comprehension into subgroups based on their performance in word reading (WR) and listening comprehension (LC). Three latent profiles emerged: (a) moderate deficits in both WR and LC of similar severity (91%), (b) severe deficit in WR paired with moderate LC deficit (5%), and (c) severe deficit in LC with moderate WR difficulties (4%). Analyses examining the associations between cognitive attributes and group membership indicated students with lower performance on cognitive predictors were more likely to be in a severe subgroup. Implications for educators targeting improved reading performance for upper elementary students with significant reading difficulties were discussed.

A Synthesis of the Sustainability of Remedial Reading Intervention Effects for Struggling Adolescent Readers.

A majority of reading-related intervention studies aiming to remediate struggling readers' reading outcomes assess student performance immediately following the conclusion of an intervention to determine intervention effects. Few studies collect follow-up data to measure the long-term sustainability of treatment effects. Hence, the aim of the current synthesis was to examine follow-up intervention effects of reading interventions involving adolescent struggling readers in Grades 6 to 12. Our literature search yielded only 10 studies that reported follow-up data for intervention participants, which highlights the dearth of intervention research that examines sustainability of intervention effects. Of the 10 included studies, the weighted mean effect size for all reading outcome measures was gw = 0.78 at immediate posttest and gw = 0.27 at follow-up, in favor of treatment group students. Although the magnitude of difference between treatment and control groups diminished at follow-up time, a comparison of treatment group students' immediate posttest and follow-up scores showed that students mostly maintained gains made during intervention at follow-up time points.

Examining Factors Affecting Reading and Math Growth and Achievement Gaps in Grades 1-5: A Cohort-Sequential Longitudinal Approach.

Despite focused efforts, achievement gaps remain a problem in the America's education system, especially those between students from higher and lower income families. Continued work on reducing these gaps benefits from an understanding of students' reading and math growth from typical school instruction and how growth differs based on initial proficiency, grade, and demographic characteristics. Data from 5,900 students in Grades 1-5 tested in math and reading at six points across two years were analyzed using cohort-sequential latent growth curve models to determine longitudinal growth patterns. Results indicated that students with low initial proficiency grew more quickly than students with higher proficiency. However, after two school years their achievement remained below average and well below that of students with higher initial proficiency. Demographic characteristics had small but significant effects on initial score and growth rates.

The Critical Role of Word Reading as a Predictor of Response to Intervention.

This study examines the initial word reading performance of fourth-grade struggling readers and the extent to which differing levels of word reading performance at pretest influenced their response to reading interventions. A large group of students with significant reading comprehension difficulties (N = 481) were classified into three clusters of word reading proficiency based on their pretest performance: (a) very low, (b) low, and (c) near adequate. We examined their performance on several academic, language, and executive functioning measures at the beginning of the year and their reading comprehension performance at the beginning of year and after 1 year of reading intervention to examine how each cluster responded to instruction. Results from a discriminant function analysis indicated that performance on five pretest variables were meaningful predictors of word reading proficiency cluster membership: phonological processing, writing fluency, math calculation, math fluency, and reading efficiency and comprehension. Results also demonstrated that word reading proficiency at pretest was related to response to intervention on reading comprehension measures. Students in the very low word reading proficiency cluster showed minimal response to intervention whereas the near-adequate word reading cluster demonstrated greatest response to intervention. These results suggest word reading is a critical predictor of response to intervention for students with significant comprehension problems in the upper elementary grades and that students with the most substantial word reading problems may require more intensive and specialized treatments than students with greater word reading performance to show meaningful progress in reading.

Examining Sources and Mechanisms of Reading Comprehension Difficulties: Comparing English Learners and Non-English Learners within the Simple View of Reading.

In the present study, we compared the extent to which linguistic comprehension (vocabulary and listening comprehension) and word reading explain reading comprehension differentially for English learners (ELs) and non-ELs with reading difficulties, and we investigated whether different mechanisms of reading comprehension failure exist for each group. Using the simple view of reading as our framework, we tested a model in which vocabulary exerts a direct effect on reading comprehension and indirect effects through listening comprehension and word reading. Results from a multigroup structural equation model with a sample of 446 struggling fourth-grade readers (n = 229 for ELs; n = 211 for non-ELs) demonstrated both similarities and differences in the sources and mechanisms of reading comprehension difficulties for ELs and non-ELs with reading problems. Word reading was an important source of reading comprehension difficulty for both groups. For non-ELs, the effect of word reading was larger than the effects of linguistic comprehension (vocabulary and listening comprehension combined); however, for ELs, the effects of linguistic comprehension were greater than the effect of word reading. Vocabulary had indirect effects via both listening comprehension and word reading for ELs, but it demonstrated a direct effect on reading comprehension for non-ELs. These results suggest that developing a range of linguistic comprehension skills (e.g., word-level and sentence-level language skills) may be important for ELs with reading comprehension difficulties in the upper-elementary grades.

How Initial Word Reading and Language Skills Affect Reading Comprehension Outcomes for Students With Reading Difficulties.

This study examined how differences in listening comprehension and word reading at the beginning of the school year influence changes in reading comprehension for English learners (ELs) with significant reading difficulties compared to non-ELs with significant reading difficulties. The study investigated heterogeneity in response to instruction among 400 struggling readers in fourth grade (n = 183 for non-EL; n = 217 for EL) who received an intensive reading intervention. At pretest, word reading, listening comprehension, and reading comprehension were measured, and at posttest, reading comprehension was measured again. Results from moderated multiple regression analyses showed a significant three-way interaction such that reading comprehension at posttest was higher for ELs than non-ELs with similar levels of low word reading but relatively higher levels of listening comprehension. However, non-ELs outperformed ELs with similar levels of relatively high word reading and average to high listening comprehension. The findings suggest that pre-intervention skill profiles may need to be interpreted differently for ELs and non-ELs with significant reading difficulties in relation to language and literacy outcomes.

Replication of an Experimental Study Investigating the Efficacy of a Multisyllabic Word Reading Intervention With and Without Motivational Beliefs Training for Struggling Readers.

This randomized control trial examined the efficacy of an intervention aimed at improving multisyllabic word reading (MWR) skills among fourth- and fifth-grade struggling readers ( n = 109, 48.6% male), as well as the relative effects of an embedded motivational beliefs training component. This study was a closely aligned replication of our earlier work. The intervention was replicated with a three-condition design: MWR only, MWR with a motivational beliefs component, and business-as-usual control. Students were tutored in small groups for 40 lessons (four 40-min lessons each week). When we combined performance of students in both MWR conditions, intervention students significantly outperformed controls on proximal measures of affix reading and MWR, as well as standardized measures of decoding, spelling, and text comprehension. Furthermore, there was a noted interaction between English learner status and treatment on spelling performance. There were no statistically significant main effects between the MWR groups on proximal or standardized measures of interest. Findings are discussed in terms of their relevance to MWR instruction for students with persistent reading difficulties and considerations for future research related to the malleability of motivation.

Examining Predictive Validity of Oral Reading Fluency Slope in Upper Elementary Grades Using Quantile Regression.

Within multitiered instructional delivery models, progress monitoring is a key mechanism for determining whether a child demonstrates an adequate response to instruction. One measure commonly used to monitor the reading progress of students is oral reading fluency (ORF). This study examined the extent to which ORF slope predicts reading comprehension outcomes for fifth-grade struggling readers ( n = 102) participating in an intensive reading intervention. Quantile regression models showed that ORF slope significantly predicted performance on a sentence-level fluency and comprehension assessment, regardless of the students' reading skills, controlling for initial ORF performance. However, ORF slope was differentially predictive of a passage-level comprehension assessment based on students' reading skills when controlling for initial ORF status. Results showed that ORF explained unique variance for struggling readers whose posttest performance was at the upper quantiles at the end of the reading intervention, but slope was not a significant predictor of passage-level comprehension for students whose reading problems were the most difficult to remediate.

Examining the Effects of Afterschool Reading Interventions for Upper Elementary Struggling Readers.

We examined the efficacy of an afterschool multicomponent reading intervention for third- through fifth-grade students with reading difficulties. A total of 419 students were identified for participation based on a 90 standard score or below on a screening measure of the Test of Silent Reading Efficiency and Comprehension. Participating students were randomly assigned to a business as usual comparison condition or one of two reading treatments. All treatment students received 30 min of computer-based instruction plus 30 min of small-group tutoring for four to five times per week. No statistically significant reading comprehension posttest group differences were identified (p > .05). The limitations of this study included high attrition and absenteeism. These findings extend those from a small sample of experimental studies examining afterschool reading interventions and provide initial evidence that more instruction, after school, may not yield the desired outcome of improved comprehension.

Examining How Treatment Fidelity Is Supported, Measured, and Reported in K-3 Reading Intervention Research.

Treatment fidelity data (descriptive and statistical) are critical to interpreting and generalizing outcomes of intervention research. Despite recommendations for treatment fidelity reporting from funding agencies and researchers, past syntheses have found treatment fidelity is frequently unreported (e.g., Swanson, The Journal of Special Education, 47, 3-13, 2011) in educational interventions and fidelity data are seldom used to analyze its relation to student outcomes (O'Donnell, Review of Educational Research, 78(1), 33-84, 2008). The purpose of this synthesis was to examine how treatment fidelity is supported, measured, and reported in reading intervention studies conducted with students at risk or with reading difficulties in grades K-3 from 1995 through 2015. All studies (k = 175) were coded to extract and classify information related to (a) the characteristics of the intervention study (e.g., publication year, research design); (b) treatment implementer training and support; (c) treatment fidelity data collection procedures, dimensions (i.e., adherence, quality, receipt, dosage, and differentiation), and levels of treatment fidelity data; and (d) the use of fidelity scores in the analysis of treatment effects. Results indicated that less than half (47%) of the reading intervention studies synthesized reported treatment fidelity data (numeric or narrative). Exploratory analyses showed that several study features were associated with the prevalence of fidelity reporting. Studies reporting treatment fidelity largely measured treatment adherence, and scores were, on average, high. Other dimensions of treatment fidelity (e.g., treatment differentiation), and analyses relating fidelity data to outcomes, were consistently absent from the corpus of reading intervention studies reviewed. Recommendations for enhancing how treatment fidelity data in intervention studies are collected and reported are presented.