ABSTRACT
Establishing validated science programs for students with or at risk for learning disabilities requires testing treatment effects and exploring differential response patterns. This study explored whether students' initial mathematics and reading skills influenced their treatment response to a whole-class, second-grade science program called Scientific Explorers (Sci2). The original Sci2 study employed a cluster randomized controlled design and included 294 students from 18 second-grade classrooms. Differential effects of the program by initial mathematics and reading skill levels were not observed for an interactive science assessment and a distal science outcome measure. However, based on initial reading skill levels, moderation results were found on a science vocabulary measure, suggesting the effects of Sci2 were greatest for students with higher initial reading skills. Similar results were found using initial mathematics skill levels as a predictor of differential response such that students with higher mathematics skills reaped stronger treatment effects on the vocabulary measure. Further, we found initial mathematics skills also influenced outcomes on the proximal science content assessment, where students with higher initial mathematics skills led to higher outcomes. Overall, findings suggest Sci2 produced robust effects for all students (g = 0.24-1.23), regardless of initial skill proficiencies. Implications for exploring differential response in science intervention research are discussed.
ABSTRACT
PURPOSE: This study examines the narrative language and reading outcomes of monolingual and bilingual students who received instruction with the Supporting Knowledge in Language and Literacy (SKILL) program, a narrative language intervention. METHOD: The main effects of the SKILL program were evaluated in a randomized controlled trial in which students (N = 355) who were at risk for English language and literacy difficulties were randomized to the SKILL intervention or a business-as-usual instruction. This article reports secondary analyses examining the efficacy of SKILL for bilingual (n = 148) and monolingual (n = 207) students who completed measures of oral and written narrative language and reading comprehension in English. RESULTS: Moderation results showed that the effects of SKILL did not differ for monolinguals and bilinguals across most narrative language measures and did not vary for monolinguals or bilinguals based on their pre-intervention language performance. CONCLUSION: These findings that suggest a language-based approach to improving narrative production and comprehension yielded similar results for monolinguals and bilinguals and that neither monolinguals nor bilinguals in this study needed to meet a certain threshold of English language proficiency to benefit from the intervention.
Subject(s)
Multilingualism , Humans , Language , Literacy , Reading , StudentsABSTRACT
This study investigated the presence of word reading difficulties in a sample of students in Grades 1-4 (n = 357) identified with language and reading comprehension difficulties. This study also examined whether distinct word reading and listening comprehension profiles emerged within this sample and the extent to which these groups varied in performance on cognitive and demographic variables. Findings showed that the majority of students (51%) with language and reading comprehension difficulties demonstrated significant risk in word reading (more than 1 SD below the mean), even though the participant screening procedures did not examine word reading directly. Three latent profiles emerged when students were classified into subgroups based on their performance in listening comprehension (LC) and word reading (WR): (1) severe difficulties in LC and moderate difficulties in WR (11%), (2) mild difficulties in both LC and WR (50%), and (3) moderate difficulties in LC and mild difficulties in WR (39%). Of note, even though students were identified for participation on the basis of poor oral language and reading comprehension abilities, all profiles demonstrated some degree of word reading difficulties. Findings revealed there were differences in age and performance on measures of working memory, nonverbal reasoning, and reading comprehension performance between profiles. Implications for educators providing instruction to students with or at risk for dyslexia and developmental language disorders were discussed.
Subject(s)
Dyslexia , Reading , Child , Cognition , Comprehension , Dyslexia/psychology , Humans , Language Tests , StudentsABSTRACT
PURPOSE: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language-Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online. METHOD: The TNL-2 was administered to 357 school-age children at risk for language and literacy difficulties as part of a randomized controlled trial, across three annual cohorts, at three time points (pretest, posttest, and 5-month follow-up). Cohort 3 students were tested using an online format at posttest and at follow-up. We compared the Cronbach's alpha internal consistency reliability of the TNL-2 online testing scores with in-person scores from TNL-2 normative data and Cohort 3 in-person testing at pretest, and interrater reliability for Cohort 3 across test points. In addition, we examined measurement invariance across test occasions and the criterion validity of the TNL-2, the latter based on its correlations with narrative sample measures (Mean Length of Utterance in words and the Monitoring Indicators of Scholarly Language rubric). RESULTS: Internal consistency reliability, interrater reliability, and measurement invariance analyses of the online and in-person administration of the TNL-2 yielded similar outcomes. The criterion validity of the TNL-2 was found to be good. CONCLUSIONS: TNL-2 psychometric properties from online administration were generally in the good range and were not significantly different from in-person testing. When administered online using standardized procedures, the TNL-2 is valid and reliable for use in assessing narrative language proficiency in school-age children at risk for language and learning difficulties.
Subject(s)
Language , Narration , Child , Humans , Psychometrics , Reproducibility of Results , Students , Surveys and QuestionnairesABSTRACT
We present findings from the first cohort of third- and fourth-grade students with reading difficulties (128 students from 31 classrooms) who participated in a 2-year intervention examining the effects of a reading intervention with and without anxiety management. Using a randomized controlled trial, students were assigned to one of three conditions: (a) small-group reading intervention with anxiety management instruction (RANX), (b) small-group reading intervention with math fact practice (RMATH), and (c) business-as-usual (BAU) comparison condition (no researcher provided treatment). Personnel from the research team provided participants in the RANX and RMATH the same reading intervention with the variation in the two treatments being whether the same amount of time per lesson was allocated to anxiety management (RANX) or practicing math facts (RMATH). Students in the RANX significantly outperformed students in the BAU on reading comprehension (effect size [ES] = 1.22) and students in the RMATH outperformed BAU on reading comprehension (ES = 0.77). Groups did not differ significantly on other reading outcomes. Reading anxiety moderated the main effect of the RANX intervention on the Test of Word Reading Efficiency (TOWRE) word reading when contrasted against the BAU group, indicating a significant difference favoring RANX where treatment's effect decreased by 0.94 units (about 1 point on the outcome) on word reading for each additional point increase in reading anxiety.
Subject(s)
Dyslexia , Reading , Anxiety/therapy , Child , Comprehension , Dyslexia/therapy , Humans , StudentsABSTRACT
The purpose of this pilot study was to determine whether positive results from a word-problem intervention implemented one-to-one contributed to similar outcomes when implemented in small groups of three to four students. Third-grade students experiencing mathematics difficulty (N = 76) were randomly assigned to word-problem intervention (n = 56) or business-as-usual comparison (n = 20). Intervention occurred for 13 weeks, 3 times per week, 30 min per session. Multilevel models revealed the intervention condition significantly outperformed the BaU on a proximal word-problem outcome, corroborating results from our prior individual intervention. When comparing student performance in the individual versus small-group intervention, findings suggest students received added benefit from the individual intervention. The word-problem intervention successfully translated to a small-group setting, which holds important implications for educators working with students in supplemental, targeted, or Tier 2 mathematics intervention settings.
Subject(s)
Problem Solving , Students , Humans , Mathematics , Pilot ProjectsABSTRACT
Despite focused efforts, achievement gaps remain a problem in the America's education system, especially those between students from higher and lower income families. Continued work on reducing these gaps benefits from an understanding of students' reading and math growth from typical school instruction and how growth differs based on initial proficiency, grade, and demographic characteristics. Data from 5,900 students in Grades 1-5 tested in math and reading at six points across two years were analyzed using cohort-sequential latent growth curve models to determine longitudinal growth patterns. Results indicated that students with low initial proficiency grew more quickly than students with higher proficiency. However, after two school years their achievement remained below average and well below that of students with higher initial proficiency. Demographic characteristics had small but significant effects on initial score and growth rates.
ABSTRACT
Conventional research methods for understanding sources of individual differences in word-problem solving (WPS) only permit estimation of average relations between component processes and outcomes. The purpose of the present study was instead to examine whether and if so how the component processes engaged in WPS differ along the spectrum of WPS performance. Second graders (N = 1,130) from 126 classrooms in 17 schools were assessed on component processes (reasoning, in-class attentive behavior, working memory, language comprehension, calculation fluency, word reading) and WPS. Multilevel, unconditional quantile multiple regression indicated that 3 component processes, calculation fluency, language comprehension, and working memory, are engaged in WPS differentially depending on students' overall word-problem skill. The role of calculation fluency and language comprehension was stronger with more competent word-problem solving ability. By contrast, the role of working memory was stronger with intermediate-level than for strong problem solving. Results deepen insight into the role of these processes in WPS and provide the basis for hypothesizing how instructional strategies may be differentiated depending on students' overall level of WPS competence.
ABSTRACT
We examined the efficacy of a content acquisition and reading comprehension intervention implemented in eighth-grade social studies classrooms. Using a within-teacher randomized control design, 18 eighth-grade teachers' social studies classes were randomly assigned to a treatment or comparison condition. Teachers taught all their classes (treatment and comparison) using the same content; however, in the treatment classes, teachers used instructional practices that included comprehension canopy, essential words, knowledge acquisition, and team-based learning. Students with reading comprehension difficulties in the treatment classes (n = 359) outperformed students with reading comprehension difficulties in the comparison classes (n = 331) on measures of content knowledge acquisition and content reading comprehension but not general reading comprehension. In addition, the proportion of students with reading comprehension difficulties in classes moderated outcomes for content knowledge acquisition and content reading comprehension.
Subject(s)
Academic Success , Comprehension , Dyslexia/rehabilitation , Reading , Social Sciences/education , Teaching , Adolescent , Female , Humans , MaleABSTRACT
PURPOSE: Given the need to find more opportunities for physical activity within the elementary school day, this study was designed to asses the impact of I-CAN!, active lessons on: 1) student physical activity (PA) outcomes via accelerometry; and 2) socioeconomic status (SES), race, sex, body mass index (BMI), or fitness as moderators of this impact. METHODS: Participants were 2,493 fourth grade students (45.9% male, 45.8% white, 21.7% low SES) from 28 central Texas elementary schools randomly assigned to intervention (n=19) or control (n=9). Multilevel regression models evaluated the effect of I-CAN! on PA and effect sizes were calculated. The moderating effects of SES, race, sex, BMI, and fitness were examined in separate models. RESULTS: Students in treatment schools took significantly more steps than those in control schools (ß = 125.267, SE = 41.327, p = .002, d = .44). I-CAN! had a significant effect on MVPA with treatment schools realizing 80% (ß = 0.796, SE =0.251, p = .001; d = .38) more MVPA than the control schools. There were no significant school-level differences on sedentary behavior (ß = -0.177, SE = 0.824, p = .83). SES, race, sex, BMI, and fitness level did not moderate the impact of active learning on step count and MVPA. CONCLUSION: Active learning increases PA within elementary students, and does so consistently across demographic sub-groups. This is important as these sub-groups represent harder to reach populations for PA interventions. While these lessons may not be enough to help children reach daily recommendations of PA, they can supplement other opportunities for PA. This speaks to the potential of schools to adopt policy change to require active learning.
ABSTRACT
Effect sizes are commonly reported for the results of educational interventions. However, researchers struggle with interpreting their magnitude in a way that transcends generic guidelines. Effect sizes can be interpreted in a meaningful context by benchmarking them against typical growth for students in the normative distribution. Such benchmarks are not currently available for students in the bottom quartile. This report remedies this by providing a comparative context for interventions involving these students. Annual growth effect sizes for K-12 students were computed from nationally normed assessments and a longitudinal study of students in special education. They reveal declining growth over time, especially for reading and math. These results allow researchers to better interpret the effects of their interventions and help practitioners by quantifying typical growth for struggling students. More longitudinal research is needed to show growth trajectories for students in the bottom quartile.
ABSTRACT
A 2-year, randomized control trial with 9th to 10th grade students with significant reading problems was provided for 50 minutes a day in small groups. Comparison students were provided an elective class and treatment students the reading intervention. Students were identified as demonstrating reading difficulties through failure on their state accountability test and were randomly assigned to one of three treatment conditions and a business as usual (BAU) condition: reading without dropout prevention, reading with dropout prevention, dropout prevention without reading, or a BAU condition. Findings from the 2-year reading intervention (reading with and without dropout prevention combined and BAU) are reported in this article. Students in reading treatment compared to students in BAU demonstrated significant gains on reading comprehension (effect size = .43), and improved reading was associated with better grades in social studies. Findings from this study provide a rationale for further implementation and investigation of intensive intervention for high school students with reading difficulties.
Subject(s)
Comprehension , Dyslexia/rehabilitation , Education, Special/methods , Reading , Adolescent , Female , Humans , Male , Treatment OutcomeABSTRACT
The purpose of the study was to estimate the impact of reading intervention on ratings of student attention over time. We used extant data from a longitudinal randomized study of a response-based reading intervention to fit a multiple-indicator, multilevel growth model. The sample at randomization was 54% male, 18% limited English proficient, 85% eligible for free or reduced-price lunch, 58% African American, and 32% Hispanic. Reading ability was measured by using the Woodcock-Johnson III Tests of Achievement. Attention was measured by using the Strengths and Weaknesses of ADHD Symptoms and Normal Behavior Scale. Findings indicate that intensive, response-based reading intervention over 3 years improved reading achievement and behavioral attention in middle school struggling readers, with treatment directly affecting reading, which in turn influenced attention. In the business-as-usual condition, there was no relation between improved reading and attention. The results are consistent with a correlated liabilities model of comorbidity. The results do not align with the inattention-as-cause hypothesis, which predicts that reading intervention should not affect attention. The findings do not support, but do not necessarily preclude, the phenocopy hypothesis. The results are especially pertinent for older students who may be inattentive partly because of years of struggling with reading.
Subject(s)
Attention , Black or African American , Hispanic or Latino , Reading , Schools , Students/psychology , Achievement , Adolescent , Black or African American/statistics & numerical data , Child , Female , Hispanic or Latino/statistics & numerical data , Humans , Longitudinal Studies , Male , Mental DisordersABSTRACT
Research suggests that contextual, self-system, and school engagement variables influence dropping out from school. However, it is not clear how different types of contextual and self-system variables interact to affect students' engagement or contribute to decisions to dropout from high school. The self-system model of motivational development represents a promising theory for understanding this complex phenomenon. The self-system model acknowledges the interactive and iterative roles of social context, self-perceptions, school engagement, and academic achievement as antecedents to the decision to dropout of school. We analyzed data from the Education Longitudinal Study of 2002-2004 in the context of the self-system model, finding that perception of social context (teacher support and parent support) predicts students' self-perceptions (perception of control and identification with school), which in turn predict students' academic and behavioral engagement, and academic achievement. Further, students' academic and behavioral engagement and achievement in 10th grade were associated with decreased likelihood of dropping out of school in 12th grade.