Bringing Assessment-to-Instruction (A2i) Technology to Scale: Exploring the Process from Development to Implementation.

Bringing effective, research-based literacy interventions into the classroom is challenging, especially given the cultural and linguistic diversity of today's classrooms. We examined the promise of Assessment-to-Instruction (A2i) technology redesigned to be used at scale to support teachers' implementation of the individualized student instruction (ISI) intervention from kindergarten through third grade. In seven randomized controlled trials, A2i and ISI have demonstrated efficacy. However, the research version of A2i was not scalable. In order to bring A2i to scale in schools serving linguistically diverse students, we carried out the current study across two phases. This study represents both an exploration of what it takes to bring an educational intervention to scale (Phase 1) and a quasi-experiment on the literacy outcomes of learners whose teachers used the technology (Phase 2). We integrated assessments of vocabulary, word decoding, and reading comprehension; revised the A2i algorithms to account for the constellation of skills English learners (ELs) bring to the classroom; updated the user interfaces and added new graphic features; and improved bandwidth and stability of the technology. Findings were mixed, including several non-significant results, a marginally significant intent-to-treat effect on word reading in kindergarten and first grade for English monolingual students and ELs, and one significant interaction effect, which suggested ELs and students with less developed reading skills in second and third grade benefitted most from the intervention. With some caution, we conclude that A2i demonstrates potential to be used at scale and promise of effectiveness for improving code-focused skills for diverse learners.

The relationship among home language use, parental beliefs, and Spanish-speaking children's vocabulary.

This study investigated the relationship among home language use, parents' beliefs about dual language development, and Spanish-speaking children's vocabulary knowledge. Parents (n = 162) completed a questionnaire about their home language use and beliefs about dual language development, and elementary-age children (N = 190)-Kindergarten (M age = 5.71, SD = .56), second grade (M age = 7.52, SD = .31), and fourth grade (M age = 9.35, SD = .45)-completed conceptually-scored vocabulary assessments. Principal component analyses revealed that Spanish-speaking parents' beliefs about dual language development are heterogeneous. Further, parents' beliefs can be characterized differently according to their children's English proficiency designations and grade levels. Structural equation modeling analyses revealed that the Bilingual Facility parental belief factor was associated with home language use practices, which in turn were associated with children's vocabulary. However, this association only applied to limited English proficient students and their parents. These results underscore the importance of attending to Spanish-speaking parents' beliefs, as they appear to relate to home language use practices and, importantly, they also relate to their children's vocabulary achievement.

Using Assessment to Improve the Accuracy of Teachers' Perceptions of Students' Academic Competence.

Teachers' perceptions of their students' academic skills can affect students' achievement and may be influenced by unrelated student characteristics such as socioeconomic status (SES). In this ad hoc randomized controlled trial, teachers (n = 28) were randomly assigned to receive training on using assessment to guide literacy instruction, Assessment-to-Instruction (A2i), or on Math PALS (control). Teachers rated students' (n = 446) academic competence. A2i teachers' ratings did not vary by SES, and their ratings correlated more strongly with students' literacy and mathematics assessment scores compared with those of the control teachers. Control teachers generally underestimated lower SES students' academic competence; underestimation was greater at more affluent schools. Teachers' ratings of students' academic competence predicted reading and mathematics outcomes. Thoughtful use of assessments to guide instruction appeared to improve the precision of teachers' ratings of students' academic competence, improve student outcomes, and reduce potential teacher biases about children from higher-poverty families.

Predicting Second and Third Graders' Reading Comprehension Gains: Observing Students' and Classmates Talk during Literacy Instruction using COLT.

This paper introduces a new observation system that is designed to investigate students' and teachers' talk during literacy instruction, Creating Opportunities to Learn from Text (COLT). Using video-recorded observations of 2nd-3rd grade literacy instruction (N=51 classrooms, 337 students, 151 observations), we found that nine types of student talk ranged from using non-verbal gestures to generating new ideas. The more a student talked, the greater were his/her reading comprehension (RC) gains. Classmate talk also predicted RC outcomes (total effect size=0.27). We found that 11 types of teacher talk ranged from asking simple questions to encouraging students' thinking and reasoning. Teacher talk predicted student talk but did not predict students' RC gains directly. Findings highlight the importance of each student's discourse during literacy instruction, how classmates' talk contributes to the learning environments that each student experiences, and how this affects RC gains, with implications for improving the effectiveness of literacy instruction.

Early Elementary Grade Dual Language Learners from Spanish-speaking Homes Struggling with English Reading Comprehension: The Dormant Role of Language Skills.

This study investigated contributors of English reading comprehension outcomes among predominantly U.S.-born first and third grade (N = 73) dual language learners (DLLs) from Spanish-speaking, low-income homes who attend English-only instructional schools in the Southern region of the U.S., which is experiencing historic rates of school-age DLL enrollment. We investigated the utility of various conceptualizations of vocabulary, namely English-only, Spanish-only, and specifically Spanish-English conceptually-scored receptive vocabulary, in understanding DLLs' reading comprehension. We first examined whether a gap was evident between the various conceptualizations of vocabulary and English word reading. Then, using structural equation modeling, we investigated the influence of the various conceptualizations of vocabulary on English reading comprehension, accounting for English word reading skills. Finally, we examined the potential contributions of DLLs' home language environments. Results revealed that the gap between English word reading and vocabulary varied as a function of the conceptualization of vocabulary. Further, English word reading emerged as the robust contributor to children's English reading comprehension, with no significant influence of receptive vocabulary, regardless of how it was conceptualized. Finally, and contributing to a nascent area of research, attention to DLLs' home language use practices suggests that the productive language domain (i.e., children's own home language use) may represent an important contributor to English reading comprehension among DLLs from Spanish-speaking homes. We discuss theoretical and practical implications.

Building Word Knowledge, Learning Strategies, and Metacognition with the Word-Knowledge E-Book.

Many children fail to comprehend what they read because they do not monitor their understanding, which requires making accurate judgements of what they know and then employing repair strategies when comprehension fails. Relying on research from learning science and cognitive and developmental psychology, we developed the Word Knowledge e-Book (WKe-Book) to improve children's calibration of their word knowledge, strategy use, and word knowledge overall; skills which are associated with reading comprehension. The WKe-Book, which is read on a tablet computer, is a choose-your-own adventure book where choices require choosing between two rare words (e.g., cogitate vs. procrastinate). Depending on the word chosen, the story follows a different plot. There are also embedded comprehension questions where students receive immediate feedback with consequences for incorrect answers, such as being sent back to reread a few pages. In a randomized controlled trial, we tested whether students (N = 603 in 25 third through fifth grade classrooms in Arizona in the US) reading the WKe-Book would demonstrate improved word knowledge, strategy use, and word knowledge calibration. Classrooms were randomly assigned to read the WKe-Book immediately (treatment) or later (delayed-treatment control), and within classrooms, students were randomly assigned to either participate in a 15-minute weekly book club (book club treatment) or to read the WKe-Book independently with no book club (no book club control). Results revealed a significant treatment effect of the WKe-Book on students' word knowledge, word knowledge calibration, and strategy use, which predicted student performance on standardized reading comprehension and vocabulary measures. The effects were greater for students who participated in weekly book clubs compared to students in the no book club control. These findings suggest that the affordances offered by technology, which are unavailable in paper-based books, can support students' development of metacognition, including word knowledge calibration, strategy use, and word learning skills.

Comorbidity in Reading Comprehension and Word-Problem Solving Difficulties: Exploring Shared Risk Factors and Their Impact on Language Minority Learners.

The purpose of this study was threefold: to examine unique and shared risk factors of comorbidity for reading comprehension and word-problem solving difficulties, to explore whether language minority (LM) learners are at increased risk of what we refer to as higher order comorbidity (reading comprehension and word-problem solving difficulties), and to examine the profiles of at-risk LM learners compared with at-risk non-LM learners. At-risk (LM n = 70; non-LM n = 89) and not-at-risk (LM n = 44; non-LM n = 114) students were evaluated on foundational academic (word reading, calculation), behavioral (behavioral attention), cognitive (working memory, processing speed, nonverbal reasoning), and language (vocabulary, listening comprehension) measures in English. Results indicated listening comprehension was the only shared risk factor for higher order comorbidity. Furthermore, LM learners were 3 times more likely to be identified as at risk compared with non-LM learners. Finally, among at-risk learners, no differences were found on cognitive dimensions by language status, but LM learners had lower reading and listening comprehension skills than non-LM learners, with a relative advantage in behavioral attention. Results have implications for understanding higher order comorbidity and for developing methods to identify and intervene with higher order comorbidity among the growing population of LM learners.

Patterns of Development in Spanish-English Conceptually Scored Vocabulary Among Elementary-Age Dual Language Learners.

Purpose Elementary-age dual language learners (DLLs) from Spanish-speaking homes in the United States are often characterized as at risk for low vocabulary in both Spanish and English. This longitudinal study examined conceptually scored receptive and expressive vocabulary development among DLLs from Spanish-speaking, low-income homes and investigated patterns of language responses on the conceptually scored measures. Method DLLs in kindergarten and second grade (N = 118) attending school in the Southeast region of the United States were followed for three consecutive academic years and assessed on measures of receptive and expressive conceptually scored vocabulary. Results Individual growth modeling, using raw scores, revealed positive vocabulary growth over time, with above average performance relative to national norms. However, initial conceptually scored receptive vocabulary scores were higher than conceptually scored expressive vocabulary scores. Furthermore, DLLs' conceptually scored receptive-but not expressive-vocabulary rate of growth was more rapid compared to national norms. Finally, DLLs' patterns of language responses revealed a shift toward more English over time, but Spanish continued to be used through fourth grade. Conclusion Results contradict deficit-driven views about DLLs' vocabulary skills and underscore the utility of conceptually scored vocabulary measures to assess vocabulary development among elementary-age DLLs to more comprehensively account for the linguistic assets they bring to learning.

Spanish-speaking English learners' English language and literacy skills: The predictive role of conceptually-scored vocabulary.

Vocabulary represents a key barrier to language and literacy development for many English learners. This study examined the relationship between Spanish-speaking English learners' conceptually-scored Spanish-English vocabulary, academic English proficiency, and English reading comprehension. Second- and fourth-grade English learners (N = 62) completed standardized conceptually-scored vocabulary measures in the fall and state-administered standardized measures of academic English proficiency and English reading comprehension in the spring. Conceptually-scored vocabulary measures are designed to tap knowledge of the number of known concepts, regardless of the specific language (Spanish or English) used to label the concept. Regression analyses revealed that academic English proficiency and English reading comprehension were not predicted by the conceptually-scored measure of receptive vocabulary. However, both academic English proficiency and English reading comprehension were predicted by the conceptually-scored measure of expressive vocabulary. Importantly, the relationship between conceptually-scored expressive vocabulary and English reading comprehension remained after controlling for academic English proficiency. Results underscore the utility of measures that incorporate English learners' first and second language skills in understanding the vocabulary knowledge English learners bring to English language and literacy learning tasks.

State-level education standards for substance use prevention programs in schools: a systematic content analysis.

PURPOSE: Three fourths of public schools in the United States maintain instructional programs to discourage alcohol, tobacco, and other drug (ATOD) use. State-sanctioned instructional standards attempt to direct this ATOD preventive education. No existing research, however, systematically codes these standards across all grades and states. We performed such an analysis. METHODS: We retrieved ATOD standards information from all 50 states and the District of Columbia from multiple sources, including the National Association of State Boards of Education's State School Health Policy Web site. Three independent researchers classified and cross-validated ATOD standards (inter-rater agreement = 98%) based on recommended content domains and pedagogic delivery methods. RESULTS: We find substantial grade-level variation in standards. Elementary schools emphasize generic social skills and affective skills, whereas middle and high school standards focus on knowledge about biological and behavioral consequences of ATOD use. States also vary widely in their content and coverage of standards. Two thirds of states do not include standards in all content areas considered "evidence-based." CONCLUSIONS: The ATOD curricular agenda for the majority of states falls well below recommended content and delivery benchmarks. We intend for our harmonized data set-the first of its kind-to promote research that examines the relation among state ATOD standards, actual classroom instruction, and adolescent ATOD use.