Retrieval Practice and Word Learning by Children With Developmental Language Disorder: Does Expanding Retrieval Provide Additional Benefit?

PURPOSE: The word learning of preschool-age children with developmental language disorder (DLD) is improved when spaced retrieval practice is incorporated into the learning sessions. In this preregistered study, we compared two types of spacing-an expanding retrieval practice schedule and an equally spaced schedule-to determine if one of these approaches yields better word learning outcomes for the children. METHOD: Fourteen children with DLD aged 4-5 years and 14 same-age children with typical language development (TD) learned eight novel nouns over two sessions. Spacing for half of the novel words was expanded gradually during learning; for the remaining novel words, greater spacing remained at the same level throughout learning. Immediately after the second session and 1 week later, the children's recall of the words was tested. RESULTS: The children with TD recalled more novel words than the children with DLD, although this difference could be accounted for by differences in the children's standardized receptive vocabulary test scores. The two groups were similar in their ability to retain the words over 1 week. Initially, the shorter spacing in the expanding schedule resulted in greater retrieval success than the corresponding (longer spaced) retrieval trials in the equally spaced schedule. These early shorter spaced trials also seemed to benefit retrieval of the trials with greater spacing that immediately followed. However, as the learning period progressed, the accuracy levels for the two conditions converged and were likewise similar during final testing. CONCLUSION: We need a greater understanding of how and when short spacing can be helpful to children's word learning, with the recognition that early gains might give a misleading picture of the benefits that short spacing can provide to longer term retention. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.25537696.

Can Retrieval Practice Facilitate Verb Learning in Children With Developmental Language Disorder and Their Peers With Typical Language Development?

PURPOSE: Children with developmental language disorder (DLD) have well-documented verb learning difficulties. In this study, we asked whether the inclusion of retrieval practice during the learning period would facilitate these children's verb learning relative to a similar procedure that provided no retrieval opportunities. METHOD: Eleven children with DLD (M age = 60.09 months) and 12 children with typical language development (TD; M age = 59.92 months) learned four novel verbs in a repeated spaced retrieval (RSR) condition and four novel verbs in a repeated study (RS) condition. The words in the two conditions were heard an equal number of times, in the context of video-recorded actors performing novel actions. RESULTS: Recall testing immediately after the learning period and 1 week later revealed greater recall for novel verbs in the RSR condition than for novel verbs in the RS condition. This was true for both groups, and for immediate as well as 1-week testing. The RSR advantage remained when children had to recall the novel verbs while watching new actors perform the novel actions. However, when tested in contexts requiring the children to inflect the novel verbs with -ing for the first time, the children with DLD were much less likely to do so than their peers with TD. Even words in the RSR condition were only inconsistently inflected. CONCLUSIONS: Retrieval practice provides benefits to verb learning-an important finding given the challenges that verbs present to children with DLD. However, these benefits do not appear to automatically translate to the process of adding inflections to newly learned verbs but rather appear to be limited to the operations of learning the verbs' phonetic forms and mapping these forms onto associated actions.

Word-learning trajectories influence long-term recall in children with developmental language disorder and typical development.

INTRODUCTION: Children with developmental language disorder (DLD) have difficulties learning words. However, the severity of these difficulties can be reduced through word learning procedures that incorporate repeated spaced retrieval (RSR). Previous studies have shown positive outcomes with RSR but we still know very little about how learning unfolds with this procedure. In this study, we focus on the process of learning under RSR. METHODS: We analyze the learning data from children with DLD and with typical development (TD) from three recent studies using RSR. We fit growth curves to the trial-by-trial learning data for immediate and spaced retrieval trials and use the characteristics of children's individual word-learning trajectories to predict their long-term recall. RESULTS: We found that children in both groups demonstrated linear growth during learning, despite breaks within and across days. Success on early immediate retrieval trials promoted success on subsequent spaced retrieval trials. Children's trial-by-trial RSR learning trajectories were related to their long-term recall: both cumulative success and growth over time on the spaced retrieval trials positively predicted long-term recall. Consecutive success was also highly correlated with growth over time. CONCLUSIONS: Repeated spaced retrieval supplemented with immediate retrieval trials during learning promotes long-term recall.

The Neural Underpinnings of Processing Newly Taught Semantic Information: The Role of Retrieval Practice.

Purpose Recent behavioral studies have demonstrated the effectiveness of implementing retrieval practice into learning tasks for children. Such approaches have revealed that repeated spaced retrieval (RSR) is particularly effective in promoting children's learning of word form and meaning information. This study further examines how retrieval practice enhances learning of word meaning information at the behavioral and neural levels. Method Twenty typically developing preschool children were taught novel words using an RSR learning schedule for some words and an immediate retrieval (IR) learning schedule for other words. In addition to the label, children were taught two arbitrary semantic features for each item. Following the teaching phase, children's learning was tested using recall tests. In addition, during the 1-week follow-up, children were presented with pictures and an auditory sentence that correctly labeled the item but stated correct or incorrect semantic information. Event-related brain potentials (ERPs) were time locked to the onset of the words noting the semantic feature. Children provided verbal judgments of whether the semantic feature was correctly paired with the item. Results Children recalled more labels and semantic features for items that had been taught in the RSR learning schedule relative to the IR learning schedule. ERPs also differentiated the learning schedules. Mismatching label-meaning pairings elicited an N400 and late positive component (LPC) for both learning conditions; however, mismatching RSR pairs elicited an N400 with an earlier onset and an LPC with a longer duration, relative to IR mismatching label-meaning pairings. These ERP timing differences indicated that the children were more efficient in processing words that were taught in the RSR schedule relative to the IR learning schedule. Conclusions Spaced retrieval practice promotes learning of both word form and meaning information. The findings lay the necessary groundwork for better understanding of processing newly learned semantic information in preschool children. Supplemental Material https://doi.org/10.23641/asha.15063060.

A multi-study examination of the role of repeated spaced retrieval in the word learning of children with developmental language disorder.

BACKGROUND: Many children with developmental language disorders (DLD) have well-documented weaknesses in vocabulary. In recent years, investigators have explored the nature of these weaknesses through the use of novel word learning paradigms. These studies have begun to uncover specific areas of difficulty and have provided hints about possible intervention strategies that might help these children learn words more accurately and efficiently. Among the studies of this type are those that incorporate repeated spaced retrieval activities in the learning procedures. METHODS: In this study, we examined the data from four of these studies that employed the same types of participants (4- and 5-year-old children with DLD and same-age children with typical language development), research design, and outcome measures. The studies differed primarily in the type of learning condition that was being compared to a spaced retrieval condition. A mixed-effects modeling framework was used, enabling the data from the four studies and different outcome measures to be aggregated. RESULTS: Across the studies, more words in the repeated spaced retrieval condition were recalled than those in the comparison conditions. This was true regardless of outcome measure. Children with typical language development recalled more words than the children with DLD. Both groups benefited from spaced retrieval, though effects were larger for the group with DLD. Children recalled words as accurately 1 week after learning as they did at the 5-min mark; the two groups were essentially identical in this respect. CONCLUSIONS: Overall, the findings support the continued refinement of these types of repeated spaced retrieval procedures, as they may have potential to serve as effective approaches to intervention.

After Initial Retrieval Practice, More Retrieval Produces Better Retention Than More Study in the Word Learning of Children With Developmental Language Disorder.

Purpose Children with developmental language disorder (DLD) often have difficulty with word learning. Recent studies have shown that incorporating retrieval practice provides a significant benefit to this learning. However, we have not yet discovered the best balance between the amount of retrieval and the amount of study (hearing the word in the presence of the referent) that is provided. In this investigation, we compared a word learning procedure using more retrieval and less study with a procedure that used more study and less retrieval. Method Participants were 13 children with DLD and 13 same-age peers with typical language development (TD). Both groups ranged in age from 4 to 6 years. The children learned two sets of novel words, with each set taught in two sessions. During an initial criterion period, the children had the opportunity to retrieve all of the words. Following this period, the words were either retrieved without further study or studied without additional retrieval. Recall and recognition testing immediately followed the second learning session and was repeated 1 week later. Testing assessed the children's retention of both the word forms and their meanings. Results Better recall both immediately after learning and after 1 week was seen for the more retrieval/less study condition. This was seen for both groups of children for word form recall and for children with DLD for meaning. Group differences were not found. Conclusion This study served as a stringent test of the benefits of retrieval to children's word learning. Continued retrieval after initial retrieval practice appeared to be helpful even when further study was discontinued and when the comparison study condition had also provided retrieval practice in the initial stages. Further refinement of retrieval procedures might lead to the development of useful clinical tools to promote word learning.

Adjective Learning in Young Typically Developing Children and Children With Developmental Language Disorder: A Retrieval-Based Approach.

Purpose There are strong retention benefits when learners frequently test themselves during the learning period. This practice of repeated retrieval has recently been applied successfully to children's word learning. In this study, we apply a repeated retrieval procedure to the learning of novel adjectives by preschool-age children with developmental language disorder (DLD) and their typically developing (TD) peers. We ask whether the benefits of retrieval extend to children's ability to apply the novel adjectives to newly introduced objects sharing the same characteristics as the objects used during the learning period. Method Fourteen children with DLD (M age = 62.64 months) and 13 TD children (M = 62.54 months) learned novel adjectives in 2 sessions. For each child, half of the adjectives were learned in a repeated spaced retrieval condition, and half were learned in a repeated study-only condition. Recall was assessed immediately after the second learning session and 1 week later. A recognition test was also administered at the 1-week mark. Results On the recall tests, for both groups of children, recall was better for adjectives learned in the repeated spaced retrieval condition. Adjectives learned by the 2nd day were retained 1 week later. Every adjective correctly applied to an object used during the learning period was also extended accurately to new objects with the same characteristics. On these recall tests, the children with DLD did not differ from the TD group in the number of items recalled, though their phonetic accuracy was lower. On the recognition test, the DLD group showed greater accuracy for adjectives that had been learned in the repeated spaced retrieval condition than for those learned in the repeated study condition, whereas the TD group performed at high levels in both conditions. Conclusion Repeated spaced retrieval appears to provide an effective boost to word learning. Because its benefits are seen even when a word must be extended to new objects, the application of this procedure seems well suited for learning new language material rather than being limited to item-specific memorization.

Retrieval-Based Word Learning in Young Typically Developing Children and Children With Developmental Language Disorder I: The Benefits of Repeated Retrieval.

Purpose Scholars have long noted that retention improves significantly when learners frequently test themselves on the new material rather than engage in continuous study with no intermittent testing. In this study, we apply the notion of repeated testing or retrieval to the process of word learning in preschool-age children with and without developmental language disorder (DLD). Method Novel words and their meanings were taught to 10 children with DLD and 10 typically developing (TD) children matched on age (DLD, M = 63.4 months; TD, M = 63.2 months). Recall was assessed immediately after the 2nd learning session and then again 1 week later. Results Both groups showed better retention when they had attempted to retrieve the words during the learning period than when they had simply listened to and studied the words paired with their referents. Relative to their TD peers, the children with DLD seemed to be weaker in their encoding, but these children's retention over a 1-week period was indistinguishable from that of their age mates. Conclusion Word learning activities that include opportunities for repeated retrieval appear to significantly benefit retention relative to more traditional word learning activities. Supplemental Material https://doi.org/10.23641/asha.7927046.

Retrieval-Based Word Learning in Young Typically Developing Children and Children With Development Language Disorder II: A Comparison of Retrieval Schedules.

Purpose Retrieval practice has been found to be a powerful strategy to enhance long-term retention of new information; however, the utility of retrieval practice when teaching young children new words is largely unknown, and even less is known for young children with language impairments. The current study examined the effect of 2 different retrieval schedules on word learning at both the behavioral and neural levels. Method Participants included 16 typically developing children ( M TD = 61.58 months) and 16 children with developmental language disorder ( M DLD = 59.60 months). Children participated in novel word learning sessions in which the spacing of retrieval practice was manipulated: Some words were retrieved only after other words had been presented (i.e., repeated retrieval that required contextual reinstatement [RRCR]); others were taught using an immediate retrieval schedule. In Experiment 1, children's recall of the novel word labels and their meanings was tested after a 5-min delay and a 1-week delay. In Experiment 2, event-related brain potentials were obtained from a match-mismatch task utilizing the novel word stimuli. Results Experiment 1 findings revealed that children were able to label referents and to retain the novel words more successfully if the words were taught in the RRCR learning condition. Experiment 2 findings revealed that mismatching picture-word pairings elicited a robust N400 event-related brain potential only for words that were taught in the RRCR condition. In addition, children were more accurate in identifying picture-word matches and mismatches for words taught in the RRCR condition, relative to the immediate retrieval condition. Conclusions Retrieval practice that requires contextual reinstatement through spacing results in enhanced word learning and long-term retention of words. Both typically developing children and children with developmental language disorder benefit from this type of retrieval procedure. Supplemental Material https://doi.org/10.23641/asha.7927112.

Reflections on the Resurgence of Interest in the Testing Effect.

We discuss the findings from our 2006 article in Psychological Science on the testing effect and describe how the project arose. The testing effect (or retrieval-practice effect) was first reported in the experimental literature about a century before our article was published, and the effect had been replicated (and sometimes discovered anew) many times over the years. Our experiments used prose materials (unlike most prior research) and produced a more powerful effect than prior research even though we used a conservative control condition for comparison. In our discussion, we drew out possible implications for educational practice. We also reported that students in the experiment could not predict the effect; this lack of metacognitive awareness represented a new finding in this context. In a companion article the same year, we provided an historical review of the testing effect. We believe the synergistic effect of the two articles accounts in part for the resurgence in interest in this phenomenon and its application in educational settings.

Improving self-regulated learning with a retrieval practice intervention.

Repeated retrieval practice is a powerful learning tool for promoting long-term retention, but students use this tool ineffectively when regulating their learning. The current experiments evaluated the efficacy of a minimal intervention aimed at improving students' self-regulated use of repeated retrieval practice. Across 2 experiments, students made decisions about when to study, engage in retrieval practice, or stop learning a set of foreign language word pairs. Some students received direct instruction about how to use repeated retrieval practice. These instructions emphasized the mnemonic benefits of retrieval practice over a less effective strategy (restudying) and told students how to use repeated retrieval practice to maximize their performance-specifically, that they should recall a translation correctly 3 times during learning. This minimal intervention promoted more effective self-regulated use of retrieval practice and better retention of the translations compared to a control group that received no instruction. Students who experienced this intervention also showed potential for long-term changes in self-regulated learning: They spontaneously used repeated retrieval practice 1 week later to learn new materials. These results provide a promising first step for developing guidelines for teaching students how to regulate their learning more effectively using repeated retrieval practice. (PsycINFO Database Record

The role of episodic context in retrieval practice effects.

The episodic context account of retrieval-based learning proposes that retrieval enhances subsequent retention because people must think back to and reinstate a prior learning context. Three experiments directly tested this central assumption of the context account. Subjects studied word lists and then either restudied the words under intentional learning conditions or made list discrimination judgments by indicating which list each word had occurred in originally. Subjects in both conditions experienced all items for the same amount of time, but subjects in the list discrimination condition were required to retrieve details about the original episodic context in which the words had occurred. Making initial list discrimination judgments consistently enhanced subsequent free recall relative to restudying the words. Analyses of recall organization and retrieval strategies on the final test showed that retrieval practice enhanced temporal organization during final recall. Semantic encoding tasks also enhanced retention relative to restudying but did so by promoting semantic organization and semantically based retrieval strategies during final recall. The results support the episodic context account of retrieval-based learning. (PsycINFO Database Record

Retrieval-Based Learning: Positive Effects of Retrieval Practice in Elementary School Children.

A wealth of research has demonstrated that practicing retrieval is a powerful way to enhance learning. However, nearly all prior research has examined retrieval practice with college students. Little is known about retrieval practice in children, and even less is known about possible individual differences in retrieval practice. In three experiments, 88 children (mean age 10 years) studied a list of words and either restudied the items or practiced retrieving them. They then took a final free recall test (Experiments 1 and 2) or recognition test (Experiment 3). In all experiments, children showed robust retrieval practice effects. Although a range of individual differences in reading comprehension and processing speed were observed among these children, the benefits of retrieval practice were independent of these factors. The results contribute to the growing body of research supporting the mnemonic benefits of retrieval practice and provide preliminary evidence that practicing retrieval may be an effective learning strategy for children with varying levels of reading comprehension and processing speed.

Elaborative retrieval: Do semantic mediators improve memory?

The elaborative retrieval account of retrieval-based learning proposes that retrieval enhances retention because the retrieval process produces the generation of semantic mediators that link cues to target information. We tested 2 assumptions that form the basis of this account: that semantic mediators are more likely to be generated during retrieval than during restudy and that the generation of mediators facilitates later recall of targets. Although these assumptions are often discussed in the context of retrieval processes, we noted that there was little prior empirical evidence to support either assumption. We conducted a series of experiments to measure the generation of mediators during retrieval and restudy and to examine the effect of the generation of mediators on later target recall. Across 7 experiments, we found that the generation of mediators was not more likely during retrieval (and may be more likely during restudy), and that the activation of mediators was unrelated to subsequent free recall of targets and was negatively related to cued recall of targets. The results pose challenges for both assumptions of the elaborative retrieval account. (PsycINFO Database Record

On the placement of practice questions during study.

Retrieval practice improves retention of information on later tests. A question remains: When should retrieval occur during learning-interspersed throughout study or at the end of each study period? In a lab experiment, an online experiment, and a classroom study, we aimed to determine the ideal placement (interspersed vs. at-the-end) of retrieval practice questions. In the lab experiment, 64 subjects viewed slides about APA style and answered short-answer practice questions about the content or restudied the slides (restudy condition). The practice questions either appeared 1 every 1-2 slides (interspersed condition), or all at the end of the presentation (at-the-end condition). One week later, subjects returned and answered the same questions on a final test. In the online experiment, 175 subjects completed the same procedure. In the classroom study, 62 undergraduate students took quizzes as part of class lectures. Short-answer practice questions appeared either throughout the lectures (interspersed condition) or at the end of the lectures (at-the-end condition). Nineteen days after the last quiz, students were given a surprise final test. Results from the 3 experiments converge in demonstrating an advantage for interspersing practice questions on the initial tests, but an absence of this advantage on the final test.

How does creating a concept map affect item-specific encoding?

Concept mapping has become a popular learning tool. However, the processes underlying the task are poorly understood. In the present study, we examined the effect of creating a concept map on the processing of item-specific information. In 2 experiments, subjects learned categorized or ad hoc word lists by making pleasantness ratings, sorting words into categories, or creating a concept map. Memory was tested using a free recall test and a recognition memory test, which is considered to be especially sensitive to item-specific processing. Typically, tasks that promote item-specific processing enhance free recall of categorized lists, relative to category sorting. Concept mapping resulted in lower recall performance than both the pleasantness rating and category sorting condition for categorized words. Moreover, concept mapping resulted in lower recognition memory performance than the other 2 tasks. These results converge on the conclusion that creating a concept map disrupts the processing of item-specific information.

Toward an episodic context account of retrieval-based learning: dissociating retrieval practice and elaboration.

We tested the predictions of 2 explanations for retrieval-based learning; while the elaborative retrieval hypothesis assumes that the retrieval of studied information promotes the generation of semantically related information, which aids in later retrieval (Carpenter, 2009), the episodic context account proposed by Karpicke, Lehman, and Aue (in press) assumes that retrieval alters the representation of episodic context and improves one's ability to guide memory search on future tests. Subjects studied multiple word lists and either recalled each list (retrieval practice), did a math task (control), or generated associates for each word (elaboration) after each list. After studying the last list, all subjects recalled the list and, after a 5-min delay, recalled all lists. Analyses of correct recall, intrusions, response times, and temporal clustering dissociate retrieval practice from elaboration, supporting the episodic context account.

Retrieval practice with short-answer, multiple-choice, and hybrid tests.

Retrieval practice improves meaningful learning, and the most frequent way of implementing retrieval practice in classrooms is to have students answer questions. In four experiments (N=372) we investigated the effects of different question formats on learning. Students read educational texts and practised retrieval by answering short-answer, multiple-choice, or hybrid questions. In hybrid conditions students first attempted to recall answers in short-answer format, then identified answers in multiple-choice format. We measured learning 1 week later using a final assessment with two types of questions: those that could be answered by recalling information verbatim from the texts and those that required inferences. Practising retrieval in all format conditions enhanced retention, relative to a study-only control condition, on both verbatim and inference questions. However, there were little or no advantages of answering short-answer or hybrid format questions over multiple-choice questions in three experiments. In Experiment 4, when retrieval success was improved under initial short-answer conditions, there was an advantage of answering short-answer or hybrid questions over multiple-choice questions. The results challenge the simple conclusion that short-answer questions always produce the best learning, due to increased retrieval effort or difficulty, and demonstrate the importance of retrieval success for retrieval-based learning activities.

Covert retrieval practice benefits retention as much as overt retrieval practice.

Many experiments provide evidence that practicing retrieval benefits retention relative to conditions of no retrieval practice. Nearly all prior research has employed retrieval practice requiring overt responses, but a few experiments have shown that covert retrieval also produces retention advantages relative to control conditions. However, direct comparisons between overt and covert retrieval are scarce: Does covert retrieval-thinking of but not producing responses-on a first test produce the same benefit as overt retrieval on a criterial test given later? We report 4 experiments that address this issue by comparing retention on a second test following overt or covert retrieval on a first test. In Experiment 1 we used a procedure designed to ensure that subjects would retrieve on covert as well as overt test trials and found equivalent testing effects in the 2 cases. In Experiment 2 we replicated these effects using a procedure that more closely mirrored natural retrieval processes. In Experiment 3 we showed that overt and covert retrieval produced equivalent testing effects after a 2-day delay. Finally, in Experiment 4 we showed that covert retrieval benefits retention more than restudying. We conclude that covert retrieval practice is as effective as overt retrieval practice, a conclusion that contravenes hypotheses in the literature proposing that overt responding is better. This outcome has an important educational implication: Students can learn as much from covert self-testing as they would from overt responding.