Comparison of online, offline, and hybrid hypotheses of motor sequence learning using a quantitative model that incorporate reactive inhibition.

Two hypotheses have been advanced for when motor sequence learning occurs: offline between bouts of practice or online concurrently with practice. A third possibility is that learning occurs both online and offline. A complication for differentiating between those hypotheses is a process known as reactive inhibition, whereby performance worsens over consecutively executed sequences, but dissipates during breaks. We advance a new quantitative modeling framework that incorporates reactive inhibition and in which the three learning accounts can be implemented. Our results show that reactive inhibition plays a far larger role in performance than is appreciated in the literature. Across four groups of participants in which break times and correct sequences per trial were varied, the best overall fits were provided by a hybrid model. The version of the offline model that does not account for reactive inhibition, which is widely assumed in the literature, had the worst fits. We discuss implications for extant hypotheses and directions for future research.

Dissipation of reactive inhibition is sufficient to explain post-rest improvements in motor sequence learning.

The prevailing hypothesis for observed post-rest motor reaction time improvements is offline consolidation. In the present study, we present evidence for an alternate account involving the accrual and dissipation of reactive inhibition. Four groups of participants (N = 159) performed a finger-tapping task involving either massed (30 s per trial) or spaced (10 s per trial) training, and with one of two break intervals between each trial: 10 s or 30 s. After 360 s of training in each group, there was a 300 s rest period followed by a final test on the same task. The results show that the smaller the ratio of break time to on-task trial time during training, the larger the improvement in reaction time after the rest period. Those results are fully consistent with a model that assumes no facilitating offline consolidation, but rather learning that is concurrent with performance and reactive inhibition that builds during performance and dissipates during breaks.

Age does not modify the processing architecture of dual memory retrieval: an investigation of age-related effects on dual-retrieval practice in younger and older adults.

The present study investigated the cognitive processing architecture of dual(-memory) retrieval from a single cue across two distinct age groups: younger and older adults. Previous research has shown that younger adults can exhibit learned parallel retrieval, but only if they synchronize response execution. This phenomenon has not been demonstrated with older adults. Experiment 1 functioned as an extension of previous studies to assess whether the finding of learned retrieval parallelism in younger adults could be observed in older adults as well. The experiment used a dual retrieval task that involved the retrieval of two responses, one vocal and one keypress, from a single cue. Experiment 2 further assessed whether the cognitive processing architecture underlying the occurrence of learned retrieval parallelism in dual memory retrieval could be influenced by the number of cues in single-retrieval practice. The results of both experiments showed that learned retrieval parallelism occurs in older as well as younger adults and that the processing mechanisms involved in dual memory retrieval are relatively stable across age groups.

Severe publication bias contributes to illusory sleep consolidation in the motor sequence learning literature.

We explored the possibility of publication bias in the sleep and explicit motor sequence learning literature by applying precision effect test (PET) and precision effect test with standard errors (PEESE) weighted regression analyses to the 88 effect sizes from a recent comprehensive literature review (Pan & Rickard, 2015). Basic PET analysis indicated pronounced publication bias; that is, the effect sizes were strongly predicted by their standard error. When variables that have previously been shown to both moderate the sleep gain effect and substantially reduce unaccounted for effect size heterogeneity were included in that analysis, evidence for publication bias remained strong. The estimated postsleep gain was negative, suggesting forgetting rather than facilitation, and it was statistically indistinguishable from the estimated postwake gain. In a qualitative review of a smaller group of more recent studies we observed that (a) small sample sizes-a major factor behind the publication bias-are still the norm, (b) use of demonstrably flawed experimental design and analysis remains prevalent, and (c) when authors conclude in favor of sleep-dependent consolidation, they frequently do not cite the articles in which those methodological flaws have been demonstrated. We conclude that there is substantial publication bias, that there is no consolidation-based, absolute performance gain following sleep, and that strong conclusions regarding the hypothesis of less forgetting after sleep than after wakefulness should await further research. Recommendations are made for reducing publication bias in future work. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Prior episodic learning and the efficacy of retrieval practice.

In three experiments we investigated how the level of study-based, episodic knowledge influences the efficacy of subsequent retrieval practice (testing) as a learning event. Possibilities are that the efficacy of a test, relative to a restudy control, decreases, increases, or is independent of the degree of prior study-based learning. The degree of study-based learning was manipulated by varying the number of item repetitions in the initial study phase between one and eight. Predictions of the dual-memory model of test-enhanced learning for the case of one study-phase repetition were used as a reference. Results support the hypothesis that the advantage of testing over restudy is independent of the degree of prior episodic learning, and they suggest that educators can apply cued-recall testing with the expectation that its efficacy is similar across varying levels of prior content learning. Implications for testing effect theory are discussed.

Test-enhanced learning for pairs and triplets: When and why does transfer occur?

In four experiments, we explored conditions under which learning due to retrieval practice (i.e., testing) transfers to the case in which the cue and response words are rearranged (e.g., a training test on gift, rose, ?, wherein the target is wine, and a final test on gift, ?, wine, wherein the answer is rose). In both Experiment 1 and a supplementary experiment, we observed divergent results for pairs and triplets: Relative to a restudy control condition, strong transfer was observed for pairs, but none for triplets. In Experiments 2 and 3, the theoretical basis of the specificity of learning for triplets was explored. The results rule out the possibilities that transfer is wholly absent for triplets and that transfer occurs only for the case of exact cue-response reversal on the final test. Rather, it appears that, for both pairs and triplets, transfer will occur unless both of the following conditions hold: (1) two or more independent cues are presented on the training test, and (2) the correct responses on the training and final tests are different. We show that the majority of the results can be explained by combining the dual-memory theory of the testing effect with an inclusive-OR representation that forms when two or more cues are presented on the training test. Follow-up analyses that were conditionalized on training test accuracy suggest that specificity of learning is greater on a correct than on an incorrect training test trial, although selection confounds and contradictory experimental results preclude a strong conclusion.

Extension of the dual-memory model of test-enhanced learning to distributions and individual differences.

The dual-memory model of test-enhanced learning (Rickard & Pan, 2018, Psychonomic Bulletin & Review, 25[3], 847-869) provides empirically supported quantitative predictions about multiple core phenomena for the case of cued recall. That model has been evaluated to date only for mean proportion correct. However, it also makes predictions about the distribution over subjects for both test-condition proportion correct and testing-effect magnitude. As a consequence, it makes predictions about aggregate individual difference effects on learning through testing. The current paper evaluates those and other predictions, focusing on a data set of 509 subjects aggregated over multiple experiments that were conducted in my laboratory. Results show that the distribution predictions hold to a close approximation for materials ranging from paired associates to history facts, and for retention intervals ranging from 1 to 7 days. The distribution analyses also allow for a novel assessment of whether accuracy on a training test with feedback is a determinant of testing-effect magnitude, and the results suggest constraints on alternative models. Limitations and prospects are discussed.

Dual-memory retrieval efficiency after practice: effects of strategy manipulations.

The study investigated practice effects, instruction manipulations, and the associated cognitive architecture of dual-memory retrieval from a single cue. In two experiments, we tested predictions about the presence of learned parallelism in dual-memory retrieval within the framework of the set-cue bottleneck model. Both experiments included three experimental laboratory sessions and involved computerized assessments of dual-memory retrieval performance with strategy instruction manipulations. In Experiment 1, subjects were assigned to three distinct dual-task practice instruction groups: (1) a neutral instruction group without a specific direction on how to solve the task (i.e., neutral instruction), (2) an instruction to synchronize the responses (i.e., synchronize instruction), and (3) an instruction to use a sequential response style (i.e., immediate instruction). Results indicate that strategy instructions are able to effectively influence dual retrieval during practice. Mainly, the instruction to synchronize responses led to the presence of learned retrieval parallelism. Experiment 2 provided an assessment of the cognitive processing architecture of dual-memory retrieval. The results provide support for the presence of a structural bottleneck that cannot be eliminated by extensive practice and instruction manipulations. Further results are discussed with respect to the set-cue bottleneck model.

Online and Clicker Quizzing on Jargon Terms Enhances Definition-Focused but Not Conceptually Focused Biology Exam Performance.

Mastery of jargon terms is an important part of student learning in biology and other science, technology, engineering, and mathematics domains. In two experiments, we investigated whether prelecture quizzes enhance memory for jargon terms, and whether that enhanced familiarity can facilitate learning of related concepts that are encountered during subsequent lectures and readings. Undergraduate students enrolled in neuroanatomy and physiology courses completed 10-minute low-stakes quizzes with feedback on jargon terms either online (experiment 1) or using in-class clickers (experiment 2). Quizzes occurred before conventional course instruction in which the terms were used. On exams occurring up to 12 weeks later, we observed improved student performance on questions that targeted memory of previously quizzed jargon terms and their definitions relative to questions on terms that were not quizzed. This pattern occurred whether those questions were identical (experiment 1) or different (experiment 2) from those used during quizzing. Benefits of jargon quizzing did not consistently generalize, however, to exam questions that assessed conceptual knowledge but not necessarily jargon knowledge. Overall, this research demonstrates that a brief and easily implemented jargon-quizzing intervention, deliverable via Internet or in-class platforms, can yield substantial improvements in students' course-relevant scientific lexica, but does not necessarily impact conceptual learning.

Conditions of highly specific learning through cued recall.

After studying a stimulus (e.g., a word triplet such as gift, rose, wine), taking a cued recall test on that stimulus (e.g., gift, rose, ?) improves later recall of the retrieved term (e.g., wine) relative to a restudy control. That testing effect, however, is specific to the tested term: later recall of a previously untested term from the same stimulus (e.g., gift or rose) is not enhanced. In the present research, two possibilities for that highly specific learning were investigated: (a) learning through cued recall is always highly specific to the tested term, or, alternatively, (b) learning specificity is unique to the case of retrieving a term from an episodic memory of a study event. We addressed those possibilities by using the pretesting paradigm, in which there is no study opportunity prior to cued recall testing, and hence retrieval occurs through semantic memory. The results of two experiments supported the latter hypothesis. Thus, it is not the recall attempt per se that produces highly specific learning, but rather the attempt to recall the response by accessing an episodic memory of a particular study event. Theoretical and practical implications for learning through cued recall are discussed.

Transfer of test-enhanced learning: Meta-analytic review and synthesis.

Attempting recall of information from memory, as occurs when taking a practice test, is one of the most potent training techniques known to learning science. However, does testing yield learning that transfers to different contexts? In the present article, we report the findings of the first comprehensive meta-analytic review into that question. Our review encompassed 192 transfer effect sizes extracted from 122 experiments and 67 published and unpublished articles (N = 10,382) that together comprise more than 40 years of research. A random-effects model revealed that testing can yield transferrable learning as measured relative to a nontesting reexposure control condition (d = 0.40, 95% CI [0.31, 0.50]). That transfer of learning is greatest across test formats, to application and inference questions, to problems involving medical diagnoses, and to mediator and related word cues; it is weakest to rearranged stimulus-response items, to untested materials seen during initial study, and to problems involving worked examples. Moderator analyses further indicated that response congruency and elaborated retrieval practice, as well as initial test performance, strongly influence the likelihood of positive transfer. In two assessments for publication bias using PET-PEESE and various selection methods, the moderator effect sizes were minimally affected. However, the intercept predictions were substantially reduced, often indicating no positive transfer when none of the aforementioned moderators are present. Overall, our results motivate a three-factor framework for transfer of test-enhanced learning and have practical implications for the effective use of practice testing in educational and other training contexts. (PsycINFO Database Record

A dual memory theory of the testing effect.

A new theoretical framework for the testing effect-the finding that retrieval practice is usually more effective for learning than are other strategies-is proposed, the empirically supported tenet of which is that separate memories form as a consequence of study and test events. A simplest case quantitative model is derived from that framework for the case of cued recall. With no free parameters, that model predicts both proportion correct in the test condition and the magnitude of the testing effect across 10 experiments conducted in our laboratory, experiments that varied with respect to material type, retention interval, and performance in the restudy condition. The model also provides the first quantitative accounts of (a) the testing effect as a function of performance in the restudy condition, (b) the upper bound magnitude of the testing effect, (c) the effect of correct answer feedback, (d) the testing effect as a function of retention interval for the cases of feedback and no feedback, and (e) the effect of prior learning method on subsequent learning through testing. Candidate accounts of several other core phenomena in the literature, including test-potentiated learning, recognition versus cued recall training effects, cued versus free recall final test effects, and other select transfer effects, are also proposed. Future prospects and relations to other theories are discussed.

Time for considering the possibility that sleep plays no unique role in motor memory consolidation: Reply to Adi-Japha and Karni (2016).

The hypothesis that sleep makes a unique contribution to motor memory consolidation has been debated in recent years. In the target article (Pan & Rickard, 2015), we reported results of a comprehensive meta-analysis of the explicit motor sequence learning literature in which evidence was evaluated for both enhanced performance after sleep and stabilization after sleep. After accounting for confounding variables, we found no compelling evidence for either empirical phenomenon, and hence no compelling evidence for sleep-specific consolidation. In their comment, Adi-Japha and Karni (2016) critiqued the target article on three primary grounds: (a) our unrealistic (in their view) assumption that, if sleep-specific consolidation occurs, it is mechanistically unitary across all variants of the motor sequence experiments included in the meta-analysis, (b) our inclusion of child groups, which they believe may have resulted in an underestimation of sleep effects among adult groups, and (c) our inclusion of several experiments with atypical experimental designs, which may have introduced unaccounted for heterogeneity. In this reply we address each of those potentially legitimate concerns. We show that the metaregression allowed for tests of multiple candidate variables that could engender separate consolidation mechanisms, yielding no behavioral evidence for it. We also show through reanalysis that the inclusion of child groups had virtually no impact on the parameter estimates among adults, and that the inclusion of experiments with atypical designs did not materially influence parameter estimates. (PsycINFO Database Record

Does retrieval practice enhance learning and transfer relative to restudy for term-definition facts?

In many pedagogical contexts, term-definition facts that link a concept term (e.g., "vision") with its corresponding definition (e.g., "the ability to see") are learned. Does retrieval practice involving retrieval of the term (given the definition) or the definition (given the term) enhance subsequent recall, relative to restudy of the entire fact? Moreover, does any benefit of retrieval practice for the term transfer to later recall of the definition, or vice versa? We addressed those questions in 4 experiments. In each, subjects first studied term-definition facts and then trained on two thirds of the facts using multiple-choice tests with feedback. Half of the test questions involved recalling terms; the other half involved recalling definitions. The remaining facts were either not trained (Experiment 1) or restudied (Experiments 2-4). A 48-hr delayed multiple-choice (Experiments 1-2) or short answer (Experiments 3a-4) final test assessed recall of all terms or all definitions. Replicating and extending prior research, retrieval practice yielded improved recall and positive transfer relative to no training. Relative to restudy, however, retrieval practice consistently enhanced subsequent term retrieval, enhanced subsequent definition retrieval only after repeated practice, and consistently yielded at best minimal positive transfer in either direction. Theoretical and practical implications are discussed. (PsycINFO Database Record

Does test-enhanced learning transfer for triple associates?

Test-enhanced learning and transfer for triple-associate word stimuli was assessed in three experiments. In each experiment, training and final-test trials involved the presentation of two words per triple associate (triplet), with the third word having to be retrieved. In agreement with the prior literature on different stimuli, training through testing with feedback yielded markedly better final-test performance than did restudy. However, in contrast to the positive transfer reported for paired associate stimuli, minimal or no positive transfer was observed, relative to a restudy control, from a trained cue combination (e.g., A, B, ?) to other cue combinations from the same triplet that required a different response (e.g., B, C, ?). That result also held when two unique cue combinations per triplet were tested during training, and for triplets with low and high average associative strengths. Supplementary analyses provided insight into the overall transfer effect: An incorrect response during training appears to yield positive transfer relative to restudy, whereas a correct response appears to yield no, or even negative, transfer. Cross-experiment analyses indicated that test-enhanced learning is not diminished when two or three cue combinations are presented during training. Thus, even though learning through testing is highly specific, testing on all possible stimulus-response combinations remains the most efficient strategy for the learning of triple associates.

Does testing with feedback improve adult spelling skills relative to copying and reading?

We examined testing's ability to enhance adult spelling acquisition, relative to copying and reading. Across 3 experiments in which testing with feedback was compared with copying, the spelling improvement after testing matched that following the same amount of time spent copying. A potent testing advantage, however, was observed for spelling words free-recalled. In the fourth experiment, a large testing advantage for both word free recall and spelling was observed, versus reading. Subjects also generally preferred testing and rated it as more effective than copying or reading. The equivalent performance of testing and copying for spelling contrasts with prior work involving children and suggests that retrieval practice may not be the only effective mechanism for spelling skill acquisition. Rather, we suggest that the critical learning event for spelling is focused study on phoneme-to-grapheme mappings for previously unlearned letter sequences. For adults with extensive spelling expertise, focused study is more automatic during both copying and testing with feedback than for individuals with beginning spelling skills. Reading, however, would not be expected to produce efficient focused study of phoneme-to-grapheme mappings, regardless of expertise level. Overall, adult spelling skill acquisition benefits both from testing and copying, and substantially less from reading.

Sleep and motor learning: Is there room for consolidation?

It is widely believed that sleep is critical to the consolidation of learning and memory. In some skill domains, performance has been shown to improve by 20% or more following sleep, suggesting that sleep enhances learning. However, recent work suggests that those performance gains may be driven by several factors that are unrelated to sleep consolidation, inviting a reconsideration of sleep's theoretical role in the consolidation of procedural memories. Here we report the first comprehensive investigation of that possibility for the case of motor sequence learning. Quantitative meta-analyses involving 34 articles, 88 experimental groups and 1,296 subjects confirmed the empirical pattern of a large performance gain following sleep and a significantly smaller gain following wakefulness. However, the results also confirm strong moderating effects of 4 previously hypothesized variables: averaging in the calculation of prepost gain scores, build-up of reactive inhibition over training, time of testing, and training duration, along with 1 supplemental variable, elderly status. With those variables accounted for, there was no evidence that sleep enhances learning. Thus, the literature speaks against, rather than for, the enhancement hypothesis. Overall there was relatively better performance after sleep than after wakefulness, suggesting that sleep may stabilize memory. That effect, however, was not consistent across different experimental designs. We conclude that sleep does not enhance motor learning and that the role of sleep in the stabilization of memory cannot be conclusively determined based on the literature to date. We discuss challenges and opportunities for the field, make recommendations for improved experimental design, and suggest approaches to data analysis that eliminate confounds due to averaging over online learning. (PsycINFO Database Record

Deliberate practice for achieving and maintaining expertise in anesthesiology.

For the dedicated anesthesiologist, a high level of expertise is needed to deliver good care to patients and to provide excellent service to surgeons, anesthesia colleagues, and others. Expertise helps the anesthesiologist recover from difficult situations and generally makes the practice run more effectively. Expertise also contributes to quality of life through higher self-esteem and long-term career satisfaction. We begin by reviewing the attributes that characterize expert performance and discussing how a specific training format, known as deliberate practice, contributes to acquisition and maintenance of expertise. Deliberate practice involves rehearsal of specific tasks to mastery, ideally under the eye of a mentor to provide feedback. This amounts to an orchestrated effort to improve that enables trainees to progress to expert levels of performance. With few exceptions, people who become recognized experts have pursued deliberate practice on the order of 4 hours per day for 10 to 15 years. In contrast, those who practice their profession in a rote manner see their skills plateau well below the level of top performers. Anesthesiology instruction with attending supervision provides all of the necessary components for deliberate practice, and it can be effective in anesthesia. Using deliberate practice in teaching requires organization in selecting training topics, effort in challenging students to excel, and skill in providing feedback. In this article, we discuss how educational programs can implement deliberate practice in anesthesiology training, review resources for instructors, and suggest how anesthesiologists can continue the practice after residency.

Specificity of children's arithmetic learning.

Among adults, arithmetic training-transfer studies have documented a high degree of learning specificity. Provided that there is a delay of at least 1day between training and testing, performance gains do not transfer to untrained problems, nor do they transfer to complement operation-inverted problems (e.g., gains for 4+7=__ do not transfer to the complement subtraction problem, 11-4=__, or vice versa). Here we demonstrate the same degree of learning specificity among 6- to 11-year-old children. These results appear to rule out, for the current training paradigm, operation-level procedural learning as well as any variant of complement problem mediation that would predict transfer. Results are consistent with either or both of two types of learning: (a) item-level procedural learning and (b) a shift to memory-based performance as predicted by the elemental elements model. These results suggest a developmental pattern such that specificity of learning among children is similar to that among adults. Educational implications are noted.

Specificity of learning through memory retrieval practice: the case of addition and subtraction.

The identical elements (IE) model (Rickard, Healy, & Bourne, Learning, Memory, and Cognition 32:734-748, 1994) of fact representation predicts that, in both verbal and numerical domains, performance gains with retrieval practice on multielement items will be specific to the practiced stimulus-response combinations, failing to transfer even to altered stimulus-response mappings of practiced items. In the case of arithmetic, the model predicts no transfer across either complementary operations (e.g., 4 × 7 to 28 / 4) or complementary division or subtraction problems (e.g., 28 / 4 to 28 / 7). Although that model has successfully described transfer effects in the domains of multiplication-division and episodic cued recall, it is challenged by a recent demonstration of positive cross-operation transfer for addition and subtraction (Campbell & Agnew, Psychonomic Bulletin & Review 16:938-944, 2009). We report results of a new addition-subtraction transfer experiment, the design of which closely matched that of a prior multiplication-division experiment that supported the model. The transfer results were consistent with the IE model. A two-component model of memory retrieval practice effects is proposed to account for the discrepant experimental results for addition and subtraction and to guide future work.