Reinforcement Learning during Locomotion.

When learning a new motor skill, people often must use trial and error to discover which movement is best. In the reinforcement learning framework, this concept is known as exploration and has been linked to increased movement variability in motor tasks. For locomotor tasks, however, increased variability decreases upright stability. As such, exploration during gait may jeopardize balance and safety, making reinforcement learning less effective. Therefore, we set out to determine if humans could acquire and retain a novel locomotor pattern using reinforcement learning alone. Young healthy male and female participants walked on a treadmill and were provided with binary reward feedback (indicated by a green checkmark on the screen) that was tied to a fixed monetary bonus, to learn a novel stepping pattern. We also recruited a comparison group who walked with the same novel stepping pattern but did so by correcting for target error, induced by providing real-time veridical visual feedback of steps and a target. In two experiments, we compared learning, motor variability, and two forms of motor memories between the groups. We found that individuals in the binary reward group did, in fact, acquire the new walking pattern by exploring (increasing motor variability). Additionally, while reinforcement learning did not increase implicit motor memories, it resulted in more accurate explicit motor memories compared with the target error group. Overall, these results demonstrate that humans can acquire new walking patterns with reinforcement learning and retain much of the learning over 24 h.

Explicit and implicit locomotor learning in individuals with chronic hemiparetic stroke.

Motor learning involves both explicit and implicit processes that are fundamental for acquiring and adapting complex motor skills. However, stroke may damage the neural substrates underlying explicit and/or implicit learning, leading to deficits in overall motor performance. While both learning processes are typically used in concert in daily life and rehabilitation, no gait studies have determined how these processes function together after stroke when tested during a task that elicits dissociable contributions from both. Here, we compared explicit and implicit locomotor learning in individuals with chronic stroke to age- and sex-matched neurologically intact controls. We assessed implicit learning using split-belt adaptation (where two treadmill belts move at different speeds). We assessed explicit learning (i.e., strategy-use) using visual feedback during split-belt walking to help individuals explicitly correct for step length errors created by the split-belts. The removal of visual feedback after the first 40 strides of split-belt walking, combined with task instructions, minimized contributions from explicit learning for the remainder of the task. We utilized computational modeling to determine the individual contributions of explicit and implicit processes to overall behavioral change. The computational and behavioral analyses revealed that, compared to controls, individuals with chronic stroke demonstrated deficits in both explicit and implicit contributions to locomotor learning, a result that runs counter to prior work testing each process individually during gait. Since post-stroke locomotor rehabilitation involves interventions that rely on both explicit and implicit motor learning, future work should determine how locomotor rehabilitation interventions can be structured to optimize overall motor learning.

A reliable and efficient adaptive Bayesian method to assess static lower limb position sense.

BACKGROUND: Lower limb proprioception is critical for maintaining stability during gait and may impact how individuals modify their movements in response to changes in the environment and body state, a process termed "sensorimotor adaptation". However, the connection between lower limb proprioception and sensorimotor adaptation during human gait has not been established. We suspect this gap is due in part to the lack of reliable, efficient methods to assess global lower limb proprioception in an ecologically valid context. NEW METHOD: We assessed static lower limb proprioception using an alternative forced choice task, administered twice to determine test-retest reliability. Participants stood on a dual-belt treadmill which passively moved one limb to stimulus locations selected by a Bayesian adaptive algorithm. At the stimulus locations, participants judged relative foot positions and the algorithm estimated the point of subjective equality (PSE) and the uncertainty of lower limb proprioception. RESULTS: Using the Bland-Altman method, combined with Bayesian statistics, we found that both the PSE and uncertainty estimates had good reliability. COMPARISON WITH EXISTING METHOD(S): Current methods assessing static lower limb proprioception do so within a single joint, in non-weight bearing positions, and rely heavily on memory. One exception assessed static lower limb proprioception in standing but did not measure reliability and contained confounds impacting participants' judgments, which we experimentally controlled here. CONCLUSIONS: This efficient and reliable method assessing lower limb proprioception will aid future mechanistic understanding of locomotor adaptation and serve as a useful tool for basic and clinical researchers studying balance and falls.

A reliable and efficient adaptive Bayesian method to assess static lower limb position sense.

Background: Lower limb proprioception is critical for maintaining stability during gait and may impact how individuals modify their movements in response to changes in the environment and body state, a process termed "sensorimotor adaptation". However, the connection between lower limb proprioception and sensorimotor adaptation during human gait has not been established. We suspect this gap is due in part to the lack of reliable, efficient methods to assess global lower limb proprioception in an ecologically valid context. New Method: We assessed static lower limb proprioception using an alternative forced choice task, administered twice to determine test-retest reliability. Participants stood on a dual-belt treadmill which passively moved one limb to stimulus locations selected by a Bayesian adaptive algorithm. At the stimulus locations, participants judged relative foot positions and the algorithm estimated the point of subjective equality (PSE) and the uncertainty of lower limb proprioception. Results: Using the Bland-Altman method, combined with Bayesian statistics, we found that both the PSE and uncertainty estimates had good reliability. Comparison with Existing Methods: Current methods assessing static lower limb proprioception do so within a single joint, in non-weight bearing positions, and rely heavily on memory. One exception assessed static lower limb proprioception in standing but did not measure reliability and contained confounds impacting participants' judgments, which we experimentally controlled here. Conclusions: This efficient and reliable method assessing lower limb proprioception will aid future mechanistic understanding of locomotor adaptation and serve as a useful tool for basic and clinical researchers studying balance and falls.

Assessing Corticospinal Excitability During Goal-Directed Reaching Behavior.

Reaching is a widely studied behavior in motor physiology and neuroscience research. While reaching has been examined using a variety of behavioral manipulations, there remain significant gaps in the understanding of the neural processes involved in reach planning, execution, and control. The novel approach described here combines a two-dimensional reaching task with transcranial magnetic stimulation (TMS) and concurrent electromyography (EMG) recording from multiple muscles. This method allows for the noninvasive detection of corticospinal activity at precise time points during the unfolding of reaching movements. The example task code includes a delayed response reaching task with two possible targets displayed ± 45° off the midline. Single pulse TMS is delivered on the majority of task trials, either at the onset of the preparatory cue (baseline) or 100 ms prior to the imperative cue (delay). This sample design is suitable for investigating changes in corticospinal excitability during reach preparation. The sample code also includes a visuomotor perturbation (i.e., cursor rotation of ± 20°) to investigate the effects of adaptation on corticospinal excitability during reach preparation. The task parameters and TMS delivery can be adjusted to address specific hypotheses about the state of the motor system during reaching behavior. In the initial implementation, motor evoked potentials (MEPs) were successfully elicited on 83% of TMS trials, and reach trajectories were recorded on all trials.

A machine learning approach to identifying important features for achieving step thresholds in individuals with chronic stroke.

BACKGROUND: While many factors are associated with stepping activity after stroke, there is significant variability across studies. One potential reason to explain this variability is that there are certain characteristics that are necessary to achieve greater stepping activity that differ from others that may need to be targeted to improve stepping activity. OBJECTIVE: Using two step thresholds (2500 steps/day, corresponding to home vs. community ambulation and 5500 steps/day, corresponding to achieving physical activity guidelines through walking), we applied 3 different algorithms to determine which predictors are most important to achieve these thresholds. METHODS: We analyzed data from 268 participants with stroke that included 25 demographic, performance-based and self-report variables. Step 1 of our analysis involved dimensionality reduction using lasso regularization. Step 2 applied drop column feature importance to compute the mean importance of each variable. We then assessed which predictors were important to all 3 mathematically unique algorithms. RESULTS: The number of relevant predictors was reduced from 25 to 7 for home vs. community and from 25 to 16 for aerobic thresholds. Drop column feature importance revealed that 6 Minute Walk Test and speed modulation were the only variables found to be important to all 3 algorithms (primary characteristics) for each respective threshold. Other variables related to readiness to change activity behavior and physical health, among others, were found to be important to one or two algorithms (ancillary characteristics). CONCLUSIONS: Addressing physical capacity is necessary but not sufficient to achieve important step thresholds, as ancillary characteristics, such as readiness to change activity behavior and physical health may also need to be targeted. This delineation may explain heterogeneity across studies examining predictors of stepping activity in stroke.

Dissociable use-dependent processes for volitional goal-directed reaching.

Repetition of specific movement biases subsequent actions towards the practiced movement, a phenomenon known as use-dependent learning (UDL). Recent experiments that impose strict constraints on planning time have revealed two sources of use-dependent biases, one arising from dynamic changes occurring during motor planning and another reflecting a stable shift in motor execution. Here, we used a distributional analysis to examine the contribution of these biases in reaching. To create the conditions for UDL, the target appeared at a designated 'frequent' location on most trials, and at one of six 'rare' locations on other trials. Strikingly, the heading angles were bimodally distributed, with peaks at both frequent and rare target locations. Despite having no constraints on planning time, participants exhibited a robust bias towards the frequent target when movements were self-initiated quickly, the signature of a planning bias; notably, the peak near the rare target was shifted in the frequently practiced direction, the signature of an execution bias. Furthermore, these execution biases were not only replicated in a delayed-response task but were also insensitive to reward. Taken together, these results extend our understanding of how volitional movements are influenced by recent experience.

Interactions between sensory prediction error and task error during implicit motor learning.

Implicit motor recalibration allows us to flexibly move in novel and changing environments. Conventionally, implicit recalibration is thought to be driven by errors in predicting the sensory outcome of movement (i.e., sensory prediction errors). However, recent studies have shown that implicit recalibration is also influenced by errors in achieving the movement goal (i.e., task errors). Exactly how sensory prediction errors and task errors interact to drive implicit recalibration and, in particular, whether task errors alone might be sufficient to drive implicit recalibration remain unknown. To test this, we induced task errors in the absence of sensory prediction errors by displacing the target mid-movement. We found that task errors alone failed to induce implicit recalibration. In additional experiments, we simultaneously varied the size of sensory prediction errors and task errors. We found that implicit recalibration driven by sensory prediction errors could be continuously modulated by task errors, revealing an unappreciated dependency between these two sources of error. Moreover, implicit recalibration was attenuated when the target was simply flickered in its original location, even though this manipulation did not affect task error - an effect likely attributed to attention being directed away from the feedback cursor. Taken as a whole, the results were accounted for by a computational model in which sensory prediction errors and task errors, modulated by attention, interact to determine the extent of implicit recalibration.

Differential Effects of Cerebellar Degeneration on Feedforward versus Feedback Control across Speech and Reaching Movements.

Errors that result from a mismatch between predicted movement outcomes and sensory afference are used to correct ongoing movements through feedback control and to adapt feedforward control of future movements. The cerebellum has been identified as a critical part of the neural circuit underlying implicit adaptation across a wide variety of movements (reaching, gait, eye movements, and speech). The contribution of this structure to feedback control is less well understood. Although it has recently been shown in the speech domain that individuals with cerebellar degeneration produce larger online corrections for sensory perturbations than control participants, similar behavior has not been observed in other motor domains. Currently, comparisons across domains are limited by different population samples and potential ceiling effects in existing tasks. To assess the relationship between changes in feedforward and feedback control associated with cerebellar degeneration across motor domains, we evaluated adaptive (feedforward) and compensatory (feedback) responses to sensory perturbations in reaching and speech production in human participants of both sexes with cerebellar degeneration and neurobiologically healthy controls. As expected, the cerebellar group demonstrated impaired adaptation in both reaching and speech. In contrast, the groups did not differ in their compensatory response in either domain. Moreover, compensatory and adaptive responses in the cerebellar group were not correlated within or across motor domains. These results point to a general impairment in feedforward control with spared feedback control in cerebellar degeneration. However, the magnitude of feedforward impairments and potential changes in feedback-based control manifest in a domain-specific manner across individuals.SIGNIFICANCE STATEMENT The cerebellum contributes to feedforward updating of movement in response to sensory errors, but its role in feedback control is less understood. Here, we tested individuals with cerebellar degeneration (CD), using sensory perturbations to assess adaptation of feedforward control and feedback gains during reaching and speech production tasks. The results confirmed that CD leads to reduced adaption in both domains. However, feedback gains were unaffected by CD in either domain. Interestingly, measures of feedforward and feedback control were not correlated across individuals within or across motor domains. Together, these results indicate a general impairment in feedforward control with spared feedback control in CD. However, the magnitude of feedforward impairments manifests in a domain-specific manner across individuals.

The Consistency of Prior Movements Shapes Locomotor Use-Dependent Learning.

Repetition is an indispensable component of motor skill acquisition. However, it is unknown how consistent repeated movement patterns must be to engage an implicit "use-dependent" learning mechanism. In this Registered Report, we tackled this question through a combination of computational modeling, simulations, and behavioral experiments involving visually-guided treadmill walking. Our hypotheses were formalized by two distinct computational models: in the two-process Strategy plus Use-Dependent model, use-dependent learning is viewed as a slowly updating and slowly decaying bias in the direction of repeated movements. The Adaptive Bayesian model frames use-dependent learning as an emergent property of quickly adapting prior probabilities of target step lengths. Critically, the Adaptive Bayesian model is much more sensitive to variable practice than the Strategy plus Use-Dependent model. To test these hypotheses, human participants (N = 18, 10 females) learned a novel asymmetric stepping pattern under three conditions with differing amounts of practice consistency during a learning block. We probed use-dependent movement biases immediately postlearning by asking participants to "walk normally" during a washout block with no visual feedback (VF). We found that the total magnitude of use-dependent learning depended on practice consistency during learning, consistent with the Adaptive Bayesian model. However, this dependence faded quickly as biases became similar in magnitude over subsequent strides across all conditions, an observation more consistent with the Strategy plus Use-Dependent model. Simple post hoc adjustments to the Strategy plus Use-Dependent model made clear that these seemingly opposing effects of practice consistency can result from a unitary use-dependent learning process shaped by recent movement history.

Beyond Physical Capacity: Factors Associated With Real-world Walking Activity After Stroke.

OBJECTIVE: To identify homogeneous subsets of survivors of chronic stroke who share similar characteristics across several domains and test if these groups differ in real-world walking activity. We hypothesized that variables representing the domains of walking ability, psychosocial, environment, and cognition would be important contributors in differentiating real-world walking activity in survivors of chronic stroke. DESIGN: Cross-sectional, secondary data analysis. SETTING: University/laboratory. PARTICIPANTS: A total of 283 individuals with chronic (≥6mo) stroke (N=238). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Thirteen variables representing 5 domains were included: (1) walking ability: 6-minute walk test (6MWT), self-selected speed (SSS) of gait; (2) psychosocial: Patient Health Questionnaire-9, Activities-specific Balance Confidence (ABC) scale; (3) physical health: low-density lipoprotein cholesterol, body mass index, Charlson Comorbidity Index (CCI); (4) cognition: Montreal Cognitive Assessment (MoCA); and (5) environment: living situation and marital status, work status, Area Deprivation Index (ADI), Walk Score. Mixture modeling was used to identify latent classes of survivors of stroke. After identifying the latent classes, walking activity, measured as steps per day (SPD), was included as a distal outcome to understand if classes were meaningfully different in their real-world walking RESULTS: A model with 3 latent classes was selected. The 6MWT, SSS, ABC scale, and Walk Score were significantly different among all 3 classes. Differences were also seen for the MoCA, ADI, and CCI between 2 of the 3 classes. Importantly, the distal outcome of SPD was significantly different in all classes, indicating that real-world walking activity differs among the groups identified by the mixture model. CONCLUSIONS: Survivors of stroke with lower walking ability, lower self-efficacy, lower cognitive abilities, and greater area deprivation had lower SPD. These results demonstrate that the physical and social environment (including socioeconomic factors) and cognitive function should also be considered when developing interventions to improve real-world walking activity after stroke.

Reexposure to a sensorimotor perturbation produces opposite effects on explicit and implicit learning processes.

The motor system demonstrates an exquisite ability to adapt to changes in the environment and to quickly reset when these changes prove transient. If similar environmental changes are encountered in the future, learning may be faster, a phenomenon known as savings. In studies of sensorimotor learning, a central component of savings is attributed to the explicit recall of the task structure and appropriate compensatory strategies. Whether implicit adaptation also contributes to savings remains subject to debate. We tackled this question by measuring, in parallel, explicit and implicit adaptive responses in a visuomotor rotation task, employing a protocol that typically elicits savings. While the initial rate of learning was faster in the second exposure to the perturbation, an analysis decomposing the 2 processes showed the benefit to be solely associated with explicit re-aiming. Surprisingly, we found a significant decrease after relearning in aftereffect magnitudes during no-feedback trials, a direct measure of implicit adaptation. In a second experiment, we isolated implicit adaptation using clamped visual feedback, a method known to eliminate the contribution of explicit learning processes. Consistent with the results of the first experiment, participants exhibited a marked reduction in the adaptation function, as well as an attenuated aftereffect when relearning from the clamped feedback. Motivated by these results, we reanalyzed data from prior studies and observed a consistent, yet unappreciated pattern of attenuation of implicit adaptation during relearning. These results indicate that explicit and implicit sensorimotor processes exhibit opposite effects upon relearning: Explicit learning shows savings, while implicit adaptation becomes attenuated.

Individual differences in proprioception predict the extent of implicit sensorimotor adaptation.

Recent studies have revealed an upper bound in motor adaptation, beyond which other learning systems may be recruited. The factors determining this upper bound are poorly understood. The multisensory integration hypothesis states that this limit arises from opposing responses to visual and proprioceptive feedback. As individuals adapt to a visual perturbation, they experience an increasing proprioceptive error in the opposite direction, and the upper bound is the point where these two error signals reach an equilibrium. Assuming that visual and proprioceptive feedback are weighted according to their variability, there should be a correlation between proprioceptive variability and the limits of adaptation. Alternatively, the proprioceptive realignment hypothesis states that the upper bound arises when the (visually biased) sensed hand position realigns with the expected sensed position (target). When a visuo-proprioceptive discrepancy is introduced, the sensed hand position is biased toward the visual cursor, and the adaptive system counteracts this discrepancy by driving the hand away from the target. This hypothesis predicts a correlation between the size of the proprioceptive shift and the upper bound of adaptation. We tested these two hypotheses by considering natural variation in proprioception and motor adaptation across individuals. We observed a modest, yet reliable correlation between the upper bound of adaptation with both proprioceptive measures (variability and shift). Although the results do not clearly favor one hypothesis over the other, they underscore the critical role of proprioception in sensorimotor adaptation.NEW & NOTEWORTHY Although the sensorimotor system uses sensory feedback to remain calibrated, this learning process is constrained, limited by the maximum degree of plasticity. The factors determining this limit remain elusive. Guided by two hypotheses, we show that individual differences in the upper bound of adaptation in response to a visual perturbation can be predicted by the bias and variability in proprioception. These results underscore the critical, but often neglected role of proprioception in human motor learning.

Long-Term Motor Learning in the "Wild" With High Volume Video Game Data.

Motor learning occurs over long periods of practice during which motor acuity, the ability to execute actions more accurately, precisely, and in less time, improves. Laboratory-based studies of motor learning are typically limited to a small number of participants and a time frame of minutes to several hours per participant. There is a need to assess the generalizability of theories and findings from lab-based motor learning studies on larger samples and time scales. In addition, laboratory-based studies of motor learning use relatively simple motor tasks which participants are unlikely to be intrinsically motivated to learn, limiting the interpretation of their findings in more ecologically valid settings ("in the wild"). We studied the acquisition and longitudinal refinement of a complex sensorimotor skill embodied in a first-person shooter video game scenario, with a large sample size (N = 7174, 682,564 repeats of the 60 s game) over a period of months. Participants voluntarily practiced the gaming scenario for up to several hours per day up to 100 days. We found improvement in performance accuracy (quantified as hit rate) was modest over time but motor acuity (quantified as hits per second) improved considerably, with 40-60% retention from 1 day to the next. We observed steady improvements in motor acuity across multiple days of video game practice, unlike most motor learning tasks studied in the lab that hit a performance ceiling rather quickly. Learning rate was a non-linear function of baseline performance level, amount of daily practice, and to a lesser extent, number of days between practice sessions. In addition, we found that the benefit of additional practice on any given day was non-monotonic; the greatest improvements in motor acuity were evident with about an hour of practice and 90% of the learning benefit was achieved by practicing 30 min per day. Taken together, these results provide a proof-of-concept in studying motor skill acquisition outside the confines of the traditional laboratory, in the presence of unmeasured confounds, and provide new insights into how a complex motor skill is acquired in an ecologically valid setting and refined across much longer time scales than typically explored.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning.

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

The effect of visual uncertainty on implicit motor adaptation.

Sensorimotor adaptation is influenced by both the size and variance of error information. In the present study, we varied visual uncertainty and error size in a factorial manner and evaluated their joint effect on adaptation, using a feedback method that avoids inherent limitations with standard visuomotor tasks. Uncertainty attenuated adaptation, but only when the error was small. This striking interaction highlights a novel constraint for models of sensorimotor adaptation. Sensorimotor adaptation is driven by sensory prediction errors, the difference between the predicted and actual feedback. When the position of the feedback is made uncertain, motor adaptation is attenuated. This effect, in the context of optimal sensory integration models, has been attributed to the motor system discounting noisy feedback and thus reducing the learning rate. In its simplest form, optimal integration predicts that uncertainty would result in reduced learning for all error sizes. However, these predictions remain untested since manipulations of error size in standard visuomotor tasks introduce confounds in the degree to which performance is influenced by other learning processes such as strategy use. Here, we used a novel visuomotor task that isolates the contribution of implicit adaptation, independent of error size. In two experiments, we varied feedback uncertainty and error size in a factorial manner. At odds with the basic predictions derived from the optimal integration theory, the results show that uncertainty attenuated learning only when the error size was small but had no effect when the error size was large. We discuss possible mechanisms that may account for this interaction, considering how uncertainty may interact with the relevance assigned to the error signal or how the output of the adaptation system in terms of recalibrating the sensorimotor map may be modified by uncertainty.NEW & NOTEWORTHY Sensorimotor adaptation is influenced by both the size and variance of error information. In the present study, we varied visual uncertainty and error size in a factorial manner and evaluated their joint effect on adaptation, using a feedback method that avoids inherent limitations with standard visuomotor tasks. Uncertainty attenuated adaptation but only when the error was small. This striking interaction highlights a novel constraint for models of sensorimotor adaptation.

Use-dependent plasticity explains aftereffects in visually guided locomotor learning of a novel step length asymmetry.

Studies of upper extremity reaching show that use-dependent plasticity, or learning from repetition, plays an important role in shaping motor behaviors. Yet the impact of repetition on locomotor learning is unclear, despite the fact that gait is developed and practiced over millions of repetitions. To test whether repetition alone can induce storage of a novel walking pattern, we instructed two groups of young healthy subjects to learn an asymmetric walking pattern through two distinct learning paradigms. The first group learned a new pattern through an established visual distortion paradigm, which provided both sensory prediction error and repetition of movement patterns to induce walking aftereffects, and the second received veridical feedback with a target change, which provided only repetition (use-dependent plasticity) to induce aftereffects. When feedback was removed, both groups demonstrated aftereffects in the primary outcome, step asymmetry index. Surprisingly, despite the different task demands, both groups produced similar aftereffect magnitudes, which also had similar rates of decay, suggesting that the addition of sensory prediction errors did not improve storage of learning beyond that induced by the use-dependent process alone. To further characterize the use-dependent process, we conducted a second experiment to quantify aftereffect size in a third group who practiced double the asymmetry magnitude. This new group showed a proportionately greater magnitude of the use-dependent aftereffect. Together, these findings show that the primary driver of storage of a new step length asymmetry during visually guided locomotor learning is repetition, not sensory prediction error, and this effect scales with the learning magnitude.NEW & NOTEWORTHY Use-dependent plasticity, or learning from repetition, is an important process for upper extremity reaching tasks, but its contribution to walking is not well established. Here, we demonstrate the existence of a dose-dependent, use-dependent process during visually guided treadmill walking. We also show that sensory prediction errors, previously thought to drive aftereffects in similar locomotor learning paradigms, do not appear to play a significant role in visually driven learning of a novel step asymmetry during treadmill walking.

The influence of task outcome on implicit motor learning.

Recent studies have demonstrated that task success signals can modulate learning during sensorimotor adaptation tasks, primarily through engaging explicit processes. Here, we examine the influence of task outcome on implicit adaptation, using a reaching task in which adaptation is induced by feedback that is not contingent on actual performance. We imposed an invariant perturbation (rotation) on the feedback cursor while varying the target size. In this way, the cursor either hit or missed the target, with the former producing a marked attenuation of implicit motor learning. We explored different computational architectures that might account for how task outcome information interacts with implicit adaptation. The results fail to support an architecture in which adaptation operates in parallel with a model-free operant reinforcement process. Rather, task outcome may serve as a gain on implicit adaptation or provide a distinct error signal for a second, independent implicit learning process. Editorial note: This article has been through an editorial process in which the authors decide how to respond to the issues raised during peer review. The Reviewing Editor's assessment is that all the issues have been addressed (see decision letter).

Invariant errors reveal limitations in motor correction rather than constraints on error sensitivity.

Implicit sensorimotor adaptation is traditionally described as a process of error reduction, whereby a fraction of the error is corrected for with each movement. Here, in our study of healthy human participants, we characterize two constraints on this learning process: the size of adaptive corrections is only related to error size when errors are smaller than 6°, and learning functions converge to a similar level of asymptotic learning over a wide range of error sizes. These findings are problematic for current models of sensorimotor adaptation, and point to a new theoretical perspective in which learning is constrained by the size of the error correction, rather than sensitivity to error.

A single exercise bout and locomotor learning after stroke: physiological, behavioural, and computational outcomes.

KEY POINTS: Previous work demonstrated an effect of a single high-intensity exercise bout coupled with motor practice on the retention of a newly acquired skilled arm movement, in both neurologically intact and impaired adults. In the present study, using behavioural and computational analyses we demonstrated that a single exercise bout, regardless of its intensity and timing, did not increase the retention of a novel locomotor task after stroke. Considering both present and previous work, we postulate that the benefits of exercise effect may depend on the type of motor learning (e.g. skill learning, sensorimotor adaptation) and/or task (e.g. arm accuracy-tracking task, walking). ABSTRACT: Acute high-intensity exercise coupled with motor practice improves the retention of motor learning in neurologically intact adults. However, whether exercise could improve the retention of locomotor learning after stroke is still unknown. Here, we investigated the effect of exercise intensity and timing on the retention of a novel locomotor learning task (i.e. split-belt treadmill walking) after stroke. Thirty-seven people post stroke participated in two sessions, 24 h apart, and were allocated to active control (CON), treadmill walking (TMW), or total body exercise on a cycle ergometer (TBE). In session 1, all groups exercised for a short bout (∼5 min) at low (CON) or high (TMW and TBE) intensity and before (CON and TMW) or after (TBE) the locomotor learning task. In both sessions, the locomotor learning task was to walk on a split-belt treadmill in a 2:1 speed ratio (100% and 50% fast-comfortable walking speed) for 15 min. To test the effect of exercise on 24 h retention, we applied behavioural and computational analyses. Behavioural data showed that neither high-intensity group showed greater 24 h retention compared to CON, and computational data showed that 24 h retention was attributable to a slow learning process for sensorimotor adaptation. Our findings demonstrated that acute exercise coupled with a locomotor adaptation task, regardless of its intensity and timing, does not improve retention of the novel locomotor task after stroke. We postulate that exercise effects on motor learning may be context specific (e.g. type of motor learning and/or task) and interact with the presence of genetic variant (BDNF Val66Met).