Chunking as a rational solution to the speed-accuracy trade-off in a serial reaction time task.

When exposed to perceptual and motor sequences, people are able to gradually identify patterns within and form a compact internal description of the sequence. One proposal of how sequences can be compressed is people's ability to form chunks. We study people's chunking behavior in a serial reaction time task. We relate chunk representation with sequence statistics and task demands, and propose a rational model of chunking that rearranges and concatenates its representation to jointly optimize for accuracy and speed. Our model predicts that participants should chunk more if chunks are indeed part of the generative model underlying a task and should, on average, learn longer chunks when optimizing for speed than optimizing for accuracy. We test these predictions in two experiments. In the first experiment, participants learn sequences with underlying chunks. In the second experiment, participants were instructed to act either as fast or as accurately as possible. The results of both experiments confirmed our model's predictions. Taken together, these results shed new light on the benefits of chunking and pave the way for future studies on step-wise representation learning in structured domains.

Deterministic and probabilistic regularities underlying risky choices are acquired in a changing decision context.

Predictions supporting risky decisions could become unreliable when outcome probabilities temporarily change, making adaptation more challenging. Therefore, this study investigated whether sensitivity to the temporal structure in outcome probabilities can develop and remain persistent in a changing decision environment. In a variant of the Balloon Analogue Risk Task with 90 balloons, outcomes (rewards or balloon bursts) were predictable in the task's first and final 30 balloons and unpredictable in the middle 30 balloons. The temporal regularity underlying the predictable outcomes differed across three experimental conditions. In the deterministic condition, a repeating three-element sequence dictated the maximum number of pumps before a balloon burst. In the probabilistic condition, a single probabilistic regularity ensured that burst probability increased as a function of pumps. In the hybrid condition, a repeating sequence of three different probabilistic regularities increased burst probabilities. In every condition, the regularity was absent in the middle 30 balloons. Participants were not informed about the presence or absence of the regularity. Sensitivity to both the deterministic and hybrid regularities emerged and influenced risk taking. Unpredictable outcomes of the middle phase did not deteriorate this sensitivity. In conclusion, humans can adapt their risky choices in a changing decision environment by exploiting the statistical structure that controls how the environment changes.

Tracking human skill learning with a hierarchical Bayesian sequence model.

Humans can implicitly learn complex perceptuo-motor skills over the course of large numbers of trials. This likely depends on our becoming better able to take advantage of ever richer and temporally deeper predictive relationships in the environment. Here, we offer a novel characterization of this process, fitting a non-parametric, hierarchical Bayesian sequence model to the reaction times of human participants' responses over ten sessions, each comprising thousands of trials, in a serial reaction time task involving higher-order dependencies. The model, adapted from the domain of language, forgetfully updates trial-by-trial, and seamlessly combines predictive information from shorter and longer windows onto past events, weighing the windows proportionally to their predictive power. As the model implies a posterior over window depths, we were able to determine how, and how many, previous sequence elements influenced individual participants' internal predictions, and how this changed with practice. Already in the first session, the model showed that participants had begun to rely on two previous elements (i.e., trigrams), thereby successfully adapting to the most prominent higher-order structure in the task. The extent to which local statistical fluctuations in trigram frequency influenced participants' responses waned over subsequent sessions, as participants forgot the trigrams less and evidenced skilled performance. By the eighth session, a subset of participants shifted their prior further to consider a context deeper than two previous elements. Finally, participants showed resistance to interference and slow forgetting of the old sequence when it was changed in the final sessions. Model parameters for individual participants covaried appropriately with independent measures of working memory and error characteristics. In sum, the model offers the first principled account of the adaptive complexity and nuanced dynamics of humans' internal sequence representations during long-term implicit skill learning.

Adaptation to recent outcomes attenuates the lasting effect of initial experience on risky decisions.

Both primarily and recently encountered information have been shown to influence experience-based risky decision making. The primacy effect predicts that initial experience will influence later choices even if outcome probabilities change and reward is ultimately more or less sparse than primarily experienced. However, it has not been investigated whether extended initial experience would induce a more profound primacy effect upon risky choices than brief experience. Therefore, the present study tested in two experiments whether young adults adjusted their risk-taking behavior in the Balloon Analogue Risk Task after an unsignaled and unexpected change point. The change point separated early "good luck" or "bad luck" trials from subsequent ones. While mostly positive (more reward) or mostly negative (no reward) events characterized the early trials, subsequent trials were unbiased. In Experiment 1, the change point occurred after one-sixth or one-third of the trials (brief vs. extended experience) without intermittence, whereas in Experiment 2, it occurred between separate task phases. In Experiment 1, if negative events characterized the early trials, after the change point, risk-taking behavior increased as compared with the early trials. Conversely, if positive events characterized the early trials, risk-taking behavior decreased after the change point. Although the adjustment of risk-taking behavior occurred due to integrating recent experiences, the impact of initial experience was simultaneously observed. The length of initial experience did not reliably influence the adjustment of behavior. In Experiment 2, participants became more prone to take risks as the task progressed, indicating that the impact of initial experience could be overcome. Altogether, we suggest that initial beliefs about outcome probabilities can be updated by recent experiences to adapt to the continuously changing decision environment.

Is procedural memory enhanced in Tourette syndrome? Evidence from a sequence learning task.

Procedural memory, which is rooted in the basal ganglia, underlies the learning and processing of numerous automatized motor and cognitive skills, including in language. Not surprisingly, disorders with basal ganglia abnormalities have been found to show impairments of procedural memory. However, brain abnormalities could also lead to atypically enhanced function. Tourette syndrome (TS) is a candidate for enhanced procedural memory, given previous findings of enhanced TS processing of grammar, which likely depends on procedural memory. We comprehensively examined procedural learning, from memory formation to retention, in children with TS and typically developing (TD) children, who performed an implicit sequence learning task over two days. The children with TS showed sequence learning advantages on both days, despite a regression of sequence knowledge overnight to the level of the TD children. This is the first demonstration of procedural learning advantages in any disorder. The findings may further our understanding of procedural memory and its enhancement. The evidence presented here, together with previous findings suggesting enhanced grammar processing in TS, underscore the dependence of language on a system that also subserves visuomotor sequencing.

Deconstructing Procedural Memory: Different Learning Trajectories and Consolidation of Sequence and Statistical Learning.

Procedural learning is a fundamental cognitive function that facilitates efficient processing of and automatic responses to complex environmental stimuli. Here, we examined training-dependent and off-line changes of two sub-processes of procedural learning: namely, sequence learning and statistical learning. Whereas sequence learning requires the acquisition of order-based relationships between the elements of a sequence, statistical learning is based on the acquisition of probabilistic associations between elements. Seventy-eight healthy young adults (58 females and 20 males) completed the modified version of the Alternating Serial Reaction Time task that was designed to measure Sequence and Statistical Learning simultaneously. After training, participants were randomly assigned to one of three conditions: active wakefulness, quiet rest, or daytime sleep. We examined off-line changes in Sequence and Statistical Learning as well as further improvements after extended practice. Performance in Sequence Learning increased during training, while Statistical Learning plateaued relatively rapidly. After the off-line period, both the acquired sequence and statistical knowledge was preserved, irrespective of the vigilance state (awake, quiet rest or sleep). Sequence Learning further improved during extended practice, while Statistical Learning did not. Moreover, within the sleep group, cortical oscillations and sleep spindle parameters showed differential associations with Sequence and Statistical Learning. Our findings can contribute to a deeper understanding of the dynamic changes of multiple parallel learning and consolidation processes that occur during procedural memory formation.