Updating predictions in a complex repertoire of actions and its neural representation.

Even though actions we observe in everyday life seem to unfold in a continuous manner, they are automatically divided into meaningful chunks, that are single actions or segments, which provide information for the formation and updating of internal predictive models. Specifically, boundaries between actions constitute a hub for predictive processing since the prediction of the current action comes to an end and calls for updating of predictions for the next action. In the current study, we investigated neural processes which characterize such boundaries using a repertoire of complex action sequences with a predefined probabilistic structure. Action sequences consisted of actions that started with the hand touching an object (T) and ended with the hand releasing the object (U). These action boundaries were determined using an automatic computer vision algorithm. Participants trained all action sequences by imitating demo videos. Subsequently, they returned for an fMRI session during which the original action sequences were presented in addition to slightly modified versions thereof. Participants completed a post-fMRI memory test to assess the retention of original action sequences. The exchange of individual actions, and thus a violation of action prediction, resulted in increased activation of the action observation network and the anterior insula. At U events, marking the end of an action, increased brain activation in supplementary motor area, striatum, and lingual gyrus was indicative of the retrieval of the previously encoded action repertoire. As expected, brain activation at U events also reflected the predefined probabilistic branching structure of the action repertoire. At T events, marking the beginning of the next action, midline and hippocampal regions were recruited, reflecting the selected prediction of the unfolding action segment. In conclusion, our findings contribute to a better understanding of the various cerebral processes characterizing prediction during the observation of complex action repertoires.

The significance of structural rich club hubs for the processing of hierarchical stimuli.

The brain's structural network follows a hierarchy that is described as rich club (RC) organization, with RC hubs forming the well-interconnected top of this hierarchy. In this study, we tested whether RC hubs are involved in the processing of hierarchically higher structures in stimulus sequences. Moreover, we explored the role of previously suggested cortical gradients along anterior-posterior and medial-lateral axes throughout the frontal cortex. To this end, we conducted a functional magnetic resonance imaging (fMRI) experiment and presented participants with blocks of digit sequences that were structured on different hierarchically nested levels. We additionally collected diffusion weighted imaging data of the same subjects to identify RC hubs. This classification then served as the basis for a region of interest analysis of the fMRI data. Moreover, we determined structural network centrality measures in areas that were found as activation clusters in the whole-brain fMRI analysis. Our findings support the previously found anterior and medial shift for processing hierarchically higher structures of stimuli. Additionally, we found that the processing of hierarchically higher structures of the stimulus structure engages RC hubs more than for lower levels. Areas involved in the functional processing of hierarchically higher structures were also more likely to be part of the structural RC and were furthermore more central to the structural network. In summary, our results highlight the potential role of the structural RC organization in shaping the cortical processing hierarchy.

Effects of DRD2/ANKK1 and COMT Val158Met polymorphisms on stabilization against and adaptation to unexpected events.

Genetic variations affecting dopaminergic neuromodulation such as the DRD2/ANKK1 and the COMT Val158Met polymorphisms contribute to goal-directed behavior that requires a balance between stabilization and updating of current states and behaviors. Dopamine is also thought to be relevant for encoding of surprise signals to sensory input and adaptive learning. A link between goal-directed behavior and learning from surprise is therefore plausible. In the present fMRI study, we investigated whether DRD2 and COMT polymorphisms are related to behavioral responses and neural signals in the caudate nucleus and dlPFC during updating or stabilizing internal models of predictable digit sequences. To-be-detected switches between sequences and to-be-ignored digit omissions within a sequence varied by information-theoretic quantities of surprise and entropy. We found that A1 noncarriers and Val-carriers showed a lower response threshold along with increased caudate and dlPFC activation to surprising switches compared with A1-carriers and Met-homozygotes, whose dlPFC activity increased with decreasing switch surprise. In contrast, there were overall smaller differences in behavioral and neural modulation by drift surprise. Our results suggest that the impact of dopamine-relevant polymorphisms in the flexibility-stability trade-off may result in part from the role of dopamine in encoding the weight afforded to events requiring updating or stabilization.

Touching events predict human action segmentation in brain and behavior.

Recognizing the actions of others depends on segmentation into meaningful events. After decades of research in this area, it remains still unclear how humans do this and which brain areas support underlying processes. Here we show that a computer vision-based model of touching and untouching events can predict human behavior in segmenting object manipulation actions with high accuracy. Using this computational model and functional Magnetic Resonance Imaging (fMRI), we pinpoint the neural networks underlying this segmentation behavior during an implicit action observation task. Segmentation was announced by a strong increase of visual activity at touching events followed by the engagement of frontal, hippocampal and insula regions, signaling updating expectation at subsequent untouching events. Brain activity and behavior show that touching-untouching motifs are critical features for identifying the key elements of actions including object manipulations.