Tutorial and simulations with ADAM: an adaptation and anticipation model of sensorimotor synchronization.

Interpersonal coordination of movements often involves precise synchronization of action timing, particularly in expert domains such as ensemble music performance. According to the adaptation and anticipation model (ADAM) of sensorimotor synchronization, precise yet flexible interpersonal coordination is supported by reactive error correction mechanisms and anticipatory mechanisms that exploit systematic patterns in stimulus timing to plan future actions. Here, we provide a tutorial introduction to the computational architecture of ADAM and present a series of single- and dual-virtual agent simulations that examine the model parameters that produce ideal synchronization performance in different tempo conditions. In the single-agent simulations, a virtual agent synchronized responses to steady tempo sequence or a sequence containing gradual tempo changes. Parameters controlling basic reactive error (phase) correction were sufficient for producing ideal synchronization performance at the steady tempo, whereas parameters controlling anticipatory mechanisms were necessary for ideal performance with a tempo-changing sequence. In the dual-agent simulations, two interacting virtual agents produced temporal sequences from either congruent or incongruent internal performance templates specifying a steady tempo or tempo changes. Ideal performance was achieved with reactive error correction alone when both agents implemented the same performance template (either steady tempo or tempo change). In contrast, anticipatory mechanisms played a key role when one agent implemented a steady tempo template and the other agent implemented a tempo change template. These findings have implications for understanding the interplay between reactive and anticipatory mechanisms when agents possess compatible versus incompatible representations of task goals during human-human and human-machine interaction.

Human Parahippocampal Cortex Supports Spatial Binding in Visual Working Memory.

Studies investigating the functional organization of the medial temporal lobe (MTL) suggest that parahippocampal cortex (PHC) generates representations of spatial and contextual information used by the hippocampus in the formation of episodic memories. However, evidence from animal studies also implicates PHC in spatial binding of visual information held in short term, working memory. Here we examined a 46-year-old man (P.J.), after he had recovered from bilateral medial occipitotemporal cortex strokes resulting in ischemic lesions of PHC and hippocampal atrophy, and a group of age-matched healthy controls. When recalling the color of 1 of 2 objects, P.J. misidentified the target when cued by its location, but not shape. When recalling the position of 1 of 3 objects, he frequently misidentified the target, which was cued by its color. Increasing the duration of the memory delay had no impact on the proportion of binding errors, but did significantly worsen recall precision in both P.J. and controls. We conclude that PHC may play a crucial role in spatial binding during encoding of visual information in working memory.

Evidence for Integrated Visual Face and Body Representations in the Anterior Temporal Lobes.

Research on visual face perception has revealed a region in the ventral anterior temporal lobes, often referred to as the anterior temporal face patch (ATFP), which responds strongly to images of faces. To date, the selectivity of the ATFP has been examined by contrasting responses to faces against a small selection of categories. Here, we assess the selectivity of the ATFP in humans with a broad range of visual control stimuli to provide a stronger test of face selectivity in this region. In Experiment 1, participants viewed images from 20 stimulus categories in an event-related fMRI design. Faces evoked more activity than all other 19 categories in the left ATFP. In the right ATFP, equally strong responses were observed for both faces and headless bodies. To pursue this unexpected finding, in Experiment 2, we used multivoxel pattern analysis to examine whether the strong response to face and body stimuli reflects a common coding of both classes or instead overlapping but distinct representations. On a voxel-by-voxel basis, face and whole-body responses were significantly positively correlated in the right ATFP, but face and body-part responses were not. This finding suggests that there is shared neural coding of faces and whole bodies in the right ATFP that does not extend to individual body parts. In contrast, the same approach revealed distinct face and body representations in the right fusiform gyrus. These results are indicative of an increasing convergence of distinct sources of person-related perceptual information proceeding from the posterior to the anterior temporal cortex.

Brain networks for temporal adaptation, anticipation, and sensory-motor integration in rhythmic human behavior.

Human interaction often requires the precise yet flexible interpersonal coordination of rhythmic behavior, as in group music making. The present fMRI study investigates the functional brain networks that may facilitate such behavior by enabling temporal adaptation (error correction), prediction, and the monitoring and integration of information about 'self' and the external environment. Participants were required to synchronize finger taps with computer-controlled auditory sequences that were presented either at a globally steady tempo with local adaptations to the participants' tap timing (Virtual Partner task) or with gradual tempo accelerations and decelerations but without adaptation (Tempo Change task). Connectome-based predictive modelling was used to examine patterns of brain functional connectivity related to individual differences in behavioral performance and parameter estimates from the adaptation and anticipation model (ADAM) of sensorimotor synchronization for these two tasks under conditions of varying cognitive load. Results revealed distinct but overlapping brain networks associated with ADAM-derived estimates of temporal adaptation, anticipation, and the integration of self-controlled and externally controlled processes across task conditions. The partial overlap between ADAM networks suggests common hub regions that modulate functional connectivity within and between the brain's resting-state networks and additional sensory-motor regions and subcortical structures in a manner reflecting coordination skill. Such network reconfiguration might facilitate sensorimotor synchronization by enabling shifts in focus on internal and external information, and, in social contexts requiring interpersonal coordination, variations in the degree of simultaneous integration and segregation of these information sources in internal models that support self, other, and joint action planning and prediction.

Subliminal access to abstract face representations does not rely on attention.

The present study used masked repetition priming to examine whether face representations can be accessed without attention. Two experiments using a face recognition task (fame judgement) presented masked repetition and control primes in spatially unattended locations prior to target onset. Experiment 1 (n=20) used the same images as primes and as targets and Experiment 2 (n=17) used different images of the same individual as primes and targets. Repetition priming was observed across both experiments regardless of whether spatial attention was cued to the location of the prime. Priming occurred for both famous and non-famous targets in Experiment 1 but was only reliable for famous targets in Experiment 2, suggesting that priming in Experiment 1 indexed access to view-specific representations whereas priming in Experiment 2 indexed access to view-invariant, abstract representations. Overall, the results indicate that subliminal access to abstract face representations does not rely on attention.

Exposure in central vision facilitates view-invariant face recognition in the periphery.

The present study investigated the extent to which a face presented in the visual periphery is processed and whether such processing can be influenced by a recent encounter in central vision. To probe face processing, a series of studies was conducted in which participants classified the sex and identity of faces presented in central and peripheral vision. The results showed that when target faces had not been previously viewed in central vision, recognition in peripheral vision was limited whereas sex categorization was not. When faces were previously viewed in central vision, recognition in peripheral vision improved even with the pose, hairstyle, and lighting conditions of these faces changed. These results are discussed with regard to possible mechanisms unpinning this exposure effect.

Multi-model mapping of phonemic fluency.

The voluntary generation of non-overlearned responses is usually assessed with phonemic fluency. Like most frontal tasks, it draws upon different complex processes and systems whose precise nature is still incompletely understood. Many claimed aspects regarding the pattern of phonemic fluency performance and its underlying anatomy remain controversial. Major limitations of past investigations include small sample size, scant analysis of phonemic output and methodologically insufficient lesion analysis approaches. We investigated a large number of patients with focal unilateral right or left frontal (n = 110) or posterior (n = 100) or subcortical (n = 65) lesions imaged with magnetic resonance or computed tomography and compared their performance on the number of overall responses, words produced over time, extremely infrequent/unknown words and inappropriate words generated. We also employed, for the first time parcel-based lesion-symptom mapping, tract-wise statistical analysis as well as Bayesian multi-variate analysis based on meta-analytically defined functional region of interest, including their interactions. We found that left frontal damage was associated with greater impairment than right frontal or posterior damage on overall fluency performance, suggesting that phonemic fluency shows specificity to frontal lesions. We also found that subcorticals, similar to frontals, performed significantly worse than posteriors on overall performance suggesting that subcortical regions are also involved. However, only frontal effects were found for words produced over time, extremely infrequent/unknown and inappropriate words. Parcel-based lesion-symptom mapping analysis found that worse fluency performance was associated with damage to the posterior segment of the left frontal middle and superior gyrus, the left dorsal anterior cingulate gyrus and caudate nucleus. Tract-wise statistical analysis revealed that disconnections of left frontal tracts are critical. Bayesian multi-variate models of lesions and disconnectome maps implicated left middle and inferior frontal and left dorsomedial frontal regions. Our study suggests that a set of well localized left frontal areas together with subcortical regions and several left frontal tracts are critical for word generation. We speculate that a left lateralized network exists. It involves medial, frontal regions supporting the process of 'energization', which sustains activation for the duration of the task and middle and inferior frontal regions concerned with 'selection', required due to the competition produced by associated stored words, respectively. The methodology adopted represents a promising and empirically robust approach in furthering our understanding of the neurocognitive architecture underpinning executive processes.

Intentionality of a co-actor influences sensorimotor synchronisation with a virtual partner.

Interpersonal sensorimotor synchronisation requires individuals to anticipate and adapt to their partner's movement timing. Research has demonstrated that the intentionality of a co-actor affects joint action planning, however, less is known about whether co-actor intentionality affects sensorimotor synchronisation. Explicit and implicit knowledge of a synchronisation partner's intentionality may influence coordination by modulating temporal anticipation and adaptation processes. We used a computer-controlled virtual partner (VP) consisting of tempo-changing auditory pacing sequences to simulate either an intentional or unintentional synchronisation partner. The VP was programmed to respond to the participant with low or moderate degrees of error correction, simulating a slightly or moderately adaptive human, respectively. In addition, task instructions were manipulated so that participants were told they were synchronising with either another person or a computer. Results indicated that synchronisation performance improved with the more adaptive VP. In addition, there was an influence of the explicit partner instruction, but this was dependent upon the degree of VP adaptivity and was modulated by subjective preferences for either the human or the computer partner. Beliefs about the intentionality of a synchronisation partner may thus influence interpersonal sensorimotor synchronisation in a manner that is modulated by preferences for interacting with intentional agents.

Emotional expressions evoke a differential response in the fusiform face area.

It is widely assumed that the fusiform face area (FFA), a brain region specialized for face perception, is not involved in processing emotional expressions. This assumption is based on the proposition that the FFA is involved in face identification and only processes features that are invariant across changes due to head movements, speaking and expressing emotions. The present study tested this proposition by examining whether the response in the human FFA varies across emotional expressions with functional magnetic resonance imaging and brain decoding analysis techniques (n = 11). A one vs. all classification analysis showed that most emotional expressions that participants perceived could be reliably predicted from the neural pattern of activity in left and the right FFA, suggesting that the perception of different emotional expressions recruit partially non-overlapping neural mechanisms. In addition, emotional expressions could also be decoded from the pattern of activity in the early visual cortex (EVC), indicating that retinotopic cortex also shows a differential response to emotional expressions. These results cast doubt on the idea that the FFA is involved in expression invariant face processing, and instead indicate that emotional expressions evoke partially de-correlated signals throughout occipital and posterior temporal cortex.