Brain circuits signaling the absence of emotion in body language.

Adaptive social behavior and mental well-being depend on not only recognizing emotional expressions but also, inferring the absence of emotion. While the neurobiology underwriting the perception of emotions is well studied, the mechanisms for detecting a lack of emotional content in social signals remain largely unknown. Here, using cutting-edge analyses of effective brain connectivity, we uncover the brain networks differentiating neutral and emotional body language. The data indicate greater activation of the right amygdala and midline cerebellar vermis to nonemotional as opposed to emotional body language. Most important, the effective connectivity between the amygdala and insula predicts people's ability to recognize the absence of emotion. These conclusions extend substantially current concepts of emotion perception by suggesting engagement of limbic effective connectivity in recognizing the lack of emotion in body language reading. Furthermore, the outcome may advance the understanding of overly emotional interpretation of social signals in depression or schizophrenia by providing the missing link between body language reading and limbic pathways. The study thus opens an avenue for multidisciplinary research on social cognition and the underlying cerebrocerebellar networks, ranging from animal models to patients with neuropsychiatric conditions.

Empathy to emotional voices and the use of real-time fMRI to enhance activation of the anterior insula.

The right anterior insula (AI), known to have a key role in the processing and understanding of social emotions, is activated during tasks that involve the act of empathising. Neurofeedback provides individuals with a visualisation of their own brain activity, enabling them to regulate and modify this activity. Following previous research investigating the ability of individuals to up-regulate right AI activity levels through neurofeedback, we investigated whether this could be similarly accomplished during an empathy task involving auditory stimuli of human positive and negative emotional expressions. Twenty participants, ten with feedback from right anterior insula and ten with feedback from a sham brain region, participated in two sessions that included sixteen neurofeedback runs and four transfer runs. Results showed that for the second session participants in the right AI neurofeedback group demonstrated better ability to up-regulate their right AI compared to the control group who received sham feedback. Examination of the relationship between individual participants' empathic traits and their ability to up-regulate right AI activity showed that participants low on empathic traits produced a greater increase in activation of right AI by the end of training. Moreover, the response to positively valenced audio stimuli was greater than for negatively valenced stimuli. These results have implications for therapeutic training of empathy in populations with limited empathic response.

Long-term music training modulates the recalibration of audiovisual simultaneity.

To overcome differences in physical transmission time and neural processing, the brain adaptively recalibrates the point of simultaneity between auditory and visual signals by adapting to audiovisual asynchronies. Here, we examine whether the prolonged recalibration process of passively sensed visual and auditory signals is affected by naturally occurring multisensory training known to enhance audiovisual perceptual accuracy. Hence, we asked a group of drummers, of non-drummer musicians and of non-musicians to judge the audiovisual simultaneity of musical and non-musical audiovisual events, before and after adaptation with two fixed audiovisual asynchronies. We found that the recalibration for the musicians and drummers was in the opposite direction (sound leading vision) to that of non-musicians (vision leading sound), and change together with both increased music training and increased perceptual accuracy (i.e. ability to detect asynchrony). Our findings demonstrate that long-term musical training reshapes the way humans adaptively recalibrate simultaneity between auditory and visual signals.

Look at those two!: The precuneus role in unattended third-person perspective of social interactions.

Human beings often observe other people's social interactions without being a part of them. Whereas the implications of some brain regions (e.g. amygdala) have been extensively examined, the implication of the precuneus remains yet to be determined. Here we examined the implication of the precuneus in third-person perspective of social interaction using functional magnetic resonance imaging (fMRI). Participants performed a socially irrelevant task while watching the biological motion of two agents acting in either typical (congruent to social conventions) or atypical (incongruent to social conventions) ways. When compared to typical displays, the atypical displays elicited greater activation in the central and posterior bilateral precuneus, and in frontoparietal and occipital regions. Whereas the right precuneus responded with greater activation also to upside down than upright displays, the left precuneus did not. Correlations and effective connectivity analysis added consistent evidence of an interhemispheric asymmetry between the right and left precuneus. These findings suggest that the precuneus reacts to violations of social expectations, and plays a crucial role in third-person perspective of others' interaction even when the social context is unattended.

The role of kinematics in cortical regions for continuous human motion perception.

It has been proposed that we make sense of the movements of others by observing fluctuations in the kinematic properties of their actions. At the neural level, activity in the human motion complex (hMT+) and posterior superior temporal sulcus (pSTS) has been implicated in this relationship. However, previous neuroimaging studies have largely utilized brief, diminished stimuli, and the role of relevant kinematic parameters for the processing of human action remains unclear. We addressed this issue by showing extended-duration natural displays of an actor engaged in two common activities, to 12 participants in an fMRI study under passive viewing conditions. Our region-of-interest analysis focused on three neural areas (hMT+, pSTS, and fusiform face area) and was accompanied by a whole-brain analysis. The kinematic properties of the actor, particularly the speed of body part motion and the distance between body parts, were related to activity in hMT+ and pSTS. Whole-brain exploratory analyses revealed additional areas in posterior cortex, frontal cortex, and the cerebellum whose activity was related to these features. These results indicate that the kinematic properties of peoples' movements are continually monitored during everyday activity as a step to determining actions and intent.

Patterns of saliency and semantic features distinguish gaze of expert and novice viewers of surveillance footage.

When viewing the actions of others, we not only see patterns of body movements, but we also "see" the intentions and social relations of people. Experienced forensic examiners - Closed Circuit Television (CCTV) operators - have been shown to convey superior performance in identifying and predicting hostile intentions from surveillance footage than novices. However, it remains largely unknown what visual content CCTV operators actively attend to, and whether CCTV operators develop different strategies for active information seeking from what novices do. Here, we conducted computational analysis for the gaze-centered stimuli captured by experienced CCTV operators and novices' eye movements when viewing the same surveillance footage. Low-level image features were extracted by a visual saliency model, whereas object-level semantic features were extracted by a deep convolutional neural network (DCNN), AlexNet, from gaze-centered regions. We found that the looking behavior of CCTV operators differs from novices by actively attending to visual contents with different patterns of saliency and semantic features. Expertise in selectively utilizing informative features at different levels of visual hierarchy may play an important role in facilitating the efficient detection of social relationships between agents and the prediction of harmful intentions.

Major Depression and the Perception of Affective Instrumental and Expressive Gestures: An fMRI Investigation.

Major depressive disorder (MDD) is associated with biased perception of human movement. Gesture is important for communication and in this study we investigated neural correlates of gesture perception in MDD. We hypothesised different neural activity between individuals with MDD and typical individuals when viewing instrumental and expressive gestures that were negatively or positively valenced. Differences were expected in brain areas associated with gesture perception, including superior temporal, frontal, and emotion processing regions. We recruited 12 individuals with MDD and 12 typical controls matched on age, gender, and handedness. They viewed gestures displayed by stick figures while functional magnetic resonance imaging (fMRI) was performed. Results of a random effects three-way mixed ANOVA indicated that individuals with MDD had greater activity in the right claustrum compared to controls, regardless of gesture type or valence. Additionally, we observed main effects of gesture type and valence, regardless of group. Perceiving instrumental compared to expressive gestures was associated with greater activity in the left cuneus and left superior temporal gyrus, while perceiving negative compared to positive gestures was associated with greater activity in the right precuneus and right lingual gyrus. We also observed a two-way interaction between gesture type and valence in various brain regions.

Do distinct atypical cortical networks process biological motion information in adults with Autism Spectrum Disorders?

Whether people with Autism Spectrum Disorders (ASDs) have a specific deficit when processing biological motion has been a topic of much debate. We used psychophysical methods to determine individual behavioural thresholds in a point-light direction discrimination paradigm for a small but carefully matched groups of adults (N=10 per group) with and without ASDs. These thresholds were used to derive individual stimulus levels in an identical fMRI task, with the purpose of equalising task performance across all participants whilst inside the scanner. The results of this investigation show that despite comparable behavioural performance both inside and outside the scanner, the group with ASDs shows a different pattern of BOLD activation from the TD group in response to the same stimulus levels. Furthermore, connectivity analysis suggests that the main differences between the groups are that the TD group utilise a unitary network with information passing from temporal to parietal regions, whilst the ASD group utilise two distinct networks; one utilising motion sensitive areas and another utilising form selective areas. Furthermore, a temporal-parietal link that is present in the TD group is missing in the ASD group. We tentatively propose that these differences may occur due to early dysfunctional connectivity in the brains of people with ASDs, which to some extent is compensated for by rewiring in high functioning adults.

A functional magnetic resonance imaging examination of audiovisual observation of a point-light string quartet using intersubject correlation and physical feature analysis.

We use functional Magnetic Resonance Imaging (fMRI) to explore synchronized neural responses between observers of audiovisual presentation of a string quartet performance during free viewing. Audio presentation was accompanied by visual presentation of the string quartet as stick figures observed from a static viewpoint. Brain data from 18 musical novices were obtained during audiovisual presentation of a 116 s performance of the allegro of String Quartet, No. 14 in D minor by Schubert played by the 'Quartetto di Cremona.' These data were analyzed using intersubject correlation (ISC). Results showed extensive ISC in auditory and visual areas as well as parietal cortex, frontal cortex and subcortical areas including the medial geniculate and basal ganglia (putamen). These results from a single fixed viewpoint of multiple musicians are greater than previous reports of ISC from unstructured group activity but are broadly consistent with related research that used ISC to explore listening to music or watching solo dance. A feature analysis examining the relationship between brain activity and physical features of the auditory and visual signals yielded findings of a large proportion of activity related to auditory and visual processing, particularly in the superior temporal gyrus (STG) as well as midbrain areas. Motor areas were also involved, potentially as a result of watching motion from the stick figure display of musicians in the string quartet. These results reveal involvement of areas such as the putamen in processing complex musical performance and highlight the potential of using brief naturalistic stimuli to localize distinct brain areas and elucidate potential mechanisms underlying multisensory integration.

Action expertise reduces brain activity for audiovisual matching actions: an fMRI study with expert drummers.

When we observe someone perform a familiar action, we can usually predict what kind of sound that action will produce. Musical actions are over-experienced by musicians and not by non-musicians, and thus offer a unique way to examine how action expertise affects brain processes when the predictability of the produced sound is manipulated. We used functional magnetic resonance imaging to scan 11 drummers and 11 age- and gender-matched novices who made judgments on point-light drumming movements presented with sound. In Experiment 1, sound was synchronized or desynchronized with drumming strikes, while in Experiment 2 sound was always synchronized, but the natural covariation between sound intensity and velocity of the drumming strike was maintained or eliminated. Prior to MRI scanning, each participant completed psychophysical testing to identify personal levels of synchronous and asynchronous timing to be used in the two fMRI activation tasks. In both experiments, the drummers' brain activation was reduced in motor and action representation brain regions when sound matched the observed movements, and was similar to that of novices when sound was mismatched. This reduction in neural activity occurred bilaterally in the cerebellum and left parahippocampal gyrus in Experiment 1, and in the right inferior parietal lobule, inferior temporal gyrus, middle frontal gyrus and precentral gyrus in Experiment 2. Our results indicate that brain functions in action-sound representation areas are modulated by multimodal action expertise.

Incongruence effects in cross-modal emotional processing in autistic traits: An fMRI study.

In everyday life, emotional information is often conveyed by both the face and the voice. Consequently, information presented by one source can alter the way in which information from the other source is perceived, leading to emotional incongruence. Here, we used functional magnetic resonance imaging (fMRI) to examine neutral correlates of two different types of emotional incongruence in audiovisual processing, namely incongruence of emotion-valence and incongruence of emotion-presence. Participants were in two groups, one group with a low Autism Quotient score (LAQ) and one with a high score (HAQ). Each participant experienced emotional (happy, fearful) or neutral faces or voices while concurrently being exposed to emotional (happy, fearful) or neutral voices or faces. They were instructed to attend to either the visual or auditory track. The incongruence effect of emotion-valence was characterized by activation in a wide range of brain regions in both hemispheres involving the inferior frontal gyrus, cuneus, superior temporal gyrus, and middle frontal gyrus. The incongruence effect of emotion-presence was characterized by activation in a set of temporal and occipital regions in both hemispheres, including the middle occipital gyrus, middle temporal gyrus and inferior temporal gyrus. In addition, the present study identified greater recruitment of the right inferior parietal lobule in perceiving audio-visual emotional expressions in HAQ individuals, as compared to the LAQ individuals. Depending on face or voice-to-be attended, different patterns of emotional incongruence were found between the two groups. Specifically, the HAQ group tend to show more incidental processing to visual information whilst the LAQ group tend to show more incidental processing to auditory information during the crossmodal emotional incongruence decoding. These differences might be attributed to different attentional demands and different processing strategies between the two groups.

Upregulation of Supplementary Motor Area Activation with fMRI Neurofeedback during Motor Imagery.

Functional magnetic resonance imaging (fMRI) neurofeedback (NF) is a promising tool to study the relationship between behavior and brain activity. It enables people to self-regulate their brain signal. Here, we applied fMRI NF to train healthy participants to increase activity in their supplementary motor area (SMA) during a motor imagery (MI) task of complex body movements while they received a continuous visual feedback signal. This signal represented the activity of participants' localized SMA regions in the NF group and a prerecorded signal in the control group (sham feedback). In the NF group only, results showed a gradual increase in SMA-related activity across runs. This upregulation was largely restricted to the SMA, while other regions of the motor network showed no, or only marginal NF effects. In addition, we found behavioral changes, i.e., shorter reaction times in a Go/No-go task after the NF training only. These results suggest that NF can assist participants to develop greater control over a specifically targeted motor region involved in motor skill learning. The results contribute to a better understanding of the underlying mechanisms of SMA NF based on MI with a direct implication for rehabilitation of motor dysfunctions.

Hyperalignment of motor cortical areas based on motor imagery during action observation.

Multivariate Pattern Analysis (MVPA) has grown in importance due to its capacity to use both coarse and fine scale patterns of brain activity. However, a major limitation of multivariate analysis is the difficulty of aligning features across brains, which makes MVPA a subject specific analysis. Recent work by Haxby et al. (2011) introduced a method called Hyperalignment that explored neural activity in ventral temporal cortex during object recognition and demonstrated the ability to align individual patterns of brain activity into a common high dimensional space to facilitate Between Subject Classification (BSC). Here we examined BSC based on Hyperalignment of motor cortex during a task of motor imagery of three natural actions (lift, knock and throw). To achieve this we collected brain activity during the combined tasks of action observation and motor imagery to a parametric action space containing 25 stick-figure blends of the three natural actions. From these responses we derived Hyperalignment transformation parameters that were used to map subjects' representational spaces of the motor imagery task in the motor cortex into a common model representational space. Results showed that BSC of the neural response patterns based on Hyperalignment exceeded both BSC based on anatomical alignment as well as a standard Within Subject Classification (WSC) approach. We also found that results were sensitive to the order in which participants entered the Hyperalignment algorithm. These results demonstrate the effectiveness of Hyperalignment to align neural responses across subject in motor cortex to enable BSC of motor imagery.

Three-dimensional arm movements at constant equi-affine speed.

It has long been acknowledged that planar hand drawing movements conform to a relationship between movement speed and shape, such that movement speed is inversely proportional to the curvature to the power of one-third. Previous literature has detailed potential explanations for the power law's existence as well as systematic deviations from it. However, the case of speed-shape relations for three-dimensional (3D) drawing movements has remained largely unstudied. In this paper we first derive a generalization of the planar power law to 3D movements, which is based on the principle that this power law implies motion at constant equi-affine speed. This generalization results in a 3D power law where speed is inversely related to the one-third power of the curvature multiplied by the one-sixth power of the torsion. Next, we present data from human 3D scribbling movements, and compare the obtained speed-shape relation to that predicted by the 3D power law. Our results indicate that the introduction of the torsion term into the 3D power law accounts for significantly more of the variance in speed-shape relations of the movement data and that the obtained exponents are very close to the predicted values.

Multisensory integration of drumming actions: musical expertise affects perceived audiovisual asynchrony.

We investigated the effect of musical expertise on sensitivity to asynchrony for drumming point-light displays, which varied in their physical characteristics (Experiment 1) or in their degree of audiovisual congruency (Experiment 2). In Experiment 1, 21 repetitions of three tempos x three accents x nine audiovisual delays were presented to four jazz drummers and four novices. In Experiment 2, ten repetitions of two audiovisual incongruency conditions x nine audiovisual delays were presented to 13 drummers and 13 novices. Participants gave forced-choice judgments of audiovisual synchrony. The results of Experiment 1 show an enhancement in experts' ability to detect asynchrony, especially for slower drumming tempos. In Experiment 2 an increase in sensitivity to asynchrony was found for incongruent stimuli; this increase, however, is attributable only to the novice group. Altogether the results indicated that through musical practice we learn to ignore variations in stimulus characteristics that otherwise would affect our multisensory integration processes.

Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments.

Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.

Exploring collective experience in watching dance through intersubject correlation and functional connectivity of fMRI brain activity.

How the brain contends with naturalistic viewing conditions when it must cope with concurrent streams of diverse sensory inputs and internally generated thoughts is still largely an open question. In this study, we used fMRI to record brain activity while a group of 18 participants watched an edited dance duet accompanied by a soundtrack. After scanning, participants performed a short behavioral task to identify neural correlates of dance segments that could later be recalled. Intersubject correlation (ISC) analysis was used to identify the brain regions correlated among observers, and the results of this ISC map were used to define a set of regions for subsequent analysis of functional connectivity. The resulting network was found to be composed of eight subnetworks and the significance of these subnetworks is discussed. While most subnetworks could be explained by sensory and motor processes, two subnetworks appeared related more to complex cognition. These results inform our understanding of the neural basis of common experience in watching dance and open new directions for the study of complex cognition.

Affective responses to dance.

The objective of the present work was the characterization of mechanisms by which affective experiences are elicited in observers when watching dance movements. A total of 203 dance stimuli from a normed stimuli library were used in a series of independent experiments. The following measures were obtained: (i) subjective measures of 97 dance-naïve participants' affective responses (Likert scale ratings, interviews); and (ii) objective measures of the physical parameters of the stimuli (motion energy, luminance), and of the movements represented in the stimuli (roundedness, impressiveness). Results showed that (i) participants' ratings of felt and perceived affect differed, (ii) felt and perceived valence but not arousal ratings correlated with physical parameters of the stimuli (motion energy and luminance), (iii) roundedness in posture shape was related to the experience of more positive emotion than edgy shapes (1 of 3 assessed rounded shapes showed a clear effect on positiveness ratings while a second reached trend level significance), (iv) more impressive movements resulted in more positive affective responses, (v) dance triggered affective experiences through the imagery and autobiographical memories it elicited in some people, and (vi) the physical parameters of the video stimuli correlated only weakly and negatively with the aesthetics ratings of beauty, liking and interest. The novelty of the present approach was twofold; (i) the assessment of multiple affect-inducing mechanisms, and (ii) the use of one single normed stimulus set. The results from this approach lend support to both previous and present findings. Results are discussed with regards to current literature in the field of empirical aesthetics and affective neuroscience.

Gender recognition from point-light walkers.

Point-light displays of human gait provide information sufficient to recognize the gender of a walker and are taken as evidence of the exquisite tuning of the visual system to biological motion. The authors revisit this topic with the goals of quantifying human efficiency at gender recognition. To achieve this, the authors first derive an ideal observer for gender recognition on the basis of center of moment (J. E. Cutting, D. R. Proffitt, & L. T. Kozlowski, 1978) and, with the use of anthropometric data from various populations, show optimal recognition of approximately 79% correct. Next, they perform a meta-analysis of 21 experiments examining gender recognition, obtaining accuracies of 66% correct for a side view and 71% for other views. Finally, results of the meta-analysis and the ideal observer are combined to obtain estimates of human efficiency at gender recognition of 26% for the side view and 47% for other views.

Differences in fMRI intersubject correlation while viewing unedited and edited videos of dance performance.

Intersubject correlation (ISC) analysis of functional magnetic resonance imaging (fMRI) data provides insight into how continuous streams of sensory stimulation are processed by groups of observers. Although edited movies are frequently used as stimuli in ISC studies, there has been little direct examination of the effect of edits on the resulting ISC maps. In this study we showed 16 observers two audiovisual movie versions of the same dance. In one experimental condition there was a continuous view from a single camera (Unedited condition) and in the other condition there were views from different cameras (Edited condition) that provided close up views of the feet or face and upper body. We computed ISC maps for each condition, as well as created a map that showed the difference between the conditions. The results from the Unedited and Edited maps largely overlapped in the occipital and temporal cortices, although more voxels were found for the Edited map. The difference map revealed greater ISC for the Edited condition in the Postcentral Gyrus, Lingual Gyrus, Precentral Gyrus and Medial Frontal Gyrus, while the Unedited condition showed greater ISC in only the Superior Temporal Gyrus. These findings suggest that the visual changes associated with editing provide a source of correlation in maps obtained from edited film, and highlight the utility of using maps to evaluate the difference in ISC between conditions.