Sisterhood predicts similar neural processing of a film.

Relationships between humans are essential for how we see the world. Using fMRI, we explored the neural basis of homophily, a sociological concept that describes the tendency to bond with similar others. Our comparison of brain activity between sisters, friends and acquaintances while they watched a movie, indicate that sisters' brain activity is more similar than that of friends and friends' activity is more similar than that of acquaintances. The increased similarity in brain activity measured as inter-subject correlation (ISC) was found both in higher-order brain areas including the default-mode network (DMN) and sensory areas. Increased ISC could not be explained by genetic relation between sisters neither by similarities in eye-movements, emotional experiences, and physiological activity. Our findings shed light on the neural basis of homophily by revealing that similarity in brain activity in the DMN and sensory areas is the stronger the closer is the relationship between the people.

Bodily maps of musical sensations across cultures.

Emotions, bodily sensations and movement are integral parts of musical experiences. Yet, it remains unknown i) whether emotional connotations and structural features of music elicit discrete bodily sensations and ii) whether these sensations are culturally consistent. We addressed these questions in a cross-cultural study with Western (European and North American, n = 903) and East Asian (Chinese, n = 1035). We precented participants with silhouettes of human bodies and asked them to indicate the bodily regions whose activity they felt changing while listening to Western and Asian musical pieces with varying emotional and acoustic qualities. The resulting bodily sensation maps (BSMs) varied as a function of the emotional qualities of the songs, particularly in the limb, chest, and head regions. Music-induced emotions and corresponding BSMs were replicable across Western and East Asian subjects. The BSMs clustered similarly across cultures, and cluster structures were similar for BSMs and self-reports of emotional experience. The acoustic and structural features of music were consistently associated with the emotion ratings and music-induced bodily sensations across cultures. These results highlight the importance of subjective bodily experience in music-induced emotions and demonstrate consistent associations between musical features, music-induced emotions, and bodily sensations across distant cultures.

Hippocampus-Centered Network Is Associated With Positive Symptom Alleviation in Patients With First-Episode Psychosis.

BACKGROUND: Previous functional magnetic resonance imaging studies have reported widespread brain functional connectivity alterations in patients with psychosis. These studies have mostly used either resting-state or simple-task paradigms, thereby compromising experimental control or ecological validity, respectively. Additionally, in a conventional functional magnetic resonance imaging intrasubject functional connectivity analysis, it is difficult to identify which connections relate to extrinsic (stimulus-induced) and which connections relate to intrinsic (non-stimulus-related) neural processes. METHODS: To mitigate these limitations, we used intersubject functional connectivity (ISFC) to analyze longitudinal functional magnetic resonance imaging data collected while 36 individuals with first-episode psychosis (FEP) and 29 age- and sex-matched population control participants watched scenes from the fantasy movie Alice in Wonderland at baseline and again at 1-year follow-up. Furthermore, to allow unconfounded comparison and to overcome possible circularity of ISFC, we introduced a novel approach wherein ISFC in both the FEP and population control groups was calculated with respect to an independent group of participants (not included in the analyses). RESULTS: Using this independent-reference ISFC approach, we found an interaction effect wherein the independent-reference ISFC in individuals with FEP, but not in the control group participants, was significantly stronger at baseline than at follow-up in a network centered in the hippocampus and involving thalamic, striatal, and cortical regions, such as the orbitofrontal cortex. Alleviation of positive symptoms, particularly delusions, from baseline to follow-up was correlated with decreased network connectivity in patients with FEP. CONCLUSIONS: These findings link deviation of naturalistic information processing in the hippocampus-centered network to positive symptoms.

Ideological values are parametrically associated with empathy neural response to vicarious suffering.

Several studies in political psychology reported higher levels of empathy among political leftists (i.e. liberals) as compared to political rightists (i.e. conservatives). Yet, all those studies lean on self-reports, which are often limited by subjective bias and conformity to social norms. Here, we tested this putative asymmetry using neuroimaging: we recorded oscillatory neural activity using magnetoencephalography while 55 participants completed a well-validated neuroimaging paradigm for empathy to vicarious suffering. The findings revealed a typical rhythmic alpha-band 'empathy response' in the temporal-parietal junction. This neural empathy response was significantly stronger in the leftist than in the rightist group. In addition to this dichotomous division, the neural response was parametrically associated with both self-reported political inclination and right-wing ideological values. This is the first study to reveal an asymmetry in the neural empathy response as a function of political ideology. The findings reported in this study are in line with the current literature in political psychology and provide a novel neural perspective to support the ideological asymmetry in empathy. This study opens new vistas for addressing questions in political psychology by using neuroimaging.

Decoding brain basis of laughter and crying in natural scenes.

Laughter and crying are universal signals of prosociality and distress, respectively. Here we investigated the functional brain basis of perceiving laughter and crying using naturalistic functional magnetic resonance imaging (fMRI) approach. We measured haemodynamic brain activity evoked by laughter and crying in three experiments with 100 subjects in each. The subjects i) viewed a 20-minute medley of short video clips, and ii) 30 min of a full-length feature film, and iii) listened to 13.5 min of a radio play that all contained bursts of laughter and crying. Intensity of laughing and crying in the videos and radio play was annotated by independent observes, and the resulting time series were used to predict hemodynamic activity to laughter and crying episodes. Multivariate pattern analysis (MVPA) was used to test for regional selectivity in laughter and crying evoked activations. Laughter induced widespread activity in ventral visual cortex and superior and middle temporal and motor cortices. Crying activated thalamus, cingulate cortex along the anterior-posterior axis, insula and orbitofrontal cortex. Both laughter and crying could be decoded accurately (66-77% depending on the experiment) from the BOLD signal, and the voxels contributing most significantly to classification were in superior temporal cortex. These results suggest that perceiving laughter and crying engage distinct neural networks, whose activity suppresses each other to manage appropriate behavioral responses to others' bonding and distress signals.

Lipreading a naturalistic narrative in a female population: Neural characteristics shared with listening and reading.

INTRODUCTION: Few of us are skilled lipreaders while most struggle with the task. Neural substrates that enable comprehension of connected natural speech via lipreading are not yet well understood. METHODS: We used a data-driven approach to identify brain areas underlying the lipreading of an 8-min narrative with participants whose lipreading skills varied extensively (range 6-100%, mean = 50.7%). The participants also listened to and read the same narrative. The similarity between individual participants' brain activity during the whole narrative, within and between conditions, was estimated by a voxel-wise comparison of the Blood Oxygenation Level Dependent (BOLD) signal time courses. RESULTS: Inter-subject correlation (ISC) of the time courses revealed that lipreading, listening to, and reading the narrative were largely supported by the same brain areas in the temporal, parietal and frontal cortices, precuneus, and cerebellum. Additionally, listening to and reading connected naturalistic speech particularly activated higher-level linguistic processing in the parietal and frontal cortices more consistently than lipreading, probably paralleling the limited understanding obtained via lip-reading. Importantly, higher lipreading test score and subjective estimate of comprehension of the lipread narrative was associated with activity in the superior and middle temporal cortex. CONCLUSIONS: Our new data illustrates that findings from prior studies using well-controlled repetitive speech stimuli and stimulus-driven data analyses are also valid for naturalistic connected speech. Our results might suggest an efficient use of brain areas dealing with phonological processing in skilled lipreaders.

Exploring the Interpersonal Level of Music Performance Anxiety: Online Listener's Accuracy in Detecting Performer Anxiety.

Music performance anxiety (MPA) affects musicians at various stages of a performance, from its preparation until the aftermath of its delivery. Given the commonality and potentially grave consequences of MPA, it is understandable that much attention has been paid to the musician experiencing it. Consequently, we have learned a great deal about the intrapersonal level of MPA: how to measure it, treatments, experimental manipulations, and subjective experiences. However, MPA may also manifest at an interpersonal level by influencing how the performance is perceived. Yet, this has not yet been measured. This exploratory online study focuses on the listener's perception of anxiety and compares it to the musician's actual experienced anxiety. Forty-eight participants rated the amount of perceived anxiety of a pianist performing two pieces of contrasting difficulty in online-recital and practice conditions. Participants were presented with two stimulus modality conditions of the performance: audiovisual and audio-only. The listener's perception of anxiety and its similarity to the musician's experienced anxiety varies depending on variables such as the piece performed, the stimulus modality, as well as interactions between these variables and the listener's musical background. We discuss the implications for performance and future research on the interpersonal level of MPA.

Processing of an Audiobook in the Human Brain Is Shaped by Cultural Family Background.

Perception of the same narrative can vary between individuals depending on a listener's previous experiences. We studied whether and how cultural family background may shape the processing of an audiobook in the human brain. During functional magnetic resonance imaging (fMRI), 48 healthy volunteers from two different cultural family backgrounds listened to an audiobook depicting the intercultural social life of young adults with the respective cultural backgrounds. Shared cultural family background increased inter-subject correlation of hemodynamic activity in the left-hemispheric Heschl's gyrus, insula, superior temporal gyrus, lingual gyrus and middle temporal gyrus, in the right-hemispheric lateral occipital and posterior cingulate cortices as well as in the bilateral middle temporal gyrus, middle occipital gyrus and precuneus. Thus, cultural family background is reflected in multiple areas of speech processing in the brain and may also modulate visual imagery. After neuroimaging, the participants listened to the narrative again and, after each passage, produced a list of words that had been on their minds when they heard the audiobook during neuroimaging. Cultural family background was reflected as semantic differences in these word lists as quantified by a word2vec-generated semantic model. Our findings may depict enhanced mutual understanding between persons who share similar cultural family backgrounds.

Classification of emotion categories based on functional connectivity patterns of the human brain.

Neurophysiological and psychological models posit that emotions depend on connections across wide-spread corticolimbic circuits. While previous studies using pattern recognition on neuroimaging data have shown differences between various discrete emotions in brain activity patterns, less is known about the differences in functional connectivity. Thus, we employed multivariate pattern analysis on functional magnetic resonance imaging data (i) to develop a pipeline for applying pattern recognition in functional connectivity data, and (ii) to test whether connectivity patterns differ across emotion categories. Six emotions (anger, fear, disgust, happiness, sadness, and surprise) and a neutral state were induced in 16 participants using one-minute-long emotional narratives with natural prosody while brain activity was measured with functional magnetic resonance imaging (fMRI). We computed emotion-wise connectivity matrices both for whole-brain connections and for 10 previously defined functionally connected brain subnetworks and trained an across-participant classifier to categorize the emotional states based on whole-brain data and for each subnetwork separately. The whole-brain classifier performed above chance level with all emotions except sadness, suggesting that different emotions are characterized by differences in large-scale connectivity patterns. When focusing on the connectivity within the 10 subnetworks, classification was successful within the default mode system and for all emotions. We thus show preliminary evidence for consistently different sustained functional connectivity patterns for instances of emotion categories particularly within the default mode system.

Rhythmic Neural Patterns During Empathy to Vicarious Pain: Beyond the Affective-Cognitive Empathy Dichotomy.

Empathy is often split into an affective facet for embodied simulation or sometimes sensorial processing, and a cognitive facet for mentalizing and perspective-taking. However, a recent neurophenomenological framework proposes a graded view on empathy (i.e., "Graded Empathy") that extends this dichotomy and considers multiple levels while integrating complex neural patterns and representations of subjective experience. In the current magnetoencephalography study, we conducted a multidimensional investigation of neural oscillatory modulations and their cortical sources in 44 subjects while observing stimuli that convey vicarious pain (vs no-pain) in a broad time window and frequency range to explore rich neural representations of pain empathy. Furthermore, we collected participants' subjective-experience of sensitivity to vicarious pain, as well as their self-reported trait levels of affective and cognitive empathy to examine the possible associations between neural mechanisms and subjective experiences and reports. While extending previous electrophysiological studies that mainly focused on alpha suppression, we found here four significant power modulation patterns corresponding to multiple facets of empathy: an early central (peaking in the paracentral sulcus) alpha (6-11 Hz) suppression pattern plausibly reflecting sensory processing, two early beta (15-23 Hz) suppression patterns in the mid-cingulate cortex (plausibly reflecting the affective component) and in the precuneus (plausibly reflecting the cognitive component), and a late anterior (peaking in the orbitofrontal cortex) alpha-beta (11-19 Hz) enhancement pattern (plausibly reflecting cognitive-control inhibitory response). Interestingly, the latter measure was negatively correlated with the subjective sensitivity to vicarious pain, thereby possibly revealing a novel inhibitory neural mechanism determining the subjective sensitivity to vicarious pain. Altogether, these multilevel findings cannot be accommodated by the dichotomous model of empathy (i.e., affective-cognitive), and provide empirical support to the Graded Empathy neurophenomenological framework. Furthermore, this work emphasizes the importance of examining multiple neural rhythms, their cortical generators, and reports of subjective-experience in the aim of elucidating the complex nature of empathy.

Movies and narratives as naturalistic stimuli in neuroimaging.

Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.

Inter-subject Similarity of Brain Activity in Expert Musicians After Multimodal Learning: A Behavioral and Neuroimaging Study on Learning to Play a Piano Sonata.

Human behavior is inherently multimodal and relies on sensorimotor integration. This is evident when pianists exhibit activity in motor and premotor cortices, as part of a dorsal pathway, while listening to a familiar piece of music, or when naïve participants learn to play simple patterns on the piano. Here we investigated the interaction between multimodal learning and dorsal-stream activity over the course of four weeks in ten skilled pianists by adopting a naturalistic data-driven analysis approach. We presented the pianists with audio-only, video-only and audiovisual recordings of a piano sonata during functional magnetic resonance imaging (fMRI) before and after they had learned to play the sonata by heart for a total of four weeks. We followed the learning process and its outcome with questionnaires administered to the pianists, one piano instructor following their training, and seven external expert judges. The similarity of the pianists' brain activity during stimulus presentations was examined before and after learning by means of inter-subject correlation (ISC) analysis. After learning, an increased ISC was found in the pianists while watching the audiovisual performance, particularly in motor and premotor regions of the dorsal stream. While these brain structures have previously been associated with learning simple audio-motor sequences, our findings are the first to suggest their involvement in learning a complex and demanding audiovisual-motor task. Moreover, the most motivated learners and the best performers of the sonata showed ISC in the dorsal stream and in the reward brain network.

Auditory representation of learned sound sequences in motor regions of the macaque brain.

Human speech production requires the ability to couple motor actions with their auditory consequences. Nonhuman primates might not have speech because they lack this ability. To address this question, we trained macaques to perform an auditory-motor task producing sound sequences via hand presses on a newly designed device ("monkey piano"). Catch trials were interspersed to ascertain the monkeys were listening to the sounds they produced. Functional MRI was then used to map brain activity while the animals listened attentively to the sound sequences they had learned to produce and to two control sequences, which were either completely unfamiliar or familiar through passive exposure only. All sounds activated auditory midbrain and cortex, but listening to the sequences that were learned by self-production additionally activated the putamen and the hand and arm regions of motor cortex. These results indicate that, in principle, monkeys are capable of forming internal models linking sound perception and production in motor regions of the brain, so this ability is not special to speech in humans. However, the coupling of sounds and actions in nonhuman primates (and the availability of an internal model supporting it) seems not to extend to the upper vocal tract, that is, the supralaryngeal articulators, which are key for the production of speech sounds in humans. The origin of speech may have required the evolution of a "command apparatus" similar to the control of the hand, which was crucial for the evolution of tool use.

Social perspective-taking shapes brain hemodynamic activity and eye movements during movie viewing.

Putting oneself into the shoes of others is an important aspect of social cognition. We measured brain hemodynamic activity and eye-gaze patterns while participants were viewing a shortened version of the movie 'My Sister's Keeper' from two perspectives: that of a potential organ donor, who violates moral norms by refusing to donate her kidney, and that of a potential organ recipient, who suffers in pain. Inter-subject correlation (ISC) of brain activity was significantly higher during the potential organ donor's perspective in dorsolateral and inferior prefrontal, lateral and inferior occipital, and inferior-anterior temporal areas. In the reverse contrast, stronger ISC was observed in superior temporal, posterior frontal and anterior parietal areas. Eye-gaze analysis showed higher proportion of fixations on the potential organ recipient during both perspectives. Taken together, these results suggest that during social perspective-taking different brain areas can be flexibly recruited depending on the nature of the perspective that is taken.

Physiological responses to affiliation during conversation: Comparing neurotypical males and males with Asperger syndrome.

We examined the emotional and psychophysiological underpinnings of social interaction in the context of autism spectrum disorder, more specifically, involving participants diagnosed with Asperger syndrome (AS). We recorded participants' autonomic nervous system (ANS) activation (electrodermal activity, heart rate, and heart rate variability) and facial muscle activation during conversations in two different types of male dyads: (1) ten dyads where one participant has been diagnosed with AS (AS/NT dyads) and (2) nine dyads where both participants are neurotypical (NT/NT dyads). Afterwards, three independent raters assessed continuously each participant's affiliative and dominant behaviors during the first and last 10 minutes of the conversations. The relationship between the assessed data and ANS responses was examined. We found that, in the NT/NT dyads, a high level of affiliation displayed by the conversational partner calms down the participant when they are actively dominating the interaction. In contrast, when the participants themselves expressed affiliation, their psychophysiological responses indicated increase in arousal, which suggests that the giving of affiliation is physiologically "hard work." The affiliation-related ANS responses were similar in those NT participants whose conversational partner had AS, while some differences in facial muscle activation did occur in comparison to NT/NT dyads. In the AS participants, in contrast, a high level of affiliation provided by the conversational partner was associated with increase in arousal, suggesting heightened alertness and stress. As for their own affiliative behavior, the AS participants exhibited similar indicators of alertness and stress as the NT participants, but only when their own level of dominance was low. Our results increase understanding of how individuals with AS experience social interaction at the physiological level, and how this experience differs from that in NT individuals. Moreover, our results confirm and further specify our earlier results, where we proposed that affiliation involves the type of "sharing of the burden" that also reverberates in the participants' bodies.

Emotions amplify speaker-listener neural alignment.

Individuals often align their emotional states during conversation. Here, we reveal how such emotional alignment is reflected in synchronization of brain activity across speakers and listeners. Two "speaker" subjects told emotional and neutral autobiographical stories while their hemodynamic brain activity was measured with functional magnetic resonance imaging (fMRI). The stories were recorded and played back to 16 "listener" subjects during fMRI. After scanning, both speakers and listeners rated the moment-to-moment valence and arousal of the stories. Time-varying similarity of the blood-oxygenation-level-dependent (BOLD) time series was quantified by intersubject phase synchronization (ISPS) between speaker-listener pairs. Telling and listening to the stories elicited similar emotions across speaker-listener pairs. Arousal was associated with increased speaker-listener neural synchronization in brain regions supporting attentional, auditory, somatosensory, and motor processing. Valence was associated with increased speaker-listener neural synchronization in brain regions involved in emotional processing, including amygdala, hippocampus, and temporal pole. Speaker-listener synchronization of subjective feelings of arousal was associated with increased neural synchronization in somatosensory and subcortical brain regions; synchronization of valence was associated with neural synchronization in parietal cortices and midline structures. We propose that emotion-dependent speaker-listener neural synchronization is associated with emotional contagion, thereby implying that listeners reproduce some aspects of the speaker's emotional state at the neural level.

Inferior parietal lobule and early visual areas support elicitation of individualized meanings during narrative listening.

INTRODUCTION: When listening to a narrative, the verbal expressions translate into meanings and flow of mental imagery. However, the same narrative can be heard quite differently based on differences in listeners' previous experiences and knowledge. We capitalized on such differences to disclose brain regions that support transformation of narrative into individualized propositional meanings and associated mental imagery by analyzing brain activity associated with behaviorally assessed individual meanings elicited by a narrative. METHODS: Sixteen right-handed female subjects were instructed to list words that best described what had come to their minds while listening to an eight-minute narrative during functional magnetic resonance imaging (fMRI). The fMRI data were analyzed by calculating voxel-wise intersubject correlation (ISC) values. We used latent semantic analysis (LSA) enhanced with Wordnet knowledge to measure semantic similarity of the produced words between subjects. Finally, we predicted the ISC with the semantic similarity using representational similarity analysis. RESULTS: We found that semantic similarity in these word listings between subjects, estimated using LSA combined with WordNet knowledge, predicting similarities in brain hemodynamic activity. Subject pairs whose individual semantics were similar also exhibited similar brain activity in the bilateral supramarginal and angular gyrus of the inferior parietal lobe, and in the occipital pole. CONCLUSIONS: Our results demonstrate, using a novel method to measure interindividual differences in semantics, brain mechanisms giving rise to semantics and associated imagery during narrative listening. During listening to a captivating narrative, the inferior parietal lobe and early visual cortical areas seem, thus, to support elicitation of individual meanings and flow of mental imagery.

Contextual knowledge provided by a movie biases implicit perception of the protagonist.

We are constantly categorizing other people as belonging to our in-group ('one of us') or out-group ('one of them'). Such grouping occurs fast and automatically and can be based on others' visible characteristics such as skin color or clothing style. Here we studied neural underpinnings of implicit social grouping not often visible on the face, male sexual orientation. A total of 14 homosexuals and 15 heterosexual males were scanned in functional magnetic resonance imaging while watching a movie about a homosexual man, whose face was also presented subliminally before (subjects did not know about the character's sexual orientation) and after the movie. We discovered significantly stronger activation to the man's face after seeing the movie in homosexual but not heterosexual subjects in medial prefrontal cortex, frontal pole, anterior cingulate cortex, right temporal parietal junction and bilateral superior frontal gyrus. In previous research, these brain areas have been connected to social perception, self-referential thinking, empathy, theory of mind and in-group perception. In line with previous studies showing biased perception of in-/out-group faces to be context dependent, our novel approach further demonstrates how complex contextual knowledge gained under naturalistic viewing can bias implicit social perception.

Opioidergic Regulation of Emotional Arousal: A Combined PET-fMRI Study.

Emotions can be characterized by dimensions of arousal and valence (pleasantness). While the functional brain bases of emotional arousal and valence have been actively investigated, the neuromolecular underpinnings remain poorly understood. We tested whether the opioid and dopamine systems involved in reward and motivational processes would be associated with emotional arousal and valence. We used in vivo positron emission tomography to quantify µ-opioid receptor and type 2 dopamine receptor (MOR and D2R, respectively) availability in brains of 35 healthy adult females. During subsequent functional magnetic resonance imaging carried out to monitor hemodynamic activity, the subjects viewed movie scenes of varying emotional content. Arousal and valence were associated with hemodynamic activity in brain regions involved in emotional processing, including amygdala, thalamus, and superior temporal sulcus. Cerebral MOR availability correlated negatively with the hemodynamic responses to arousing scenes in amygdala, hippocampus, thalamus, and hypothalamus, whereas no positive correlations were observed in any brain region. D2R availability-here reliably quantified only in striatum-was not associated with either arousal or valence. These results suggest that emotional arousal is regulated by the MOR system, and that cerebral MOR availability influences brain activity elicited by arousing stimuli.