Dissecting abstract, modality-specific and experience-dependent coding of affect in the human brain.

Emotion and perception are tightly intertwined, as affective experiences often arise from the appraisal of sensory information. Nonetheless, whether the brain encodes emotional instances using a sensory-specific code or in a more abstract manner is unclear. Here, we answer this question by measuring the association between emotion ratings collected during a unisensory or multisensory presentation of a full-length movie and brain activity recorded in typically developed, congenitally blind and congenitally deaf participants. Emotional instances are encoded in a vast network encompassing sensory, prefrontal, and temporal cortices. Within this network, the ventromedial prefrontal cortex stores a categorical representation of emotion independent of modality and previous sensory experience, and the posterior superior temporal cortex maps the valence dimension using an abstract code. Sensory experience more than modality affects how the brain organizes emotional information outside supramodal regions, suggesting the existence of a scaffold for the representation of emotional states where sensory inputs during development shape its functioning.

Functional correlates of subliminal stimulation in Posttraumatic Stress Disorder: Systematic review and meta-analysis.

Patients with Post-traumatic stress disorder (PTSD) exposed to traumatic reminders show hyperreactivity in brain areas (e.g., amygdala) belonging or related to the Innate Alarm System (IAS), allowing the rapid processing of salient stimuli. Evidence that IAS is activated by subliminal trauma-reminders could shed a new light on the factors precipitating and perpetuating PTSD symptomatology. Thus, we systematically reviewed studies investigating neuroimaging correlates of subliminal stimulation in PTSD. Twenty-three studies were selected from the MEDLINE and Scopus® databases for a qualitative synthesis, 5 of which allowed a further meta-analysis of fMRI data. The intensity of IAS responses to subliminal trauma-related reminders ranged from a minimum in healthy controls to a maximum in the PTSD patients with the most severe (e.g., dissociative) symptoms or the least responsiveness to treatment. Comparisons with other disorders (e.g., phobias) revealed contrasting results. Our findings demonstrate the hyperactivation of areas belonging or related to IAS in response to unconscious threats that should be integrated in diagnostic as well as in therapeutic protocols.

Information load dynamically modulates functional brain connectivity during narrative listening.

Narratives are paradigmatic examples of natural language, where nouns represent a proxy of information. Functional magnetic resonance imaging (fMRI) studies revealed the recruitment of temporal cortices during noun processing and the existence of a noun-specific network at rest. Yet, it is unclear whether, in narratives, changes in noun density influence the brain functional connectivity, so that the coupling between regions correlates with information load. We acquired fMRI activity in healthy individuals listening to a narrative with noun density changing over time and measured whole-network and node-specific degree and betweenness centrality. Network measures were correlated with information magnitude with a time-varying approach. Noun density correlated positively with the across-regions average number of connections and negatively with the average betweenness centrality, suggesting the pruning of peripheral connections as information decreased. Locally, the degree of the bilateral anterior superior temporal sulcus (aSTS) was positively associated with nouns. Importantly, aSTS connectivity cannot be explained by changes in other parts of speech (e.g., verbs) or syllable density. Our results indicate that the brain recalibrates its global connectivity as a function of the information conveyed by nouns in natural language. Also, using naturalistic stimulation and network metrics, we corroborate the role of aSTS in noun processing.

A modality-independent proto-organization of human multisensory areas.

The processing of multisensory information is based upon the capacity of brain regions, such as the superior temporal cortex, to combine information across modalities. However, it is still unclear whether the representation of coherent auditory and visual events requires any prior audiovisual experience to develop and function. Here we measured brain synchronization during the presentation of an audiovisual, audio-only or video-only version of the same narrative in distinct groups of sensory-deprived (congenitally blind and deaf) and typically developed individuals. Intersubject correlation analysis revealed that the superior temporal cortex was synchronized across auditory and visual conditions, even in sensory-deprived individuals who lack any audiovisual experience. This synchronization was primarily mediated by low-level perceptual features, and relied on a similar modality-independent topographical organization of slow temporal dynamics. The human superior temporal cortex is naturally endowed with a functional scaffolding to yield a common representation across multisensory events.

Brain metabolic correlates of Locus Coeruleus degeneration in Alzheimer's disease: a multimodal neuroimaging study.

Locus Coeruleus (LC) degeneration occurs early in Alzheimer's disease (AD) and this could affect several brain regions innervated by LC noradrenergic axon terminals, as these bear neuroprotective effects and modulate neurovascular coupling/neuronal activity. We used LC-sensitive Magnetic Resonance imaging (MRI) sequences enabling LC integrity quantification, and [18F]Fluorodeoxyglucose (FDG) PET, to investigate the association of LC-MRI changes with brain glucose metabolism in cognitively impaired patients (30 amnesticMCI and 13 demented ones). Fifteen cognitively intact age-matched controls (HCs) were submitted only to LC-MRI for comparison with patients. Voxel-wise regression analyses of [18F]FDG images were conducted using the LC-MRI parameters signal intensity (LCCR) and LC-belonging voxels (LCVOX). Both LCCR and LCVOX were significantly lower in patients compared to HCs, and were directly associated with [18F]FDG uptake in fronto-parietal cortical areas, mainly involving the left hemisphere (p < 0.001, kE > 100). These results suggest a possible association between LC degeneration and cortical hypometabolism in degenerative cognitive impairment with a prevalent left-hemispheric vulnerability, and that LC degeneration might be linked to large-scale functional network alteration in AD pathology.

Autoimmune Encephalitis and Other Neurological Syndromes With Rare Neuronal Surface Antibodies in Children: A Systematic Literature Review.

Neuronal surface antibody syndromes (NSAS) are an expanding group of autoimmune neurological diseases, whose most frequent clinical manifestation is autoimmune encephalitis (AE). Anti-NMDAR, anti-LGI1, and anti-CASPR2 autoimmunity represent the most described forms, while other NSAS are rarer and less well-characterized, especially in children. We carried out a systematic literature review of children with rare NSAS (with antibodies targeting D2R, GABAAR, GlyR, GABABR, AMPAR, amphiphysin, mGluR5, mGluR1, DPPX, IgLON5, and neurexin-3alpha) and available individual data, to contribute to improve their clinical characterization and identification of age-specific features. Ninety-four children were included in the review (47/94 female, age range 0.2-18 years). The most frequent NSAS were anti-D2R (28/94, 30%), anti-GABAAR (23/94, 24%), and anti-GlyR (22/94, 23%) autoimmunity. The most frequent clinical syndromes were AE, including limbic and basal ganglia encephalitis (57/94, 61%; GABAAR, D2R, GABABR, AMPAR, amphiphysin, and mGluR5), and isolated epileptic syndromes (15/94, 16%; GlyR, GABAAR). With the limitations imposed by the low number of cases, the main distinctive features of our pediatric literature cohort compared to the respective NSAS in adults included: absent/lower tumor association (exception made for anti-mGluR5 autoimmunity, and most evident in anti-amphiphysin autoimmunity); loss of female preponderance (AMPAR); relatively frequent association with preceding viral encephalitis (GABAAR, D2R). Moreover, while SPS and PERM are the most frequent syndromes in adult anti-GlyR and anti-amphiphysin autoimmunity, in children isolated epileptic syndromes and limbic encephalitis appear predominant, respectively. To our knowledge, this is the first systematic review on rare pediatric NSAS. An improved characterization may aid their recognition in children.

Default and control network connectivity dynamics track the stream of affect at multiple timescales.

In everyday life, the stream of affect results from the interaction between past experiences, expectations and the unfolding of events. How the brain represents the relationship between time and affect has been hardly explored, as it requires modeling the complexity of everyday life in the laboratory setting. Movies condense into hours a multitude of emotional responses, synchronized across subjects and characterized by temporal dynamics alike real-world experiences. Here, we use time-varying intersubject brain synchronization and real-time behavioral reports to test whether connectivity dynamics track changes in affect during movie watching. The results show that polarity and intensity of experiences relate to the connectivity of the default mode and control networks and converge in the right temporoparietal cortex. We validate these results in two experiments including four independent samples, two movies and alternative analysis workflows. Finally, we reveal chronotopic connectivity maps within the temporoparietal and prefrontal cortex, where adjacent areas preferentially encode affect at specific timescales.

U-Limb: A multi-modal, multi-center database on arm motion control in healthy and post-stroke conditions.

BACKGROUND: Shedding light on the neuroscientific mechanisms of human upper limb motor control, in both healthy and disease conditions (e.g., after a stroke), can help to devise effective tools for a quantitative evaluation of the impaired conditions, and to properly inform the rehabilitative process. Furthermore, the design and control of mechatronic devices can also benefit from such neuroscientific outcomes, with important implications for assistive and rehabilitation robotics and advanced human-machine interaction. To reach these goals, we believe that an exhaustive data collection on human behavior is a mandatory step. For this reason, we release U-Limb, a large, multi-modal, multi-center data collection on human upper limb movements, with the aim of fostering trans-disciplinary cross-fertilization. CONTRIBUTION: This collection of signals consists of data from 91 able-bodied and 65 post-stroke participants and is organized at 3 levels: (i) upper limb daily living activities, during which kinematic and physiological signals (electromyography, electro-encephalography, and electrocardiography) were recorded; (ii) force-kinematic behavior during precise manipulation tasks with a haptic device; and (iii) brain activity during hand control using functional magnetic resonance imaging.

Cortical and subcortical hemodynamic changes during sleep slow waves in human light sleep.

EEG slow waves, the hallmarks of NREM sleep are thought to be crucial for the regulation of several important processes, including learning, sensory disconnection and the removal of brain metabolic wastes. Animal research indicates that slow waves may involve complex interactions within and between cortical and subcortical structures. Conventional EEG in humans, however, has a low spatial resolution and is unable to accurately describe changes in the activity of subcortical and deep cortical structures. To overcome these limitations, here we took advantage of simultaneous EEG-fMRI recordings to map cortical and subcortical hemodynamic (BOLD) fluctuations time-locked to slow waves of light sleep. Recordings were performed in twenty healthy adults during an afternoon nap. Slow waves were associated with BOLD-signal increases in the posterior brainstem and in portions of thalamus and cerebellum characterized by preferential functional connectivity with limbic and somatomotor areas, respectively. At the cortical level, significant BOLD-signal decreases were instead found in several areas, including insula and somatomotor cortex. Specifically, a slow signal increase preceded slow-wave onset and was followed by a delayed, stronger signal decrease. Similar hemodynamic changes were found to occur at different delays across most cortical brain areas, mirroring the propagation of electrophysiological slow waves, from centro-frontal to inferior temporo-occipital cortices. Finally, we found that the amplitude of electrophysiological slow waves was positively related to the magnitude and inversely related to the delay of cortical and subcortical BOLD-signal changes. These regional patterns of brain activity are consistent with theoretical accounts of the functions of sleep slow waves.

Learning to Segment From Scribbles Using Multi-Scale Adversarial Attention Gates.

Large, fine-grained image segmentation datasets, annotated at pixel-level, are difficult to obtain, particularly in medical imaging, where annotations also require expert knowledge. Weakly-supervised learning can train models by relying on weaker forms of annotation, such as scribbles. Here, we learn to segment using scribble annotations in an adversarial game. With unpaired segmentation masks, we train a multi-scale GAN to generate realistic segmentation masks at multiple resolutions, while we use scribbles to learn their correct position in the image. Central to the model's success is a novel attention gating mechanism, which we condition with adversarial signals to act as a shape prior, resulting in better object localization at multiple scales. Subject to adversarial conditioning, the segmentor learns attention maps that are semantic, suppress the noisy activations outside the objects, and reduce the vanishing gradient problem in the deeper layers of the segmentor. We evaluated our model on several medical (ACDC, LVSC, CHAOS) and non-medical (PPSS) datasets, and we report performance levels matching those achieved by models trained with fully annotated segmentation masks. We also demonstrate extensions in a variety of settings: semi-supervised learning; combining multiple scribble sources (a crowdsourcing scenario) and multi-task learning (combining scribble and mask supervision). We release expert-made scribble annotations for the ACDC dataset, and the code used for the experiments, at https://vios-s.github.io/multiscale-adversarial-attention-gates.

Shape coding in occipito-temporal cortex relies on object silhouette, curvature, and medial axis.

Object recognition relies on different transformations of the retinal input, carried out by the visual system, that range from local contrast to object shape and category. While some of those transformations are thought to occur at specific stages of the visual hierarchy, the features they represent are correlated (e.g., object shape and identity) and selectivity for the same feature overlaps in many brain regions. This may be explained either by collinearity across representations or may instead reflect the coding of multiple dimensions by the same cortical population. Moreover, orthogonal and shared components may differently impact distinctive stages of the visual hierarchy. We recorded functional MRI activity while participants passively attended to object images and employed a statistical approach that partitioned orthogonal and shared object representations to reveal their relative impact on brain processing. Orthogonal shape representations (silhouette, curvature, and medial axis) independently explained distinct and overlapping clusters of selectivity in the occitotemporal and parietal cortex. Moreover, we show that the relevance of shared representations linearly increases moving from posterior to anterior regions. These results indicate that the visual cortex encodes shared relations between different features in a topographic fashion and that object shape is encoded along different dimensions, each representing orthogonal features.NEW & NOTEWORTHY There are several possible ways of characterizing the shape of an object. Which shape description better describes our brain responses while we passively perceive objects? Here, we employed three competing shape models to explain brain representations when viewing real objects. We found that object shape is encoded in a multidimensional fashion and thus defined by the interaction of multiple features.

Reductions in perceived stress following Transcendental Meditation practice are associated with increased brain regional connectivity at rest.

Transcendental Meditation (TM) is defined as a mental process of transcending using a silent mantra. Previous work showed that relatively brief period of TM practice leads to decreases in stress and anxiety. However, whether these changes are subserved by specific morpho-functional brain modifications (as observed in other meditation techniques) is still unclear. Using a longitudinal design, we combined psychometric questionnaires, structural and resting-state functional magnetic resonance imaging (RS-fMRI) to investigate the potential brain modifications underlying the psychological effects of TM. The final sample included 19 naïve subjects instructed to complete two daily 20-min TM sessions, and 15 volunteers in the control group. Both groups were evaluated at recruitment (T0) and after 3 months (T1). At T1, only meditators showed a decrease in perceived anxiety and stress (t(18) = 2.53, p = 0.02), which correlated negatively with T1-T0 changes in functional connectivity among posterior cingulate cortex (PCC), precuneus and left superior parietal lobule. Additionally, TM practice was associated with increased connectivity between PCC and right insula, likely reflecting changes in interoceptive awareness. No structural changes were observed in meditators or control subjects. These preliminary findings indicate that beneficial effects of TM may be mediated by functional brain changes that take place after a short practice period of 3 months.

Emotionotopy in the human right temporo-parietal cortex.

Humans use emotions to decipher complex cascades of internal events. However, which mechanisms link descriptions of affective states to brain activity is unclear, with evidence supporting either local or distributed processing. A biologically favorable alternative is provided by the notion of gradient, which postulates the isomorphism between functional representations of stimulus features and cortical distance. Here, we use fMRI activity evoked by an emotionally charged movie and continuous ratings of the perceived emotion intensity to reveal the topographic organization of affective states. Results show that three orthogonal and spatially overlapping gradients encode the polarity, complexity and intensity of emotional experiences in right temporo-parietal territories. The spatial arrangement of these gradients allows the brain to map a variety of affective states within a single patch of cortex. As this organization resembles how sensory regions represent psychophysical properties (e.g., retinotopy), we propose emotionotopy as a principle of emotion coding.

Brain Hemodynamic Intermediate Phenotype Links Vitamin B12 to Cognitive Profile of Healthy and Mild Cognitive Impaired Subjects.

Vitamin B12, folate, and homocysteine are implicated in pivotal neurodegenerative mechanisms and partake in elders' mental decline. Findings on the association between vitamin-related biochemistry and cognitive abilities suggest that the structural and functional properties of the brain may represent an intermediate biomarker linking vitamin concentrations to cognition. Despite this, no previous study directly investigated whether vitamin B12, folate, and homocysteine levels are sufficient to explain individual neuropsychological profiles or, alternatively, whether the activity of brain regions modulated by these compounds better predicts cognition in elders. Here, we measured the relationship between vitamin blood concentrations, scores at seventeen neuropsychological tests, and brain activity of sixty-five elders spanning from normal to Mild Cognitive Impairment. We then evaluated whether task-related brain responses represent an intermediate phenotype, providing a better prediction of subjects' neuropsychological scores, as compared to the one obtained considering blood biochemistry only. We found that the hemodynamic activity of the right dorsal anterior cingulate cortex was positively associated (p value < 0.05 cluster corrected) with vitamin B12 concentrations, suggesting that elders with higher B12 levels had a more pronounced recruitment of this salience network region. Crucially, the activity of this area significantly predicted subjects' visual search and attention abilities (p value = 0.0023), whereas B12 levels per se failed to do so. Our results demonstrate that the relationship between blood biochemistry and elders' cognitive abilities is revealed when brain activity is included into the equation, thus highlighting the role of brain imaging as intermediate phenotype.

Common spatiotemporal processing of visual features shapes object representation.

Biological vision relies on representations of the physical world at different levels of complexity. Relevant features span from simple low-level properties, as contrast and spatial frequencies, to object-based attributes, as shape and category. However, how these features are integrated into coherent percepts is still debated. Moreover, these dimensions often share common biases: for instance, stimuli from the same category (e.g., tools) may have similar shapes. Here, using magnetoencephalography, we revealed the temporal dynamics of feature processing in human subjects attending to objects from six semantic categories. By employing Relative Weights Analysis, we mitigated collinearity between model-based descriptions of stimuli and showed that low-level properties (contrast and spatial frequencies), shape (medial-axis) and category are represented within the same spatial locations early in time: 100-150 ms after stimulus onset. This fast and overlapping processing may result from independent parallel computations, with categorical representation emerging later than the onset of low-level feature processing, yet before shape coding. Categorical information is represented both before and after shape, suggesting a role for this feature in the refinement of categorical matching.

Visual imagery and visual perception induce similar changes in occipital slow waves of sleep.

Previous studies have shown that regional slow-wave activity (SWA) during non-rapid eye movement (NREM) sleep is modulated by prior experience and learning. Although this effect has been convincingly demonstrated for the sensorimotor domain, attempts to extend these findings to the visual system have provided mixed results. In this study we asked whether depriving subjects of external visual stimuli during daytime would lead to regional changes in slow waves during sleep and whether the degree of "internal visual stimulation" (spontaneous imagery) would influence such changes. In two 8-h sessions spaced 1 wk apart, 12 healthy volunteers either were blindfolded while listening to audiobooks or watched movies (control condition), after which their sleep was recorded with high-density EEG. We found that during NREM sleep, the number of small, local slow waves in the occipital cortex decreased after listening with blindfolding relative to movie watching in a way that depended on the degree of visual imagery subjects reported during blindfolding: subjects with low visual imagery showed a significant reduction of occipital sleep slow waves, whereas those who reported a high degree of visual imagery did not. We also found a positive relationship between the reliance on visual imagery during blindfolding and audiobook listening and the degree of correlation in sleep SWA between visual areas and language-related areas. These preliminary results demonstrate that short-term alterations in visual experience may trigger slow-wave changes in cortical visual areas. Furthermore, they suggest that plasticity-related EEG changes during sleep may reflect externally induced ("bottom up") visual experiences, as well as internally generated ("top down") processes. NEW & NOTEWORTHY Previous work has shown that slow-wave activity, a marker of sleep depth, is linked to neural plasticity in the sensorimotor cortex. We show that after short-term visual deprivation, subjects who reported little visual imagery had a reduced incidence of occipital slow waves. This effect was absent in subjects who reported strong spontaneous visual imagery. These findings suggest that visual imagery may "substitute" for visual perception and induce similar changes in non-rapid eye movement slow waves.

Formant Space Reconstruction From Brain Activity in Frontal and Temporal Regions Coding for Heard Vowels.

Classical studies have isolated a distributed network of temporal and frontal areas engaged in the neural representation of speech perception and production. With modern literature arguing against unique roles for these cortical regions, different theories have favored either neural code-sharing or cortical space-sharing, thus trying to explain the intertwined spatial and functional organization of motor and acoustic components across the fronto-temporal cortical network. In this context, the focus of attention has recently shifted toward specific model fitting, aimed at motor and/or acoustic space reconstruction in brain activity within the language network. Here, we tested a model based on acoustic properties (formants), and one based on motor properties (articulation parameters), where model-free decoding of evoked fMRI activity during perception, imagery, and production of vowels had been successful. Results revealed that phonological information organizes around formant structure during the perception of vowels; interestingly, such a model was reconstructed in a broad temporal region, outside of the primary auditory cortex, but also in the pars triangularis of the left inferior frontal gyrus. Conversely, articulatory features were not associated with brain activity in these regions. Overall, our results call for a degree of interdependence based on acoustic information, between the frontal and temporal ends of the language network.

Eight Weddings and Six Funerals: An fMRI Study on Autobiographical Memories.

"Autobiographical memory" (AM) refers to remote memories from one's own life. Previous neuroimaging studies have highlighted that voluntary retrieval processes from AM involve different forms of memory and cognitive functions. Thus, a complex and widespread brain functional network has been found to support AM. The present functional magnetic resonance imaging (fMRI) study used a multivariate approach to determine whether neural activity within the AM circuit would recognize memories of real autobiographical events, and to evaluate individual differences in the recruitment of this network. Fourteen right-handed females took part in the study. During scanning, subjects were presented with sentences representing a detail of a highly emotional real event (positive or negative) and were asked to indicate whether the sentence described something that had or had not really happened to them. Group analysis showed a set of cortical areas able to discriminate the truthfulness of the recalled events: medial prefrontal cortex, posterior cingulate/retrosplenial cortex, precuneus, bilateral angular, superior frontal gyri, and early visual cortical areas. Single-subject results showed that the decoding occurred at different time points. No differences were found between recalling a positive or a negative event. Our results show that the entire AM network is engaged in monitoring the veracity of AMs. This process is not affected by the emotional valence of the experience but rather by individual differences in cognitive strategies used to retrieve AMs.

Foreground-Background Segmentation Revealed during Natural Image Viewing.

One of the major challenges in visual neuroscience is represented by foreground-background segmentation. Data from nonhuman primates show that segmentation leads to two distinct, but associated processes: the enhancement of neural activity during figure processing (i.e., foreground enhancement) and the suppression of background-related activity (i.e., background suppression). To study foreground-background segmentation in ecological conditions, we introduce a novel method based on parametric modulation of low-level image properties followed by application of simple computational image-processing models. By correlating the outcome of this procedure with human fMRI activity, measured during passive viewing of 334 natural images, we produced easily interpretable "correlation images" from visual populations. Results show evidence of foreground enhancement in all tested regions, from V1 to lateral occipital complex (LOC), while background suppression occurs in V4 and LOC only. Correlation images derived from V4 and LOC revealed a preserved spatial resolution of foreground textures, indicating a richer representation of the salient part of natural images, rather than a simplistic model of object shape. Our results indicate that scene segmentation occurs during natural viewing, even when individuals are not required to perform any particular task.

Peripersonal space representation develops independently from visual experience.

Our daily-life actions are typically driven by vision. When acting upon an object, we need to represent its visual features (e.g. shape, orientation, etc.) and to map them into our own peripersonal space. But what happens with people who have never had any visual experience? How can they map object features into their own peripersonal space? Do they do it differently from sighted agents? To tackle these questions, we carried out a series of behavioral experiments in sighted and congenitally blind subjects. We took advantage of a spatial alignment effect paradigm, which typically refers to a decrease of reaction times when subjects perform an action (e.g., a reach-to-grasp pantomime) congruent with that afforded by a presented object. To systematically examine peripersonal space mapping, we presented visual or auditory affording objects both within and outside subjects' reach. The results showed that sighted and congenitally blind subjects did not differ in mapping objects into their own peripersonal space. Strikingly, this mapping occurred also when objects were presented outside subjects' reach, but within the peripersonal space of another agent. This suggests that (the lack of) visual experience does not significantly affect the development of both one's own and others' peripersonal space representation.