The N400 and late occipital positivity in processing dynamic facial expressions with natural emotional voice.

People require multimodal emotional interactions to live in a social environment. Several studies using dynamic facial expressions and emotional voices have reported that multimodal emotional incongruency evokes an early sensory component of event-related potentials (ERPs), while others have found a late cognitive component. The integration mechanism of two different results remains unclear. We speculate that it is semantic analysis in a multimodal integration framework that evokes the late ERP component. An electrophysiological experiment was conducted using emotionally congruent or incongruent dynamic faces and natural voices to promote semantic analysis. To investigate the top-down modulation of the ERP component, attention was manipulated via two tasks that directed participants to attend to facial versus vocal expressions. Our results revealed interactions between facial and vocal emotional expressions, manifested as modulations of the auditory N400 ERP amplitudes but not N1 and P2 amplitudes, for incongruent emotional face-voice combinations only in the face-attentive task. A late occipital positive potential amplitude emerged only during the voice-attentive task. Overall, these findings support the idea that semantic analysis is a key factor in evoking the late cognitive component. The task effect for these ERPs suggests that top-down attention alters not only the amplitude of ERP but also the ERP component per se. Our results implicate a principle of emotional face-voice processing in the brain that may underlie complex audiovisual interactions in everyday communication.

Neural network for Braille reading and the speech-reading convergence in the blind: Similarities and differences to visual reading.

All writing systems represent units of spoken language. Studies on the neural correlates of reading in different languages show that this skill relies on access to brain areas dedicated to speech processing. Speech-reading convergence onto a common perisylvian network is therefore considered universal among different writing systems. Using fMRI, we test whether this holds true also for tactile Braille reading in the blind. The neural networks for Braille and visual reading overlapped in the left ventral occipitotemporal (vOT) cortex. Even though we showed similar perisylvian specialization for speech in both groups, blind subjects did not engage this speech system for reading. In contrast to the sighted, speech-reading convergence in the blind was absent in the perisylvian network. Instead, the blind engaged vOT not only in reading but also in speech processing. The involvement of the vOT in speech processing and its engagement in reading in the blind suggests that vOT is included in a modality independent language network in the blind, also evidenced by functional connectivity results. The analysis of individual speech-reading convergence suggests that there may be segregated neuronal populations in the vOT for speech processing and reading in the blind.

Transcutaneous Vagus Nerve Stimulation in Humans Induces Pupil Dilation and Attenuates Alpha Oscillations.

Vagus nerve stimulation (VNS) is widely used to treat drug-resistant epilepsy and depression. While the precise mechanisms mediating its long-term therapeutic effects are not fully resolved, they likely involve locus coeruleus (LC) stimulation via the nucleus of the solitary tract, which receives afferent vagal inputs. In rats, VNS elevates LC firing and forebrain noradrenaline levels, whereas LC lesions suppress VNS therapeutic efficacy. Noninvasive transcutaneous VNS (tVNS) uses electrical stimulation that targets the auricular branch of the vagus nerve at the cymba conchae of the ear. However, the extent to which tVNS mimics VNS remains unclear. Here, we investigated the short-term effects of tVNS in healthy human male volunteers (n = 24), using high-density EEG and pupillometry during visual fixation at rest. We compared short (3.4 s) trials of tVNS to sham electrical stimulation at the earlobe (far from the vagus nerve branch) to control for somatosensory stimulation. Although tVNS and sham stimulation did not differ in subjective intensity ratings, tVNS led to robust pupil dilation (peaking 4-5 s after trial onset) that was significantly higher than following sham stimulation. We further quantified, using parallel factor analysis, how tVNS modulates idle occipital alpha (8-13Hz) activity identified in each participant. We found greater attenuation of alpha oscillations by tVNS than by sham stimulation. This demonstrates that tVNS reliably induces pupillary and EEG markers of arousal beyond the effects of somatosensory stimulation, thus supporting the hypothesis that tVNS elevates noradrenaline and other arousal-promoting neuromodulatory signaling, and mimics invasive VNS.SIGNIFICANCE STATEMENT Current noninvasive brain stimulation techniques are mostly confined to modulating cortical activity, as is typical with transcranial magnetic or transcranial direct/alternating current electrical stimulation. Transcutaneous vagus nerve stimulation (tVNS) has been proposed to stimulate subcortical arousal-promoting nuclei, though previous studies yielded inconsistent results. Here we show that short (3.4 s) tVNS pulses in naive healthy male volunteers induced transient pupil dilation and attenuation of occipital alpha oscillations. These markers of brain arousal are in line with the established effects of invasive VNS on locus coeruleus-noradrenaline signaling, and support that tVNS mimics VNS. Therefore, tVNS can be used as a tool for studying how endogenous subcortical neuromodulatory signaling affects human cognition, including perception, attention, memory, and decision-making; and also for developing novel clinical applications.

Attachment styles modulate neural markers of threat and imagery when engaging in self-criticism.

Attachment styles hold important downstream consequences for mental health through their contribution to the emergence of self-criticism. To date, no work has extended our understanding of the influence of attachment styles on self-criticism at a neurobiological level. Herein we investigate the relationship between self-reported attachment styles and neural markers of self-criticism using fMRI. A correlation network analysis revealed lingual gyrus activation during self-criticism, a marker of visual mental imagery, correlated with amygdala activity (threat response). It also identified that secure attachment positively correlated with lingual gyrus activation, whilst avoidant attachment was negatively correlated with lingual gyrus activation. Further, at greater levels of amygdala response, more securely attached individuals showed greater lingual gyrus activation, and more avoidantly attached individuals showed less lingual gyrus activation. Our data provide the first evidence that attachment mechanisms may modulate threat responses and mental imagery when engaging in self-criticism, which have important clinical and broader social implications.

Mental rotation ability and spontaneous brain activity: a magnetoencephalography study.

We performed experiments using magnetoencephalography to clarify the relationship between three-dimensional visuospatial abilities and spontaneous visual thinking characteristics. Subjects were divided into two groups based on the rate of correct answers to mental rotation tasks: those with good performances (Group G) and those with bad performances (Group B). We found the followings: (1) in the mental rotation tasks, the 25-35 Hz lower γ band activities in the superior parietal lobule/intraparietal sulcus regions and in the occipitotemporal region were significantly larger in Group G than in Group B and (2) in the spontaneous mental imagery tasks, the 20-Hz band activity in the left premotor cortex and the 35-Hz band activity in the supplementary motor area were significantly larger in Group G.

Sex Differences and Commonalities in the Impact of a Palatable Meal on Thalamic and Insular Connectivity.

The neural mechanisms underlying subjective responses to meal ingestion remain incompletely understood. We previously showed in healthy men an increase in thalamocortical, and a decrease in insular-cortical connectivity in response to a palatable meal. As sex is increasingly recognized as an important biological variable, we aimed to evaluate sex differences and commonalities in the impact of a well-liked meal on thalamic and anterior insular connectivity in healthy individuals. Participants (20 women and 20 age-matched men) underwent resting-state magnetic resonance imaging (rsMRI) before and after ingesting a palatable meal. In general, the insula showed extensive postprandial reductions in connectivity with sensorimotor and prefrontal cortices, while the thalamus showed increases in connectivity with insular, frontal, and occipital cortices, in both women and men. However, reductions in insular connectivity were more prominent in men, and were related to changes in meal-related sensations (satiety and digestive well-being) in men only. In contrast, increases in thalamic connectivity were more prominent in women, and were related to changes in satiety and digestive well-being in women only. These results suggest that brain imaging may provide objective and sex-specific biomarkers of the subjective feelings associated with meal ingestion.

Visual representations of time elicit early responses in human temporal cortex.

Time perception is inherently part of human life. All human sensory modalities are always involved in the complex task of creating a temporal representation of the external world. However, when representing time, people primarily rely on auditory information. Since the auditory system prevails in many audio-visual temporal tasks, one may expect that the early recruitment of the auditory network is necessary for building a highly resolved and flexible temporal representation in the visual modality. To test this hypothesis, we asked 17 healthy participants to temporally bisect three consecutive flashes while we recorded EEG. We demonstrated that visual stimuli during temporal bisection elicit an early (50-90 â€‹ms) response of an extended area of the temporal cortex, likely including auditory cortex too. The same activation did not appear during an easier spatial bisection task. These findings suggest that the brain may use auditory representations to deal with complex temporal representation in the visual system.

Reorganization of Sound Location Processing in the Auditory Cortex of Blind Humans.

Auditory spatial tasks induce functional activation in the occipital-visual-cortex of early blind humans. Less is known about the effects of blindness on auditory spatial processing in the temporal-auditory-cortex. Here, we investigated spatial (azimuth) processing in congenitally and early blind humans with a phase-encoding functional magnetic resonance imaging (fMRI) paradigm. Our results show that functional activation in response to sounds in general-independent of sound location-was stronger in the occipital cortex but reduced in the medial temporal cortex of blind participants in comparison with sighted participants. Additionally, activation patterns for binaural spatial processing were different for sighted and blind participants in planum temporale. Finally, fMRI responses in the auditory cortex of blind individuals carried less information on sound azimuth position than those in sighted individuals, as assessed with a 2-channel, opponent coding model for the cortical representation of sound azimuth. These results indicate that early visual deprivation results in reorganization of binaural spatial processing in the auditory cortex and that blind individuals may rely on alternative mechanisms for processing azimuth position.

Motor and Limbic System Contribution to Emotional Laughter across the Lifespan.

Laughter is a universal human behavior generated by the cooperation of different systems toward the construction of an expressive vocal pattern. Given the sensitivity of neuroimaging techniques to movements, the neural mechanisms underlying laughter expression remain unclear. Herein, we characterized the neural correlates of emotional laughter using the onsets and the duration of laughter bursts to inform functional magnetic resonance imaging. Laughter-related blood oxygen level-dependent (BOLD) increases involved both the motor (motor cortex, supplementary motor area, frontal operculum) and the emotional/limbic (anterior cingulate cortex, amygdala, n. accumbens, hippocampus) systems, as well as modulatory circuitries encompassing the basal ganglia, thalamus, and cerebellum. BOLD changes related to the 2 s preceding the laughter outbreak were selectively observed at the temporo-occipital junction and the periaqueductal gray matter, supporting the role of the former in the detection of incongruity and the gating role of the latter in the initiation of spontaneous laughter. Moreover, developmental changes were identified in laughter processing, consisting in a greater engagement of the reward circuitry in younger subjects; conversely, the default mode network appears more activated in older participants. Our findings contribute valuable information about the processing of real-life humorous materials and suggest a close link between laughter-related motor, affective, and cognitive elements, confirming its complex and multi-faceted nature.

Alpha Neurofeedback Has a Positive Effect for Participants Who Are Unable to Sustain Their Alpha Activity.

Alpha rhythm (8-13 Hz) is linked to relaxed mental state in humans. Earlier reports have shown that individuals can increase their alpha power if provided with a valid feedback, compared to controls who are provided invalid feedback. However, these results remain controversial, partly because controls may be in a different behavioral state, making it difficult to directly compare their alpha power with the valid group. We here address this issue by using an experimental paradigm in which an invalid feedback is given on a fraction of trials, such that both valid and invalid conditions can be obtained from the same participant. Using electroencephalography (EEG), we recorded alpha power from the occipital area from 24 humans (nine females) and played a feedback tone which could be valid (tone frequency proportional to alpha power), invalid (tone sequence from a previous valid trial; participants were unaware of this condition), or neutral (constant tone frequency). We found that during eyes closed-state, neurofeedback did not enhance alpha activity beyond pre-trained state within the experimental duration, probably because of saturation of alpha rhythmicity. However, for participants whose alpha power decreased over time within a trial, valid feedback helped them to sustain alpha more than invalid feedback. Further, alpha increase showed a weak negative correlation with their self-reported attentional load but was uncorrelated with relaxation levels. Our results reconcile many conflicting reports in the neurofeedback literature, and show that even under most stringent control, valid neurofeedback can help participants who are otherwise unable to sustain their alpha activity.

Visual imagery during real-time fMRI neurofeedback from occipital and superior parietal cortex.

Visual imagery has been suggested to recruit occipital cortex via feedback projections from fronto-parietal regions, suggesting that these feedback projections might be exploited to boost recruitment of occipital cortex by means of real-time neurofeedback. To test this prediction, we instructed a group of healthy participants to perform peripheral visual imagery while they received real-time auditory feedback based on the BOLD signal from either early visual cortex or the medial superior parietal lobe. We examined the amplitude and temporal aspects of the BOLD response in the two regions. Moreover, we compared the impact of self-rated mental focus and vividness of visual imagery on the BOLD responses in these two areas. We found that both early visual cortex and the medial superior parietal cortex are susceptible to auditory neurofeedback within a single feedback session per region. However, the signal in parietal cortex was sustained for a longer time compared to the signal in occipital cortex. Moreover, the BOLD signal in the medial superior parietal lobe was more affected by focus and vividness of the visual imagery than early visual cortex. Our results thus demonstrate that (a) participants can learn to self-regulate the BOLD signal in early visual and parietal cortex within a single session, (b) that different nodes in the visual imagery network respond differently to neurofeedback, and that (c) responses in parietal, but not in occipital cortex are susceptible to self-rated vividness of mental imagery. Together, these results suggest that medial superior parietal cortex might be a suitable candidate to provide real-time feedback to patients suffering from visual field defects.

Theory of visual attention thalamic model for visual short-term memory capacity and top-down control: Evidence from a thalamo-cortical structural connectivity analysis.

In the theory of visual attention (TVA), it is suggested that objects in a visual scene compete for representation in a visual short-term memory (vSTM) store. The race towards the store is assumed to be biased by top-down controlled weighting of the objects according to their task relevance. Only objects that reach the store before its capacity limitation is reached are represented consciously in a given instant. TVA-based computational modeling of participants' performance in whole- and partial-report tasks permits independent parameters of individual efficiency of top-down control α and vSTM storage capacity K to be extracted. The neural interpretation of the TVA proposes recurrent loops between the posterior thalamus and posterior visual cortices to be relevant for generating attentional weights for competing objects and for maintaining selected objects in vSTM. Accordingly, we tested whether structural connectivity between posterior thalamus and occipital cortices (PT-OC) is associated with estimates of top-down control and vSTM capacity. We applied whole- and partial-report tasks and probabilistic tractography in a sample of 37 healthy adults. We found vSTM capacity K to be associated with left PT-OC structural connectivity and a trend-wise relation between top-down control α and right PT-OC structural connectivity. These findings support the assumption of the relevance of thalamic structures and their connections to visual cortex for top-down control and vSTM capacity.

The role of the IPL in person identification.

We investigate the brain activations when identifying a newly encountered individual as being the same as a person previously perceived, a fundamental but seldom acknowledged process. In an identity condition, two faces had to be identified as the same person in contrast to a control condition, in which two faces had to be recognised as belonging to similar looking twins. Our results demonstrate an increase of neural activation in frontal as well as in parietal areas including the left inferior parietal lobe and the precuneus during identification. We introduce mental files theory to model this process as a linking of co-referential files and identify important connections to other domains in neurological and cognitive science (e.g., delusional misidentification syndromes, theory of mind).

The dynamic contribution of the high-level visual cortex to imagery and perception.

Mental imagery and visual perception rely on the same content-dependent brain areas in the high-level visual cortex (HVC). However, little is known about dynamic mechanisms in these areas during imagery and perception. Here we disentangled local and inter-regional dynamic mechanisms underlying imagery and perception in the HVC and the hippocampus (HC), a key region for memory retrieval during imagery. Nineteen healthy participants watched or imagined a familiar scene or face during fMRI acquisition. The neural code for familiar landmarks and faces was distributed across the HVC and the HC, although with a different representational structure, and generalized across imagery and perception. However, different regional adaptation effects and inter-regional functional couplings were detected for faces and landmarks during imagery and perception. The left PPA showed opposite adaptation effects, with activity suppression following repeated observation of landmarks, but enhancement following repeated imagery of landmarks. Also, functional coupling between content-dependent brain areas of the HVC and HC changed as a function of task and content. These findings provide important information about the dynamic networks underlying imagery and perception in the HVC and shed some light upon the thin line between imagery and perception which has characterized the neuropsychological debates on mental imagery.

The right thalamic glutamate level correlates with functional connectivity with right dorsal anterior cingulate cortex/middle occipital gyrus in unmedicated obsessive-compulsive disorder: A combined fMRI and 1H-MRS study.

OBJECTIVE: The imbalance in neurotransmitter and neuronal metabolite concentration within cortico-striato-thalamo-cortical (CSTC) circuit contributes to obsessive-compulsive disorder's (OCD) onset. Previous studies showed that glutamate mediated upregulation of resting-state activity in healthy people. However, there have been few studies investigating the correlational features between functional and neurochemical alterations in OCD. METHODS: We utilize a combined resting-state functional magnetic resonance imaging (rs-fMRI) and proton magnetic resonance spectroscopy (1H-MRS) approach to investigate the altered functional connectivity (FC) in association with glutamatergic dysfunction in OCD pathophysiology. Three regions of interest are investigated, i.e., medial prefrontal cortex and bilateral thalamus, for seed-based whole-brain FC analysis as well as MRS data acquisition. There are 23 unmedicated adult OCD patients and 23 healthy controls recruited for brain FC analysis. Among them, 12 OCD and 8 controls are performed MRS data acquisition. RESULTS: Besides abnormal FC within CSTC circuit, we also find altered FCs in large-scale networks outside CSTC circuit, including occipital area and limbic and motor systems. The decreased FC between right thalamus and right middle occipital gyrus (MOG) is correlated with glutamatergic signal within right thalamus in OCD patients. Moreover, the FC between right thalamus and right dorsal anterior cingulate cortex (dACC) is associated with glutamate level in right thalamus, specifically in patient's group. Finally, the FC between right thalamus and right MOG is correlated with patient's Yale-Brown Obsessive Compulsive Scale (YBOCS) compulsion and total scores, while the right thalamic glutamatergic signal is associated with YBOCS-compulsion score. CONCLUSION: Our findings showed that the coupled intrinsic functional-biochemical alterations existed both within CSTC circuit and from CSTC to occipital lobe in OCD pathophysiology.

Arithmetic word problems describing discrete quantities: E.E.G evidence for the construction of a situation model.

In this research, university students were asked to solve arithmetic word problems constructed either with discrete quantities, such as apples or marbles, or continuous quantities such as meters of rope or grams of sand. An analysis of their brain activity showed different alpha levels between the two types of problems with, in particular, a lower alpha power in the parieto-occipital area for problems describing discrete quantities. This suggests that processing discrete quantities during problem solving prompts more mental imagery than processing continuous quantities. These results are difficult to reconcile with the schema theory, according to which arithmetic problem solving depends on the activation of ready-made mental frames stored in long-term memory and triggered by the mathematical expression used in the texts. Within the schema framework, the nature of the objects described in the text should be quickly abstracted during problem solving because it cannot impact the semantic structure of the problem. On the contrary, our results support the situation model theory, which places greater emphasis on the problem context in order to account for individuals' behaviour. On a more methodological point of view, this study constitutes the first attempt to infer the characteristics of individual's mental representations of arithmetic text problems from EEG recordings. This opens the door for the application of brain activity measures in the field of arithmetic word problem.

Interleaved 31 P MRS imaging of human frontal and occipital lobes using dual RF coils in combination with single-channel transmitter-receiver and dynamic B0 shimming.

In vivo 31 P magnetic resonance spectroscopy (MRS) provides a unique tool for the non-invasive study of brain energy metabolism and mitochondrial function. The assessment of bioenergetic impairment in different brain regions is essential to understand the pathophysiology and progression of human brain diseases. This article presents a simple and effective approach which allows the interleaved measurement of 31 P spectra and imaging from two distinct human brain regions of interest with dynamic B0 shimming capability. A transistor-transistor logic controller was employed to actively switch the single-channel X-nuclear radiofrequency (RF) transmitter-receiver between two 31 P RF surface coils, enabling the interleaved acquisition of two 31 P free induction decays (FIDs) from human occipital and frontal lobes within the same repetition time. Linear gradients were incorporated into the RF pulse sequence to perform the first-order dynamic shimming to further improve spectral resolution. The overall results demonstrate that the approach provides a cost-effective and time-efficient solution for reliable 31 P MRS measurement of cerebral phosphate metabolites and adenosine triphosphate (ATP) metabolic fluxes from two human brain regions with high detection sensitivity and spectral quality at 7 T. The same design concept can be extended to acquire multiple spectra from more than two brain regions or can be employed for other magnetic resonance applications beyond the 31 P spin.

Spatial localization of sound elicits early responses from occipital visual cortex in humans.

Much evidence points to an interaction between vision and audition at early cortical sites. However, the functional role of these interactions is not yet understood. Here we show an early response of the occipital cortex to sound that it is strongly linked to the spatial localization task performed by the observer. The early occipital response to a sound, usually absent, increased by more than 10-fold when presented during a space localization task, but not during a time localization task. The response amplification was not only specific to the task, but surprisingly also to the position of the stimulus in the two hemifields. We suggest that early occipital processing of sound is linked to the construction of an audio spatial map that may utilize the visual map of the occipital cortex.

Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations.

Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.

Direct evidence for the contributive role of the right inferior fronto-occipital fasciculus in non-verbal semantic cognition.

The neural foundations underlying semantic processing have been extensively investigated, highlighting a pivotal role of the ventral stream. However, although studies concerning the involvement of the left ventral route in verbal semantics are proficient, the potential implication of the right ventral pathway in non-verbal semantics has been to date unexplored. To gain insights on this matter, we used an intraoperative direct electrostimulation to map the structures mediating the non-verbal semantic system in the right hemisphere. Thirteen patients presenting with a right low-grade glioma located within or close to the ventral stream were included. During the 'awake' procedure, patients performed both a visual non-verbal semantic task and a verbal (control) task. At the cortical level, in the right hemisphere, we found non-verbal semantic-related sites (n = 7 in 6 patients) in structures commonly associated with verbal semantic processes in the left hemisphere, including the superior temporal gyrus, the pars triangularis, and the dorsolateral prefrontal cortex. At the subcortical level, we found non-verbal semantic-related sites in all but one patient (n = 15 sites in 12 patients). Importantly, all these responsive stimulation points were located on the spatial course of the right inferior fronto-occipital fasciculus (IFOF). These findings provide direct support for a critical role of the right IFOF in non-verbal semantic processing. Based upon these original data, and in connection with previous findings showing the involvement of the left IFOF in non-verbal semantic processing, we hypothesize the existence of a bilateral network underpinning the non-verbal semantic system, with a homotopic connectional architecture.