Emotion and consciousness: ends of a continuum.

We suggest a united concept of consciousness and emotion, based on the systemic cognitive neuroscience perspective regarding organisms as active and goal-directed. We criticize the idea that consciousness and emotion are psychological phenomena having quite different neurophysiological mechanisms. We argue that both characterize a unified systemic organization of behavior, but at different levels. All systems act to achieve intended behavioral results in interaction with their environment. Differentiation of this interaction increases during individual development. Any behavioral act is a simultaneous realization of systems ranking from the least to the most differentiated. We argue that consciousness and emotion are dynamic systemic characteristics that are prominent at the most and least differentiated systemic levels, correspondingly. These levels are created during development. Our theory is based on both theoretical and empirical research and provides a solid framework for experimental work.

Effect of attentional load on audiovisual speech perception: evidence from ERPs.

Seeing articulatory movements influences perception of auditory speech. This is often reflected in a shortened latency of auditory event-related potentials (ERPs) generated in the auditory cortex. The present study addressed whether this early neural correlate of audiovisual interaction is modulated by attention. We recorded ERPs in 15 subjects while they were presented with auditory, visual, and audiovisual spoken syllables. Audiovisual stimuli consisted of incongruent auditory and visual components known to elicit a McGurk effect, i.e., a visually driven alteration in the auditory speech percept. In a Dual task condition, participants were asked to identify spoken syllables whilst monitoring a rapid visual stream of pictures for targets, i.e., they had to divide their attention. In a Single task condition, participants identified the syllables without any other tasks, i.e., they were asked to ignore the pictures and focus their attention fully on the spoken syllables. The McGurk effect was weaker in the Dual task than in the Single task condition, indicating an effect of attentional load on audiovisual speech perception. Early auditory ERP components, N1 and P2, peaked earlier to audiovisual stimuli than to auditory stimuli when attention was fully focused on syllables, indicating neurophysiological audiovisual interaction. This latency decrement was reduced when attention was loaded, suggesting that attention influences early neural processing of audiovisual speech. We conclude that reduced attention weakens the interaction between vision and audition in speech.

Valence scaling of dynamic facial expressions is altered in high-functioning subjects with autism spectrum disorders: an fMRI study.

FMRI was performed with the dynamic facial expressions fear and happiness. This was done to detect differences in valence processing between 25 subjects with autism spectrum disorders (ASDs) and 27 typically developing controls. Valence scaling was abnormal in ASDs. Positive valence induces lower deactivation and abnormally strong activity in ASD in multiple regions. Negative valence increased deactivation in visual areas in subjects with ASDs. The most marked differences between valences focus on fronto-insular and temporal regions. This supports the idea that subjects with ASDs may have difficulty in passive processing of the salience and mirroring of expressions. When the valence scaling of brain activity fails, in contrast to controls, these areas activate and/or deactivate inappropriately during facial stimuli presented dynamically.

Gaze-Direction-Based MEG Averaging During Audiovisual Speech Perception.

To take a step towards real-life-like experimental setups, we simultaneously recorded magnetoencephalographic (MEG) signals and subject's gaze direction during audiovisual speech perception. The stimuli were utterances of /apa/ dubbed onto two side-by-side female faces articulating /apa/ (congruent) and /aka/ (incongruent) in synchrony, repeated once every 3 s. Subjects (N = 10) were free to decide which face they viewed, and responses were averaged to two categories according to the gaze direction. The right-hemisphere 100-ms response to the onset of the second vowel (N100m') was a fifth smaller to incongruent than congruent stimuli. The results demonstrate the feasibility of realistic viewing conditions with gaze-based averaging of MEG signals.