Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind.

Cortical plasticity in congenitally blind individuals leads to cross-modal activation of the visual cortex and may lead to superior perceptual processing in the intact sensory domains. Although mental imagery is often defined as a quasi-perceptual experience, it is unknown whether it follows similar cortical reorganization as perception in blind individuals. In this study, we show that auditory versus tactile perception evokes similar intra-modal discriminative patterns in congenitally blind compared with sighted participants. These results indicate that cortical plasticity following visual deprivation does not influence broad intra-modal organization of auditory and tactile perception as measured by our task. Furthermore, not only the blind, but also the sighted participants showed cross-modal discriminative patterns for perception modality in the visual cortex. During mental imagery, both groups showed similar decoding accuracies for imagery modality in the intra-modal primary sensory cortices. However, no cross-modal discriminative information for imagery modality was found in early visual cortex of blind participants, in contrast to the sighted participants. We did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area V4.

Modality-specific attention and multisensory integration of emotions in schizophrenia: reduced regulatory effects.

BACKGROUND: Deficits in emotion perception are a well-established phenomenon in schizophrenic patients and studies have typically used unimodal emotion tasks, presenting either emotional faces or emotional vocalizations. We introduced bimodal emotion conditions in two previous studies in order to study the process of multisensory integration of visible and audible emotion cues. We now build on our earlier work and address the regulatory effects of selective attention mechanisms on the ability to integrate emotion cues stemming from multisensory channels. METHODS: We added a neutral secondary distractor condition to the original bimodal paradigm in order to investigate modality-specific selective attention mechanisms. We compared schizophrenic patients (n=50) to non-schizophrenic psychotic patients (n=46), as well as to healthy controls (n=50). A trained psychiatrist used the Schedules of Clinical Assessment in Neuropsychiatry (SCAN 2.1) to diagnose the patients. RESULTS: As expected, in healthy controls, and to a lesser extent in non-schizophrenic psychotic patients, modality-specific attention attenuated multisensory integration of emotional faces and vocalizations. Conversely, in schizophrenic patients, auditory and visual distractor conditions yielded unaffected and even exaggerated multisensory integration. CONCLUSIONS: These results suggest that schizophrenics, as compared to healthy controls and non-schizophrenic psychotic patients, have modality-specific attention deficits when attempting to integrate information regarding emotions that stem from multichannel sources. Various explanations for our findings, as well as their possible consequences, are discussed.

Covert processing of faces in prosopagnosia is restricted to facial expressions: evidence from cross-modal bias.

We present a single case study of a brain-damaged patient, AD, suffering from visual face and object agnosia, with impaired visual perception and preserved mental imagery. She is severely impaired in all aspects of overt recognition of faces as well as in covert recognition of familiar faces. She shows a complete loss of processing facial expressions in recognition as well as in matching tasks. Nevertheless, when presented with a task where face and voice expressions were presented concurrently, there was a clear impact of face expressions on her ratings of the voice. The cross-modal paradigm used here and validated previously with normal subjects (de Gelder & Vroomen, 1995, 2000), appears as a useful tool in investigating spared covert face processing in a neuropsychological perspective, especially with prosopagnosic patients. These findings are discussed against the background of different models of the covert recognition of face expressions.

An ERP correlate of metrical stress in spoken word recognition.

Rhythmic properties of spoken language such as metrical stress, that is, the alternation of strong and weak syllables, are important in speech recognition of stress-timed languages such as Dutch and English. Nineteen subjects listened passively to or discriminated actively between sequences of bisyllabic Dutch words, which started with either a weak or a strong syllable. Weak-initial words, which constitute 12% of the Dutch lexicon, evoked more negativity than strong-initial words in the interval between P2 and N400 components of the auditory event-related potential. This negativity was denoted as N325. The N325 was larger during stress discrimination than during passive listening. N325 was also larger when a weak-initial word followed a sequence of strong-initial words than when it followed words with the same stress pattern. The latter difference was larger for listeners who performed well on stress discrimination. It was concluded that the N325 is probably a manifestation of the extraction of metrical stress from the acoustic signal and its transformation into task requirements.

Multiple-domain dissociation between impaired visual perception and preserved mental imagery in a patient with bilateral extrastriate lesions.

A brain-damaged patient is described whose pattern of performance provides insight into both the functional mechanisms and the neural structures involved in visual mental imagery. The patient became severely agnosic, alexic, achromatopsic and prosopagnosic following bilateral brain lesions in the temporo-occipital cortex. However, her mental imagery for the same visual entities that she could not perceive was perfectly preserved. This clear-cut dissociation held across all the major domains of high-level vision: object recognition, reading, colour and face processing. Our findings, together with other reports on domain-specific dissociations and functional brain imaging studies, provide evidence to support the view that visual perception and visual mental imagery are subserved by independent functional mechanisms, which do not share the same cortical implementation. In particular, our results suggest that mental imagery abilities need not be mediated by early visual cortices.