The Motor Network Reduces Multisensory Illusory Perception.

Observing mouth movements has strikingly effects on the perception of speech. Any mismatch between sound and mouth movements will result in listeners perceiving illusory consonants (McGurk effect), whereas matching mouth movements assist with the correct recognition of speech sounds. Recent neuroimaging studies have yielded evidence that the motor areas are involved in speech processing, yet their contributions to multisensory illusion remain unclear. Using functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS) in an event-related design, we aimed to identify the functional roles of the motor network in the occurrence of multisensory illusion in female and male brains. fMRI showed bilateral activation of the inferior frontal gyrus (IFG) in audiovisually incongruent trials. Activity in the left IFG was negatively correlated with occurrence of the McGurk effect. The effective connectivity between the left IFG and the bilateral precentral gyri was stronger in incongruent than in congruent trials. The McGurk effect was reduced in incongruent trials by applying single-pulse TMS to motor cortex (M1) lip areas, indicating that TMS facilitates the left IFG-precentral motor network to reduce the McGurk effect. TMS of the M1 lip areas was effective in reducing the McGurk effect within the specific temporal range from 100 ms before to 200 ms after the auditory onset, and TMS of the M1 foot area did not influence the McGurk effect, suggesting topographical specificity. These results provide direct evidence that the motor network makes specific temporal and topographical contributions to the processing of multisensory integration of speech to avoid illusion.SIGNIFICANCE STATEMENT The human motor network, including the inferior frontal gyrus and primary motor cortex lip area, appears to be involved in speech perception, but the functional contribution to the McGurk effect is unknown. Functional magnetic resonance imaging revealed that activity in these areas of the motor network increased when the audiovisual stimuli were incongruent, and that the increased activity was negatively correlated with perception of the McGurk effect. Furthermore, applying transcranial magnetic stimulation to the motor areas reduced the McGurk effect. These two observations provide evidence that the motor network contributes to the avoidance of multisensory illusory perception.

Neural capacity limits during unconscious semantic processing.

A growing body of neuroimaging data suggests that direct measurements of brain activity can reveal subliminal effects that remain invisible with behavior measures alone. We examined whether sentence comprehension processes could be triggered by a sequence of masked words. On each trial, participants viewed a rapid sequence of masked or unmasked words, including a subject noun, three adverbs and followed by a visible target verb. To probe the capacity limits of unconscious processing, we measured event-related potentials associated with the semantic congruency between the noun and the verb, while varying the subject position in each sentence. Unmasked sentences produced significant behavioral effects of congruency, paralleled by robust N400 effects, independently of subject-verb distance. By contrast, masked sentences produced no behavioral effect and elicited N400 effects only when subjects and verbs were separated by 0 or 1 word. The present results suggest that semantic integration of multiple words can occur unconsciously only if the distance between the words to be integrated does not exceed two words. Although the possibility remains that even longer sequence of invisible words may produce similar neural effects in different experimental settings, our ERP data show that only conscious perception gives access to a buffer that enables robust sentence-level processing independently of temporal distance.

Graphomotor memory in Exner's area enhances word learning in the blind.

Handwriting is thought to impede vocabulary learning in sighted adults because the motor execution of writing interferes with efficient audiovisual processing during encoding. However, the motor memory of writing may facilitate adult word learning when visual sensory inputs are severely restricted. Using functional MRI, we show that late-blind participants, but not sighted participants, learned novel words by recruiting the left dorsal premotor cortex known as Exner's writing area and its functional coupling with the left hippocampus. During later recall, the phonological and semantic contents of these words are represented in the activation patterns of the left hippocampus as well as in those of left frontotemporal language areas. These findings suggest that motor codes of handwriting help blind participants maintain word-form representations during learning and retrieval. We propose that such reliance on the motor system reflects a broad architecture of the cerebral language network which encompasses the limb motor system as a hardwired component.