Practice modality of motor sequences impacts the neural signature of motor imagery.

Motor imagery is conceptualized as an internal simulation that uses motor-related parts of the brain as its substrate. Many studies have investigated this sharing of common neural resources between the two modalities of motor imagery and motor execution. They have shown overlapping but not identical activation patterns that thereby result in a modality-specific neural signature. However, it is not clear how far this neural signature depends on whether the imagined action has previously been practiced physically or only imagined. The present study aims to disentangle whether the neural imprint of an imagined manual pointing sequence within cortical and subcortical motor areas is determined by the nature of this prior practice modality. Each participant practiced two sequences physically, practiced two other sequences mentally, and did a behavioural pre-test without any further practice on a third pair of sequences. After a two-week practice intervention, participants underwent fMRI scans while imagining all six sequences. Behavioural data demonstrated practice-related effects as well as very good compliance with instructions. Functional MRI data confirmed the previously known motor imagery network. Crucially, we found that mental and physical practice left a modality-specific footprint during mental motor imagery. In particular, activation within the right posterior cerebellum was stronger when the imagined sequence had previously been practiced physically. We conclude that cerebellar activity is shaped specifically by the nature of the prior practice modality.

Subjective vividness of motor imagery has a neural signature in human premotor and parietal cortex.

Motor imagery (MI) is the process in which subjects imagine executing a body movement with a strong kinesthetic component from a first-person perspective. The individual capacity to elicit such mental images is not universal but varies within and between subjects. Neuroimaging studies have shown that these inter-as well as intra-individual differences in imagery quality mediate the amplitude of neural activity during MI on a group level. However, these analyses were not sensitive to forms of representation that may not map onto a simple modulation of overall amplitude. Therefore, the present study asked how far the subjective impression of motor imagery vividness is reflected by a spatial neural code, and how patterns of neural activation in different motor regions relate to specific imagery impressions. During fMRI scanning, 20 volunteers imagined three different types of right-hand actions. After each imagery trial, subjects were asked to evaluate the perceived vividness of their imagery. A correlation analysis compared the rating differences and neural dissimilarity values of the rating groups separately for each region of interest. Results showed a significant positive correlation in the left vPMC and right IPL, indicating that these regions particularly reflect perceived imagery vividness in that similar rated trials evoke more similar neural patterns. A decoding analysis revealed that the vividness of the motor image related systematically to the action specificity of neural activation patterns in left vPMC and right SPL. Imagined actions accompanied by higher vividness ratings were significantly more distinguishable within these areas. Altogether, results showed that spatial patterns of neural activity within the human motor cortices reflect the individual vividness of imagined actions. Hence, the findings reveal a link between the subjective impression of motor imagery vividness and objective physiological markers.

Imagined and Executed Actions in the Human Motor System: Testing Neural Similarity Between Execution and Imagery of Actions with a Multivariate Approach.

Simulation theory proposes motor imagery (MI) to be a simulation based on representations also used for motor execution (ME). Nonetheless, it is unclear how far they use the same neural code. We use multivariate pattern analysis (MVPA) and representational similarity analysis (RSA) to describe the neural representations associated with MI and ME within the frontoparietal motor network. During functional magnetic resonance imaging scanning, 20 volunteers imagined or executed 3 different types of right-hand actions. Results of MVPA showed that these actions as well as their modality (MI or ME) could be decoded significantly above chance from the spatial patterns of BOLD signals in premotor and posterior parietal cortices. This was also true for cross-modal decoding. Furthermore, representational dissimilarity matrices of frontal and parietal areas showed that MI and ME representations formed separate clusters, but that the representational organization of action types within these clusters was identical. For most ROIs, this pattern of results best fits with a model that assumes a low-to-moderate degree of similarity between the neural patterns associated with MI and ME. Thus, neural representations of MI and ME are neither the same nor totally distinct but exhibit a similar structural geometry with respect to different types of action.

Auditory modulation of visual stimulus encoding in human retinotopic cortex.

Sounds can modulate visual perception as well as neural activity in retinotopic cortex. Most studies in this context investigated how sounds change neural amplitude and oscillatory phase reset in visual cortex. However, recent studies in macaque monkeys show that congruence of audio-visual stimuli also modulates the amount of stimulus information carried by spiking activity of primary auditory and visual neurons. Here, we used naturalistic video stimuli and recorded the spatial patterns of functional MRI signals in human retinotopic cortex to test whether the discriminability of such patterns varied with the presence and congruence of co-occurring sounds. We found that incongruent sounds significantly impaired stimulus decoding from area V2 and there was a similar trend for V3. This effect was associated with reduced inter-trial reliability of patterns (i.e. higher levels of noise), but was not accompanied by any detectable modulation of overall signal amplitude. We conclude that sounds modulate naturalistic stimulus encoding in early human retinotopic cortex without affecting overall signal amplitude. Subthreshold modulation, oscillatory phase reset and dynamic attentional modulation are candidate neural and cognitive mechanisms mediating these effects.

The duration of a co-occurring sound modulates visual detection performance in humans.

BACKGROUND: The duration of sounds can affect the perceived duration of co-occurring visual stimuli. However, it is unclear whether this is limited to amodal processes of duration perception or affects other non-temporal qualities of visual perception. METHODOLOGY/PRINCIPAL FINDINGS: Here, we tested the hypothesis that visual sensitivity--rather than only the perceived duration of visual stimuli--can be affected by the duration of co-occurring sounds. We found that visual detection sensitivity (d') for unimodal stimuli was higher for stimuli of longer duration. Crucially, in a cross-modal condition, we replicated previous unimodal findings, observing that visual sensitivity was shaped by the duration of co-occurring sounds. When short visual stimuli (∼24 ms) were accompanied by sounds of matching duration, visual sensitivity was decreased relative to the unimodal visual condition. However, when the same visual stimuli were accompanied by longer auditory stimuli (∼60-96 ms), visual sensitivity was increased relative to the performance for ∼24 ms auditory stimuli. Across participants, this sensitivity enhancement was observed within a critical time window of ∼60-96 ms. Moreover, the amplitude of this effect correlated with visual sensitivity enhancement found for longer lasting visual stimuli across participants. CONCLUSIONS/SIGNIFICANCE: Our findings show that the duration of co-occurring sounds affects visual perception; it changes visual sensitivity in a similar way as altering the (actual) duration of the visual stimuli does.

Grey matter volume in early human visual cortex predicts proneness to the sound-induced flash illusion.

Visual perception can be modulated by sounds. A drastic example of this is the sound-induced flash illusion: when a single flash is accompanied by two bleeps, it is sometimes perceived in an illusory fashion as two consecutive flashes. However, there are strong individual differences in proneness to this illusion. Some participants experience the illusion on almost every trial, whereas others almost never do. We investigated whether such individual differences in proneness to the sound-induced flash illusion were reflected in structural differences in brain regions whose activity is modulated by the illusion. We found that individual differences in proneness to the illusion were strongly and significantly correlated with local grey matter volume in early retinotopic visual cortex. Participants with smaller early visual cortices were more prone to the illusion. We propose that strength of auditory influences on visual perception is determined by individual differences in recurrent connections, cross-modal attention and/or optimal weighting of sensory channels.