Dynamic emotional and neural responses to music depend on performance expression and listener experience.

Apart from its natural relevance to cognition, music provides a window into the intimate relationships between production, perception, experience, and emotion. Here, emotional responses and neural activity were observed as they evolved together with stimulus parameters over several minutes. Participants listened to a skilled music performance that included the natural fluctuations in timing and sound intensity that musicians use to evoke emotional responses. A mechanical performance of the same piece served as a control. Before and after fMRI scanning, participants reported real-time emotional responses on a 2-dimensional rating scale (arousal and valence) as they listened to each performance. During fMRI scanning, participants listened without reporting emotional responses. Limbic and paralimbic brain areas responded to the expressive dynamics of human music performance, and both emotion and reward related activations during music listening were dependent upon musical training. Moreover, dynamic changes in timing predicted ratings of emotional arousal, as well as real-time changes in neural activity. BOLD signal changes correlated with expressive timing fluctuations in cortical and subcortical motor areas consistent with pulse perception, and in a network consistent with the human mirror neuron system. These findings show that expressive music performance evokes emotion and reward related neural activations, and that music's affective impact on the brains of listeners is altered by musical training. Our observations are consistent with the idea that music performance evokes an emotional response through a form of empathy that is based, at least in part, on the perception of movement and on violations of pulse-based temporal expectancies.

Perturbation-induced false starts as a test of the jirsa-kelso excitator model.

One difference between the excitator model and other theoretical models of coordination is the mechanism of discrete movement initiation. In addition to an imperative signal common to all discrete movement initiation, the excitator model proposes that movements are initiated when a threshold element in state space, the so-called separatrix, is crossed as a consequence of stimulation or random fluctuations. The existence of a separatrix predicts that false starts will be caused by mechanical perturbations and that they depend on the perturbation's direction. The authors tested this prediction in a reaction-time task to an auditory stimulus. Participants applied perturbations in the direction of motion (i.e., index finger flexion) or opposed to the motion prior to the stimulus on 1/4 of the trials. The authors found false starts in 34% and 9% of trials following flexion perturbations and extension perturbations, respectively, as compared with only 2% of trials without perturbations, confirming a unique prediction of the excitator model.

Neuroimaging coordination dynamics in the sport sciences.

Key methodological issues for designing, analyzing, and interpreting neuroimaging experiments are presented from the perspective of the framework of Coordination Dynamics. To this end, a brief overview of Coordination Dynamics is introduced, including the main concepts of control parameters and collective variables, theoretical modeling, novel experimental paradigms, and cardinal empirical findings. Basic conceptual and methodological issues for the design and implementation of coordination experiments in the context of neuroimaging are discussed. The paper concludes with a presentation of neuroimaging findings central to understanding the neural basis of coordination and addresses their relevance for the sport sciences. The latter include but are not restricted to learning and practice-related issues, the role of mental imagery, and the recovery of function following brain injury.

Multisensory integration for timing engages different brain networks.

How does the brain integrate information from different senses into a unitary percept? What factors influence such multisensory integration? Using a rhythmic behavioral paradigm and functional magnetic resonance imaging, we identified networks of brain regions for perceptions of physically synchronous and asynchronous auditory-visual events. Measures of behavioral performance revealed the existence of three distinct perceptual states. Perception of asynchrony activated a network of the primary sensory, prefrontal, and inferior parietal cortices, perception of synchrony disengaged the inferior parietal cortex and further recruited the superior colliculus, and when no clear percept was established, only the residual areas comprised of prefrontal and sensory areas were active. These results indicate that distinct percepts arise within specific brain sub-networks, the components of which are differentially engaged and disengaged depending on the timing of environmental signals.

Assessing recovery in middle cerebral artery stroke using functional MRI.

PRIMARY OBJECTIVE: To understand the temporal evolution of brain reorganization during recovery from stroke. RESEARCH DESIGN: A patient who suffered left middle cerebral artery stroke 9 months earlier was studied on three occasions, approximately 1 month apart. METHODS AND PROCEDURES: Brain activation was studied using functional Magnetic Resonance Imaging (fMRI). During each session, the patient performed a finger-to-thumb opposition task, which involved one bimanual and two unimanual conditions. Each condition consisted of overt movement of fingers and imagery of the same task. RESULTS: With recovery, greater recruitment was observed of the affected primary motor cortex (M1) and a decrease in activation of the unaffected M1 and supplementary motor area. In addition, the widespread activation of brain areas seen during the initial session changed to a more focused pattern of activation as the patient recovered. Imagery tasks resulted in similar brain activity as overt execution pointing to imagery as a potential tool for rehabilitation.

Functional MRI reveals the existence of modality and coordination-dependent timing networks.

Growing evidence suggests that interval timing in humans is supported by distributed brain networks. Recently, we demonstrated that the specific network recruited for the performance of rhythmic timing is not static but is influenced by the coordination pattern employed during interval acquisition. Here we expand on this previous work to investigate the role of stimulus modality and coordination pattern in determining the brain areas recruited for performance of a self-paced rhythmic timing task. Subjects were paced with either a visual or an auditory metronome in either a synchronized (on the beat) or syncopated (off the beat) coordination pattern. The pacing stimulus was then removed and subjects continued to move based on the required interval. When compared with networks recruited for auditory pacing and continuation, the visual-specific activity was observed in the classic dorsal visual stream that included bilateral MT/V5, bilateral superior parietal lobe, and right ventral premotor cortex. Activity in these regions was present not only during pacing, when visual information is used to guide motor behavior, but also during continuation, when visual information specifying the temporal interval was no longer present. These results suggest a role for modality-specific areas in processing and representing temporal information. The cognitive demands imposed by syncopated coordination resulted in increased activity in a broad network that included supplementary motor area, lateral pre-motor cortex, bilateral insula, and cerebellum. This coordination-dependent activity persisted during the subsequent continuation period, when stimuli were removed and no coordination constraints were imposed. Taken together, the present results provide additional evidence that time and timing are served by a context-dependent distributed network rooted in basic sensorimotor processes.

Neural substrates of real and imagined sensorimotor coordination.

Much debate in the behavioral literature focuses on the relative contribution of motor and perceptual processes in mediating coordinative stability. To a large degree, such debate has proceeded independently of what is going on in the brain. Here, using blood oxygen level-dependent measures of neural activation, we compare physically executed and imagined rhythmic coordination in order to better assess the relative contribution of hypothesized neuromusculoskeletal mechanisms in modulating behavioral stability. The executed tasks were to coordinate index finger to thumb opposition movements of the right hand with an auditory metronome in either a synchronized (on the beat) or syncopated (off the beat) pattern. Imagination involved the same tasks, except without physical movement. Thus, the sensory stimulus and coordination constraints were the same in both physical and imagination tasks, but the motoric requirements were not. Results showed that neural differences between executed synchronization and syncopation found in premotor cortex, supplementary motor area, basal ganglia and lateral cerebellum persist even when the coordinative patterns were only imagined. Neural indices reflecting behavioral stability were not abolished by the absence of overt movement suggesting that coordination phenomena are not exclusively rooted in purely motoric constraints. On the other hand, activity in the superior temporal gyrus was modulated by both the presence of movement and the nature of the coordination, attesting to the intimacy between perceptual and motoric processes in coordination dynamics.

Spatiotemporal analysis of the neuromagnetic response to rhythmic auditory stimulation: rate dependence and transient to steady-state transition.

OBJECTIVE: Whole head magnetoencephalography was used to investigate the spatiotemporal dynamics of neuromagnetic brain activity associated with rhythmic auditory stimulation. METHODS: In order to characterize the evolution of the auditory responses we applied a Karhunen-Loève decomposition and k-means cluster analysis to globally compare spatial patterns of brain activity at different latencies and stimulation rates. Tones were presented binaurally at 27 different stimulation rates within a perceptually and behaviorally relevant range from 0.6 to 8.1 Hz. RESULTS: Over this range, we observed a linear increase of the amplitude of the main auditory response at 100 ms latency (N1m) with increasing inter-stimulus interval, and qualitative changes of the overall spatiotemporal dynamics of the auditory response. In particular, a transition occurred between a transient evoked response at low frequencies, and a continuous steady-state response at high frequencies. CONCLUSIONS: We show the onset of temporal overlap between responses to successive tones that leads to this transition. Response overlap begins to occur near 2 Hz, marking the onset of a continuous perceptual representation.

Cortical and subcortical networks underlying syncopated and synchronized coordination revealed using fMRI. Functional magnetic resonance imaging.

Inherent differences in difficulty between on the beat (synchronization) and off the beat (syncopation) coordination modes are well known. Synchronization is typically quite easy and, once begun, may be carried out with little apparent attention demand. Syncopation tends to be difficult, even though it has been described as a simple, phase-shifted version of a synchronized pattern. We hypothesize that syncopation, unlike synchronization, is organized on a cycle-by-cycle basis, thereby imposing much greater preparatory and attentional demands on the central nervous system. To test this hypothesis we used fMRI to measure the BOLD response during syncopation and synchronization to an auditory stimulus. We found that the distribution of cortical and subcortical areas involved in intentionally coordinating movement with an external metronome depends on the timing pattern employed. Both synchronized and syncopated patterns require activation of contralateral sensorimotor and caudal supplementary motor cortices as well as the (primarily ipsilateral) cerebellum. Moving off the beat, however, requires not only additional activation of the cerebellum but also the recruitment of another network comprised of the basal ganglia, dorsolateral premotor, rostral supplementary motor, prefrontal, and temporal association cortices. No areas were found to be more active during synchronization than syncopation. The functional role of the cortical and subcortical regions areas involved in syncopation supports the hypothesis that whereas synchronization requires little preparation and monitoring, syncopated movements are planned and executed individually on each perception-action cycle.

Event-related changes in neuromagnetic activity associated with syncopation and synchronization timing tasks.

For low rhythmic rates (1.0 to approximately 2.0 Hz), subjects are able to successfully coordinate finger flexion with an external metronome in either a syncopated (between the beats) or synchronized (on each beat) fashion. Beyond this rate, however, syncopation becomes unstable and subjects spontaneously switch to synchronization to maintain a 1:1 stimulus/response relationship. We used a whole-head magnetometer to investigate the spatiotemporal dynamics of neuromagnetic activity (MEG) associated with both coordinative patterns at eight different rates spanning the range 1.0-2.75 Hz. Timing changes in the event-related fields accompanied transitions from syncopation to synchronization and followed the placement of the motor response within each stimulus/response cycle. Decomposition of event-related fields into component auditory and motor brain responses revealed that the amplitude of the former decreased with increasing coordination rate whereas the motor contribution remained approximately constant across all rates. Such an interaction may contribute to changes in auditory-motor integration that cause syncopation to become unstable. Examination of event-related changes in high frequency bands revealed that MEG signal power in the beta band (15-30 Hz) was significantly lower during syncopated coordination in sensors covering the contralateral sensorimotor area suggesting a dependence of beta rhythm amplitude on task difficulty. Suppression of beta rhythms was also stronger during synchronization preceded by syncopation, e.g., after subjects had switched, when compared with a control condition in which subjects synchronized throughout the entire range of rates.

Neuromagnetic activity in alpha and beta bands reflect learning-induced increases in coordinative stability.

OBJECTIVE: To investigate how learning induced increases in stability on a syncopation task are manifest in the dynamics of cortical activity. METHOD: Magnetoencephalography was recorded from 143 sensors (CTF Systems, Inc). A pre-training procedure determined the critical frequency (F(c)) for each subject (n=4). Subjects either syncopated or synchronized to a metronome that increased in frequency from 1.2 to 3.0 Hz in 0.2 Hz steps. The F(c) was the point at which subjects spontaneously switched from syncopation to synchronization. Subjects then underwent 100 training trials (with feedback) at F(c). Following the learning phase the pre-training procedure was repeated. RESULTS: An increase in the F(c) occurred indicating that practice improved the stability of syncopation. The transition delay was also observed in the phase of the time-averaged signal in sensors over the contralateral sensorimotor area and in power analysis in the 8-12 Hz and 18-24 Hz frequency bands. Initially, reduced power was observed bilaterally during syncopation compared to synchronization. Following training, these differences were reduced or eliminated. CONCLUSION: Pre-training power differences can be explained by the greater difficulty of the syncopation task. The reduction in power differences following training suggests that at the cortical level, syncopation became more similar to synchronization possibly reflecting a decrease in task and/or attention demands.

Functional stabilization of unstable fixed points: human pole balancing using time-to-balance information.

Humans are often faced with tasks that require stabilizing inherently unstable situations. The authors explored the dynamics of human functional stabilization by having participants continually balance a pole until a minimum time criterion was reached. Conditions were manipulated with respect to geometry, mass, and characteristic "fall time" of the pole. Distributions of timing between pole and hand velocities showed strong action-perception coupling. When actions demonstrated a potential for catastrophic failure, the period of hand oscillation correlated well with the perceptual quantity "time to balance" (tau(bal) = theta/theta), but not other quantities such as theta and theta alone. This suggests that participants were using available tau(bal) information during critical conditions, although they may not have been attending to this type of perceptual information during typical, noncritical motions of successful performance. In a model analysis and simulation, the authors showed how discrete tau(bal) information may be used to adjust the parameters of a controller to perform this task.

Spatiotemporal reorganization of electrical activity in the human brain associated with a timing transition in rhythmic auditory-motor coordination.

We used a 61-channel electrode array to investigate the spatiotemporal dynamics of electroencephalographic (EEG) activity related to behavioral transitions in rhythmic sensorimotor coordination. Subjects were instructed to maintain a 1:1 relationship between repeated right index finger flexion and a series of periodically delivered tones (metronome) in a syncopated (anti-phase) fashion. Systematic increases in stimulus presentation rate are known to induce a spontaneous switch in behavior from syncopation to synchronization (in-phase coordination). We show that this transition is accompanied by a large-scale reorganization of cortical activity manifested in the spatial distributions of EEG power at the coordination frequency. Significant decreases in power were observed at electrode locations over left central and anterior parietal areas, most likely reflecting reduced activation of left primary sensorimotor cortex. A second condition in which subjects were instructed to synchronize with the metronome controlled for the effects of movement frequency, since synchronization is known to remain stable across a wide range of frequencies. Different, smaller spatial differences were observed between topographic patterns associated with synchronization at low versus high stimulus rates. Our results demonstrate qualitative changes in the spatial dynamics of human brain electrical activity associated with a transition in the timing of sensorimotor coordination and suggest that maintenance of a more difficult anti-phase timing relation is associated with greater activation of primary sensorimotor areas.

Frequency and phase characteristics of slow cortical potentials preceding bimanual coordination.

The aim of the present study was to derive quantities which relate behavioral and neurophysiological levels of observation during a bimanual coordination task. We recorded the scalp electroencephalographic (EEG) signal preceding a sequence of 4 bimanual finger flexions of varying response rates in 12 subjects. A slow negative-going Bereitschaftspotential (BP) displayed larger mean amplitudes and earlier onset times for the faster required response rates. The amplitude of the BP was also larger for electrode locations contralateral to the side initiating the behavioral response. A Fourier transform showed two predominant frequencies (0.5 and 2.0 Hz) to be amplitude modulated as a function of the required response rate in addition to increased power on the contralateral side of the finger initiating the response. A measure of the phase relationship between the left (C3) and right (C4) hemispheres of the fronto-central cortex at each of these spectral frequencies was calculated as well as the variance in this measure and found to correspond closely to the variance in inter-response times derived from the subjects' movements. These findings indicate that changes in the stability and rate of a patterned movement are generally preceded by similar changes in the stability and amplitude of components observed on the neurophysiological level.