Auditory-motor synchronization in developmental coordination disorder: Effects on interlimb coordination during walking and running.

Developmental coordination disorder (DCD) presents challenges in motor control. DCD affects tasks such as walking and running and is characterized by poor interlimb coordination and increased spatiotemporal variability compared to typically developing children (TDC). While auditory rhythm synchronization has shown to have benefits for gait performance in adults, its impact on children with DCD during walking and running remains unclear. This study investigated auditory-motor synchronization and interlimb coordination during walking and running in children with and without DCD. Twenty-one DCD and 23 TDC participants aged 8-12 years walked and ran to two different auditory metronomes (discrete and continuous). Synchronization consistency was the primary outcome, with interlimb coordination and spatiotemporal variability as secondary outcomes. Results showed that children with DCD exhibited significantly lower synchronization consistency than TDC, particularly during running. The metronome structure did not influence synchronization ability. Additionally, interlimb coordination differed significantly between DCD and TDC during running and was not impacted by auditory-motor synchronization. Spatiotemporal variability was higher in DCD during both walking and running than in TDC, and accentuated during running. Variability of cadence was influenced by the use of continuous metronomes, which may offer potential benefits in reducing cadence variability.

Expressivity attributed to music affects the smoothness of bowing movements in violinists.

Playing music is a complex task that relies on the combination of musicians' technical and expressive skills. While the literature has investigated the effects of musical expressivity on the listeners, the way how technical difficulty and emotional expressivity affect musicians during playing has surprisingly received no attention. In an attempt to fill this gap in the literature, we collected behavioral and physiological data from twelve violinists playing 29 pieces that included both technical exercises and excerpts from classical repertoire for violin. After playing each stimulus, participants rated it for emotional expressivity and technical difficulty. During the entire session, cardiac parameters and electrodermal activity were collected, together with the kinematic parameters of the bowing gesture. A set of Linear Mixed-Effect (LME) models suggested that emotional expressivity attributed to music affected the fluidity of bowing (i.e., smoothness), with the excerpts rated as more expressive being performed in a less smooth way. In contrast, LME models revealed no effects of expressivity and technical difficulty on any of the physiological parameters of violinists. Our results offer novel insights into the psychophysiological dynamics that link motor parameters with musical expressivity. These findings could influence educational practices in music and deepen our understanding of aesthetic emotions.

Perceptual coupling in human dyads: Kinematics does not affect interpersonal synchronization.

The minimal, essential condition for individuals to interact is that they exchange information via at least one sensory channel. Once informational coupling is established, it enables basic forms of coordinated behavior to spontaneously emerge from the interaction. Our previous study revealed different coordination dynamics in dyads engaged in a joint finger-tapping task based on visual versus auditory coupling. This observation led us to propose the 'modality-dependent hypothesis', which posits that coordination dynamics are influenced by the sensory modality mediating informational coupling. However, recognizing that different modalities have inherent differences in accessing spatiotemporal features of perceived movement, we formulated the alternative 'kinematic hypothesis'. This hypothesis posits that differences in dynamics would vanish given equivalent kinematic information across modalities. The study involved forty (N = 40) participants, grouped into twenty (N = 20) dyads, who engaged in a joint finger-tapping task. This task was conducted under varying conditions of visual and auditory coupling, with manipulations in the access to kinematic information, categorized as discrete and continuous. Contrary to our initial predictions, the results strongly supported the 'modality-dependent hypothesis'. We observed that visual and auditory coupling consistently yielded distinct attractor dynamics, regardless of the access to kinematic information. Furthermore, all conditions of auditory coupling resulted in higher levels of synchronization than their visual counterparts. These findings suggest that the differences in interpersonal synchronization are predominantly influenced by the sensory modality, rather than the continuity of kinematic information. Our study highlights the significance of sensorimotor interactions in interpersonal synchronization and addresses the potential of sonification strategies in supporting motor training and rehabilitation.

Enhancing human-human musical interaction through kinesthetic haptic feedback using wearable exoskeletons: theoretical foundations, validation scenarios, and limitations.

In this perspective paper, we explore the use of haptic feedback to enhance human-human interaction during musical tasks. We start by providing an overview of the theoretical foundation that underpins our approach, which is rooted in the embodied music cognition framework, and by briefly presenting the concepts of action-perception loop, sensorimotor coupling and entrainment. Thereafter, we focus on the role of haptic information in music playing and we discuss the use of wearable technologies, namely lightweight exoskeletons, for the exchange of haptic information between humans. We present two experimental scenarios in which the effectiveness of this technology for enhancing musical interaction and learning might be validated. Finally, we briefly discuss some of the theoretical and pedagogical implications of the use of technologies for haptic communication in musical contexts, while also addressing the potential barriers to the widespread adoption of exoskeletons in such contexts.

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography.

Within the broader context of improving interactions between artificial intelligence and humans, the question has arisen regarding whether auditory and rhythmic support could increase attention for visual stimuli that do not stand out clearly from an information stream. To this end, we designed an experiment inspired by pip-and-pop but more appropriate for eliciting attention and P3a-event-related potentials (ERPs). In this study, the aim was to distinguish between targets and distractors based on the subject's electroencephalography (EEG) data. We achieved this objective by employing different machine learning (ML) methods for both individual-subject (IS) and cross-subject (CS) models. Finally, we investigated which EEG channels and time points were used by the model to make its predictions using saliency maps. We were able to successfully perform the aforementioned classification task for both the IS and CS scenarios, reaching classification accuracies up to 76%. In accordance with the literature, the model primarily used the parietal-occipital electrodes between 200 ms and 300 ms after the stimulus to make its prediction. The findings from this research contribute to the development of more effective P300-based brain-computer interfaces. Furthermore, they validate the EEG data collected in our experiment.

Embodied perspective-taking enhances interpersonal synchronization: A body-swap study.

Humans exhibit a strong tendency to synchronize movements with each other, with visual perspective potentially influencing interpersonal synchronization. By manipulating the visual scenes of participants engaged in a joint finger-tapping task, we examined the effects of 1st person and 2nd person visual perspectives on their coordination dynamics. We hypothesized that perceiving the partner's movements from their 1st person perspective would enhance spontaneous interpersonal synchronization, potentially mediated by the embodiment of the partner's hand. We observed significant differences in attractor dynamics across visual perspectives. Specifically, participants in 1st person coupling were unable to maintain de-coupled trajectories as effectively as in 2nd person coupling. Our findings suggest that visual perspective influences coordination dynamics in dyadic interactions, engaging error-correction mechanisms in individual brains as they integrate the partner's hand into their body representation. Our results have the potential to inform the development of applications for motor training and rehabilitation.

Auditory attention measured by EEG in neurological populations: systematic review of literature and meta-analysis.

Sensorimotor synchronization strategies have been frequently used for gait rehabilitation in different neurological populations. Despite these positive effects on gait, attentional processes required to dynamically attend to the auditory stimuli needs elaboration. Here, we investigate auditory attention in neurological populations compared to healthy controls quantified by EEG recordings. Literature was systematically searched in databases PubMed and Web of Science. Inclusion criteria were investigation of auditory attention quantified by EEG recordings in neurological populations in cross-sectional studies. In total, 35 studies were included, including participants with Parkinson's disease (PD), stroke, Traumatic Brain Injury (TBI), Multiple Sclerosis (MS), Amyotrophic Lateral Sclerosis (ALS). A meta-analysis was performed on P3 amplitude and latency separately to look at the differences between neurological populations and healthy controls in terms of P3 amplitude and latency. Overall, neurological populations showed impairments in auditory processing in terms of magnitude and delay compared to healthy controls. Consideration of individual auditory processes and thereafter selecting and/or designing the auditory structure during sensorimotor synchronization paradigms in neurological physical rehabilitation is recommended.

The assessment of presence and performance in an AR environment for motor imitation learning: A case-study on violinists.

The acquisition of advanced gestures is a challenge in various domains of proficient sensorimotor performance. For example, orchestral violinists must move in sync with the lead violinist's gestures. To help train these gestures, an educational music play-back system was developed using a HoloLens 2 simulated AR environment and an avatar representation of the lead violinist. This study aimed to investigate the impact of using a 2D or 3D representation of the lead violinist's avatar on students' learning experience in the AR environment. To assess the learning outcome, the study employed a longitudinal experiment design, in which eleven participants practiced two pieces of music in four trials, evenly spaced over a month. Participants were asked to mimic the avatar's gestures as closely as possible when it came to using the bow, including bowing, articulations, and dynamics. The study compared the similarities between the avatar's gestures and those of the participants at the biomechanical level, using motion capture measurements, as well as the smoothness of the participants' movements. Additionally, presence and perceived difficulty were assessed using questionnaires. The results suggest that using a 3D representation of the avatar leads to better gesture resemblance and a higher experience of presence compared to a 2D representation. The 2D representation, however, showed a learning effect, but this was not observed in the 3D condition. The findings suggest that the 3D condition benefits from stereoscopic information that enhances spatial cognition, making it more effective in relation to sensorimotor performance. Overall, the 3D condition had a greater impact on performance than on learning. This work concludes with recommendations for future efforts directed towards AR-based advanced gesture training to address the challenges related to measurement methodology and participants' feedback on the AR application.

Neural entrainment underpins sensorimotor synchronization to dynamic rhythmic stimuli.

Neural entrainment, defined as unidirectional synchronization of neural oscillations to an external rhythmic stimulus, is a topic of major interest in the field of neuroscience. Despite broad scientific consensus on its existence, on its pivotal role in sensory and motor processes, and on its fundamental definition, empirical research struggles in quantifying it with non-invasive electrophysiology. To this date, broadly adopted state-of-the-art methods still fail to capture the dynamic underlying the phenomenon. Here, we present event-related frequency adjustment (ERFA) as a methodological framework to induce and to measure neural entrainment in human participants, optimized for multivariate EEG datasets. By applying dynamic phase and tempo perturbations to isochronous auditory metronomes during a finger-tapping task, we analyzed adaptive changes in instantaneous frequency of entrained oscillatory components during error correction. Spatial filter design allowed us to untangle, from the multivariate EEG signal, perceptual and sensorimotor oscillatory components attuned to the stimulation frequency. Both components dynamically adjusted their frequency in response to perturbations, tracking the stimulus dynamics by slowing down and speeding up the oscillation over time. Source separation revealed that sensorimotor processing enhanced the entrained response, supporting the notion that the active engagement of the motor system plays a critical role in processing rhythmic stimuli. In the case of phase shift, motor engagement was a necessary condition to observe any response, whereas sustained tempo changes induced frequency adjustment even in the perceptual oscillatory component. Although the magnitude of the perturbations was controlled across positive and negative direction, we observed a general bias in the frequency adjustments towards positive changes, which points at the effect of intrinsic dynamics constraining neural entrainment. We conclude that our findings provide compelling evidence for neural entrainment as mechanism underlying overt sensorimotor synchronization, and highlight that our methodology offers a paradigm and a measure for quantifying its oscillatory dynamics by means of non-invasive electrophysiology, rigorously informed by the fundamental definition of entrainment.

Knee flexion of saxophone players anticipates tonal context of music.

Music performance requires high levels of motor control. Professional musicians use body movements not only to accomplish and help technical efficiency, but to shape expressive interpretation. Here, we recorded motion and audio data of twenty participants performing four musical fragments varying in the degree of technical difficulty to analyze how knee flexion is employed by expert saxophone players. Using a computational model of the auditory periphery, we extracted emergent acoustical properties of sound to inference critical cognitive patterns of music processing and relate them to motion data. Results showed that knee flexion is causally linked to tone expectations and correlated to rhythmical density, suggesting that this gesture is associated with expressive and facilitative purposes. Furthermore, when instructed to play immobile, participants tended to microflex (>1 Hz) more frequently compared to when playing expressively, possibly indicating a natural urge to move to the music. These results underline the robustness of body movement in musical performance, providing valuable insights for the understanding of communicative processes, and development of motor learning cues.

Cholinergic-related pupil activity reflects level of emotionality during motor performance.

Pupil size covaries with the diffusion rate of the cholinergic and noradrenergic neurons throughout the brain, which are essential to arousal. Recent findings suggest that slow pupil fluctuations during locomotion are an index of sustained activity in cholinergic axons, whereas phasic dilations are related to the activity of noradrenergic axons. Here, we investigated movement induced arousal (i.e., by singing and swaying to music), hypothesising that actively engaging in musical behaviour will provoke stronger emotional engagement in participants and lead to different qualitative patterns of tonic and phasic pupil activity. A challenge in the analysis of pupil data is the turbulent behaviour of pupil diameter due to exogenous ocular activity commonly encountered during motor tasks and the high variability typically found between individuals. To address this, we developed an algorithm that adaptively estimates and removes pupil responses to ocular events, as well as a functional data methodology, derived from Pfaffs' generalised arousal, that provides a new statistical dimension on how pupil data can be interpreted according to putative neuromodulatory signalling. We found that actively engaging in singing enhanced slow cholinergic-related pupil dilations and having the opportunity to move your body while performing amplified the effect of singing on pupil activity. Phasic pupil oscillations during motor execution attenuated in time, which is often interpreted as a measure of sense of agency over movement.

Influence of musical context on sensorimotor synchronization in classical ballet solo dance.

Several studies have addressed motor coordination in dance, but few have addressed the influence of musical context on micro-timing during sensorimotor synchronization (SMS) in classical ballet. In this study, we analyze the Promenade in Arabesque of the Odile variations, first as a dance-music fragment non-embedded in a musical context, then as a dance-music fragment embedded in a musical context at two different instances. Given the musical structure of the fragments, there are repeats of patterns between and within the fragments. Four dancers were invited to perform the three fragments in twelve successive performances. The beats of the music were extracted and compared with the timing of the dancers' heel movements, using circular-linear smooth regression modelling, and circular statistics. The results reveal an effect of repeat within fragments, and an effect of musical context between fragments, on micro-timing anticipation in SMS. The methodology offers a framework for future work on dynamical aspects of SMS.

Mutual beta power modulation in dyadic entrainment.

Across a broad spectrum of interactions, humans exhibit a prominent tendency to synchronize their movements with one another. Traditionally, this phenomenon has been explained from the perspectives of predictive coding or dynamical systems theory. While these theories diverge with respect to whether individuals hold internal models of each other, they both assume a predictive or anticipatory mechanism enabling rhythmic interactions. However, the neural bases underpinning interpersonal synchronization are still a subject under active investigation. Here we provide evidence that the brain relies on a common oscillatory mechanism to pace self-generated rhythmic movements and to track the movements produced by a partner. By performing dual-electroencephalography recordings during a joint finger-tapping task, we identified an oscillatory component in the beta range (∼ 20 Hz), which was significantly modulated by both self-generated and other-generated movement. In conditions where the partners perceived each other, we observed periodic fluctuations of beta power as a function of the reciprocal movement cycles. Crucially, this modulation occurred both in visually and in auditorily coupled conditions, and was accompanied by recurrent periods of dyadic synchronized behavior. Our results show that periodic beta power modulations may be a critical mechanism underlying interpersonal synchronization, possibly enabling mutual predictions between coupled individuals, leading to co-regulation of timing and overt mutual adaptation. Our findings thus provide a potential bridge between influential theories attempting to explain interpersonal coordination, and a concrete connection to its neurophysiological bases.

With No Attention Specifically Directed to It, Rhythmic Sound Does Not Automatically Facilitate Visual Task Performance.

In a century where humans and machines-powered by artificial intelligence or not-increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography (EEG), should be recorded. This approach can be subject to a future work.

Embodied learning in multiple sclerosis using melodic, sound, and visual feedback: a potential rehabilitation approach.

Given the prevalence of motor and cognitive functions in persons with multiple sclerosis (PwMS), we proposed that the theoretical framework of embodiment could provide a rehabilitation avenue to train these functions as one functional unit. PwMS (n = 31) and age- and gender-matched healthy controls (n = 30) underwent an embodied learning protocol. This involved learning a cognitive sequence while performing it through bodily stepping movement under three feedback conditions (melody, sound, and visual). Cognitive and movement performance was assessed by a delayed recall 15 min after undergoing the embodied learning protocol. Half of participants correctly recalled the sequence in all three conditions, while 70% of healthy controls achieved correct recall within the melody condition. Balance impairment predicted the speed of executing the sequence irrespective of learning, most apparent in the melody condition. Information processing speed predicted the speed of executing the sequence in the melody and sound conditions between participants as well as over time. Those who learned performed the sequence faster in the melody condition only and overall were faster over time. We propose how embodied learning could expand the current context of rehabilitation of cognitive and motor control in PwMS.

Foot strike determines the center of pressure behavior and affects impact severity in heel-toe running.

This study assessed the centre of pressure (COP) behaviour and the relationship with impact severity during heel-toe running in conventional athletic footwear. We hypothesized that the COP behaviour depends on its location at foot strike, which would be associated with the vertical loading rate and peak tibial accelerations in heel-toe running. Ground reaction force and tibial acceleration were measured in 104 distance runners running level at ~3.2 m/s. High-speed plantar pressure captured at high temporal resolution (500 Hz) and spatial resolution (7.62 · 5.08 mm/sensor) allowed for localization of the COP directly in the footprint during running in self-selected athletic footwear. More lateral X-coordinates of the COP at first foot contact had, in general, more anterior Y-coordinates (adj.R2:0.609). In heel-toe running, a more anterior foot strike had a greater refined strike index, which was associated with a quicker roll-over in the rearfoot zone. This strike index contributed to greater maximum vertical loading rates (R2:0.121), and greater axial (R2:0.047) and resultant (R2:0.247) peak tibial accelerations. These findings indicate that (1) the COP progression is dependend on the COP location at foot strike; (2) more anterior rearfoot strikes are more likely to have greater impact severity than posterior rearfoot strikes.

Reducing the peak tibial acceleration of running by music-based biofeedback: A quasi-randomized controlled trial.

BACKGROUND: Running retraining with the use of biofeedback on an impact measure has been executed or evaluated in the biomechanics laboratory. Here, the execution and evaluation of feedback-driven retraining are taken out of the laboratory. PURPOSE: To determine whether biofeedback can reduce the peak tibial acceleration with or without affecting the running cadence in a 3-week retraining protocol. STUDY DESIGN: Quasi-randomized controlled trial. METHODS: Twenty runners with high peak tibial acceleration were allocated to either the retraining (n = 10, 32.1 ± 7.8 years, 10.9 ± 2.8 g) or control (n = 10, 39.1 ± 10.4 years, 13.0 ± 3.9 g) groups. They performed six running sessions in an athletic training environment. A body-worn system collected axial tibial acceleration and provided real-time feedback. The retraining group received music-based biofeedback in a faded feedback scheme. Pink noise was superimposed on tempo-synchronized music when the peak tibial acceleration was ≥70% of the runner's baseline. The control group received tempo-synchronized music, which acted as a placebo for blinding purposes. Speed feedback was provided to obtain a stable running speed of ~2.9 m·s-1 . Peak tibial acceleration and running cadence were evaluated. RESULTS: A significant group-by-feedback interaction effect was detected for peak tibial acceleration. The experimental group had a decrease in peak tibial acceleration by 25.5% (mean: 10.9 ± 2.8 g versus 8.1 ± 3.9 g, p = 0.008, d = 1.08, mean difference = 2.77 [0.94, 4.61]) without changing the running cadence. The control group had no statistically significant change in peak tibial acceleration nor in running cadence. CONCLUSION: The retraining protocol was effective at reducing the peak tibial acceleration in high-impact runners by reacting to music-based biofeedback that was provided in real time per wearable technology in a training environment. This reduction magnitude may have meaningful influences on injury risk.

Application of step and beat alignment approaches and its effect on gait in progressive multiple sclerosis with severe cerebellar ataxia: A proof of concept case study.

BACKGROUND: In a case report of a progressive multiple sclerosis with cerebellar impairments, we reported that synchronisation of steps to beats was possible only at -12% of usual walking cadence during 1 minute of walking. OBJECTIVES AND METHODS: Here, we investigate the effect of synchronisation using two different alignment approaches on the patient's gait pattern over 2 minutes of walking, compared to walking in silence. RESULTS AND CONCLUSION: This proof of concept showed that the adaptive approach was successful resulting in an improved gait pattern compared to the other conditions, providing preliminary evidence to support a full-scale intervention study.

Modality-specific attractor dynamics in dyadic entrainment.

Rhythmic joint coordination is ubiquitous in daily-life human activities. In order to coordinate their actions towards shared goals, individuals need to co-regulate their timing and move together at the collective level of behavior. Remarkably, basic forms of coordinated behavior tend to emerge spontaneously as long as two individuals are exposed to each other's rhythmic movements. The present study investigated the dynamics of spontaneous dyadic entrainment, and more specifically how they depend on the sensory modalities mediating informational coupling. By means of a novel interactive paradigm, we showed that dyadic entrainment systematically takes place during a minimalistic rhythmic task despite explicit instructions to ignore the partner. Crucially, the interaction was organized by clear dynamics in a modality-dependent fashion. Our results showed highly consistent coordination patterns in visually-mediated entrainment, whereas we observed more chaotic and more variable profiles in the auditorily-mediated counterpart. The proposed experimental paradigm yields empirical evidence for the overwhelming tendency of dyads to behave as coupled rhythmic units. In the context of our experimental design, it showed that coordination dynamics differ according to availability and nature of perceptual information. Interventions aimed at rehabilitating, teaching or training sensorimotor functions can be ultimately informed and optimized by such fundamental knowledge.