Neural entrainment underpins sensorimotor synchronization to dynamic rhythmic stimuli.

Neural entrainment, defined as unidirectional synchronization of neural oscillations to an external rhythmic stimulus, is a topic of major interest in the field of neuroscience. Despite broad scientific consensus on its existence, on its pivotal role in sensory and motor processes, and on its fundamental definition, empirical research struggles in quantifying it with non-invasive electrophysiology. To this date, broadly adopted state-of-the-art methods still fail to capture the dynamic underlying the phenomenon. Here, we present event-related frequency adjustment (ERFA) as a methodological framework to induce and to measure neural entrainment in human participants, optimized for multivariate EEG datasets. By applying dynamic phase and tempo perturbations to isochronous auditory metronomes during a finger-tapping task, we analyzed adaptive changes in instantaneous frequency of entrained oscillatory components during error correction. Spatial filter design allowed us to untangle, from the multivariate EEG signal, perceptual and sensorimotor oscillatory components attuned to the stimulation frequency. Both components dynamically adjusted their frequency in response to perturbations, tracking the stimulus dynamics by slowing down and speeding up the oscillation over time. Source separation revealed that sensorimotor processing enhanced the entrained response, supporting the notion that the active engagement of the motor system plays a critical role in processing rhythmic stimuli. In the case of phase shift, motor engagement was a necessary condition to observe any response, whereas sustained tempo changes induced frequency adjustment even in the perceptual oscillatory component. Although the magnitude of the perturbations was controlled across positive and negative direction, we observed a general bias in the frequency adjustments towards positive changes, which points at the effect of intrinsic dynamics constraining neural entrainment. We conclude that our findings provide compelling evidence for neural entrainment as mechanism underlying overt sensorimotor synchronization, and highlight that our methodology offers a paradigm and a measure for quantifying its oscillatory dynamics by means of non-invasive electrophysiology, rigorously informed by the fundamental definition of entrainment.

Cholinergic-related pupil activity reflects level of emotionality during motor performance.

Pupil size covaries with the diffusion rate of the cholinergic and noradrenergic neurons throughout the brain, which are essential to arousal. Recent findings suggest that slow pupil fluctuations during locomotion are an index of sustained activity in cholinergic axons, whereas phasic dilations are related to the activity of noradrenergic axons. Here, we investigated movement induced arousal (i.e., by singing and swaying to music), hypothesising that actively engaging in musical behaviour will provoke stronger emotional engagement in participants and lead to different qualitative patterns of tonic and phasic pupil activity. A challenge in the analysis of pupil data is the turbulent behaviour of pupil diameter due to exogenous ocular activity commonly encountered during motor tasks and the high variability typically found between individuals. To address this, we developed an algorithm that adaptively estimates and removes pupil responses to ocular events, as well as a functional data methodology, derived from Pfaffs' generalised arousal, that provides a new statistical dimension on how pupil data can be interpreted according to putative neuromodulatory signalling. We found that actively engaging in singing enhanced slow cholinergic-related pupil dilations and having the opportunity to move your body while performing amplified the effect of singing on pupil activity. Phasic pupil oscillations during motor execution attenuated in time, which is often interpreted as a measure of sense of agency over movement.

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography.

Within the broader context of improving interactions between artificial intelligence and humans, the question has arisen regarding whether auditory and rhythmic support could increase attention for visual stimuli that do not stand out clearly from an information stream. To this end, we designed an experiment inspired by pip-and-pop but more appropriate for eliciting attention and P3a-event-related potentials (ERPs). In this study, the aim was to distinguish between targets and distractors based on the subject's electroencephalography (EEG) data. We achieved this objective by employing different machine learning (ML) methods for both individual-subject (IS) and cross-subject (CS) models. Finally, we investigated which EEG channels and time points were used by the model to make its predictions using saliency maps. We were able to successfully perform the aforementioned classification task for both the IS and CS scenarios, reaching classification accuracies up to 76%. In accordance with the literature, the model primarily used the parietal-occipital electrodes between 200 ms and 300 ms after the stimulus to make its prediction. The findings from this research contribute to the development of more effective P300-based brain-computer interfaces. Furthermore, they validate the EEG data collected in our experiment.

Mutual beta power modulation in dyadic entrainment.

Across a broad spectrum of interactions, humans exhibit a prominent tendency to synchronize their movements with one another. Traditionally, this phenomenon has been explained from the perspectives of predictive coding or dynamical systems theory. While these theories diverge with respect to whether individuals hold internal models of each other, they both assume a predictive or anticipatory mechanism enabling rhythmic interactions. However, the neural bases underpinning interpersonal synchronization are still a subject under active investigation. Here we provide evidence that the brain relies on a common oscillatory mechanism to pace self-generated rhythmic movements and to track the movements produced by a partner. By performing dual-electroencephalography recordings during a joint finger-tapping task, we identified an oscillatory component in the beta range (∼ 20 Hz), which was significantly modulated by both self-generated and other-generated movement. In conditions where the partners perceived each other, we observed periodic fluctuations of beta power as a function of the reciprocal movement cycles. Crucially, this modulation occurred both in visually and in auditorily coupled conditions, and was accompanied by recurrent periods of dyadic synchronized behavior. Our results show that periodic beta power modulations may be a critical mechanism underlying interpersonal synchronization, possibly enabling mutual predictions between coupled individuals, leading to co-regulation of timing and overt mutual adaptation. Our findings thus provide a potential bridge between influential theories attempting to explain interpersonal coordination, and a concrete connection to its neurophysiological bases.

Application of step and beat alignment approaches and its effect on gait in progressive multiple sclerosis with severe cerebellar ataxia: A proof of concept case study.

BACKGROUND: In a case report of a progressive multiple sclerosis with cerebellar impairments, we reported that synchronisation of steps to beats was possible only at -12% of usual walking cadence during 1 minute of walking. OBJECTIVES AND METHODS: Here, we investigate the effect of synchronisation using two different alignment approaches on the patient's gait pattern over 2 minutes of walking, compared to walking in silence. RESULTS AND CONCLUSION: This proof of concept showed that the adaptive approach was successful resulting in an improved gait pattern compared to the other conditions, providing preliminary evidence to support a full-scale intervention study.

Reducing the peak tibial acceleration of running by music-based biofeedback: A quasi-randomized controlled trial.

BACKGROUND: Running retraining with the use of biofeedback on an impact measure has been executed or evaluated in the biomechanics laboratory. Here, the execution and evaluation of feedback-driven retraining are taken out of the laboratory. PURPOSE: To determine whether biofeedback can reduce the peak tibial acceleration with or without affecting the running cadence in a 3-week retraining protocol. STUDY DESIGN: Quasi-randomized controlled trial. METHODS: Twenty runners with high peak tibial acceleration were allocated to either the retraining (n = 10, 32.1 ± 7.8 years, 10.9 ± 2.8 g) or control (n = 10, 39.1 ± 10.4 years, 13.0 ± 3.9 g) groups. They performed six running sessions in an athletic training environment. A body-worn system collected axial tibial acceleration and provided real-time feedback. The retraining group received music-based biofeedback in a faded feedback scheme. Pink noise was superimposed on tempo-synchronized music when the peak tibial acceleration was ≥70% of the runner's baseline. The control group received tempo-synchronized music, which acted as a placebo for blinding purposes. Speed feedback was provided to obtain a stable running speed of ~2.9 m·s-1 . Peak tibial acceleration and running cadence were evaluated. RESULTS: A significant group-by-feedback interaction effect was detected for peak tibial acceleration. The experimental group had a decrease in peak tibial acceleration by 25.5% (mean: 10.9 ± 2.8 g versus 8.1 ± 3.9 g, p = 0.008, d = 1.08, mean difference = 2.77 [0.94, 4.61]) without changing the running cadence. The control group had no statistically significant change in peak tibial acceleration nor in running cadence. CONCLUSION: The retraining protocol was effective at reducing the peak tibial acceleration in high-impact runners by reacting to music-based biofeedback that was provided in real time per wearable technology in a training environment. This reduction magnitude may have meaningful influences on injury risk.

Foot strike determines the center of pressure behavior and affects impact severity in heel-toe running.

This study assessed the centre of pressure (COP) behaviour and the relationship with impact severity during heel-toe running in conventional athletic footwear. We hypothesized that the COP behaviour depends on its location at foot strike, which would be associated with the vertical loading rate and peak tibial accelerations in heel-toe running. Ground reaction force and tibial acceleration were measured in 104 distance runners running level at ~3.2 m/s. High-speed plantar pressure captured at high temporal resolution (500 Hz) and spatial resolution (7.62 · 5.08 mm/sensor) allowed for localization of the COP directly in the footprint during running in self-selected athletic footwear. More lateral X-coordinates of the COP at first foot contact had, in general, more anterior Y-coordinates (adj.R2:0.609). In heel-toe running, a more anterior foot strike had a greater refined strike index, which was associated with a quicker roll-over in the rearfoot zone. This strike index contributed to greater maximum vertical loading rates (R2:0.121), and greater axial (R2:0.047) and resultant (R2:0.247) peak tibial accelerations. These findings indicate that (1) the COP progression is dependend on the COP location at foot strike; (2) more anterior rearfoot strikes are more likely to have greater impact severity than posterior rearfoot strikes.

Listener evaluations of violins made from composites.

For centuries, wood, and more specifically spruce, has been the material of choice for violin top plates. Lately, carbon fiber instruments have entered the market. Some studies show that composite materials have potential advantages for making instruments [Damodaran, Lessard, and Babu, Acoust. Aust. 43, 117-122 (2015)]. However, no studies exist that evaluate violins made of different composite materials as judged by listeners. For this study, six prototype violins, differing only by the material of the top plate, were manufactured in a controlled laboratory setting. The six prototype violins were judged by experienced listeners in two double-blind experiments. In contrast to popular opinion that violins made from carbon have or lack a specific sound quality, the study provides insights in the diverse sounds and timbres violins from fiber-reinforced polymers can create. It allows an investigation of the links between the perception and the variations in material properties of the soundboards. Additionally, as neither players nor listeners are acquainted with these instruments, these results provide an interesting view on what type of qualities of violin-like sounds are preferred by listeners.

Change-Point Detection of Peak Tibial Acceleration in Overground Running Retraining.

A method is presented for detecting changes in the axial peak tibial acceleration while adapting to self-discovered lower-impact running. Ten runners with high peak tibial acceleration were equipped with a wearable auditory biofeedback system. They ran on an athletic track without and with real-time auditory biofeedback at the instructed speed of 3.2 m·s-1. Because inter-subject variation may underline the importance of individualized retraining, a change-point analysis was used for each subject. The tuned change-point application detected major and subtle changes in the time series. No changes were found in the no-biofeedback condition. In the biofeedback condition, a first change in the axial peak tibial acceleration occurred on average after 309 running gait cycles (3'40"). The major change was a mean reduction of 2.45 g which occurred after 699 running gait cycles (8'04") in this group. The time needed to achieve the major reduction varied considerably between subjects. Because of the individualized approach to gait retraining and its relatively quick response due to a strong sensorimotor coupling, we want to highlight the potential of a stand-alone biofeedback system that provides real-time, continuous, and auditory feedback in response to the axial peak tibial acceleration for lower-impact running.

Musical agency reduces perceived exertion during strenuous physical performance.

Music is known to be capable of reducing perceived exertion during strenuous physical activity. The current interpretation of this modulating effect of music is that music may be perceived as a diversion from unpleasant proprioceptive sensations that go along with exhaustion. Here we investigated the effects of music on perceived exertion during a physically strenuous task, varying musical agency, a task that relies on the experience of body proprioception, rather than simply diverting from it. For this we measured psychologically indicated exertion during physical workout with and without musical agency while simultaneously acquiring metabolic values with spirometry. Results showed that musical agency significantly decreased perceived exertion during workout, indicating that musical agency may actually facilitate physically strenuous activities. This indicates that the positive effect of music on perceived exertion cannot always be explained by an effect of diversion from proprioceptive feedback. Furthermore, this finding suggests that the down-modulating effect of musical agency on perceived exertion may be a previously unacknowledged driving force for the development of music in humans: making music makes strenuous physical activities less exhausting.

Enhancing human-human musical interaction through kinesthetic haptic feedback using wearable exoskeletons: theoretical foundations, validation scenarios, and limitations.

In this perspective paper, we explore the use of haptic feedback to enhance human-human interaction during musical tasks. We start by providing an overview of the theoretical foundation that underpins our approach, which is rooted in the embodied music cognition framework, and by briefly presenting the concepts of action-perception loop, sensorimotor coupling and entrainment. Thereafter, we focus on the role of haptic information in music playing and we discuss the use of wearable technologies, namely lightweight exoskeletons, for the exchange of haptic information between humans. We present two experimental scenarios in which the effectiveness of this technology for enhancing musical interaction and learning might be validated. Finally, we briefly discuss some of the theoretical and pedagogical implications of the use of technologies for haptic communication in musical contexts, while also addressing the potential barriers to the widespread adoption of exoskeletons in such contexts.

Anatomical differences in the human inferior colliculus relate to the perceived valence of musical consonance and dissonance.

Helmholtz himself speculated about a role of the cochlea in the perception of musical dissonance. Here we indirectly investigated this issue, assessing the valence judgment of musical stimuli with variable consonance/dissonance and presented diotically (exactly the same dissonant signal was presented to both ears) or dichotically (a consonant signal was presented to each ear--both consonant signals were rhythmically identical but differed by a semitone in pitch). Differences in brain organisation underlying inter-subject differences in the percept of dichotically presented dissonance were determined with voxel-based morphometry. Behavioral results showed that diotic dissonant stimuli were perceived as more unpleasant than dichotically presented dissonance, indicating that interactions within the cochlea modulated the valence percept during dissonance. However, the behavioral data also suggested that the dissonance percept did not depend crucially on the cochlea, but also occurred as a result of binaural integration when listening to dichotic dissonance. These results also showed substantial between-participant variations in the valence response to dichotic dissonance. These differences were in a voxel-based morphometry analysis related to differences in gray matter density in the inferior colliculus, which strongly substantiated a key role of the inferior colliculus in consonance/dissonance representation in humans.

Auditory perception of note transitions in simulated complex bowing patterns.

Recent motion-capture measurements of violin bowing revealed an interesting coordination behavior in fast repetitive bowing patterns involving bow changes and string crossings; bow changes were consistently lagging behind string crossings, and the relative timing appeared to be an integral part of the bow-movement patterns. The aim of the current study was to investigate if there might be a perceptual explanation for the observed coordination behavior. For this purpose a virtual violin was used, controlled by simulated bowing gestures. A simplified coordination model is presented, which was implemented to allow real-time control of complex bowing patterns. This synthesis approach was employed in a perceptual experiment in which the participants were asked to optimize the sound by adjusting a slider controlling the main coordination parameters. It was found that the resulting coordination patterns were similar to those observed in performance, implying that complex bowing trajectories for an important part emerge from auditory-motor interaction. Further analysis of the responses shed light on temporal and spatial constraints of the simulated gestures associated with the note transitions. The results raise interesting questions with regard to auditory-motor interaction in complex instrumental control gestures.

Influence of musical context on sensorimotor synchronization in classical ballet solo dance.

Several studies have addressed motor coordination in dance, but few have addressed the influence of musical context on micro-timing during sensorimotor synchronization (SMS) in classical ballet. In this study, we analyze the Promenade in Arabesque of the Odile variations, first as a dance-music fragment non-embedded in a musical context, then as a dance-music fragment embedded in a musical context at two different instances. Given the musical structure of the fragments, there are repeats of patterns between and within the fragments. Four dancers were invited to perform the three fragments in twelve successive performances. The beats of the music were extracted and compared with the timing of the dancers' heel movements, using circular-linear smooth regression modelling, and circular statistics. The results reveal an effect of repeat within fragments, and an effect of musical context between fragments, on micro-timing anticipation in SMS. The methodology offers a framework for future work on dynamical aspects of SMS.

Embodied perspective-taking enhances interpersonal synchronization: A body-swap study.

Humans exhibit a strong tendency to synchronize movements with each other, with visual perspective potentially influencing interpersonal synchronization. By manipulating the visual scenes of participants engaged in a joint finger-tapping task, we examined the effects of 1st person and 2nd person visual perspectives on their coordination dynamics. We hypothesized that perceiving the partner's movements from their 1st person perspective would enhance spontaneous interpersonal synchronization, potentially mediated by the embodiment of the partner's hand. We observed significant differences in attractor dynamics across visual perspectives. Specifically, participants in 1st person coupling were unable to maintain de-coupled trajectories as effectively as in 2nd person coupling. Our findings suggest that visual perspective influences coordination dynamics in dyadic interactions, engaging error-correction mechanisms in individual brains as they integrate the partner's hand into their body representation. Our results have the potential to inform the development of applications for motor training and rehabilitation.

Knee flexion of saxophone players anticipates tonal context of music.

Music performance requires high levels of motor control. Professional musicians use body movements not only to accomplish and help technical efficiency, but to shape expressive interpretation. Here, we recorded motion and audio data of twenty participants performing four musical fragments varying in the degree of technical difficulty to analyze how knee flexion is employed by expert saxophone players. Using a computational model of the auditory periphery, we extracted emergent acoustical properties of sound to inference critical cognitive patterns of music processing and relate them to motion data. Results showed that knee flexion is causally linked to tone expectations and correlated to rhythmical density, suggesting that this gesture is associated with expressive and facilitative purposes. Furthermore, when instructed to play immobile, participants tended to microflex (>1 Hz) more frequently compared to when playing expressively, possibly indicating a natural urge to move to the music. These results underline the robustness of body movement in musical performance, providing valuable insights for the understanding of communicative processes, and development of motor learning cues.

Auditory attention measured by EEG in neurological populations: systematic review of literature and meta-analysis.

Sensorimotor synchronization strategies have been frequently used for gait rehabilitation in different neurological populations. Despite these positive effects on gait, attentional processes required to dynamically attend to the auditory stimuli needs elaboration. Here, we investigate auditory attention in neurological populations compared to healthy controls quantified by EEG recordings. Literature was systematically searched in databases PubMed and Web of Science. Inclusion criteria were investigation of auditory attention quantified by EEG recordings in neurological populations in cross-sectional studies. In total, 35 studies were included, including participants with Parkinson's disease (PD), stroke, Traumatic Brain Injury (TBI), Multiple Sclerosis (MS), Amyotrophic Lateral Sclerosis (ALS). A meta-analysis was performed on P3 amplitude and latency separately to look at the differences between neurological populations and healthy controls in terms of P3 amplitude and latency. Overall, neurological populations showed impairments in auditory processing in terms of magnitude and delay compared to healthy controls. Consideration of individual auditory processes and thereafter selecting and/or designing the auditory structure during sensorimotor synchronization paradigms in neurological physical rehabilitation is recommended.

The assessment of presence and performance in an AR environment for motor imitation learning: A case-study on violinists.

The acquisition of advanced gestures is a challenge in various domains of proficient sensorimotor performance. For example, orchestral violinists must move in sync with the lead violinist's gestures. To help train these gestures, an educational music play-back system was developed using a HoloLens 2 simulated AR environment and an avatar representation of the lead violinist. This study aimed to investigate the impact of using a 2D or 3D representation of the lead violinist's avatar on students' learning experience in the AR environment. To assess the learning outcome, the study employed a longitudinal experiment design, in which eleven participants practiced two pieces of music in four trials, evenly spaced over a month. Participants were asked to mimic the avatar's gestures as closely as possible when it came to using the bow, including bowing, articulations, and dynamics. The study compared the similarities between the avatar's gestures and those of the participants at the biomechanical level, using motion capture measurements, as well as the smoothness of the participants' movements. Additionally, presence and perceived difficulty were assessed using questionnaires. The results suggest that using a 3D representation of the avatar leads to better gesture resemblance and a higher experience of presence compared to a 2D representation. The 2D representation, however, showed a learning effect, but this was not observed in the 3D condition. The findings suggest that the 3D condition benefits from stereoscopic information that enhances spatial cognition, making it more effective in relation to sensorimotor performance. Overall, the 3D condition had a greater impact on performance than on learning. This work concludes with recommendations for future efforts directed towards AR-based advanced gesture training to address the challenges related to measurement methodology and participants' feedback on the AR application.

With No Attention Specifically Directed to It, Rhythmic Sound Does Not Automatically Facilitate Visual Task Performance.

In a century where humans and machines-powered by artificial intelligence or not-increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography (EEG), should be recorded. This approach can be subject to a future work.