A practical guide to EEG hyperscanning in joint action research: from motivation to implementation.

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos.

Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.

A review of psychological and neuroscientific research on musical groove.

When listening to music, we naturally move our bodies rhythmically to the beat, which can be pleasurable and difficult to resist. This pleasurable sensation of wanting to move the body to music has been called "groove." Following pioneering humanities research, psychological and neuroscientific studies have provided insights on associated musical features, behavioral responses, phenomenological aspects, and brain structural and functional correlates of the groove experience. Groove research has advanced the field of music science and more generally informed our understanding of bidirectional links between perception and action, and the role of the motor system in prediction. Activity in motor and reward-related brain networks during music listening is associated with the groove experience, and this neural activity is linked to temporal prediction and learning. This article reviews research on groove as a psychological phenomenon with neurophysiological correlates that link musical rhythm perception, sensorimotor prediction, and reward processing. Promising future research directions range from elucidating specific neural mechanisms to exploring clinical applications and socio-cultural implications of groove.

You, me, and us: Maintaining self-other distinction enhances coordination, agency, and affect.

Coordinating our actions with others changes how we behave and feel. Here, we provide evidence that interacting with others rests on a balance between self-other integration and segregation. Using a group walking paradigm, participants were instructed to synchronize with a metronome while listening to the sounds of 8 virtual partners. By manipulating the similarity and synchronicity of the partners' steps to the participant's own, our novel auditory task disentangles the effects of synchrony and self-other similarity and examines their contribution to both collective and individual awareness. We measured temporal coordination (step timing regularity and synchrony with the metronome), gait patterns, and subjective reports about sense of self and group cohesion. The main findings show that coordination is best when participants hear distinct but synchronous virtual others, leading to greater subjective feelings of agency, strength, dominance, and happiness.

Sex-related communicative functions of voice spectral energy in human chorusing.

Music is a human communicative art whose evolutionary origins may lie in capacities that support cooperation and/or competition. A mixed account favouring simultaneous cooperation and competition draws on analogous interactive displays produced by collectively signalling non-human animals (e.g. crickets and frogs). In these displays, rhythmically coordinated calls serve as a beacon whereby groups of males 'cooperatively' attract potential female mates, while the likelihood of each male competitively attracting an actual mate depends on the precedence of his signal. Human behaviour consistent with the mixed account was previously observed in a renowned boys choir, where the basses-the oldest boys with the deepest voices-boosted their acoustic prominence by increasing energy in a high-frequency band of the vocal spectrum when girls were in an otherwise male audience. The current study tested female and male sensitivity and preferences for this subtle vocal modulation in online listening tasks. Results indicate that while female and male listeners are similarly sensitive to enhanced high-spectral energy elicited by the presence of girls in the audience, only female listeners exhibit a reliable preference for it. Findings suggest that human chorusing is a flexible form of social communicative behaviour that allows simultaneous group cohesion and sexually motivated competition.

Electrophysiological Activity from the Eye Muscles, Cerebellum and Cerebrum During Reflexive (Classical Pavlovian) Versus Voluntary (Ivanov-Smolensky) Eye-Blink Conditioning.

We report an experiment to investigate the role of the cerebellum and cerebrum in motor learning of timed movements. Eleven healthy human subjects were recruited to perform two experiments, the first was a classical eye-blink conditioning procedure with an auditory tone as conditional stimulus (CS) and vestibular unconditional stimulus (US) in the form of a double head-tap. In the second experiment, subjects were asked to blink voluntarily in synchrony with the double head-tap US preceded by a CS, a form of Ivanov-Smolensky conditioning in which a command or instruction is associated with the US. Electrophysiological recordings were made of extra-ocular EMG and EOG at infra-ocular sites (IO1/2), EEG from over the frontal eye fields (C3'/C4') and from over the posterior fossa over the cerebellum for the electrocerebellogram (ECeG). The behavioural outcomes of the experiments showed weak reflexive conditioning for the first experiment despite the double tap but robust, well-synchronised voluntary conditioning for the second. Voluntary conditioned blinks were larger than the reflex ones. For the voluntary conditioning experiment, a contingent negative variation (CNV) was also present in the EEG leads prior to movement, and modulation of the high-frequency EEG occurred during movement. US-related cerebellar activity was prominent in the high-frequency ECeG for both experiments, while conditioned response-related cerebellar activity was additionally present in the voluntary conditioning experiment. These results demonstrate a role for the cerebellum in voluntary (Ivanov-Smolensky) as well as in reflexive (classical Pavlovian) conditioning.

Extended source analysis of movement related potentials (MRPs) for self-paced hand and foot movements demonstrates opposing cerebral and cerebellar laterality: a preliminary study.

The cerebellum is known to have extensive reciprocal connectivity with the cerebral cortex, including with prefrontal and posterior parietal cortex, which play an important role on the planning and execution of voluntary movement. In the present article we report an exploratory non-invasive electrophysiological study of the activity of the cerebellum and cerebrum during voluntary finger and foot movements. In a sample of five healthy adult subjects, we recorded EEG and the electro-cerebellogram (ECeG) with a 10% cerebellar extension montage during voluntary left and right index finger and foot movements. EMG was recorded from finger extensors and flexors and from the tibialis anterior and soleus muscles and was used to generate triggers for movement related averaging (-2000 to +2000 ms). Source analysis was conducted over five epochs defined relative to EMG onset: whole epoch (-1000 to +1000 ms), pre-move 1000 (-1000 to 0 ms), pre-move 500 (-500 to 0 ms), post-move 500 (0 to +500 ms) and post-move 1000 (0 to +1000 ms). This yielded a total of 123 cerebral and 65 cerebellar dipole clusters from across all epochs, including the pre-movement epochs, which were then subject to statistical analysis. These demonstrated predominantly contralateral dominance for the cerebral clusters, but predominantly ipsilateral dominance for the cerebellar clusters. In addition, both cerebral and cerebellar clusters showed evidence of a somatotopic gradient, medially (X-axis) for the cerebral clusters, and medially and dorso-ventrally (Z-axis) for the cerebellar clusters. These findings support the value of recording cerebellar ECeG and demonstrate its potential to contribute to understanding cerebellar function.

The Neuroscience of Dance: A Conceptual Framework and Systematic Review.

Ancient and culturally universal, dance pervades many areas of life and has multiple benefits. In this article, we provide a conceptual framework and systematic review, as a guide for researching the neuroscience of dance. We identified relevant articles following PRISMA guidelines, and summarised and evaluated all original results. We identified avenues for future research in: the interactive and collective aspects of dance; groove; dance performance; dance observation; and dance therapy. Furthermore, the interactive and collective aspects of dance constitute a vital part of the field but have received almost no attention from a neuroscientific perspective so far. Dance and music engage overlapping brain networks, including common regions involved in perception, action, and emotion. In music and dance, rhythm, melody, and harmony are processed in an active, sustained pleasure cycle giving rise to action, emotion, and learning, led by activity in specific hedonic brain networks. The neuroscience of dance is an exciting field, which may yield information concerning links between psychological processes and behaviour, human flourishing, and the concept of eudaimonia.

Measuring rhythms of vocal interactions: a proof of principle in harbour seal pups.

Rhythmic patterns in interactive contexts characterize human behaviours such as conversational turn-taking. These timed patterns are also present in other animals, and often described as rhythm. Understanding fine-grained temporal adjustments in interaction requires complementary quantitative methodologies. Here, we showcase how vocal interactive rhythmicity in a non-human animal can be quantified using a multi-method approach. We record vocal interactions in harbour seal pups (Phoca vitulina) under controlled conditions. We analyse these data by combining analytical approaches, namely categorical rhythm analysis, circular statistics and time series analyses. We test whether pups' vocal rhythmicity varies across behavioural contexts depending on the absence or presence of a calling partner. Four research questions illustrate which analytical approaches are complementary versus orthogonal. For our data, circular statistics and categorical rhythms suggest that a calling partner affects a pup's call timing. Granger causality suggests that pups predictively adjust their call timing when interacting with a real partner. Lastly, the ADaptation and Anticipation Model estimates statistical parameters for a potential mechanism of temporal adaptation and anticipation. Our analytical complementary approach constitutes a proof of concept; it shows feasibility in applying typically unrelated techniques to seals to quantify vocal rhythmic interactivity across behavioural contexts. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Brain networks for temporal adaptation, anticipation, and sensory-motor integration in rhythmic human behavior.

Human interaction often requires the precise yet flexible interpersonal coordination of rhythmic behavior, as in group music making. The present fMRI study investigates the functional brain networks that may facilitate such behavior by enabling temporal adaptation (error correction), prediction, and the monitoring and integration of information about 'self' and the external environment. Participants were required to synchronize finger taps with computer-controlled auditory sequences that were presented either at a globally steady tempo with local adaptations to the participants' tap timing (Virtual Partner task) or with gradual tempo accelerations and decelerations but without adaptation (Tempo Change task). Connectome-based predictive modelling was used to examine patterns of brain functional connectivity related to individual differences in behavioral performance and parameter estimates from the adaptation and anticipation model (ADAM) of sensorimotor synchronization for these two tasks under conditions of varying cognitive load. Results revealed distinct but overlapping brain networks associated with ADAM-derived estimates of temporal adaptation, anticipation, and the integration of self-controlled and externally controlled processes across task conditions. The partial overlap between ADAM networks suggests common hub regions that modulate functional connectivity within and between the brain's resting-state networks and additional sensory-motor regions and subcortical structures in a manner reflecting coordination skill. Such network reconfiguration might facilitate sensorimotor synchronization by enabling shifts in focus on internal and external information, and, in social contexts requiring interpersonal coordination, variations in the degree of simultaneous integration and segregation of these information sources in internal models that support self, other, and joint action planning and prediction.

Electrophysiological activity from over the cerebellum and cerebrum during eye blink conditioning in human subjects.

We report the results of an experiment in which electrophysiological activity was recorded from the human cerebellum and cerebrum in a sample of 14 healthy subjects before, during and after a classical eye blink conditioning procedure with an auditory tone as conditional stimulus and a maxillary nerve unconditional stimulus. The primary aim was to show changes in the cerebellum and cerebrum correlated with behavioral ocular responses. Electrodes recorded EMG and EOG at peri-ocular sites, EEG from over the frontal eye-fields and the electrocerebellogram (ECeG) from over the posterior fossa. Of the 14 subjects half strongly conditioned while the other half were resistant. We confirmed that conditionability was linked under our conditions to the personality dimension of extraversion-introversion. Inhibition of cerebellar activity was shown prior to the conditioned response, as predicted by Albus (1971). However, pausing in high frequency ECeG and the appearance of a contingent negative variation (CNV) in both central leads occurred in all subjects. These led us to conclude that while conditioned cerebellar pausing may be necessary, it is not sufficient alone to produce overt behavioral conditioning, implying the existence of another central mechanism. The outcomes of this experiment indicate the potential value of the noninvasive electrophysiology of the cerebellum.

Neural tracking of visual periodic motion.

Periodicity is a fundamental property of biological systems, including human movement systems. Periodic movements support displacements of the body in the environment as well as interactions and communication between individuals. Here, we use electroencephalography (EEG) to investigate the neural tracking of visual periodic motion, and more specifically, the relevance of spatiotemporal information contained at and between their turning points. We compared EEG responses to visual sinusoidal oscillations versus nonlinear Rayleigh oscillations, which are both typical of human movements. These oscillations contain the same spatiotemporal information at their turning points but differ between turning points, with Rayleigh oscillations having an earlier peak velocity, shown to increase an individual's capacity to produce accurately synchronized movements. EEG analyses highlighted the relevance of spatiotemporal information between the turning points by showing that the brain precisely tracks subtle differences in velocity profiles, as indicated by earlier EEG responses for Rayleigh oscillations. The results suggest that the brain is particularly responsive to velocity peaks in visual periodic motion, supporting their role in conveying behaviorally relevant timing information at a neurophysiological level. The results also suggest key functions of neural oscillations in the Alpha and Beta frequency bands, particularly in the right hemisphere. Together, these findings provide insights into the neural mechanisms underpinning the processing of visual periodic motion and the critical role of velocity peaks in enabling proficient visuomotor synchronization.

Spatial and temporal (non)binding of audiovisual rhythms in sensorimotor synchronisation.

Human movement synchronisation with moving objects strongly relies on visual input. However, auditory information also plays an important role, since real environments are intrinsically multimodal. We used electroencephalography (EEG) frequency tagging to investigate the selective neural processing and integration of visual and auditory information during motor tracking and tested the effects of spatial and temporal congruency between audiovisual modalities. EEG was recorded while participants tracked with their index finger a red flickering (rate fV = 15 Hz) dot oscillating horizontally on a screen. The simultaneous auditory stimulus was modulated in pitch (rate fA = 32 Hz) and lateralised between left and right audio channels to induce perception of a periodic displacement of the sound source. Audiovisual congruency was manipulated in terms of space in Experiment 1 (no motion, same direction or opposite direction), and timing in Experiment 2 (no delay, medium delay or large delay). For both experiments, significant EEG responses were elicited at fV and fA tagging frequencies. It was also hypothesised that intermodulation products corresponding to the nonlinear integration of visual and auditory stimuli at frequencies fV ± fA would be elicited, due to audiovisual integration, especially in Congruent conditions. However, these components were not observed. Moreover, synchronisation and EEG results were not influenced by congruency manipulations, which invites further exploration of the conditions which may modulate audiovisual processing and the motor tracking of moving objects.

Infants show enhanced neural responses to musical meter frequencies beyond low-level features.

Music listening often entails spontaneous perception and body movement to a periodic pulse-like meter. There is increasing evidence that this cross-cultural ability relates to neural processes that selectively enhance metric periodicities, even when these periodicities are not prominent in the acoustic stimulus. However, whether these neural processes emerge early in development remains largely unknown. Here, we recorded the electroencephalogram (EEG) of 20 healthy 5- to 6-month-old infants, while they were exposed to two rhythms known to induce the perception of meter consistently across Western adults. One rhythm contained prominent acoustic periodicities corresponding to the meter, whereas the other rhythm did not. Infants showed significantly enhanced representations of meter periodicities in their EEG responses to both rhythms. This effect is unlikely to reflect the tracking of salient acoustic features in the stimulus, as it was observed irrespective of the prominence of meter periodicities in the audio signals. Moreover, as previously observed in adults, the neural enhancement of meter was greater when the rhythm was delivered by low-pitched sounds. Together, these findings indicate that the endogenous enhancement of metric periodicities beyond low-level acoustic features is a neural property that is already present soon after birth. These high-level neural processes could set the stage for internal representations of musical meter that are critical for human movement coordination during rhythmic musical behavior. RESEARCH HIGHLIGHTS: 5- to 6-month-old infants were presented with auditory rhythms that induce the perception of a periodic pulse-like meter in adults. Infants showed selective enhancement of EEG activity at meter-related frequencies irrespective of the prominence of these frequencies in the stimulus. Responses at meter-related frequencies were boosted when the rhythm was conveyed by bass sounds. High-level neural processes that transform rhythmic auditory stimuli into internal meter templates emerge early after birth.

Cortico-cerebellar audio-motor regions coordinate self and other in musical joint action.

Joint music performance requires flexible sensorimotor coordination between self and other. Cognitive and sensory parameters of joint action-such as shared knowledge or temporal (a)synchrony-influence this coordination by shifting the balance between self-other segregation and integration. To investigate the neural bases of these parameters and their interaction during joint action, we asked pianists to play on an MR-compatible piano, in duet with a partner outside of the scanner room. Motor knowledge of the partner's musical part and the temporal compatibility of the partner's action feedback were manipulated. First, we found stronger activity and functional connectivity within cortico-cerebellar audio-motor networks when pianists had practiced their partner's part before. This indicates that they simulated and anticipated the auditory feedback of the partner by virtue of an internal model. Second, we observed stronger cerebellar activity and reduced behavioral adaptation when pianists encountered subtle asynchronies between these model-based anticipations and the perceived sensory outcome of (familiar) partner actions, indicating a shift towards self-other segregation. These combined findings demonstrate that cortico-cerebellar audio-motor networks link motor knowledge and other-produced sounds depending on cognitive and sensory factors of the joint performance, and play a crucial role in balancing self-other integration and segregation.

Lateralised dynamic modulations of corticomuscular coherence associated with bimanual learning of rhythmic patterns.

Human movements are spontaneously attracted to auditory rhythms, triggering an automatic activation of the motor system, a central phenomenon to music perception and production. Cortico-muscular coherence (CMC) in the theta, alpha, beta and gamma frequencies has been used as an index of the synchronisation between cortical motor regions and the muscles. Here we investigated how learning to produce a bimanual rhythmic pattern composed of low- and high-pitch sounds affects CMC in the beta frequency band. Electroencephalography (EEG) and electromyography (EMG) from the left and right First Dorsal Interosseus and Flexor Digitorum Superficialis muscles were concurrently recorded during constant pressure on a force sensor held between the thumb and index finger while listening to the rhythmic pattern before and after a bimanual training session. During the training, participants learnt to produce the rhythmic pattern guided by visual cues by pressing the force sensors with their left or right hand to produce the low- and high-pitch sounds, respectively. Results revealed no changes after training in overall beta CMC or beta oscillation amplitude, nor in the correlation between the left and right sides for EEG and EMG separately. However, correlation analyses indicated that left- and right-hand beta EEG-EMG coherence were positively correlated over time before training but became uncorrelated after training. This suggests that learning to bimanually produce a rhythmic musical pattern reinforces lateralised and segregated cortico-muscular communication.

Neural Correlates of Listening to Varying Synchrony Between Beats in Samba Percussion and Relations to Feeling the Groove.

Listening to samba percussion often elicits feelings of pleasure and the desire to move with the beat-an experience sometimes referred to as "feeling the groove"- as well as social connectedness. Here we investigated the effects of performance timing in a Brazilian samba percussion ensemble on listeners' experienced pleasantness and the desire to move/dance in a behavioral experiment, as well as on neural processing as assessed via functional magnetic resonance imaging (fMRI). Participants listened to different excerpts of samba percussion produced by multiple instruments that either were "in sync", with no additional asynchrony between instrumental parts other than what is usual in naturalistic recordings, or were presented "out of sync" by delaying the snare drums (by 28, 55, or 83 ms). Results of the behavioral experiment showed increasing pleasantness and desire to move/dance with increasing synchrony between instruments. Analysis of hemodynamic responses revealed stronger bilateral brain activity in the supplementary motor area, the left premotor area, and the left middle frontal gyrus with increasing synchrony between instruments. Listening to "in sync" percussion thus strengthens audio-motor interactions by recruiting motor-related brain areas involved in rhythm processing and beat perception to a higher degree. Such motor related activity may form the basis for "feeling the groove" and the associated desire to move to music. Furthermore, in an exploratory analysis we found that participants who reported stronger emotional responses to samba percussion in everyday life showed higher activity in the subgenual cingulate cortex, an area involved in prosocial emotions, social group identification and social bonding.