Distinct and common mechanisms of cross-model semantic conflict and response conflict in an auditory relevant task.

The mechanisms of semantic conflict and response conflict in the Stroop task have mainly been investigated in the visual modality. However, the understanding of these mechanisms in cross-modal modalities remains limited. In this electroencephalography (EEG) study, an audiovisual 2-1 mapping Stroop task was utilized to investigate whether distinct and/or common neural mechanisms underlie cross-modal semantic conflict and response conflict. The response time data showed significant effects on both cross-modal semantic and response conflicts. Interestingly, the magnitude of semantic conflict was found to be smaller in the fast response time bins than in the slow response time bins, whereas no such difference was observed for response conflict. The EEG data demonstrated that cross-modal semantic conflict specifically increased the N450 amplitude. However, cross-modal response conflict specifically enhanced theta band power and theta phase synchronization between the medial frontal cortex (MFC) and lateral prefrontal electrodes as well as between the MFC and motor electrodes. In addition, both cross-modal semantic conflict and response conflict led to a decrease in P3 amplitude. Taken together, these findings provide cross-modal evidence for domain-specific mechanism in conflict detection and suggest both domain-specific and domain-general mechanisms exist in conflict resolution.

Socializing Sensorimotor Contingencies.

The aim of this review is to highlight the idea of grounding social cognition in sensorimotor interactions shared across agents. We discuss an action-oriented account that emerges from a broader interpretation of the concept of sensorimotor contingencies. We suggest that dynamic informational and sensorimotor coupling across agents can mediate the deployment of action-effect contingencies in social contexts. We propose this concept of socializing sensorimotor contingencies (socSMCs) as a shared framework of analysis for processes within and across brains and bodies, and their physical and social environments. In doing so, we integrate insights from different fields, including neuroscience, psychology, and research on human-robot interaction. We review studies on dynamic embodied interaction and highlight empirical findings that suggest an important role of sensorimotor and informational entrainment in social contexts. Furthermore, we discuss links to closely related concepts, such as enactivism, models of coordination dynamics and others, and clarify differences to approaches that focus on mentalizing and high-level cognitive representations. Moreover, we consider conceptual implications of rethinking cognition as social sensorimotor coupling. The insight that social cognitive phenomena like joint attention, mutual trust or empathy rely heavily on the informational and sensorimotor coupling between agents may provide novel remedies for people with disturbed social cognition and for situations of disturbed social interaction. Furthermore, our proposal has potential applications in the field of human-robot interaction where socSMCs principles might lead to more natural and intuitive interfaces for human users.

Modality-specific neural mechanisms of cognitive control in a Stroop-like task.

The successful resolution of ever-changing conflicting contexts requires efficient cognitive control. Previous studies have found similar neural patterns in conflict processing for different modalities using an event-related potential (ERP) approach and have concluded that cognitive control is supramodal. However, recent behavioral studies have found that conflict adaptation (a phenomenon with the reduction of congruency effect in the current trial after an incongruent trial as compared with a congruent trial) could not transfer across visual and auditory modalities and suggested that cognitive control is modality-specific, challenging the supramodal view. These discrepancies may have also arisen from methodological differences across studies. The current study examined the electroencephalographic profiles of a Stroop-like task to elucidate the modality-specific neural mechanisms of cognitive control. Participants were instructed to respond to a target always coming from the visual modality while disregarding the distractor coming from either the auditory or the visual modality. The results revealed significant congruency effects on both behavioral indices, i.e., reaction time and error rate, and ERP components, including the P3 and the conflict slow potential. Besides, the congruency effects on the amplitude of the P3 showed a negative correlation with reaction time, indicating an intrinsic link between these neural and behavioral indices. Furthermore, in the modality-repetition condition, conflict adaptation effects were significant on both reaction time and P3 amplitude, and the reaction time could be predicted by the P3 amplitude, while such effects were not observed in the modality-alternation condition. The time-frequency analysis also showed that conflict adaptation occurred in the modality-repetition condition, but not in the modality-alternation condition in low frequency bands, including the theta (4-8 Hz), alpha (8-12 Hz), and beta1 (12-20 Hz) bands. Taken together, our results revealed modality-specific patterns of the conflict adaptation effects on the P3 amplitude and oscillatory power (in theta, alpha, and beta1 bands), providing neural evidence for the modality specificity of cognitive control and expanding the boundaries of cognitive control.

Crossmodal Congruency Enhances Performance of Healthy Older Adults in Visual-Tactile Pattern Matching.

One of the pivotal challenges of aging is to maintain independence in the activities of daily life. In order to adapt to changes in the environment, it is crucial to continuously process and accurately combine simultaneous input from different sensory systems, i.e., crossmodal or multisensory integration. With aging, performance decreases in multiple domains, affecting bottom-up sensory processing as well as top-down control. However, whether this decline leads to impairments in crossmodal interactions remains an unresolved question. While some researchers propose that crossmodal interactions degrade with age, others suggest that they are conserved or even gain compensatory importance. To address this question, we compared the behavioral performance of older and young participants in a well-established crossmodal matching task, requiring the evaluation of congruency in simultaneously presented visual and tactile patterns. Older participants performed significantly worse than young controls in the crossmodal task when being stimulated at their individual unimodal visual and tactile perception thresholds. Performance increased with adjustment of stimulus intensities. This improvement was driven by better detection of congruent stimulus pairs, while the detection of incongruent pairs was not significantly enhanced. These results indicate that age-related impairments lead to poor performance in complex crossmodal scenarios and demanding cognitive tasks. Crossmodal congruency effects attenuate the difficulties of older adults in visuotactile pattern matching and might be an important factor to drive the benefits of older adults demonstrated in various crossmodal integration scenarios. Congruency effects might, therefore, be used to develop strategies for cognitive training and neurological rehabilitation.

Sensory capability and information integration independently explain the cognitive status of healthy older adults.

While there is evidence that sensory processing and multisensory integration change with age, links between these alterations and their relation to cognitive status remain unclear. In this study, we assessed sensory thresholds and performance of healthy younger and older adults in a visuotactile delayed match-to-sample task. Using Bayesian structural equation modelling (BSEM), we explored the factors explaining cognitive status in the group of older adults. Additionally, we applied transcranial alternating current stimulation (tACS) to a parieto-central network found to underlie visuotactile interactions and working memory matching in our previous work. Response times and signal detection measures indicated enhanced multisensory integration and enhanced benefit from successful working memory matching in older adults. Further, tACS caused a frequency-specific speeding (20 Hz) and delaying (70 Hz) of responses. Data exploration suggested distinct underlying factors for sensory acuity and sensitivity d' on the one side, and multisensory and working memory enhancement on the other side. Finally, BSEM showed that these two factors labelled 'sensory capability' and 'information integration' independently explained cognitive status. We conclude that sensory decline and enhanced information integration might relate to distinct processes of ageing and discuss a potential role of the parietal cortex in mediating augmented integration in older adults.

Long-range functional coupling predicts performance: Oscillatory EEG networks in multisensory processing.

The integration of sensory signals from different modalities requires flexible interaction of remote brain areas. One candidate mechanism to establish communication in the brain is transient synchronization of oscillatory neural signals. Although there is abundant evidence for the involvement of cortical oscillations in brain functions based on the analysis of local power, assessment of the phase dynamics among spatially distributed neuronal populations and their relevance for behavior is still sparse. In the present study, we investigated the interaction between remote brain areas by analyzing high-density electroencephalogram (EEG) data obtained from human participants engaged in a visuotactile pattern matching task. We deployed an approach for purely data-driven clustering of neuronal phase coupling in source space, which allowed imaging of large-scale functional networks in space, time and frequency without defining a priori constraints. Based on the phase coupling results, we further explored how brain areas interacted across frequencies by computing phase-amplitude coupling. Several networks of interacting sources were identified with our approach, synchronizing their activity within and across the theta (∼5 Hz), alpha (∼10 Hz), and beta (∼20 Hz) frequency bands and involving multiple brain areas that have previously been associated with attention and motor control. We demonstrate the functional relevance of these networks by showing that phase delays - in contrast to spectral power - were predictive of task performance. The data-driven analysis approach employed in the current study allowed an unbiased examination of functional brain networks based on EEG source level connectivity data. Showcased for multisensory processing, our results provide evidence that large-scale neuronal coupling is vital to long-range communication in the human brain and relevant for the behavioral outcome in a cognitive task.

Oscillatory brain activity during multisensory attention reflects activation, disinhibition, and cognitive control.

In this study, we used a novel multisensory attention paradigm to investigate attention-modulated cortical oscillations over a wide range of frequencies using magnetencephalography in healthy human participants. By employing a task that required the evaluation of the congruence of audio-visual stimuli, we promoted the formation of widespread cortical networks including early sensory cortices as well as regions associated with cognitive control. We found that attention led to increased high-frequency gamma-band activity and decreased lower frequency theta-, alpha-, and beta-band activity in early sensory cortex areas. Moreover, alpha-band coherence decreased in visual cortex. Frontal cortex was found to exert attentional control through increased low-frequency phase synchronisation. Crossmodal congruence modulated beta-band coherence in mid-cingulate and superior temporal cortex. Together, these results offer an integrative view on the concurrence of oscillations at different frequencies during multisensory attention.

Oscillatory signatures of crossmodal congruence effects: An EEG investigation employing a visuotactile pattern matching paradigm.

Coherent percepts emerge from the accurate combination of inputs from the different sensory systems. There is an ongoing debate about the neurophysiological mechanisms of crossmodal interactions in the brain, and it has been proposed that transient synchronization of neurons might be of central importance. Oscillatory activity in lower frequency ranges (<30Hz) has been implicated in mediating long-range communication as typically studied in multisensory research. In the current study, we recorded high-density electroencephalograms while human participants were engaged in a visuotactile pattern matching paradigm and analyzed oscillatory power in the theta- (4-7Hz), alpha- (8-13Hz) and beta-bands (13-30Hz). Employing the same physical stimuli, separate tasks of the experiment either required the detection of predefined targets in visual and tactile modalities or the explicit evaluation of crossmodal stimulus congruence. Analysis of the behavioral data showed benefits for congruent visuotactile stimulus combinations. Differences in oscillatory dynamics related to crossmodal congruence within the two tasks were observed in the beta-band for crossmodal target detection, as well as in the theta-band for congruence evaluation. Contrasting ongoing activity preceding visuotactile stimulation between the two tasks revealed differences in the alpha- and beta-bands. Source reconstruction of between-task differences showed prominent involvement of premotor cortex, supplementary motor area, somatosensory association cortex and the supramarginal gyrus. These areas not only exhibited more involvement in the pre-stimulus interval for target detection compared to congruence evaluation, but were also crucially involved in post-stimulus differences related to crossmodal stimulus congruence within the detection task. These results add to the increasing evidence that low frequency oscillations are functionally relevant for integration in distributed brain networks, as demonstrated for crossmodal interactions in visuotactile pattern matching in the current study.

Attention modulates visual-tactile interaction in spatial pattern matching.

Factors influencing crossmodal interactions are manifold and operate in a stimulus-driven, bottom-up fashion, as well as via top-down control. Here, we evaluate the interplay of stimulus congruence and attention in a visual-tactile task. To this end, we used a matching paradigm requiring the identification of spatial patterns that were concurrently presented visually on a computer screen and haptically to the fingertips by means of a Braille stimulator. Stimulation in our paradigm was always bimodal with only the allocation of attention being manipulated between conditions. In separate blocks of the experiment, participants were instructed to (a) focus on a single modality to detect a specific target pattern, (b) pay attention to both modalities to detect a specific target pattern, or (c) to explicitly evaluate if the patterns in both modalities were congruent or not. For visual as well as tactile targets, congruent stimulus pairs led to quicker and more accurate detection compared to incongruent stimulation. This congruence facilitation effect was more prominent under divided attention. Incongruent stimulation led to behavioral decrements under divided attention as compared to selectively attending a single sensory channel. Additionally, when participants were asked to evaluate congruence explicitly, congruent stimulation was associated with better performance than incongruent stimulation. Our results extend previous findings from audiovisual studies, showing that stimulus congruence also resulted in behavioral improvements in visuotactile pattern matching. The interplay of stimulus processing and attentional control seems to be organized in a highly flexible fashion, with the integration of signals depending on both bottom-up and top-down factors, rather than occurring in an 'all-or-nothing' manner.

Agency matters! Social preferences in the three-person ultimatum game.

In the present study EEG was recorded simultaneously while two participants were playing the three-person ultimatum game (UG). Both participants received different offers from changing proposers about how to split up a certain amount of money between the three players. One of the participants had no say, whereas the other, the responder, was able to harm the payoff of all other players. The aim of the study was to investigate how the outcomes of the respective other are evaluated by participants who were treated fairly or unfairly themselves and to what extent agency influences concerns for fairness. Analyses were focused on the medial frontal negativity (MFN) as an early index for subjective value assignment. Recipients with veto-power exhibited enhanced, more negative-going, MFN amplitudes following proposals that comprised a low share for both recipients, suggesting that responders favored offers with a fair amount to at least one of the two players. Though, the powerless players cared about the amount assigned to the responder, MFN amplitudes were larger following fair compared to unfair offers assigned to the responder. Similarly, concerns for fairness which determined the amplitude of the MFN, suggested that the powerless players exhibited negative and conversely the responders, positive social preferences.