Feeling of Ownership over an Embodied Avatar's Hand Brings About Fast Changes of Fronto-Parietal Cortical Dynamics.

When we look at our body parts, we are immediately aware that they belong to us and we rarely doubt about the integrity, continuity, and sense of ownership of our body. Despite this certainty, immersive virtual reality (IVR) may lead to a strong feeling of embodiment over an artificial body part seen from a first-person perspective (1PP). Although such feeling of ownership (FO) has been described in different situations, it is not yet understood how this phenomenon is generated at neural level. To track the real-time brain dynamics associated with FO, we delivered transcranial magnetic stimuli over the hand region in the primary motor cortex (M1) and simultaneously recorded electroencephalography (EEG) in 19 healthy volunteers (11 male/8 female) watching IVR renderings of anatomically plausible (full-limb) versus implausible (hand disconnected from the forearm) virtual limbs. Our data show that embodying a virtual hand is temporally associated with a rapid drop of cortical activity of the onlookers' hand region in the M1 contralateral to the observed hand. Spatiotemporal analysis shows that embodying the avatar's hand is also associated with fast changes of activity within an interconnected fronto-parietal circuit ipsilateral to the brain stimulation. Specifically, an immediate reduction of connectivity with the premotor area is paralleled by an enhancement in the connectivity with the posterior parietal cortex (PPC) which is related to the strength of ownership illusion ratings and thus likely reflects conscious feelings of embodiment. Our results suggest that changes of bodily representations are underpinned by a dynamic cross talk within a highly-plastic, fronto-parietal network.SIGNIFICANCE STATEMENT Observing an avatar's body part from a first-person perspective (1PP) induces an illusory embodiment over it. What remains unknown are the cortical dynamics underpinning the embodiment of artificial agents. To shed light on the physiological mechanisms of embodiment we used a novel approach that combines noninvasive stimulation of the cortical motor-hand area and whole-scalp electroencephalographic (EEG) recordings in people observing an embodied artificial limb. We found that just before the illusion started, there is a decrease of activity of the motor-hand area accompanied by an increase of connectivity with the parietal region ipsilateral to the stimulation that reflects the ratings of the embodiment illusion. Our results suggest that changes of bodily representations are underpinned by a dynamic cross talk within a fronto-parietal circuit.

Embodying Others in Immersive Virtual Reality: Electro-Cortical Signatures of Monitoring the Errors in the Actions of an Avatar Seen from a First-Person Perspective.

Brain monitoring of errors in one's own and other's actions is crucial for a variety of processes, ranging from the fine-tuning of motor skill learning to important social functions, such as reading out and anticipating the intentions of others. Here, we combined immersive virtual reality and EEG recording to explore whether embodying the errors of an avatar by seeing it from a first-person perspective may activate the error monitoring system in the brain of an onlooker. We asked healthy participants to observe, from a first- or third-person perspective, an avatar performing a correct or an incorrect reach-to-grasp movement toward one of two virtual mugs placed on a table. At the end of each trial, participants reported verbally how much they embodied the avatar's arm. Ratings were maximal in first-person perspective, indicating that immersive virtual reality can be a powerful tool to induce embodiment of an artificial agent, even through mere visual perception and in the absence of any cross-modal boosting. Observation of erroneous grasping from a first-person perspective enhanced error-related negativity and medial-frontal theta power in the trials where human onlookers embodied the virtual character, hinting at the tight link between early, automatic coding of error detection and sense of embodiment. Error positivity was similar in 1PP and 3PP, suggesting that conscious coding of errors is similar for self and other. Thus, embodiment plays an important role in activating specific components of the action monitoring system when others' errors are coded as if they are one's own errors. SIGNIFICANCE STATEMENT: Detecting errors in other's actions is crucial for social functions, such as reading out and anticipating the intentions of others. Using immersive virtual reality and EEG recording, we explored how the brain of an onlooker reacted to the errors of an avatar seen from a first-person perspective. We found that mere observation of erroneous actions enhances electrocortical markers of error detection in the trials where human onlookers embodied the virtual character. Thus, the cerebral system for action monitoring is maximally activated when others' errors are coded as if they are one's own errors. The results have important implications for understanding how the brain can control the external world and thus creating new brain-computer interfaces.

Frequency-specific insight into short-term memory capacity.

The digit span is one of the most widely used memory tests in clinical and experimental neuropsychology for reliably measuring short-term memory capacity. In the forward version, sequences of digits of increasing length have to be reproduced in the order in which they are presented, whereas in the backward version items must be reproduced in the reversed order. Here, we assessed whether transcranial alternating current stimulation (tACS) increases the memory span for digits of young and midlife adults. Imperceptibly weak electrical currents in the alpha (10 Hz), beta (20 Hz), theta (5 Hz), and gamma (40 Hz) range, as well as a sham stimulation, were delivered over the left posterior parietal cortex, a cortical region thought to sustain maintenance processes in short-term memory through oscillatory brain activity in the beta range. We showed a frequency-specific effect of beta-tACS that robustly increased the forward memory span of young, but not middle-aged, healthy individuals. The effect correlated with age: the younger the subjects, the greater the benefit arising from parietal beta stimulation. Our results provide evidence of a short-term memory capacity improvement in young adults by online frequency-specific tACS application.

Perceiving monetary loss as due to inequity reduces behavioral and cortical responses to pain.

Studies indicate that physical and social pain may share some mechanisms and neural correlates. Nothing is known, however, on whether the neural activity in the nociceptive system, as indexed by laser-evoked potentials (LEPs), is modified when suffering the consequences of a conspecific violating social norms. To explore this issue, we created an interaction scenario where participants could gain money by performing a time-estimation task. On each win-trial, another player connected online could arbitrarily decide to keep the participant's pay-off for him- or herself. Thus, participants knew that monetary loss could occur because of their own failure in performing the task or because of the inequitable behavior of another individual. Moreover, participants were asked to play for themselves or on behalf of a third party. In reality, the win/loss events were entirely decided by an ad hoc programmed computer. At the end of the interaction, participants reported if they believed the game-playing interaction was real. Results showed that the loss due to the opponent's inequitable behavior brought about a reduction both in pain intensity self-reports and in the amplitude of LEPs' components (i.e., N2, N2/P2, P2a, P2b). Importantly, both the behavioral and neurophysiological effects were found in the participants who believed their deserved payoff was stolen by their opponent. Furthermore, reduction of vertex components was present only when the inequitable behavior was directed toward the self. These results suggest that, far from being a private experience, pain perception might be modulated by the social saliency of interpersonal interactions.

Kinematics fingerprints of leader and follower role-taking during cooperative joint actions.

Performing online complementary motor adjustments is quintessential to joint actions since it allows interacting people to coordinate efficiently and achieve a common goal. We sought to determine whether, during dyadic interactions, signaling strategies and simulative processes are differentially implemented on the basis of the interactional role played by each partner. To this aim, we recorded the kinematics of the right hand of pairs of individuals who were asked to grasp as synchronously as possible a bottle-shaped object according to an imitative or complementary action schedule. Task requirements implied an asymmetric role assignment so that participants performed the task acting either as (1) Leader (i.e., receiving auditory information regarding the goal of the task with indications about where to grasp the object) or (2) Follower (i.e., receiving instructions to coordinate their movements with their partner's by performing imitative or complementary actions). Results showed that, when acting as Leader, participants used signaling strategies to enhance the predictability of their movements. In particular, they selectively emphasized kinematic parameters and reduced movement variability to provide the partner with implicit cues regarding the action to be jointly performed. Thus, Leaders make their movements more "communicative" even when not explicitly instructed to do so. Moreover, only when acting in the role of Follower did participants tend to imitate the Leader, even in complementary actions where imitation is detrimental to joint performance. Our results show that mimicking and signaling are implemented in joint actions according to the interactional role of the agent, which in turn is reflected in the kinematics of each partner.

Lateral head turning affects temporal memory.

Spatial attention is a key factor in the exploration and processing of the surrounding environment, and plays a role in linking magnitudes such as space, time, and numbers. The present work evaluates whether shifting the coordinates of spatial attention through rotational head movements may affect the ability to estimate the duration of different time intervals. A computer-based implicit timing task was employed, in which participants were asked to concentrate and report verbally on colour changes of sequential stimuli displayed on a computer screen; subsequently, they were required to reproduce the temporal duration (ranging between 5 and 80 sec.) of the perceived stimuli using the computer keyboard. There was statistically significant overestimation of the 80-sec. intervals exclusively on the rightward rotation head posture, whereas head posture did not affect timing performances on shorter intervals. These findings support the hypothesis that the coordinates of spatial attention influence the ability to process time, consistent with the existence of common cortical metrics of space and time in healthy humans.

Inkjet-printed fully customizable and low-cost electrodes matrix for gesture recognition.

The use of surface electromyography (sEMG) is rapidly spreading, from robotic prostheses and muscle computer interfaces to rehabilitation devices controlled by residual muscular activities. In this context, sEMG-based gesture recognition plays an enabling role in controlling prosthetics and devices in real-life settings. Our work aimed at developing a low-cost, print-and-play platform to acquire and analyse sEMG signals that can be arranged in a fully customized way, depending on the application and the users' needs. We produced 8-channel sEMG matrices to measure the muscular activity of the forearm using innovative nanoparticle-based inks to print the sensors embedded into each matrix using a commercial inkjet printer. Then, we acquired the multi-channel sEMG data from 12 participants while repeatedly performing twelve standard finger movements (six extensions and six flexions). Our results showed that inkjet printing-based sEMG signals ensured significant similarity values across repetitions in every participant, a large enough difference between movements (dissimilarity index above 0.2), and an overall classification accuracy of 93-95% for flexion and extension, respectively.

The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence.

Real-world experience is typically multimodal. Evidence indicates that the facilitation in the detection of multisensory stimuli is modulated by the perceptual load, the amount of information involved in the processing of the stimuli. Here, we used a realistic virtual reality environment while concomitantly acquiring Electroencephalography (EEG) and Galvanic Skin Response (GSR) to investigate how multisensory signals impact target detection in two conditions, high and low perceptual load. Different multimodal stimuli (auditory and vibrotactile) were presented, alone or in combination with the visual target. Results showed that only in the high load condition, multisensory stimuli significantly improve performance, compared to visual stimulation alone. Multisensory stimulation also decreases the EEG-based workload. Instead, the perceived workload, according to the "NASA Task Load Index" questionnaire, was reduced only by the trimodal condition (i.e., visual, auditory, tactile). This trimodal stimulation was more effective in enhancing the sense of presence, that is the feeling of being in the virtual environment, compared to the bimodal or unimodal stimulation. Also, we show that in the high load task, the GSR components are higher compared to the low load condition. Finally, the multimodal stimulation (Visual-Audio-Tactile-VAT and Visual-Audio-VA) induced a significant decrease in latency, and a significant increase in the amplitude of the P300 potentials with respect to the unimodal (visual) and visual and tactile bimodal stimulation, suggesting a faster and more effective processing and detection of stimuli if auditory stimulation is included. Overall, these findings provide insights into the relationship between multisensory integration and human behavior and cognition.

Does subliminal visual perception have an error-monitoring system?

There is substantial evidence that subliminal stimuli, i.e. stimuli that cannot be perceived consciously, may influence visually guided human behaviour. Two important points require further investigation, namely, the neural bases and the functional capability of unconscious stimulus processing. In this study we aimed at studying one specific aspect of the latter question, i.e. whether unconscious vision can feed into an error-monitoring system in much the same way as conscious vision. We therefore tested whether the event-related potential component known as error-related negativity, which represents the electrophysiological correlate of an error-monitoring system, is produced by unconscious errors. We found an error-related negativity not only for errors committed in a discrimination task with visible stimuli but also for those committed with subthreshold stimuli. Moreover, behavioural analysis showed post-error slowing of reaction time for correct responses following unconscious as well as conscious errors. Thus, the present results provide both electrophysiological and behavioural evidence of an error-monitoring system operating even when stimuli cannot access consciousness.

Dynamic changes in prefrontal cortex involvement during verbal episodic memory formation.

During encoding, the neural activity immediately before or during an event can predict whether that event will be later remembered. The contribution of brain activity immediately after an event to memory formation is however less known. Here, we used repetitive Transcranial Magnetic Stimulation (rTMS) to investigate the temporal dynamics of episodic memory encoding with a focus on post-stimulus time intervals. At encoding, rTMS was applied during the online processing of the word, at its offset, or 100, 200, 300 or 400ms thereafter. rTMS was delivered to the left ventrolateral (VLPFC) or dorsolateral prefrontal cortex (DLPFC). VLPFC rTMS during the first few hundreds of milliseconds after word offset disrupted subsequent recognition accuracy. We did not observe effects of DLPFC rTMS at any time point. These results suggest that encoding-related VLPFC engagement starts at a relatively late processing stage, and may reflect brain processes related to the offset of the stimulus.

Embodied Medicine: Mens Sana in Corpore Virtuale Sano.

Progress in medical science and technology drastically improved physicians' ability to interact with patient's physical body. Nevertheless, medicine still addresses the human body from a Hippocratic point of view, considering the organism and its processes just as a matter of mechanics and fluids. However, the interaction between the cognitive neuroscience of bodily self-consciousness (BSC), fundamentally rooted in the integration of multisensory bodily inputs, with virtual reality (VR), haptic technologies and robotics is giving a new meaning to the classic Juvenal's latin dictum "Mens sana in corpore sano" (a healthy mind in a healthy body). This vision provides the basis for a new research field, "Embodied Medicine": the use of advanced technologies for altering the experience of being in a body with the goal of improving health and well-being. Up to now, most of the research efforts in the field have been focused upon how external bodily information is processed and integrated. Despite the important results, we believe that existing bodily illusions still need to be improved to enhance their capability to effectively correct pathological dysfunctions. First, they do not follow the suggestions provided by the free-energy and predictive coding approaches. More, they lacked to consider a peculiar feature of the human body, the multisensory integration of internal inputs (interoceptive, proprioceptive and vestibular) that constitute our inner body dimension. So, a future challenge is the integration of simulation/stimulation technologies also able to measure and modulate this internal/inner experience of the body. Finally, we also proposed the concept of "Sonoception" as an extension of this approach. The core idea is to exploit recent technological advances in the acoustic field to use sound and vibrations to modify the internal/inner body experience.

Body visual discontinuity affects feeling of ownership and skin conductance responses.

When we look at our hands we are immediately aware that they belong to us and we rarely doubt about the integrity, continuity and sense of ownership of our bodies. Here we explored whether the mere manipulation of the visual appearance of a virtual limb could influence the subjective feeling of ownership and the physiological responses (Skin Conductance Responses, SCRs) associated to a threatening stimulus approaching the virtual hand. Participants observed in first person perspective a virtual body having the right hand-forearm (i) connected by a normal wrist (Full-Limb) or a thin rigid wire connection (Wire) or (ii) disconnected because of a missing wrist (m-Wrist) or a missing wrist plus a plexiglass panel positioned between the hand and the forearm (Plexiglass). While the analysis of subjective ratings revealed that only the observation of natural full connected virtual limb elicited high levels of ownership, high amplitudes of SCRs were found also during observation of the non-natural, rigid wire connection condition. This result suggests that the conscious embodiment of an artificial limb requires a natural looking visual body appearance while implicit reactivity to threat may require physical body continuity, even non-naturally looking, that allows the implementation of protective reactions to threat.

Cerebellar damage impairs the self-rating of regret feeling in a gambling task.

Anatomical, clinical, and neuroimaging evidence implicates the cerebellum in processing emotions and feelings. Moreover recent studies showed a cerebellar involvement in pathologies such as autism, schizophrenia and alexithymia, in which emotional processing have been found altered. However, cerebellar function in the modulation of emotional responses remains debated. In this study, emotions that are involved directly in decision-making were examined in 15 patients (six males; age range 17-60 years) affected by cerebellar damage and 15 well matched healthy controls. We used a gambling task, in which subjects' choices and evaluation of outcomes with regard to their anticipated and actual emotional impact were analyzed. Emotions, such as regret and relief, were elicited, based on the outcome of the unselected gamble. Interestingly, despite their ability to avoid regret in subsequent choices, patients affected by cerebellar lesions were significantly impaired in evaluating the feeling of regret subjectively. These results demonstrate that the cerebellum is involved in conscious recognizing of negative feelings caused by the sense of self-responsibility for an incorrect decision.

Prejudiced interactions: implicit racial bias reduces predictive simulation during joint action with an out-group avatar.

During social interactions people automatically apply stereotypes in order to rapidly categorize others. Racial differences are among the most powerful cues that drive these categorizations and modulate our emotional and cognitive reactivity to others. We investigated whether implicit racial bias may also shape hand kinematics during the execution of realistic joint actions with virtual in- and out-group partners. Caucasian participants were required to perform synchronous imitative or complementary reach-to-grasp movements with avatars that had different skin color (white and black) but showed identical action kinematics. Results demonstrate that stronger visuo-motor interference (indexed here as hand kinematics differences between complementary and imitative actions) emerged: i) when participants were required to predict the partner's action goal in order to on-line adapt their own movements accordingly; ii) during interactions with the in-group partner, indicating the partner's racial membership modulates interactive behaviors. Importantly, the in-group/out-group effect positively correlated with the implicit racial bias of each participant. Thus visuo-motor interference during joint action, likely reflecting predictive embodied simulation of the partner's movements, is affected by cultural inter-individual differences.

Aversive pavlovian responses affect human instrumental motor performance.

IN NEUROSCIENCE AND PSYCHOLOGY, AN INFLUENTIAL PERSPECTIVE DISTINGUISHES BETWEEN TWO KINDS OF BEHAVIORAL CONTROL: instrumental (habitual and goal-directed) and Pavlovian. Understanding the instrumental-Pavlovian interaction is fundamental for the comprehension of decision-making. Animal studies (as those using the negative auto-maintenance paradigm), have demonstrated that Pavlovian mechanisms can have maladaptive effects on instrumental performance. However, evidence for a similar effect in humans is scarce. In addition, the mechanisms modulating the impact of Pavlovian responses on instrumental performance are largely unknown, both in human and non-human animals. The present paper describes a behavioral experiment investigating the effects of Pavlovian conditioned responses on performance in humans, focusing on the aversive domain. Results showed that Pavlovian responses influenced human performance, and, similar to animal studies, could have maladaptive effects. In particular, Pavlovian responses either impaired or increased performance depending on modulator variables such as threat distance, task controllability, punishment history, amount of training, and explicit punishment expectancy. Overall, these findings help elucidating the computational mechanisms underlying the instrumental-Pavlovian interaction, which might be at the base of apparently irrational phenomena in economics, social behavior, and psychopathology.

And yet they act together: interpersonal perception modulates visuo-motor interference and mutual adjustments during a joint-grasping task.

Prediction of "when" a partner will act and "what" he is going to do is crucial in joint-action contexts. However, studies on face-to-face interactions in which two people have to mutually adjust their movements in time and space are lacking. Moreover, while studies on passive observation have shown that somato-motor simulative processes are disrupted when the observed actor is perceived as an out-group or unfair individual, the impact of interpersonal perception on joint-actions has never been directly addressed. Here we explored this issue by comparing the ability of pairs of participants who did or did not undergo an interpersonal perception manipulation procedure to synchronise their reach-to-grasp movements during: i) a guided interaction, requiring pure temporal reciprocal coordination, and ii) a free interaction, requiring both time and space adjustments. Behavioural results demonstrate that while in neutral situations free and guided interactions are equally challenging for participants, a negative interpersonal relationship improves performance in guided interactions at the expense of the free interactive ones. This was paralleled at the kinematic level by the absence of movement corrections and by low movement variability in these participants, indicating that partners cooperating within a negative interpersonal bond executed the cooperative task on their own, without reciprocally adapting to the partner's motor behaviour. Crucially, participants' performance in the free interaction improved in the manipulated group during the second experimental session while partners became interdependent as suggested by higher movement variability and by the appearance of interference between the self-executed actions and those observed in the partner. Our study expands current knowledge about on-line motor interactions by showing that visuo-motor interference effects, mutual motor adjustments and motor-learning mechanisms are influenced by social perception.

Situational and dispositional determinants of intentional deceiving.

Does opportunity make the thief or are people dispositionally prone to deceive? The interaction between personality and the circumstances surrounding deception is crucial to understand what promotes dishonesty in our society. Due to its inherent spontaneity and sociality, deceptive behaviour may be hardly reproducible in experimental settings. We developed a novel paradigm in the form of an interactive game where participants can choose whether to lie to another person in situations of loss vs. gain, and of no-reputation-risk vs. reputation-risk linked to the disclosure of their deceptive behaviour to others. Thus, our ecological paradigm allowed subjects to spontaneously decide when to lie and face the challenge of deceiving others. In the case of loss, participants lied to reverse the outcome in their favour. Deception was lower in the reputation-risk condition where personality traits concerning social interactions also played an important role. The results suggest that deception is definitely promoted by unfavourable events, and that maintaining one's own reputation encourages honesty, particularly in socially inclined individuals.

Suffering makes you egoist: acute pain increases acceptance rates and reduces fairness during a bilateral ultimatum game.

Social preferences like interpersonal altruism, fairness, reciprocity and inequity aversion are inherently linked to departures from pure self-interest. During economic interactions, for example, defectors may be punished even if this implies a cost for the punishers. This violation of canonical assumptions in economics indicates that socially oriented decisions may predominate over self-centred stances. Here we explore whether the personal experience of pain changes the balance between self-gain and socially based choices. We used laser stimulation to induce pain or a warm sensation in subjects playing a modified version of the Ultimatum Game (UG) both in the role of responder and proposer. After each shot, responders evaluated the fairness of the offer. Moreover, responders and proposers rated the intensity and unpleasantness of the sensation evoked by the laser stimulation. Results show that suffering proposers decrease fair offers and suffering responders increase their acceptance rate irrespective of economic offer. Crucially, the intensity of painful stimulation has a predictive role on Moderately Unfair offers' acceptance rates. Thus the personal experience of pain may favour the emergence of a self-centered perspective aimed at maximizing self-gain. The results suggest that bodily states play a fundamental role in higher-order interpersonal negotiations and interactions.