The effect of Surround sound on embodiment and sense of presence in cinematic experience: a behavioral and HD-EEG study.

Although many studies have investigated spectators' cinematic experience, only a few of them explored the neurophysiological correlates of the sense of presence evoked by the spatial characteristics of audio delivery devices. Nevertheless, nowadays both the industrial and the consumer markets have been saturated by some forms of spatial audio format that enrich the audio-visual cinematic experience, reducing the gap between the real and the digitally mediated world. The increase in the immersive capabilities corresponds to the instauration of both the sense of presence and the psychological sense of being in the virtual environment and also embodied simulation mechanisms. While it is well-known that these mechanisms can be activated in the real world, it is hypothesized that they may be elicited even in a virtual acoustic spatial environment and could be modulated by the acoustic spatialization cues reproduced by sound systems. Hence, the present study aims to investigate the neural basis of the sense of presence evoked by different forms of mediation by testing different acoustic space sound delivery (Presentation modes: Monophonic, Stereo, and Surround). To these aims, a behavioral investigation and a high-density electroencephalographic (HD-EEG) study have been developed. A large set of ecological and heterogeneous stimuli extracted from feature films were used. Furthermore, participants were selected following the generalized listener selection procedure. We found a significantly higher event-related desynchronization (ERD) in the Surround Presentation mode when compared to the Monophonic Presentation mode both in Alpha and Low-Beta centro-parietal clusters. We discuss this result as an index of embodied simulation mechanisms that could be considered as a possible neurophysiological correlation of the instauration of the sense of presence.

The Remapping of Peripersonal Space in a Real but Not in a Virtual Environment.

One of the most surprising features of our brain is the fact that it is extremely plastic. Among the various plastic processes supported by our brain, there is the neural representation of the space surrounding our body, the peripersonal space (PPS). The effects of real-world tool use on the PPS are well known in cognitive neuroscience, but little is still known whether similar mechanisms also govern virtual tool use. To this purpose, the present study investigated the plasticity of the PPS before and after a real (Experiment 1) or virtual motor training with a tool (Experiment 2). The results show the expansion of the PPS only following real-world tool use but not virtual use, highlighting how the two types of training potentially rely on different processes. This study enriches the current state of the art on the plasticity of PPS in real and virtual environments. We discuss our data with respect to the relevance for the development of effective immersive environment for trainings, learning and rehabilitation.

Tool-use Extends Peripersonal Space Boundaries in Schizophrenic Patients.

BACKGROUND AND HYPOTHESIS: A primary disruption of the bodily self is considered a core feature of schizophrenia (SCZ). The "disembodied" self might be underpinned by inefficient body-related multisensory integration processes, normally occurring in the peripersonal space (PPS), a plastic sector of space surrounding the body whose extent is altered in SCZ. Although PPS is a malleable interface marking the perceptual border between self and others, no study has addressed the potential alteration of its plasticity in SCZ. We investigated the plasticity of PPS in SCZ patients after a motor training with a tool in the far space. STUDY DESIGN: Twenty-seven SCZ patients and 32 healthy controls (HC) underwent an audio-tactile task to estimate PPS boundary before (Session 1) and after (Session 3) the tool-use. Parameters of PPS, including the size and the slope of the psychometric function describing audio-tactile RTs as a function of the audio-tactile distances, were estimated. STUDY RESULTS: Results confirm a narrow PPS extent in SCZ. Surprisingly, we found PPS expansion in both groups, thus showing for the first time a preserved PPS plasticity in SCZ. Patients experienced a weaker differentiation from others, as indicated by a shallower PPS slope at Session 1 that correlated positively with negative symptoms. However, at Session 3, patients marked their bodily boundary in a steeper way, suggesting a sharper demarcation of PPS boundaries after the action with the tool. CONCLUSIONS: These findings highlight the importance of investigating the multisensory and motor roots of self-disorders, paving the way for future body-centred rehabilitation interventions that could improve patients' altered body boundary.

The consequences of COVID-19 on social interactions: an online study on face covering.

The COVID-19 pandemic has dramatically changed the nature of our social interactions. In order to understand how protective equipment and distancing measures influence the ability to comprehend others' emotions and, thus, to effectively interact with others, we carried out an online study across the Italian population during the first pandemic peak. Participants were shown static facial expressions (Angry, Happy and Neutral) covered by a sanitary mask or by a scarf. They were asked to evaluate the expressed emotions as well as to assess the degree to which one would adopt physical and social distancing measures for each stimulus. Results demonstrate that, despite the covering of the lower-face, participants correctly recognized the facial expressions of emotions with a polarizing effect on emotional valence ratings found in females. Noticeably, while females' ratings for physical and social distancing were driven by the emotional content of the stimuli, males were influenced by the "covered" condition. The results also show the impact of the pandemic on anxiety and fear experienced by participants. Taken together, our results offer novel insights on the impact of the COVID-19 pandemic on social interactions, providing a deeper understanding of the way people react to different kinds of protective face covering.

Haptic Aesthetics and Bodily Properties of Ori Gersht's Digital Art: A Behavioral and Eye-Tracking Study.

Experimental aesthetics has shed light on the involvement of pre-motor areas in the perception of abstract art. However, the contribution of texture perception to aesthetic experience is still understudied. We hypothesized that digital screen-based art, despite its immateriality, might suggest potential sensorimotor stimulation. Original born-digital works of art were selected and manipulated by the artist himself. Five behavioral parameters: Beauty, Liking, Touch, Proximity, and Movement, were investigated under four experimental conditions: Resolution (high/low), and Magnitude (Entire image/detail). These were expected to modulate the quantity of material and textural information afforded by the image. While the Detail condition afforded less content-related information, our results show that it augmented the image's haptic appeal. High Resolution improved the haptic and aesthetic properties of the images. Furthermore, aesthetic ratings positively correlated with sensorimotor ratings. Our results demonstrate a strict relation between the aesthetic and sensorimotor/haptic qualities of the images, empirically establishing a relationship between beholders' bodily involvement and their aesthetic judgment of visual works of art. In addition, we found that beholders' oculomotor behavior is selectively modulated by the perceptual manipulations being performed. The eye-tracking results indicate that the observation of the Entire, original images is the only condition in which the latency of the first fixation is shorter when participants gaze to the left side of the images. These results thus demonstrate the existence of a left-side bias during the observation of digital works of art, in particular, while participants are observing their original version.