Altering One's Body-Perception Through E-Textiles and Haptic Metaphors.

Technologies change rapidly our perception of reality, moving from augmented to virtual to magical. While e-textiles are a key component in exergame or space suits, the transformative potential of the internal side of garments to create embodied experiences still remains largely unexplored. This paper is the result from an art-science collaborative project that combines recent neuroscience findings, body-centered design principles and 2D vibrotactile array-based fabrics to alter one's body perception. We describe an iterative design process intertwined with two user studies on the effects on body-perceptions and emotional responses of various vibration patterns within textile that were designed as spatial haptic metaphors. Our results show potential in considering materials (e.g., rocks) as sensations to design for body perceptions (e.g., being heavy, strong) and emotional responses. We discuss these results in terms of sensory effects on body perception and synergetic impact to research on embodiment in virtual environments, human-computer interaction, and e-textile design. The work brings a new perspective to the sensorial design of embodied experiences which is based on "material perception" and haptic metaphors, and highlights potential opportunities opened by haptic clothing to change body-perception.

Modulation of Recognition Memory for Emotional Images by Vertical Vection.

Our previous research showed that vertical vection could modulate human mood. We further examined this possibility by using memory recognition task of positive, negative and neutral emotional images with high and low arousal levels. Those images were remembered accidentally while the participants did visual dummy task, and later presented together with novel images during vertical vection-inducing or neutral visual stimuli. The results showed that downward vection facilitated the recognition of negative images and inhibited the recognition of positive ones. These modulations of incidental memory task provide an additional evidence for vection influence on cognitive and emotional processing, and also provide a new paradigm that can be used in future vection and embodied cognition research.

Emotion-inducing approaching sounds shape the boundaries of multisensory peripersonal space.

In order to survive in a complex environment, inhabited by potentially threatening and noxious objects or living beings, we need to constantly monitor our surrounding space, especially in the vicinity of our body. Such a space has been commonly referred to as one's 'peripersonal space' (PPS). In this study we investigated whether emotion-inducing approaching sound sources impact the boundaries of PPS. Previous studies have indeed showed that the boundaries of PPS are not fixed but modulate according to properties of stimuli in the surrounding environment. In Experiment 1, participants performed a simple tactile detection task of targets presented to their right hand. Concurrently, they were presented with intensity-changing task-irrelevant artificial sound sources perceived as approaching toward their body. The physical properties of the sound elicited emotional responses of either neutral or negative valence. Results showed larger PPS when the approaching stimulus had negative as compared to neutral emotional valence. In Experiment 2, we used ecological sounds which content (i.e., psychological associations to the sound producing source), rather than physical properties, elicited emotional responses of negative, positive or neutral valence. In agreement with results from experiment 1, we found larger PPS when the approaching stimuli had negative emotional valence as compared to both neutral and positive ones. Results are discussed within the theoretical framework that conceives PPS as a safety zone around one's body.

Shutting down sensorimotor interference unblocks the networks for stimulus processing: an SMR neurofeedback training study.

OBJECTIVE: In the present study, we investigated how the electrical activity in the sensorimotor cortex contributes to improved cognitive processing capabilities and how SMR (sensorimotor rhythm, 12-15Hz) neurofeedback training modulates it. Previous evidence indicates that higher levels of SMR activity reduce sensorimotor interference and thereby promote cognitive processing. METHODS: Participants were randomly assigned to two groups, one experimental (N=10) group receiving SMR neurofeedback training, in which they learned to voluntarily increase SMR, and one control group (N=10) receiving sham feedback. Multiple cognitive functions and electrophysiological correlates of cognitive processing were assessed before and after 10 neurofeedback training sessions. RESULTS: The experimental group but not the control group showed linear increases in SMR power over training runs, which was associated with behavioural improvements in memory and attentional performance. Additionally, increasing SMR led to a more salient stimulus processing as indicated by increased N1 and P3 event-related potential amplitudes after the training as compared to the pre-test. Finally, functional brain connectivity between motor areas and visual processing areas was reduced after SMR training indicating reduced sensorimotor interference. CONCLUSIONS: These results indicate that SMR neurofeedback improves stimulus processing capabilities and consequently leads to improvements in cognitive performance. SIGNIFICANCE: The present findings contribute to a better understanding of the mechanisms underlying SMR neurofeedback training and cognitive processing and implicate that SMR neurofeedback might be an effective cognitive training tool.

The influence of imagery vividness on cognitive and perceptual cues in circular auditorily-induced vection.

In the absence of other congruent multisensory motion cues, sound contribution to illusions of self-motion (vection) is relatively weak and often attributed to purely cognitive, top-down processes. The present study addressed the influence of cognitive and perceptual factors in the experience of circular, yaw auditorily-induced vection (AIV), focusing on participants imagery vividness scores. We used different rotating sound sources (acoustic landmark vs. movable types) and their filtered versions that provided different binaural cues (interaural time or level differences, ITD vs. ILD) when delivering via loudspeaker array. The significant differences in circular vection intensity showed that (1) AIV was stronger for rotating sound fields containing auditory landmarks as compared to movable sound objects; (2) ITD based acoustic cues were more instrumental than ILD based ones for horizontal AIV; and (3) individual differences in imagery vividness significantly influenced the effects of contextual and perceptual cues. While participants with high scores of kinesthetic and visual imagery were helped by vection "rich" cues, i.e., acoustic landmarks and ITD cues, the participants from the low-vivid imagery group did not benefit from these cues automatically. Only when specifically asked to use their imagination intentionally did these external cues start influencing vection sensation in a similar way to high-vivid imagers. These findings are in line with the recent fMRI work which suggested that high-vivid imagers employ automatic, almost unconscious mechanisms in imagery generation, while low-vivid imagers rely on more schematic and conscious framework. Consequently, our results provide an additional insight into the interaction between perceptual and contextual cues when experiencing purely auditorily or multisensory induced vection.

Enactive cinema paves way for understanding complex real-time social interaction in neuroimaging experiments.

We outline general theoretical and practical implications of what we promote as enactive cinema for the neuroscientific study of online socio-emotional interaction. In a real-time functional magnetic resonance imaging (rt-fMRI) setting, participants are immersed in cinematic experiences that simulate social situations. While viewing, their physiological reactions-including brain responses-are tracked, representing implicit and unconscious experiences of the on-going social situations. These reactions, in turn, are analyzed in real-time and fed back to modify the cinematic sequences they are viewing while being scanned. Due to the engaging cinematic content, the proposed setting focuses on living-by in terms of shared psycho-physiological epiphenomena of experience rather than active coping in terms of goal-oriented motor actions. It constitutes a means to parametrically modify stimuli that depict social situations and their broader environmental contexts. As an alternative to studying the variation of brain responses as a function of a priori fixed stimuli, this method can be applied to survey the range of stimuli that evoke similar responses across participants at particular brain regions of interest.

Quantifying human subjective experience and social interaction using the eXperience Induction Machine.

With the advance of novel brain imaging technology more correlations between complex human properties and the neuronal substrate can be assessed. However, thus far, not many well-validated paradigms exist that would allow for a systematic and quantitative exploration of these phenomena. For instance, despite the rapid technological advances in the domain of mixed and virtual reality systems, a fundamental issue remains how we can define and quantify "presence". A standard approach has been to use questionnaires and self-report measures. However, it has been well established that humans' capabilities to access and externalize their internal states are limited. Hence, we have investigated the question whether other less subjective measures can be devised that can corroborate subjective self-reports on presence. In particular, we have developed a quantitative recollection task that assesses the ability of human subjects (N=40) to recollect the factual structure and organization of a structured and fully controlled experience in a human accessible mixed reality space, the eXperience Induction Machine (XIM). In this structured experience - referred to as the "Autodemo"--a virtual guide explains the key elements and properties of XIM while the user is able to freely move around in the space. To evaluate the users' experience and the amount of factual information retained about the Autodemo, we used the ITC-SOPI questionnaire and a recall test specifically designed for the Autodemo. We found significant correlations between spatial presence and engagement factors of ITC-SOPI and recall performance. Moreover we observed an interaction with the participants' gender. Our results show that we can assess correlates of "presence" by focusing on other dependent measures such as those related to memory and performance. Additionally, our work exemplifies how virtual and mixed reality systems provide new ways to address fundamental questions in psychology and cognitive neuroscience.

When room size matters: acoustic influences on emotional responses to sounds.

When people hear a sound (a "sound object" or a "sound event") the perceived auditory space around them might modulate their emotional responses to it. Spaces can affect both the acoustic properties of the sound event itself and may also impose boundaries to the actions one can take with respect to this event. Virtual acoustic rooms of different sizes were used in a subjective and psychophysiological experiment that evaluated the influence of the auditory space perception on emotional responses to various sound sources. Participants (N = 20) were exposed to acoustic spaces with sound source positions and room acoustic properties varying across the experimental conditions. The results suggest that, overall, small rooms were considered more pleasant, calmer, and safer than big rooms, although this effect of size seems to disappear when listening to threatening sound sources. Sounds heard behind the listeners tended to be more arousing, and elicited larger physiological changes than sources in front of the listeners. These effects were more pronounced for natural, compared to artificial, sound sources, as confirmed by subjective and physiological measures.

Embodied auditory perception: the emotional impact of approaching and receding sound sources.

Research has shown the existence of perceptual and neural bias toward sounds perceived as sources approaching versus receding a listener. It has been suggested that a greater biological salience of approaching auditory sources may account for these effects. In addition, these effects may hold only for those sources critical for our survival. In the present study, we bring support to these hypotheses by quantifying the emotional responses to different sounds with changing intensity patterns. In 2 experiments, participants were exposed to artificial and natural sounds simulating approaching or receding sources. The auditory-induced emotional effect was reflected in the performance of participants in an emotion-related behavioral task, their self-reported emotional experience, and their physiology (electrodermal activity and facial electromyography). The results of this study suggest that approaching unpleasant sound sources evoke more intense emotional responses in listeners than receding ones, whereas such an effect of perceived sound motion does not exist for pleasant or neutral sound sources. The emotional significance attributed to the sound source itself, the loudness of the sound, and loudness change duration seem to be relevant factors in this disparity.

Auditorily-induced illusory self-motion: a review.

The aim of this paper is to provide a first review of studies related to auditorily-induced self-motion (vection). These studies have been scarce and scattered over the years and over several research communities including clinical audiology, multisensory perception of self-motion and its neural correlates, ergonomics, and virtual reality. The reviewed studies provide evidence that auditorily-induced vection has behavioral, physiological and neural correlates. Although the sound contribution to self-motion perception appears to be weaker than the visual modality, specific acoustic cues appear to be instrumental for a number of domains including posture prosthesis, navigation in unusual gravitoinertial environments (in the air, in space, or underwater), non-visual navigation, and multisensory integration during self-motion. A number of open research questions are highlighted opening avenue for more active and systematic studies in this area.

Auditory-somatosensory multisensory interactions are spatially modulated by stimulated body surface and acoustic spectra.

Previous research has provided inconsistent results regarding the spatial modulation of auditory-somatosensory interactions. The present study reports three experiments designed to investigate the nature of these interactions in the space close to the head. Human participants made speeded detection responses to unimodal auditory, somatosensory, or simultaneous auditory-somatosensory stimuli. In Experiment 1, electrocutaneous stimuli were presented to either earlobe, while auditory stimuli were presented from the same versus opposite sides, and from one of two distances (20 vs. 70 cm) from the participant's head. The results demonstrated a spatial modulation of auditory-somatosensory interactions when auditory stimuli were presented from close to the head. In Experiment 2, electrocutaneous stimuli were delivered to the hands, which were placed either close to or far from the head, while the auditory stimuli were again presented at one of two distances. The results revealed that the spatial modulation observed in Experiment 1 was specific to the particular body part stimulated (head) rather than to the region of space (i.e. around the head) where the stimuli were presented. The results of Experiment 3 demonstrate that sounds that contain high-frequency components are particularly effective in eliciting this auditory-somatosensory spatial effect. Taken together, these findings help to resolve inconsistencies in the previous literature and suggest that auditory-somatosensory multisensory integration is modulated by the stimulated body surface and acoustic spectra of the stimuli presented.

Self-representation in mediated environments: the experience of emotions modulated by auditory-vibrotactile heartbeat.

In 1890, William James hypothesized that emotions are our perception of physiological changes. Many different theories of emotion have emerged since then, but it has been demonstrated that a specifically induced physiological state can influence an individual's emotional responses to stimuli. In the present study, auditory and/or vibrotactile heartbeat stimuli were presented to participants (N = 24), and the stimuli's effect on participants' physiological state and subsequent emotional attitude to affective pictures was measured. In particular, we aimed to investigate the effect of the perceived distance to stimuli on emotional experience. Distant versus close sound reproduction conditions (loudspeakers vs. headphones) were used to identify whether an "embodied" experience can occur in which participants would associate the external heartbeat sound with their own. Vibrotactile stimulation of an experimental chair and footrest was added to magnify the experience. Participants' peripheral heartbeat signals, self-reported valence (pleasantness) and arousal (activation) ratings for the pictures, and memory performance scores were collected. Heartbeat sounds significantly affected participants' heartbeat, the emotional judgments of pictures, and their recall. The effect of distance to stimuli was observed in the significant interaction between the spatial location of the heartbeat sound and the vibrotactile stimulation, which was mainly caused by the auditory-vibrotactile interaction in the loudspeakers condition. This interaction might suggest that vibrations transform the far sound condition (sound via loudspeakers) in a close-stimulation condition and support the hypothesis that close sounds are more affective than distant ones. These findings have implications for the design and evaluation of mediated environments.