Anisotropy of lateral peripersonal space is linked to handedness.

The space immediately surrounding our bodies, i.e., peripersonal space (PPS), is a critical area for the interaction with the external world, be it to deal with imminent threat or to attain objects of interest. In the brain, a dedicated system codes PPS in motor terms for the purpose of action. Yet, humans have asymmetric motor abilities: the dominant hand has an advantage in term of movements' precision and reaction time. Furthermore, spatial attention is asymmetric and seems to be linked to a right hemispheric dominance for spatial processing. Here, we tested whether handedness and attentional asymmetries impact the detection of a tactile stimulus when an irrelevant auditory stimulus is looming towards the individual from the right or left hemispace. We examined the distance at which sound started speeding up tactile detection to estimate the morphometry of peri-trunk PPS. Our results show that right-handers' PPS is larger in the left than in the right hemispace, whereas left-handers' PPS is symmetric. The expansion of right-handers' PPS on the side of the non-dominant hand is coherent with a protective function of PPS. Left-handers' symmetric PPS can be related to the symmetric request of their motor abilities induced by living in a right-handers' world. These findings reveal that PPS is not uniform and suggest that general mechanisms of spatial processing as well as motor skills could play a role in the representation of peri-trunk PPS.

Multisensory aversive stimuli differentially modulate negative feelings in near and far space.

Affect, space, and multisensory integration are processes that are closely linked. However, it is unclear whether the spatial location of emotional stimuli interacts with multisensory presentation to influence the emotional experience they induce in the perceiver. In this study, we used the unique advantages of virtual reality techniques to present potentially aversive crowd stimuli embedded in a natural context and to control their display in terms of sensory and spatial presentation. Individuals high in crowdphobic fear navigated in an auditory-visual virtual environment, in which they encountered virtual crowds presented through the visual channel, the auditory channel, or both. They reported the intensity of their negative emotional experience at a far distance and at a close distance from the crowd stimuli. Whereas auditory-visual presentation of close feared stimuli amplified negative feelings, auditory-visual presentation of distant feared stimuli did not amplify negative feelings. This suggests that spatial closeness allows multisensory processes to modulate the intensity of the emotional experience induced by aversive stimuli. Nevertheless, the specific role of auditory stimulation must be investigated to better understand this interaction between multisensory, affective, and spatial representation processes. This phenomenon may serve the implementation of defensive behaviors in response to aversive stimuli that are in position to threaten an individual's feeling of security.

Design and evaluation of tinnitus synthesis methods: from spectral to spatial matching.

PURPOSE: This study was designed to investigate methods to help patients suffering from unilateral tinnitus synthesizing an auditory replica of their tinnitus. MATERIALS AND METHODS: Two semi-automatic methods (A and B) derived from the auditory threshold of the patient and a method (C) combining a pure tone and a narrow band-pass noise centred on an adjustable frequency were devised and rated on their likeness over two test sessions. A third test evaluated the stability over time of the synthesized tinnitus replica built with method C, and its proneness to merge with the patient's tinnitus. Patients were then asked to try and control the lateralisation of this single percept through the adjustment of the tinnitus replica level. RESULTS: The first two tests showed that seven out of ten patients chose the tinnitus replica built with method C as their preferred one. The third test, performed on twelve patients, revealed pitch tuning was rather stable over a week interval. It showed that eight patients were able to consistently match the central frequency of the synthesized tinnitus (presented to the contralateral ear) to their own tinnitus, which leaded to a unique tinnitus percept. The lateralisation displacement was consistent across patients and revealed an average range of 29dB to obtain a full lateral shift from the ipsilateral to the contralateral side. CONCLUSIONS: Although spectrally simpler than the semi-automatic methods, method C could replicate patients' tinnitus, to some extent. When a unique percept between synthesized tinnitus and patients' tinnitus arose, lateralisation of this percept was achieved.

Human computer confluence applied in healthcare and rehabilitation.

Human computer confluence (HCC) is an ambitious research program studying how the emerging symbiotic relation between humans and computing devices can enable radically new forms of sensing, perception, interaction, and understanding. It is an interdisciplinary field, bringing together researches from horizons as various as pervasive computing, bio-signals processing, neuroscience, electronics, robotics, virtual & augmented reality, and provides an amazing potential for applications in medicine and rehabilitation.

Auditory-visual integration of emotional signals in a virtual environment for cynophobia.

Cynophobia (dog phobia) has both visual and auditory relevant components. In order to investigate the efficacy of virtual reality (VR) exposure-based treatment for cynophobia, we studied the efficiency of auditory-visual environments in generating presence and emotion. We conducted an evaluation test with healthy participants sensitive to cynophobia in order to assess the capacity of auditory-visual virtual environments (VE) to generate fear reactions. Our application involves both high fidelity visual stimulation displayed in an immersive space and 3D sound. This specificity enables us to present and spatially manipulate fearful stimuli in the auditory modality, the visual modality and both. Our specific presentation of animated dog stimuli creates an environment that is highly arousing, suggesting that VR is a promising tool for cynophobia treatment and that manipulating auditory-visual integration might provide a way to modulate affect.

Auditory roughness elicits defense reactions.

Auditory roughness elicits aversion, and higher activation in cerebral areas involved in threat processing, but its link with defensive behavior is unknown. Defensive behaviors are triggered by intrusions into the space immediately surrounding the body, called peripersonal space (PPS). Integrating multisensory information in PPS is crucial to assure the protection of the body. Here, we assessed the behavioral effects of roughness on auditory-tactile integration, which reflects the monitoring of this multisensory region of space. Healthy human participants had to detect as fast as possible a tactile stimulation delivered on their hand while an irrelevant sound was approaching them from the rear hemifield. The sound was either a simple harmonic sound or a rough sound, processed through binaural rendering so that the virtual sound source was looming towards participants. The rough sound speeded tactile reaction times at a farther distance from the body than the non-rough sound. This indicates that PPS, as estimated here via auditory-tactile integration, is sensitive to auditory roughness. Auditory roughness modifies the behavioral relevance of simple auditory events in relation to the body. Even without emotional or social contextual information, auditory roughness constitutes an innate threat cue that elicits defensive responses.

Superstitiousness in obsessive-compulsive disorder.

It has been speculated that superstitiousness and obsessive-compulsive disorder (OCD) exist along a continuum. The distinction between superstitious behavior and superstitious belief, however, is crucial for any theoretical account of claimed associations between superstitiousness and OCD. By demonstrating that there is a dichotomy between behavior and belief, which is experimentally testable, we can differentiate superstitious behavior from superstitious belief, or magical ideation. Different brain circuits are responsible for these two forms of superstitiousness; thus, determining which type of superstition is prominent in the symptomatology of an individual patient may inform us about the primarily affected neurocognitive systems.

Capturing the dynamics of peripersonal space by integrating expectancy effects and sound propagation properties.

BACKGROUND: Humans perceive near space and far space differently. Peripersonal space (PPS), i.e. the space directly surrounding the body, is often studied using paradigms based on audiotactile integration. In these paradigms, reaction time (RT) to a tactile stimulus is measured in the presence of a concurrent auditory looming stimulus. NEW METHOD: We propose here to refine the experimental procedure by disentangling behavioral contributions of the targeted audiotactile integration mechanisms from expectancy effects. To this aim, we added to the protocol a baseline with a fixed sound distance. Furthermore, in order to improve the relevance of the audiotactile integration measures, we took into account sound propagation properties and assessed RTs for logarithmically spaced auditory distances. RESULTS: Expectation contributed significantly to overall behavioral responses. Subtracting it isolated the audiotactile effect due to the stimulus proximity. This revealed that audiotactile integration effects have to be tested on a logarithmic scale of distances, and that they follow a linear variation on this scale. COMPARISON WITH EXISTING METHOD(S): The current method allows cleaner and more pertinent sampling measures for evaluating audiotactile integration phenomena linked to PPS. Furthermore, most of the existing methods propose a sigmoid fitting, which rests on the intuitive framework that PPS is an in-or-out zone. Our results suggest that behavioral effects follow a logarithmic decrease, thus a response graduated in space. CONCLUSIONS: The proposed protocol design and method of analysis contribute to sharpen the experimental investigation of the factors influencing and modifying multisensory integration phenomena in the space surrounding the body.

Integration of auditory and visual information in the recognition of realistic objects.

Recognizing a natural object requires one to pool information from various sensory modalities, and to ignore information from competing objects. That the same semantic knowledge can be accessed through different modalities makes it possible to explore the retrieval of supramodal object concepts. Here, object-recognition processes were investigated by manipulating the relationships between sensory modalities, specifically, semantic content, and spatial alignment between auditory and visual information. Experiments were run under realistic virtual environment. Participants were asked to react as fast as possible to a target object presented in the visual and/or the auditory modality and to inhibit a distractor object (go/no-go task). Spatial alignment had no effect on object-recognition time. The only spatial effect observed was a stimulus-response compatibility between the auditory stimulus and the hand position. Reaction times were significantly shorter for semantically congruent bimodal stimuli than would be predicted by independent processing of information about the auditory and visual targets. Interestingly, this bimodal facilitation effect was twice as large as found in previous studies that also used information-rich stimuli. An interference effect was observed (i.e. longer reaction times to semantically incongruent stimuli than to the corresponding unimodal stimulus) only when the distractor was auditory. When the distractor was visual, the semantic incongruence did not interfere with object recognition. Our results show that immersive displays with large visual stimuli may provide large multimodal integration effects, and reveal a possible asymmetry in the attentional filtering of irrelevant auditory and visual information.

Social coding of the multisensory space around us.

Multisensory integration of stimuli occurring in the area surrounding our bodies gives rise to the functional representation of peripersonal space (PPS). PPS extent is flexible according to the affective context and the target of an action, but little is known about how social context modulates it. We used an audiotactile interaction task to investigate PPS of individuals during social interaction. Participants had to detect as fast as possible a tactile stimulus while task-irrelevant looming sounds were presented, while they were paired as collaborative dyads and as competitive dyads. We also measured PPS in participants seated near an inactive individual. PPS boundaries were modulated only when participants collaborated with a partner, in the form of an extension on the right hemispace and independently of the location of the partner. This suggests that space processing is modified during collaborative tasks. During collective actions, a supra-individual representation of the space of action could be at stake in order to adapt our individual motor control to an interaction as a group with the external world. Reassessing multisensory integration in the light of its potential social sensitivity might reveal that low-level mechanisms are modified by the need to interact with others.

The time course of auditory recognition measured with rapid sequences of short natural sounds.

Human listeners are able to recognize accurately an impressive range of complex sounds, such as musical instruments or voices. The underlying mechanisms are still poorly understood. Here, we aimed to characterize the processing time needed to recognize a natural sound. To do so, by analogy with the "rapid visual sequential presentation paradigm", we embedded short target sounds within rapid sequences of distractor sounds. The core hypothesis is that any correct report of the target implies that sufficient processing for recognition had been completed before the time of occurrence of the subsequent distractor sound. We conducted four behavioral experiments using short natural sounds (voices and instruments) as targets or distractors. We report the effects on performance, as measured by the fastest presentation rate for recognition, of sound duration, number of sounds in a sequence, the relative pitch between target and distractors and target position in the sequence. Results showed a very rapid auditory recognition of natural sounds in all cases. Targets could be recognized at rates up to 30 sounds per second. In addition, the best performance was observed for voices in sequences of instruments. These results give new insights about the remarkable efficiency of timbre processing in humans, using an original behavioral paradigm to provide strong constraints on future neural models of sound recognition.

Hemineglect: take a look at the back space.

Visual hemineglect, the failure to explore the half of space, real or imagined, contralateral to a cerebral lesion with respect to body or head, can be seen as an illustration of the brain's Euclidean representation of the left/right axis. Here we present two patients with left-sided neglect, in whom only the left hemispace in front of an imagined and/or real body position was inaccessible, but the space behind them remained fully represented. These observations suggest that of the three Euclidean dimensions (up/down, left/right, and front/back), at least the latter two are modularly and separately represented in the human brain.

Magical ideation and hyperacusis.

The subjective experience conferred by auditory perception has rarely been addressed outside of the studies of auditory hallucinations. The aim of this study is to describe the phenomenology of auditory experiences in individuals who endorse magical beliefs, but do not report hallucinations. We examined the relationship between subjective auditory sensitivity and a 'psychotic-like' thinking style. Hyperacusis questionnaire scores were compared between 25 high scoring participants on Chapman's magical ideation (MI) scale, 25 high scoring participants on Chapman's physical anhedonia scale and 25 control participants, pre-selected from a large student pool (n=1289). The participants who obtained high scores on the MI scale rated their auditory sensitivity higher than the two other groups. Our results indicate that, in healthy subjects, subjective auditory sensitivity is associated with MI without the mediation by anxiety commonly observed in pathological cases. We propose that hyperacusis associated to high scores of MI may be a predispositional factor to deviant auditory experiences. The relative uncoupling of perception from auditory sensory input may result in a central hypersensitivity, which could play a role in triggering off the experience of auditory hallucinations.

Ventriloquism aftereffects occur in the rear hemisphere.

After exposure to a consistent spatial disparity of auditory and visual stimuli, subjective localization of sound sources is usually shifted in the direction of the visual stimuli. This study investigates whether such aftereffects can be observed in humans after exposure to a conflicting bimodal stimulation in virtual reality and whether these aftereffects are confined to the trained locations. Fourteen subjects participated in an adaptation experiment, in which auditory stimuli were convolved with non-individual head-related transfer functions, delivered via headphones. First, we assessed the auditory localization of subjects in darkness. They indicated the perceived direction of a sound using an angular pointer. We then immersed the subjects in a virtual environment by means of a head-mounted display. They were asked to reproduce sequences of movements of virtual objects with a mouse click on the objects. However, we introduced a spatial disparity of 15 degrees between the visual event and the concurrent auditory stimulation. After 20 min of exposure, we tested the subjects again in total darkness to determine whether their auditory localization system had been modified by the conflicting visual signals. We observed a shift of subjective localization towards the left in both dorsal and frontal hemifields of the subject, mainly for auditory stimuli located in the right hemispace. This result suggests that interaural difference cues and monaural spectral cues were not equally adapted, and that visual stimuli mainly influence the processing of binaural directional cues of sound localization.

High sensitivity to multisensory conflicts in agoraphobia exhibited by virtual reality.

The primary aim of this study was to evaluate the effect of auditory feedback in a VR system planned for clinical use and to address the different factors that should be taken into account in building a bimodal virtual environment (VE). We conducted an experiment in which we assessed spatial performances in agoraphobic patients and normal subjects comparing two kinds of VEs, visual alone (Vis) and auditory-visual (AVis), during separate sessions. Subjects were equipped with a head-mounted display coupled with an electromagnetic sensor system and immersed in a virtual town. Their task was to locate different landmarks and become familiar with the town. In the AVis condition subjects were equipped with the head-mounted display and headphones, which delivered a soundscape updated in real-time according to their movement in the virtual town. While general performances remained comparable across the conditions, the reported feeling of immersion was more compelling in the AVis environment. However, patients exhibited more cybersickness symptoms in this condition. The result of this study points to the multisensory integration deficit of agoraphobic patients and underline the need for further research on multimodal VR systems for clinical use.

Auditory Sketches: Very Sparse Representations of Sounds Are Still Recognizable.

Sounds in our environment like voices, animal calls or musical instruments are easily recognized by human listeners. Understanding the key features underlying this robust sound recognition is an important question in auditory science. Here, we studied the recognition by human listeners of new classes of sounds: acoustic and auditory sketches, sounds that are severely impoverished but still recognizable. Starting from a time-frequency representation, a sketch is obtained by keeping only sparse elements of the original signal, here, by means of a simple peak-picking algorithm. Two time-frequency representations were compared: a biologically grounded one, the auditory spectrogram, which simulates peripheral auditory filtering, and a simple acoustic spectrogram, based on a Fourier transform. Three degrees of sparsity were also investigated. Listeners were asked to recognize the category to which a sketch sound belongs: singing voices, bird calls, musical instruments, and vehicle engine noises. Results showed that, with the exception of voice sounds, very sparse representations of sounds (10 features, or energy peaks, per second) could be recognized above chance. No clear differences could be observed between the acoustic and the auditory sketches. For the voice sounds, however, a completely different pattern of results emerged, with at-chance or even below-chance recognition performances, suggesting that the important features of the voice, whatever they are, were removed by the sketch process. Overall, these perceptual results were well correlated with a model of auditory distances, based on spectro-temporal excitation patterns (STEPs). This study confirms the potential of these new classes of sounds, acoustic and auditory sketches, to study sound recognition.

Influence of a sensorimotor conflict on the memorization of a path traveled in virtual reality.

Studies of visual-vestibular and vestibular-proprioceptive interactions suggest that prolonged exposure to sensory conflicts induces a modification of the relation between sensory modalities for self-motion perception. With most models conflicts are solved by a weighting process. However, the brain could also switch between conflicting cues. The present study focused on the effect of mismatched visual and non-visual information on the reproduction of actively performed turns. Standing subjects viewed a virtual corridor in which forward movements were simulated at a constant linear velocity, and rotations were actually performed. They were asked to learn the trajectory and then to reproduce it from memory in total darkness. In the baseline condition, the relative amplitudes of visual and non-visual information for the rotations performed were the same, but were manipulated in the two 'sensory conflict' conditions. The results show that even when subjects did not notice the sensory conflict, the discrepancy between visual and non-visual information affected their ability to reproduce the angular displacements. In one conflict condition, subjects relied on visual information when asked to draw the trajectory traveled, yet reproduced rotations on the basis of non-visual information during active blindfolded movements. This dissociation suggests that for mental simulation of the same path, there are at least two cognitive strategies of memory storage and retrieval, using either visual or non-visual information, according to the task and the sensory context.

Cynophobic fear adaptively extends peri-personal space.

Peri-personal space (PPS) is defined as the space immediately surrounding our bodies, which is critical in the adaptation of our social behavior. As a space of interaction with the external world, PPS is involved in the control of motor action as well as in the protection of the body. The boundaries of this PPS are known to be flexible but so far, little is known about how PPS boundaries are influenced by unreasonable fear. We hypothesized that unreasonable fear extends the neural representation of the multisensory space immediately surrounding the body in the presence of a feared object, with the aim of expanding the space of protection around the body. To test this hypothesis, we explored the impact of unreasonable fear on the size of PPS in two groups of non-clinical participants: dog-fearful and non-fearful participants. The sensitivity to cynophobia was assessed with a questionnaire. We measured participants' PPS extent in the presence of threatening (dog growling) and non-threatening (sheep bleating) auditory stimuli. The sound stimuli were processed through binaural rendering so that the virtual sound sources were looming toward participants from their rear hemi-field. We found that, when in the presence of the auditory dog stimulus, the PPS of dog-fearful participants is larger than that of non-fearful participants. Our results demonstrate that PPS size is adaptively modulated by cynophobia and suggest that anxiety tailors PPS boundaries when exposed to fear-relevant features. Anxiety, with the exception of social phobia, has rarely been studied as a disorder of social interaction. These findings could help develop new treatment strategies for anxious disorders by involving the link between space and interpersonal interaction in the approach of the disorder.

From ear to body: the auditory-motor loop in spatial cognition.

SPATIAL MEMORY IS MAINLY STUDIED THROUGH THE VISUAL SENSORY MODALITY: navigation tasks in humans rarely integrate dynamic and spatial auditory information. In order to study how a spatial scene can be memorized on the basis of auditory and idiothetic cues only, we constructed an auditory equivalent of the Morris water maze, a task widely used to assess spatial learning and memory in rodents. Participants were equipped with wireless headphones, which delivered a soundscape updated in real time according to their movements in 3D space. A wireless tracking system (video infrared with passive markers) was used to send the coordinates of the subject's head to the sound rendering system. The rendering system used advanced HRTF-based synthesis of directional cues and room acoustic simulation for the auralization of a realistic acoustic environment. Participants were guided blindfolded in an experimental room. Their task was to explore a delimitated area in order to find a hidden auditory target, i.e., a sound that was only triggered when walking on a precise location of the area. The position of this target could be coded in relationship to auditory landmarks constantly rendered during the exploration of the area. The task was composed of a practice trial, 6 acquisition trials during which they had to memorize the localization of the target, and 4 test trials in which some aspects of the auditory scene were modified. The task ended with a probe trial in which the auditory target was removed. The configuration of searching paths allowed observing how auditory information was coded to memorize the position of the target. They suggested that space can be efficiently coded without visual information in normal sighted subjects. In conclusion, space representation can be based on sensorimotor and auditory cues only, providing another argument in favor of the hypothesis that the brain has access to a modality-invariant representation of external space.

Auditory-visual virtual reality as a diagnostic and therapeutic tool for cynophobia.

Traditionally, virtual reality (VR) exposure-based treatment concentrates primarily on the presentation of a high-fidelity visual experience. However, adequately combining the visual and the auditory experience provides a powerful tool to enhance sensory processing and modulate attention. We present the design and usability testing of an auditory-visual interactive environment for investigating VR exposure-based treatment for cynophobia. The specificity of our application involves 3D sound, allowing the presentation and spatial manipulations of a fearful stimulus in the auditory modality and in the visual modality. We conducted an evaluation test with 10 participants who fear dogs to assess the capacity of our auditory-visual virtual environment (VE) to generate fear reactions. The specific perceptual characteristics of the dog model that were implemented in the VE were highly arousing, suggesting that VR is a promising tool to treat cynophobia.