Movement-related tactile gating in blindness.

When we perform an action, self-elicited movement induces suppression of somatosensory information to the cortex, requiring a correct motor-sensory and inter-sensory (i.e. cutaneous senses, kinesthesia, and proprioception) integration processes to be successful. However, recent works show that blindness might impact some of these elements. The current study investigates the effect of movement on tactile perception and the role of vision in this process. We measured the velocity discrimination threshold in 18 sighted and 18 blind individuals by having them perceive a sequence of two movements and discriminate the faster one in passive and active touch conditions. Participants' Just Noticeable Difference (JND) was measured to quantify their precision. Results showed a generally worse performance during the active touch condition compared to the passive. In particular, this difference was significant in the blind group, regardless of the blindness duration, but not in the sighted one. These findings suggest that the absence of visual calibration impacts motor-sensory and inter-sensory integration required during movement, diminishing the reliability of tactile signals in blind individuals. Our work spotlights the need for intervention in this population and should be considered in the sensory substitution/reinforcement device design.

Young children can use their subjective straight-ahead to remap visuo-motor alterations.

Young children and adults process spatial information differently: the former use their bodies as primary reference, while adults seem capable of using abstract frames. The transition is estimated to occur between the 6th and the 12th year of age. The mechanisms underlying spatial encoding in children and adults are unclear, as well as those underlying the transition. Here, we investigated the role of the subjective straight-ahead (SSA), the body antero-posterior half-plane mental model, in spatial encoding before and after the expected transition. We tested 6-7-year-old and 10-11-year-old children, and adults on a spatial alignment task in virtual reality, searching for differences in performance when targets were placed frontally or sideways. The performance differences were assessed both in a naturalistic baseline condition and in a test condition that discouraged using body-centered coordinates through a head-related visuo-motor conflict. We found no differences in the baseline condition, while all groups showed differences between central and lateral targets (SSA effect) in the visuo-motor conflict condition, and 6-7-year-old children showed the largest effect. These results confirm the expected transition timing; moreover, they suggest that children can abstract from the body using their SSA and that the transition underlies the maturation of a world-centered reference frame.

Deaf individuals use compensatory strategies to estimate visual time events.

Temporal perception is so profoundly linked to hearing that congenitally and early deaf individuals appear to experience visual temporal impairments. However, most studies investigated visual temporal perception in deaf individuals using static stimuli, while ecological objects with which we interact in everyday life often move across space and time. Given that deafness does not impact spatial metric representations, we hypothesize that, while the temporal perception of static stimuli is altered after early hearing loss, it can be enhanced by providing additional, ecologically relevant information. To evaluate our hypothesis, deaf and hearing participants were tested using an oddball-like visual temporal task. In such a task, participants had to temporally discriminate a Target embedded in a series of static stimuli, whose spatiotemporal structure was dynamically manipulated during the presentation. Our results highlighted that deaf participants could not successfully discriminate the Target's duration when only temporal information was manipulated, while their temporal sensitivity significantly improved when coherent spatiotemporal information was displayed. Our findings suggest that deaf individuals might develop compensatory strategies based on other visual, non-temporal features to estimate external time events.

Moderate physical activity alters the estimation of time, but not space.

Moderate physical activity can influence cognitive functions and visual cortical activity. However, little is known about the effects of exercise on fundamental perceptual domains, such as spatial and temporal representation. Here we tackled this issue by testing the impact of physical activity on a temporal estimation task in a group of adult volunteers in three different conditions: (1) in a resting condition (baseline), (2) during moderate physical activity (cycling in place - PA), and (3) approximately 15 to 20 min following the physical activity phase, in which participants were seated and returned to a regular heart rate (POST). We show that physical activity specifically impacts time perception, inducing a consistent overestimation for durations in the range of milliseconds. Notably, the effect persisted in the POST session, ruling out the main contribution of either heart rate or cycling rhythmicity. In a control experiment, we found that spatial perception (distance estimation) was unaffected by physical activity, ruling out a major contribution of arousal and fatigue to the observed temporal distortion. We speculate that physical exercise might alter temporal estimation either by up-regulating the dopaminergic system or modulating GABAergic inhibition.

The development of adaptation aftereffects in the vibrotactile domain.

Sensory adaptation is a feature-specific modulation of neural responses and is potentially fundamental to maximizing perceptual sensitivity. Despite its function being unclear, it has been hypothesized that sensory adaptation modifies the neurons' response codes, increasing the ability to process sensory signals on a larger scale. To better understand how such flexibility of our brain is possible, we investigated the effect of high- and low-frequency vibrotactile adaptation on perceived tactile temporal frequency during childhood, a time known for the brain to experience varying levels of plasticity. We tested tactile temporal frequency discrimination thresholds in both children and adults before and after tactile adaptation. Our results demonstrate that sensory adaptation does not consistently change perceived tactile temporal frequency in younger children as it does in adults, as adult-like trends begin to emerge at around 8 years of age but consolidate only in 10-year-old children. The absence of adaptation aftereffects suggests that, under certain conditions, sensory history does not affect perception in younger children in a similar way to adults. Surprisingly, younger children proved to be less flexible in modulating neural responses after prolonged exposure to an adapting stimulus, a tendency conflicting with the high plasticity levels the brain experiences during the early stages of life. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Deprivation of Auditory Experience Influences Numerosity Discrimination, but Not Numerosity Estimation.

Number sense is the ability to estimate the number of items, and it is common to many species. Despite the numerous studies dedicated to unveiling how numerosity is processed in the human brain, to date, it is not clear whether the representation of numerosity is supported by a single general mechanism or by multiple mechanisms. Since it is known that deafness entails a selective impairment in the processing of temporal information, we assessed the approximate numerical abilities of deaf individuals to disentangle these two hypotheses. We used a numerosity discrimination task (2AFC) and an estimation task, in both cases using sequential (temporal) or simultaneous (spatial) stimuli. The results showed a selective impairment of the deaf participants compared with the controls (hearing) in the temporal numerosity discrimination task, while no difference was found to discriminate spatial numerosity. Interestingly, the deaf and hearing participants did not differ in spatial or temporal numerosity estimation. Overall, our results suggest that the deficit in temporal processing induced by deafness also impacts perception in other domains such as numerosity, where sensory information is conveyed in a temporal format, which further suggests the existence of separate mechanisms subserving the processing of temporal and spatial numerosity.

Reduced flash lag illusion in early deaf individuals.

When a brief flash is quickly presented aligned with a moving target, the flash typically appears to lag behind the moving stimulus. This effect is widely known in the literature as a flash-lag illusion (FLI). The flash-lag is an example of a motion-induced position shift. Since auditory deprivation leads to both enhanced visual skills and impaired temporal abilities, both crucial for the perception of the flash-lag effect, here we hypothesized that lack of audition could influence the FLI. 13 early deaf and 18 hearing individuals were tested in a visual FLI paradigm to investigate this hypothesis. As expected, results demonstrated a reduction of the flash-lag effect following early deafness, both in the central and peripheral visual fields. Moreover, only for deaf individuals, there is a positive correlation between the flash-lag effect in the peripheral and central visual field, suggesting that the mechanisms underlying the effect in the center of the visual field expand to the periphery following deafness. Overall, these findings reveal that lack of audition early in life profoundly impacts early visual processing underlying the flash-lag effect.

An audio-visual motor training improves audio spatial localization skills in individuals with scotomas due to retinal degenerative diseases.

Several studies have shown that impairments in a sensory modality can induce perceptual deficits in tasks involving the remaining senses. For example, people with retinal degenerative diseases like Macular Degeneration (MD) and with central scotoma show biased auditory localization abilities towards the visual field's scotoma area. This result indicates an auditory spatial reorganization of cross-modal processing in people with scotoma when the visual information is impaired. Recent works showed that multisensory training could be beneficial to improve spatial perception. In line with this idea, here we hypothesize that audio-visual and motor training could improve people's spatial skills with retinal degenerative diseases. In the present study, we tested this hypothesis by testing two groups of scotoma patients in an auditory and visual localization task before and after a training or rest performance. The training group was tested before and after multisensory training, while the control group performed the two tasks twice after 10 min of break. The training was done with a portable device positioned on the finger, providing spatially and temporally congruent audio and visual feedback during arm movement. Our findings show improved audio and visual localization for the training group and not for the control group. These results suggest that integrating multiple spatial sensory cues can improve the spatial perception of scotoma patients. This finding ignites further research and applications for people with central scotoma for whom rehabilitation is classically focused on training visual modality only.

Audio-Visual Thumble (AVT): A low-vision rehabilitation device using multisensory feedbacks.

Since the 70s sensory substitution devices have been used for blind individuals to compensate for the lack of vision and enable them to perceive environment through intact sensory modalities. In this study, we present a rehabilitation device called Audio Visual Thumble (AVT), which is a small ring-like device with LED and buzzer, that can be worn on pharynx. We focus on a unique group of low-vision individuals with a black spot or scotoma in their visual field due to a disease called Macular Degeneration. The visual localization abilities of these individuals are highly impaired due to developing scotoma. We recently showed that also their audio localization skills are impaired [9]. Rehabilitation techniques developed so far for Macular Degeneration focus on visual modality only. Since audition can also be used to improve their spatial skills, we developed the AVT device. It permits to associate the multisensory information (audio and visual feedbacks) coming from the device with the own movement (proprioceptive feedback). We propose that the AVT has the potential to help people with visual dysfunctions to improve in the identification of audio and visual targets outside or at the edge of the residual visual field. AVT could be used for a wide range of applications combined with classical rehabilitation techniques in Macular Degeneration patients.Clinical relevance- This device can be an effective addition for low-vision rehabilitation experts and can be used combined with classical rehabilitation methods.

Early visual cortex response for sound in expert blind echolocators, but not in early blind non-echolocators.

Echolocation is a perceptual and navigational skill that can be acquired by some individuals. Regarding blind people, this skill can help them "see" the environment around them via a new form of auditory information based on echoes. Expert human echolocators benefit from using this technique not only in controlled environments but also in their everyday lives. In the current study, we investigate the effect of echolocation on blind people's auditory spatial abilities at the cortical level. In an auditory spatial bisection task, we tested people who are early blinds and early blind expert echolocators, along with sighted people. Our results showed that there is similar early activation (50-90 ms) in the posterior area of the scalp for both early blind expert echolocators and sighted participants, but not in the early blind group. This activation was related to sound stimulation, and it is contralateral to the position of the sound in space. These findings indicate that echolocation is a good substitute for the visual modality that enables the development of auditory spatial representations when vision is not available.

The Role of Temporal and Spatial Attention in Size Adaptation.

One of the most important tasks for the visual system is to construct an internal representation of the spatial properties of objects, including their size. Size perception includes a combination of bottom-up (retinal inputs) and top-down (e.g., expectations) information, which makes the estimates of object size malleable and susceptible to numerous contextual cues. For example, it has been shown that size perception is prone to adaptation: brief previous presentations of larger or smaller adapting stimuli at the same region of space changes the perceived size of a subsequent test stimulus. Large adapting stimuli cause the test to appear smaller than its veridical size and vice versa. Here, we investigated whether size adaptation is susceptible to attentional modulation. First, we measured the magnitude of adaptation aftereffects for a size discrimination task. Then, we compared these aftereffects (on average 15-20%) with those measured while participants were engaged, during the adaptation phase, in one of the two highly demanding central visual tasks: Multiple Object Tracking (MOT) or Rapid Serial Visual Presentation (RSVP). Our results indicate that deploying visual attention away from the adapters did not significantly affect the distortions of perceived size induced by adaptation, with accuracy and precision in the discrimination task being almost identical in all experimental conditions. Taken together, these results suggest that visual attention does not play a key role in size adaptation, in line with the idea that this phenomenon can be accounted for by local gain control mechanisms within area V1.

Coarse to Fine Audio-Visual Size Correspondences Develop During Primary School Age.

Developmental studies have shown that children can associate visual size with non-visual and apparently unrelated stimuli, such as pure tone frequencies. Most research to date has focused on audio-visual size associations by showing that children can associate low pure tone frequencies with large objects, and high pure tone frequencies with small objects. Researchers relate these findings to coarser association, i.e., less precise associations for which binary categories of stimuli are used such as in the case of low versus high frequencies and large versus small visual stimuli. This study investigates how finer, more precise, crossmodal audio-visual associations develop during primary school age (from 6 to 11 years old). To unveil such patterns, we took advantage of a range of auditory pure tones and tested how primary school children match sounds with visually presented shapes. We tested 66 children (6-11 years old) in an audio-visual matching task involving a range of pure tone frequencies. Visual stimuli were circles or angles of different sizes. We asked participants to indicate the shape matching the sound. All children associated large objects/angles with low pitch, and small objects/angles with high pitch sounds. Interestingly, older children made greater use of intermediate visual sizes to provide their responses. Indeed, audio-visual associations for finer differences between stimulus features such as size and pure tone frequencies, may develop later depending on the maturation of supramodal size perception processes. Considering our results, we suggest that audio-visual size correspondences can be used for educational purposes by aiding the discrimination of sizes, including angles of different aperture. Moreover, their use should be shaped according to children's specific developmental stage.

Enhanced audio-tactile multisensory interaction in a peripersonal task after echolocation.

Peripersonal space (PPS) is created by a multisensory interaction between different sensory modalities and can be modified by experience. In this article, we investigated whether an auditory training, inside the peripersonal space area, can modify the PPS around the head in sighted participants. The auditory training was based on echolocation. We measured the participant's reaction times to a tactile stimulation on the neck, while task-irrelevant looming auditory stimuli were presented. Sounds more strongly affect tactile processing when located within a limited distance from the body. We measured spatially dependent audio-tactile interaction as a proxy of PPS representation before and after an echolocation training. We found a significant speeding effect on tactile RTs after echolocation, specifically when sounds where around the location where the echolocation task was performed. This effect could not be attributed to a task repetition effect nor to a shift of spatial attention, as no changes of PPS were found in two control groups of participants, who performed the PPS task after either a break or a temporal auditory task (with stimuli located at the same position of echolocation task). These findings show that echolocation affects multisensory processing inside PPS representation, likely to better represent the space where external stimuli, have to be localized.

Can a Robot Catch You Lying? A Machine Learning System to Detect Lies During Interactions.

Deception is a complex social skill present in human interactions. Many social professions such as teachers, therapists and law enforcement officers leverage on deception detection techniques to support their work activities. Robots with the ability to autonomously detect deception could provide an important aid to human-human and human-robot interactions. The objective of this work is to demonstrate the possibility to develop a lie detection system that could be implemented on robots. To this goal, we focus on human and human robot interaction to understand if there is a difference in the behavior of the participants when lying to a robot or to a human. Participants were shown short movies of robberies and then interrogated by a human and by a humanoid robot "detectives." According to the instructions, subjects provided veridical responses to half of the question and false replies to the other half. Behavioral variables such as eye movements, time to respond and eloquence were measured during the task, while personality traits were assessed before experiment initiation. Participant's behavior showed strong similarities during the interaction with the human and the humanoid. Moreover, the behavioral features were used to train and test a lie detection algorithm. The results show that the selected behavioral variables are valid markers of deception both in human-human and in human-robot interactions and could be exploited to effectively enable robots to detect lies.

How body motion influences echolocation while walking.

This study investigated the influence of body motion on an echolocation task. We asked a group of blindfolded novice sighted participants to walk along a corridor, made with plastic sound-reflecting panels. By self-generating mouth clicks, the participants attempted to understand some spatial properties of the corridor, i.e. a left turn, a right turn or a dead end. They were asked to explore the corridor and stop whenever they were confident about the corridor shape. Their body motion was captured by a camera system and coded. Most participants were able to accomplish the task with the percentage of correct guesses above the chance level. We found a mutual interaction between some kinematic variables that can lead to optimal echolocation skills. These variables are head motion, accounting for spatial exploration, the motion stop-point of the person and the amount of correct guesses about the spatial structure. The results confirmed that sighted people are able to use self-generated echoes to navigate in a complex environment. The inter-individual variability and the quality of echolocation tasks seems to depend on how and how much the space is explored.

Early visual deprivation prompts the use of body-centered frames of reference for auditory localization.

The effects of early visual deprivation on auditory spatial processing are controversial. Results from recent psychophysical studies show that people who were born blind have a spatial impairment in localizing sound sources within specific auditory settings, while previous psychophysical studies revealed enhanced auditory spatial abilities in early blind compared to sighted individuals. An explanation of why an auditory spatial deficit is sometimes observed within blind populations and its task-dependency remains to be clarified. We investigated auditory spatial perception in early blind adults and demonstrated that the deficit derives from blind individual's reduced ability to remap sound locations using an external frame of reference. We found that performance in blind population was severely impaired when they were required to localize brief auditory stimuli with respect to external acoustic landmarks (external reference frame) or when they had to reproduce the spatial distance between two sounds. However, they performed similarly to sighted controls when had to localize sounds with respect to their own hand (body-centered reference frame), or to judge the distances of sounds from their finger. These results suggest that early visual deprivation and the lack of visual contextual cues during the critical period induce a preference for body-centered over external spatial auditory representations.

The Influence of Auditory Information on Visual Size Adaptation.

Size perception can be influenced by several visual cues, such as spatial (e.g., depth or vergence) and temporal contextual cues (e.g., adaptation to steady visual stimulation). Nevertheless, perception is generally multisensory and other sensory modalities, such as auditory, can contribute to the functional estimation of the size of objects. In this study, we investigate whether auditory stimuli at different sound pitches can influence visual size perception after visual adaptation. To this aim, we used an adaptation paradigm (Pooresmaeili et al., 2013) in three experimental conditions: visual-only, visual-sound at 100 Hz and visual-sound at 9,000 Hz. We asked participants to judge the size of a test stimulus in a size discrimination task. First, we obtained a baseline for all conditions. In the visual-sound conditions, the auditory stimulus was concurrent to the test stimulus. Secondly, we repeated the task by presenting an adapter (twice as big as the reference stimulus) before the test stimulus. We replicated the size aftereffect in the visual-only condition: the test stimulus was perceived smaller than its physical size. The new finding is that we found the auditory stimuli have an effect on the perceived size of the test stimulus after visual adaptation: low frequency sound decreased the effect of visual adaptation, making the stimulus perceived bigger compared to the visual-only condition, and contrarily, the high frequency sound had the opposite effect, making the test size perceived even smaller.

Intercepting a sound without vision.

Visual information is extremely important to generate internal spatial representations. In the auditory modality, the absence of visual cues during early infancy does not preclude the development of some spatial strategies. However, specific spatial abilities might result impaired. In the current study, we investigated the effect of early visual deprivation on the ability to localize static and moving auditory stimuli by comparing sighted and early blind individuals' performance in different spatial tasks. We also examined perceptual stability in the two groups of participants by matching localization accuracy in a static and a dynamic head condition that involved rotational head movements. Sighted participants accurately localized static and moving sounds. Their localization ability remained unchanged after rotational movements of the head. Conversely, blind participants showed a leftward bias during the localization of static sounds and a little bias for moving sounds. Moreover, head movements induced a significant bias in the direction of head motion during the localization of moving sounds. These results suggest that internal spatial representations might be body-centered in blind individuals and that in sighted people the availability of visual cues during early infancy may affect sensory-motor interactions.