Some, but not all, cochlear implant users prefer music stimuli with congruent haptic stimulation.

Cochlear implant (CI) users often report being unsatisfied by music listening through their hearing device. Vibrotactile stimulation could help alleviate those challenges. Previous research has shown that musical stimuli was given higher preference ratings by normal-hearing listeners when concurrent vibrotactile stimulation was congruent in intensity and timing with the corresponding auditory signal compared to incongruent. However, it is not known whether this is also the case for CI users. Therefore, in this experiment, we presented 18 CI users and 24 normal-hearing listeners with five melodies and five different audio-to-tactile maps. Each map varied the congruence between the audio and tactile signals related to intensity, fundamental frequency, and timing. Participants were asked to rate the maps from zero to 100, based on preference. It was shown that almost all normal-hearing listeners, as well as a subset of the CI users, preferred tactile stimulation, which was congruent with the audio in intensity and timing. However, many CI users had no difference in preference between timing aligned and timing unaligned stimuli. The results provide evidence that vibrotactile music enjoyment enhancement could be a solution for some CI users; however, more research is needed to understand which CI users can benefit from it most.

Spike timing-based coding in neuromimetic tactile system enables dynamic object classification.

Rapid processing of tactile information is essential to human haptic exploration and dexterous object manipulation. Conventional electronic skins generate frames of tactile signals upon interaction with objects. Unfortunately, they are generally ill-suited for efficient coding of temporal information and rapid feature extraction. In this work, we report a neuromorphic tactile system that uses spike timing, especially the first-spike timing, to code dynamic tactile information about touch and grasp. This strategy enables the system to seamlessly code highly dynamic information with millisecond temporal resolution on par with the biological nervous system, yielding dynamic extraction of tactile features. Upon interaction with objects, the system rapidly classifies them in the initial phase of touch and grasp, thus paving the way to fast tactile feedback desired for neuro-robotics and neuro-prosthetics.

Toward more naturalistic tactile sensors.

An artificial tactile system mimicking human touch enables effective object recognition.

Tactile cues compensate for unbalanced vestibular cues during progression on inclined surfaces.

A previous study demonstrated that rodents on an inclined square platform traveled straight vertically or horizontally and avoided diagonal travel. Through behavior they aligned their head with the horizontal plane, acquiring similar bilateral vestibular cues - a basic requirement for spatial orientation and a salient feature of animals in motion. This behavior had previously been shown to be conspicuous in Tristram's jirds. Here, therefore jirds were challenged by testing their travel behavior on a circular arena inclined at 0°-75°. Our hypothesis was that if, as typical to rodents, the jirds would follow the curved arena wall, they would need to display a compensating mechanism to enable traveling in such a path shape, which involves a tilted frontal head axis and unbalanced bilateral vestibular cues. We found that with the increase in inclination, the jirds remained more in the lower section of the arena (geotaxis). When tested on the steep inclinations, however, their travel away from the arena wall was strictly straight up or down, in contrast to the curved paths that followed the circular arena wall. We suggest that traveling along a circular path while maintaining contact with the wall (thigmotaxis), provided tactile information that compensated for the unbalanced bilateral vestibular cues present when traveling along such curved inclined paths. In the latter case, the frontal plane of the head was in a diagonal posture in relation to gravity, a posture that was avoided when traveling away from the wall.

Biases in hand perception are driven by somatosensory computations, not a distorted hand model.

To sense and interact with objects in the environment, we effortlessly configure our fingertips at desired locations. It is therefore reasonable to assume that the underlying control mechanisms rely on accurate knowledge about the structure and spatial dimensions of our hand and fingers. This intuition, however, is challenged by years of research showing drastic biases in the perception of finger geometry.1,2,3,4,5 This perceptual bias has been taken as evidence that the brain's internal representation of the body's geometry is distorted,6 leading to an apparent paradox regarding the skillfulness of our actions.7 Here, we propose an alternative explanation of the biases in hand perception-they are the result of the Bayesian integration of noisy, but unbiased, somatosensory signals about finger geometry and posture. To address this hypothesis, we combined Bayesian reverse engineering with behavioral experimentation on joint and fingertip localization of the index finger. We modeled the Bayesian integration either in sensory or in space-based coordinates, showing that the latter model variant led to biases in finger perception despite accurate representation of finger length. Behavioral measures of joint and fingertip localization responses showed similar biases, which were well fitted by the space-based, but not the sensory-based, model variant. The space-based model variant also outperformed a distorted hand model with built-in geometric biases. In total, our results suggest that perceptual distortions of finger geometry do not reflect a distorted hand model but originate from near-optimal Bayesian inference on somatosensory signals.

Enhancing touch sensibility with sensory electrical stimulation and sensory retraining.

A large proportion of stroke survivors suffer from sensory loss, negatively impacting their independence, quality of life, and neurorehabilitation prognosis. Despite the high prevalence of somatosensory impairments, our understanding of somatosensory interventions such as sensory electrical stimulation (SES) in neurorehabilitation is limited. We aimed to study the effectiveness of SES combined with a sensory discrimination task in a well-controlled virtual environment in healthy participants, setting a foundation for its potential application in stroke rehabilitation. We employed electroencephalography (EEG) to gain a better understanding of the underlying neural mechanisms and dynamics associated with sensory training and SES. We conducted a single-session experiment with 26 healthy participants who explored a set of three visually identical virtual textures-haptically rendered by a robotic device and that differed in their spatial period-while physically guided by the robot to identify the odd texture. The experiment consisted of three phases: pre-intervention, intervention, and post-intervention. Half the participants received subthreshold whole-hand SES during the intervention, while the other half received sham stimulation. We evaluated changes in task performance-assessed by the probability of correct responses-before and after intervention and between groups. We also evaluated differences in the exploration behavior, e.g., scanning speed. EEG was employed to examine the effects of the intervention on brain activity, particularly in the alpha frequency band (8-13 Hz) associated with sensory processing. We found that participants in the SES group improved their task performance after intervention and their scanning speed during and after intervention, while the sham group did not improve their task performance. However, the differences in task performance improvements between groups only approached significance. Furthermore, we found that alpha power was sensitive to the effects of SES; participants in the stimulation group exhibited enhanced brain signals associated with improved touch sensitivity likely due to the effects of SES on the central nervous system, while the increase in alpha power for the sham group was less pronounced. Our findings suggest that SES enhances texture discrimination after training and has a positive effect on sensory-related brain areas. Further research involving brain-injured patients is needed to confirm the potential benefit of our solution in neurorehabilitation.

Developmental changes of bodily self-consciousness in adolescent girls.

The body and the self change markedly during adolescence, but how does bodily self-consciousness, the pre-reflexive experience of being a bodily subject, change? We addressed this issue by studying embodiment towards virtual avatars in 70 girls aged 10-17 years. We manipulated the synchrony between participants' and avatars' touch or movement, as well as the avatar visual shape or size relative to each participant's body. A weaker avatar's embodiment in case of mismatch between the body seen in virtual reality and the real body is indicative of a more robust bodily self-consciousness. In both the visuo-tactile and the visuo-motor experiments, asynchrony decreased ownership feeling to the same extent for all participants, while the effect of asynchrony on agency feeling increased with age. In the visuo-tactile experiment, incongruence in visual appearance did not affect agency feeling but impacted ownership, especially in older teenage girls. These findings highlight the higher malleability of bodily self-consciousness at the beginning of adolescence and suggest some independence between body ownership and agency.

To touch or to be touched? comparing appraisal of vicarious execution and reception of interpersonal touch.

Unmyelinated C-Tactile (CT) fibres are activated by caress-like touch, eliciting a pleasant feeling that decreases for static and faster stroking. Previous studies documented this effect also for vicarious touch, hypothesising simulation mechanisms driving the perception and appreciation of observed interpersonal touch. Notably, less is known about appreciation of vicarious execution of touch, that is as referred to the one giving gentle touch. To address this issue, 53 healthy participants were asked to view and rate a series of videoclips displaying an individual being touched by another on hairy (i.e., hand dorsum) or glabrous (i.e., palm) skin sites, with touch being delivered at CT-optimal (5 cm/s) or non-CT optimal velocities (0 cm/s or 30 cm/s). Following the observation of each clip, participants were asked to rate self-referred desirability and model-referred pleasantness of vicarious touch for both executer (toucher-referred) and receiver (touchee-referred). Consistent with the CT fibres properties, for both self-referred desirability and model-referred pleasantness judgements of vicarious touch execution and reception, participants provided higher ratings for vicarious touch delivered at CT-optimal than other velocities, and when observed CT-optimal touch was delivered to the hand-dorsum compared to the palm. However, higher ratings were attributed to vicarious reception compared to execution of CT-optimal touch. Notably, individual differences in interoceptive trusting and attitude to interpersonal touch were positively correlated with, respectively, toucher- and touchee-related overall appraisal ratings of touch. These findings suggest that the appreciation of both toucher- and touchee-referred vicarious touch is specifically attuned to CT-optimal touch, even though they might rely on different neurocognitive mechanisms to understand affective information conveyed by interpersonal tactile interactions.

Exploring virtual reality object perception following sensory-motor interactions with different visuo-haptic collider properties.

Interacting with the environment often requires the integration of visual and haptic information. Notably, perceiving external objects depends on how our brain binds sensory inputs into a unitary experience. The feedback provided by objects when we interact (through our movements) with them might then influence our perception. In VR, the interaction with an object can be dissociated by the size of the object itself by means of 'colliders' (interactive spaces surrounding the objects). The present study investigates possible after-effects in size discrimination for virtual objects after exposure to a prolonged interaction characterized by visual and haptic incongruencies. A total of 96 participants participated in this virtual reality study. Participants were distributed into four groups, in which they were required to perform a size discrimination task between two cubes before and after 15 min of a visuomotor task involving the interaction with the same virtual cubes. Each group interacted with a different cube where the visual (normal vs. small collider) and the virtual cube's haptic (vibration vs. no vibration) features were manipulated. The quality of interaction (number of touches and trials performed) was used as a dependent variable to investigate the performance in the visuomotor task. To measure bias in size perception, we compared changes in point of subjective equality (PSE) before and after the task in the four groups. The results showed that a small visual collider decreased manipulation performance, regardless of the presence or not of the haptic signal. However, change in PSE was found only in the group exposed to the small visual collider with haptic feedback, leading to increased perception of the cube size. This after-effect was absent in the only visual incongruency condition, suggesting that haptic information and multisensory integration played a crucial role in inducing perceptual changes. The results are discussed considering the recent findings in visual-haptic integration during multisensory information processing in real and virtual environments.

Dynamic changes in somatosensory and cerebellar activity mediate temporal recalibration of self-touch.

An organism's ability to accurately anticipate the sensations caused by its own actions is crucial for a wide range of behavioral, perceptual, and cognitive functions. Notably, the sensorimotor expectations produced when touching one's own body attenuate such sensations, making them feel weaker and less ticklish and rendering them easily distinguishable from potentially harmful touches of external origin. How the brain learns and keeps these action-related sensory expectations updated is unclear. Here we employ psychophysics and functional magnetic resonance imaging to pinpoint the behavioral and neural substrates of dynamic recalibration of expected temporal delays in self-touch. Our psychophysical results reveal that self-touches are less attenuated after systematic exposure to delayed self-generated touches, while responses in the contralateral somatosensory cortex that normally distinguish between delayed and nondelayed self-generated touches become indistinguishable. During the exposure, the ipsilateral anterior cerebellum shows increased activity, supporting its proposed role in recalibrating sensorimotor predictions. Moreover, responses in the cingulate areas gradually increase, suggesting that as delay adaptation progresses, the nondelayed self-touches trigger activity related to cognitive conflict. Together, our results show that sensorimotor predictions in the simplest act of touching one's own body are upheld by a sophisticated and flexible neural mechanism that maintains them accurate in time.

Alpha interbrain synchrony during mediated interpersonal touch.

Interpersonal touch plays a crucial role in human communication, development, and wellness. Mediated interpersonal touch (MIT), a technology to distance or virtually simulated interpersonal touch, has received significant attention to counteract the negative consequences of touch deprivation. Studies investigating the effectiveness of MIT have primarily focused on self-reporting or behavioral correlates. It is largely unknown how MIT affects neural processes such as interbrain functional connectivity during human interactions. Given how users exchange haptic information simultaneously during interpersonal touch, interbrain functional connectivity provides a more ecologically valid way of studying the neural correlates associated with MIT. In this study, a palm squeeze task is designed to examine interbrain synchrony associated with MIT using EEG-based hyperscanning methodology. The phase locking value (PLV) index is used to measure interbrain synchrony. Results demonstrate that MIT elicits a significant increase in alpha interbrain synchronization between participants' brains. Especially, there was a significant difference in the alpha PLV indices between no MIT and MIT conditions in the early stage (130-470 ms) of the interaction period (t-test, p < 0.05). Given the role that alpha interbrain synchrony plays during social interaction, a significant increase in PLV index during MIT interaction seems to indicate an effect of social coordination. The findings and limitations of this study are further discussed, and perspectives on future research are provided.

Tactile adaptation to orientation produces a robust tilt aftereffect and exhibits crossmodal transfer when tested in vision.

Orientation processing is one of the most fundamental functions in both visual and somatosensory perception. Converging findings suggest that orientation processing in both modalities is closely linked: somatosensory neurons share a similar orientation organisation as visual neurons, and the visual cortex has been found to be heavily involved in tactile orientation perception. Hence, we hypothesized that somatosensation would exhibit a similar orientation adaptation effect, and this adaptation effect would be transferable between the two modalities, considering the above-mentioned connection. The tilt aftereffect (TAE) is a demonstration of orientation adaptation and is used widely in behavioural experiments to investigate orientation mechanisms in vision. By testing the classic TAE paradigm in both tactile and crossmodal orientation tasks between vision and touch, we were able to show that tactile perception of orientation shows a very robust TAE, similar to its visual counterpart. We further show that orientation adaptation in touch transfers to produce a TAE when tested in vision, but not vice versa. Additionally, when examining the test sequence following adaptation for serial effects, we observed another asymmetry between the two conditions where the visual test sequence displayed a repulsive intramodal serial dependence effect while the tactile test sequence exhibited an attractive serial dependence. These findings provide concrete evidence that vision and touch engage a similar orientation processing mechanism. However, the asymmetry in the crossmodal transfer of TAE and serial dependence points to a non-reciprocal connection between the two modalities, providing further insights into the underlying processing mechanism.

Tactile shape discrimination for moving stimuli.

In this study, we explored spatial-temporal dependencies and their impact on the tactile perception of moving objects. Building on previous research linking visual perception and human movement, we examined if an imputed motion mechanism operates within the tactile modality. We focused on how biological coherence between space and time, characteristic of human movement, influences tactile perception. An experiment was designed wherein participants were stimulated on their right palm with tactile patterns, either ambiguous (incongruent conditions) or non-ambiguous (congruent conditions) relative to a biological motion law (two-thirds power law) and asked to report perceived shape and associated confidence. Our findings reveal that introducing ambiguous tactile patterns (1) significantly diminishes tactile discrimination performance, implying motor features of shape recognition in vision are also observed in the tactile modality, and (2) undermines participants' response confidence, uncovering the accessibility degree of information determining the tactile percept's conscious representation. Analysis based on the Hierarchical Drift Diffusion Model unveiled the sensitivity of the evidence accumulation process to the stimulus's informational ambiguity and provides insight into tactile perception as predictive dynamics for reducing uncertainty. These discoveries deepen our understanding of tactile perception mechanisms and underscore the criticality of predictions in sensory information processing.

Vision matters for shape representation: Evidence from sculpturing and drawing in the blind.

Shape is a property that could be perceived by vision and touch, and is classically considered to be supramodal. While there is mounting evidence for the shared cognitive and neural representation space between visual and tactile shape, previous research tended to rely on dissimilarity structures between objects and had not examined the detailed properties of shape representation in the absence of vision. To address this gap, we conducted three explicit object shape knowledge production experiments with congenitally blind and sighted participants, who were asked to produce verbal features, 3D clay models, and 2D drawings of familiar objects with varying levels of tactile exposure, including tools, large nonmanipulable objects, and animals. We found that the absence of visual experience (i.e., in the blind group) led to stronger differences in animals than in tools and large objects, suggesting that direct tactile experience of objects is essential for shape representation when vision is unavailable. For tools with rich tactile/manipulation experiences, the blind produced overall good shapes comparable to the sighted, yet also showed intriguing differences. The blind group had more variations and a systematic bias in the geometric property of tools (making them stubbier than the sighted), indicating that visual experience contributes to aligning internal representations and calibrating overall object configurations, at least for tools. Taken together, the object shape representation reflects the intricate orchestration of vision, touch and language.

Cortical activations associated with spatial remapping of finger touch using EEG.

The spatial coding of tactile information is functionally essential for touch-based shape perception and motor control. However, the spatiotemporal dynamics of how tactile information is remapped from the somatotopic reference frame in the primary somatosensory cortex to the spatiotopic reference frame remains unclear. This study investigated how hand position in space or posture influences cortical somatosensory processing. Twenty-two healthy subjects received electrical stimulation to the right thumb (D1) or little finger (D5) in three position conditions: palm down on right side of the body (baseline), hand crossing the body midline (effect of position), and palm up (effect of posture). Somatosensory-evoked potentials (SEPs) were recorded using electroencephalography. One early-, two mid-, and two late-latency neurophysiological components were identified for both fingers: P50, P1, N125, P200, and N250. D1 and D5 showed different cortical activation patterns: compared with baseline, the crossing condition showed significant clustering at P1 for D1, and at P50 and N125 for D5; the change in posture showed a significant cluster at N125 for D5. Clusters predominated at centro-parietal electrodes. These results suggest that tactile remapping of fingers after electrical stimulation occurs around 100-125 ms in the parietal cortex.

Cortical cellular encoding of thermotactile integration.

Recent evidence suggests that primary sensory cortical regions play a role in the integration of information from multiple sensory modalities. How primary cortical neurons integrate different sources of sensory information is unclear, partly because non-primary sensory input to a cortical sensory region is often weak or modulatory. To address this question, we take advantage of the robust representation of thermal (cooling) and tactile stimuli in mouse forelimb primary somatosensory cortex (fS1). Using a thermotactile detection task, we show that the perception of threshold-level cool or tactile information is enhanced when they are presented simultaneously, compared with presentation alone. To investigate the cortical cellular correlates of thermotactile integration, we performed in vivo extracellular recordings from fS1 in awake resting and anesthetized mice during unimodal and bimodal stimulation of the forepaw. Unimodal stimulation evoked thermal- or tactile- specific excitatory and inhibitory responses of fS1 neurons. The most prominent features of combined thermotactile stimulation are the recruitment of unimodally silent fS1 neurons, non-linear integration features, and response dynamics that favor longer response durations with additional spikes. Together, we identify quantitative and qualitative changes in cortical encoding that may underlie the improvement in perception of thermotactile surfaces during haptic exploration.

Autonomic and hedonic response to affective touch in autism spectrum disorder.

Interpersonal touch plays a crucial role in shaping relationships and encouraging social connections. Failure in processing tactile input or abnormal tactile sensitivity may hamper social behaviors and have severe consequences in individuals' relational lives. Autism Spectrum Disorder (ASD) is characterized by both sensory disruptions and social impairments, making affective touch an ideal meeting point for understanding these features in ASD individuals. By integrating behavioral and physiological measures, we investigated the effects of affective touch on adult individuals with ASD from both an implicit and explicit perspective. Specifically, at an implicit level, we investigated whether and how receiving an affective touch influenced participants' skin conductance tonic and phasic components. At the explicit level, we delved into the affective and unpleasant features of affective touch. Overall, we observed lower skin conductance level in ASD compared to TD subjects. Interestingly, the typically developing (TD) group showed an increased autonomic response for affective touch compared to a control touch, while ASD subjects' autonomic response did not differ between the two conditions. Furthermore, ASD participants provided higher ratings for both the affective and unpleasant components of the touch, compared to TD subjects. Our results reveal a noteworthy discrepancy in ASD population between the subjective experience, characterized by amplified hedonic but also unpleasant responses, and the physiological response, marked by a lack of autonomic activation related to affective touch. This insightful dissociation seems crucial for a deeper understanding of the distinctive challenges characterizing people with ASD and may have implications for diagnosis and therapeutic approaches.

Fluid face but not gender: Enfacement illusion through digital face filters does not affect gender identity.

It has been shown that observing a face being touched or moving in synchrony with our own face increases self-identification with the former which might alter both cognitive and affective processes. The induction of this phenomenon, termed enfacement illusion, has often relied on laboratory tools that are unavailable to a large audience. However, digital face filters applications are nowadays regularly used and might provide an interesting tool to study similar mechanisms in a wider population. Digital filters are able to render our faces in real time while changing important facial features, for example, rendering them more masculine or feminine according to normative standards. Recent literature using full-body illusions has shown that participants' own gender identity shifts when embodying a different gendered avatar. Here we studied whether participants' filtered faces, observed while moving in synchrony with their own face, may induce an enfacement illusion and if so, modulate their gender identity. We collected data from 35 female and 33 male participants who observed a stereotypically gender mismatched version of themselves either moving synchronously or asynchronously with their own face on a screen. Our findings showed a successful induction of the enfacement illusion in the synchronous condition according to a questionnaire addressing the feelings of ownership, agency and perceived similarity. However, we found no evidence of gender identity being modulated, neither in explicit nor in implicit measures of gender identification. We discuss the distinction between full-body and facial processing and the relevance of studying widely accessible devices that may impact the sense of a bodily self and our cognition, emotion and behaviour.

Evolutionarily conserved neural responses to affective touch in monkeys transcend consciousness and change with age.

Affective touch-a slow, gentle, and pleasant form of touch-activates a different neural network than which is activated during discriminative touch in humans. Affective touch perception is enabled by specialized low-threshold mechanoreceptors in the skin with unmyelinated fibers called C tactile (CT) afferents. These CT afferents are conserved across mammalian species, including macaque monkeys. However, it is unknown whether the neural representation of affective touch is the same across species and whether affective touch's capacity to activate the hubs of the brain that compute socioaffective information requires conscious perception. Here, we used functional MRI to assess the preferential activation of neural hubs by slow (affective) vs. fast (discriminative) touch in anesthetized rhesus monkeys (Macaca mulatta). The insula, anterior cingulate cortex (ACC), amygdala, and secondary somatosensory cortex were all significantly more active during slow touch relative to fast touch, suggesting homologous activation of the interoceptive-allostatic network across primate species during affective touch. Further, we found that neural responses to affective vs. discriminative touch in the insula and ACC (the primary cortical hubs for interoceptive processing) changed significantly with age. Insula and ACC in younger animals differentiated between slow and fast touch, while activity was comparable between conditions for aged monkeys (equivalent to >70 y in humans). These results, together with prior studies establishing conserved peripheral nervous system mechanisms of affective touch transduction, suggest that neural responses to affective touch are evolutionarily conserved in monkeys, significantly impacted in old age, and do not necessitate conscious experience of touch.

Theta Phase Entrainment of Single-Cell Spiking in Rat Somatosensory Barrel Cortex and Secondary Visual Cortex Is Enhanced during Multisensory Discrimination Behavior.

Phase entrainment of cells by theta oscillations is thought to globally coordinate the activity of cell assemblies across different structures, such as the hippocampus and neocortex. This coordination is likely required for optimal processing of sensory input during recognition and decision-making processes. In quadruple-area ensemble recordings from male rats engaged in a multisensory discrimination task, we investigated phase entrainment of cells by theta oscillations in areas along the corticohippocampal hierarchy: somatosensory barrel cortex (S1BF), secondary visual cortex (V2L), perirhinal cortex (PER), and dorsal hippocampus (dHC). Rats discriminated between two 3D objects presented in tactile-only, visual-only, or both tactile and visual modalities. During task engagement, S1BF, V2L, PER, and dHC LFP signals showed coherent theta-band activity. We found phase entrainment of single-cell spiking activity to locally recorded as well as hippocampal theta activity in S1BF, V2L, PER, and dHC. While phase entrainment of hippocampal spikes to local theta oscillations occurred during sustained epochs of task trials and was nonselective for behavior and modality, somatosensory and visual cortical cells were only phase entrained during stimulus presentation, mainly in their preferred modality (S1BF, tactile; V2L, visual), with subsets of cells selectively phase-entrained during cross-modal stimulus presentation (S1BF: visual; V2L: tactile). This effect could not be explained by modulations of firing rate or theta amplitude. Thus, hippocampal cells are phase entrained during prolonged epochs, while sensory and perirhinal neurons are selectively entrained during sensory stimulus presentation, providing a brief time window for coordination of activity.