Differential Hemodynamic Responses to Motor and Tactile Imagery: Insights from Multichannel fNIRS Mapping.

Tactile and motor imagery are crucial components of sensorimotor functioning and cognitive neuroscience research, yet the neural mechanisms of tactile imagery remain underexplored compared to motor imagery. This study employs multichannel functional near-infrared spectroscopy (fNIRS) combined with image reconstruction techniques to investigate the neural hemodynamics associated with tactile (TI) and motor imagery (MI). In a study of 15 healthy participants, we found that MI elicited significantly greater hemodynamic responses (HRs) in the precentral area compared to TI, suggesting the involvement of different cortical areas involved in two different types of sensorimotor mental imagery. Concurrently, the HRs in S1 and parietal areas exhibited comparable patterns in both TI and MI. During MI, both motor and somatosensory areas demonstrated comparable HRs. However, in TI, somatosensory activation was observed to be more pronounced. Our results highlight the distinctive neural profiles of motor versus tactile imagery and indicate fNIRS technique to be sensitive for this. This distinction is significant for fundamental understanding of sensorimotor integration and for developing advanced neurotechnologies, including imagery-based brain-computer interfaces (BCIs) that can differentiate between different types of mental imagery.

Effects of unconscious tactile stimuli on autonomic nervous activity and afferent signal processing.

Autonomic nervous system (ANS) is a mechanism that regulates our internal environment. In recent years, the interest in how tactile stimuli presented directly to the body affect ANS function and cortical processing in humans has been renewed. However, it is not yet clear how subtle tactile stimuli below the level of consciousness affect human heart rate and cortical processing. To examine this, subthreshold electrical stimuli were presented to the left forearm of 43 participants during an image-viewing task, and electrocardiogram (ECG) and electroencephalogram (EEG) data were collected. The changes in the R-wave interval of the ECG immediately after the subthreshold electrical presentation and heartbeat-evoked potential (HEP), the afferent signal processing of cardiac activity, were measured. The results showed that heart rate decelerated immediately after the presentation of subthreshold electrical stimuli. The HEP during stimulus presentation was amplified for participants with greater heart rate acceleration immediately after this deceleration. The magnitude of these effects depended on the type of the subthreshold tactile stimuli. The results suggest that even with subthreshold stimulation, the changes in autonomic activity associated with orienting response and related afferent signal processing differ depending on the clarity of the tactile stimuli.

Instilling the perception of weight in augmented reality using minimal haptic feedback.

Humans perceive gravitational forces on their surroundings through a mix of visual and sensorimotor cues. The accurate presentation of such cues is a difficult task in Mixed/Augmented Reality (MR/AR), technological paradigms that blend physical and virtual elements to enhance the way we interact with our environment. Realistically perceiving the weight of virtual elements within a MR/AR scenario aids in the embodiment of those elements within the user's reality, further blurring the lines between what is real and virtual. Unfortunately, current force feedback devices are not designed for or are entirely compatible with MR/AR experiences. To address this need, we explore minimal haptic feedback for weight perception in MR/AR, aiming to simplify the rendering of gravitational cues that are crucial to an immersive experience. Our benchtop device, focused on wrist feedback, showed improved user experience even within an implicit weight feedback task, i.e., a task where weight perception was not required for task completion. However, challenges arose in mixed real-virtual environments, a cornerstone of MR/AR interaction, where weight discrimination was observed to be less accurate. To address this, we developed a compensation scheme for virtual weights, leading to performance on par with a purely virtual environment. Our work demonstrates the viability of minimal haptic feedback in MR/AR applications and highlights the importance of integrating weight perception for increased realism. Our work also fills a research gap in MR/AR development, providing insights for designing future MR/AR systems that integrate with human sensory mechanisms to create virtual interactions that more closely mirror the physical world.

Audio visual stimuli based out of body illusion.

Previous studies have reported that bodily self-consciousness could be altered so that one's body was perceived in extra-personal space. However, whether this could be induced without tactile stimuli has not been investigated. We investigated whether out-of-body illusion could be induced via synchronized audio-visual stimuli, in which auditory stimuli were used instead of tactile stimuli. We conducted an experiment in which a sounding bell was moved in front of the participant, and synchronously, a non-sounding bell was moved in front of a camera that captured the image and projected on a head-mounted device. We expected the participants to experience that the sound came from the non-sounding bell in the video and they were in the camera's position. Results from the questionnaires conducted after the experiment revealed that items related to out-of-body illusion were significantly enhanced in the synchronized conditions. Furthermore, participants reported a similarly strong out-of-body illusion for both the synchronized audio-visual and tactile-visual stimuli. This study demonstrated that out-of-body illusion could also be induced by synchronized audio-visual stimuli, which was a novel finding.

Convergent representation of values from tactile and visual inputs for efficient goal-directed behavior in the primate putamen.

Animals can discriminate diverse sensory values with a limited number of neurons, raising questions about how the brain utilizes neural resources to efficiently process multi-dimensional inputs for decision-making. Here, we demonstrate that this efficiency is achieved by reducing sensory dimensions and converging towards the value dimension essential for goal-directed behavior in the putamen. Humans and monkeys performed tactile and visual value discrimination tasks while their neural responses were examined. Value information, whether originating from tactile or visual stimuli, was found to be processed within the human putamen using fMRI. Notably, at the single-neuron level in the macaque putamen, half of the individual neurons encode values independently of sensory inputs, while the other half selectively encode tactile or visual value. The responses of bimodal value neurons correlate with value-guided finger insertion behavior in both tasks, whereas modality-selective value neurons show task-specific correlations. Simulation using these neurons reveals that the presence of bimodal value neurons enables value discrimination with a significantly reduced number of neurons compared to simulations without them. Our data indicate that individual neurons in the primate putamen process different values in a convergent manner, thereby facilitating the efficient use of constrained neural resources for value-guided behavior.

Tactile stimulation designs adapted to clinical settings result in reliable fMRI-based somatosensory digit maps.

Movement constraints in stroke survivors are often accompanied by additional impairments in related somatosensory perception. A complex interplay between the primary somatosensory and motor cortices is essential for adequate and precise movements. This necessitates investigating the role of the primary somatosensory cortex in movement deficits of stroke survivors. The first step towards this goal could be a fast and reliable functional Magnetic Resonance Imaging (fMRI)-based mapping of the somatosensory cortex applicable for clinical settings. Here, we compare two 3 T fMRI-based somatosensory digit mapping techniques adapted for clinical usage in seven neurotypical volunteers and two sessions, to assess their validity and retest-reliability. Both, the traveling wave and the blocked design approach resulted in complete digit maps in both sessions of all participants, showing the expected layout. Similarly, no evidence for differences in the volume of activation, nor the activation overlap between neighboring activations could be detected, indicating the general feasibility of the clinical adaptation and their validity. Retest-reliability, indicated by the Dice coefficient, exhibited reasonable values for the spatial correspondence of single digit activations across sessions, but low values for the spatial correspondence of the area of overlap between neighboring digits across sessions. Parameters describing the location of the single digit activations exhibited very high correlations across sessions, while activation volume and overlap only exhibited medium to low correlations. The feasibility and high retest-reliabilities for the parameters describing the location of the single digit activations are promising concerning the implementation into a clinical context to supplement diagnosis and treatment stratification in upper limb stroke patients.

Pupil dilation responds to the intrinsic social characteristics of affective touch.

Affective Touch is characterized by both emotional and arousing dimensions that rely on specific features of a gentle human caress. In this study, we investigated whether and how both the nature of the touching effector (Human hand vs. Artificial hand) and touch type (Dynamic vs. Static) influenced the participants' pupil dilation and their subjective experience during tactile stimulation. We observed that when participants received a dynamic touch, their pupil dilation increased more when the touch was produced by a human compared to an artificial hand. This discrimination was not present for static touch. Also, dynamic touch given by a human hand invoked a supralinear enhancement of pupil dilation indicating that the combination of these two features induced a stronger autonomic activation than the summed effects of each separately. Moreover, this specific type of touch was perceived as the most pleasant compared to all other tactile stimulations. Overall, our results suggest that pupil dilation could reflect the pleasant experience of human-to-human tactile interactions, supporting the notion that the autonomic nervous system is responsive to the emotional and hedonic aspects associated with Affective Touch as a part of a complex and holistic social experience, rather than solely reacting to its low-level sensory properties.

Brain-to-brain synchrony increased during interpersonal touch in romantic lovers: an EEG-based hyperscanning study.

BACKGROUND: Interpersonal touch is an essential element of human social life. It's unclear whether the neural patterns of interpersonal touch are specific to intimate relationships or generally apply to other social relationships. Romantic lovers are typically intimate and have a high level of interpersonal touch. Currently, researchers focused on the neurobiological basis and neural processes of romantic love. METHODS: 110 participants finished two resting-state blocks, no-handholding and handholding conditions, with Electroencephalogram (EEG). We aimed to explore the differences in the brain-brain synchrony pattern of interpersonal touch between romantic lovers and strangers by calculating dynamic interpersonal functional connectivity (dIFC) via EEG-based hyperscanning. RESULTS: Our results supported that the neural processing of interpersonal touch is a dynamic process. At first half, both groups tended to adapt, and then interpersonal touch increased the dIFC between romantic lovers and decreased the dIFC between strangers. Finally, we employed Support Vector Machine (SVM) to classify EEG signals into two different relationships. SVM recognized two relationships with an accuracy of 71% and 0.77 AUC of ROC at the first half, a 73% accuracy and 0.8 AUC of ROC at the second half. CONCLUSIONS: Our study indicates that interpersonal touch may have different meanings between romantic lovers and strangers. Specifically, interpersonal touch enhances the dIFC between romantic lovers while reducing the dIFC between strangers. The research has important implications for planning touch-based interventions in social and medical care.

A bioinspired tactile scanner for computer haptics.

Computer haptics (CH) is about integration of tactile sensation and rendering in Metaverse. However, unlike computer vision (CV) where both hardware infrastructure and software programs are well developed, a generic tactile data capturing device that serves the same role as what a camera does for CV, is missing. Bioinspired by electrophysiological processes in human tactile somatosensory nervous system, here we propose a tactile scanner along with a neuromorphically-engineered system, in which a closed-loop tactile acquisition and rendering (re-creation) are preliminarily achieved. Based on the architecture of afferent nerves and intelligent functions of mechano-gating and leaky integrate-and-fire models, such a tactile scanner is designed and developed by using piezoelectric transducers as axon neurons and thin film transistor (TFT)-based neuromorphic circuits to mimic synaptic behaviours and neural functions. As an example, the neuron-like tactile information of surface textures is captured and further used to render the texture friction of a virtual surface for "recreating" a "true" feeling of touch.

Optimality of multisensory integration while compensating for uncertain visual target information with artificial vibrotactile cues during reach planning.

BACKGROUND: Planning and executing movements requires the integration of different sensory modalities, such as vision and proprioception. However, neurological diseases like stroke can lead to full or partial loss of proprioception, resulting in impaired movements. Recent advances focused on providing additional sensory feedback to patients to compensate for the sensory loss, proving vibrotactile stimulation to be a viable option as it is inexpensive and easy to implement. Here, we test how such vibrotactile information can be integrated with visual signals to estimate the spatial location of a reach target. METHODS: We used a center-out reach paradigm with 31 healthy human participants to investigate how artificial vibrotactile stimulation can be integrated with visual-spatial cues indicating target location. Specifically, we provided multisite vibrotactile stimulation to the moving dominant arm using eccentric rotating mass (ERM) motors. As the integration of inputs across multiple sensory modalities becomes especially relevant when one of them is uncertain, we additionally modulated the reliability of visual cues. We then compared the weighing of vibrotactile and visual inputs as a function of visual uncertainty to predictions from the maximum likelihood estimation (MLE) framework to decide if participants achieve quasi-optimal integration. RESULTS: Our results show that participants could estimate target locations based on vibrotactile instructions. After short training, combined visual and vibrotactile cues led to higher hit rates and reduced reach errors when visual cues were uncertain. Additionally, we observed lower reaction times in trials with low visual uncertainty when vibrotactile stimulation was present. Using MLE predictions, we found that integration of vibrotactile and visual cues followed optimal integration when vibrotactile cues required the detection of one or two active motors. However, if estimating the location of a target required discriminating the intensities of two cues, integration violated MLE predictions. CONCLUSION: We conclude that participants can quickly learn to integrate visual and artificial vibrotactile information. Therefore, using additional vibrotactile stimulation may serve as a promising way to improve rehabilitation or the control of prosthetic devices by patients suffering loss of proprioception.

Brain Encoding of Naturalistic, Continuous, and Unpredictable Tactile Events.

Studies employing EEG to measure somatosensory responses have been typically optimized to compute event-related potentials in response to discrete events. However, tactile interactions involve continuous processing of nonstationary inputs that change in location, duration, and intensity. To fill this gap, this study aims to demonstrate the possibility of measuring the neural tracking of continuous and unpredictable tactile information. Twenty-seven young adults (females, 15) were continuously and passively stimulated with a random series of gentle brushes on single fingers of each hand, which were covered from view. Thus, tactile stimulations were unique for each participant and stimulated fingers. An encoding model measured the degree of synchronization between brain activity and continuous tactile input, generating a temporal response function (TRF). Brain topographies associated with the encoding of each finger stimulation showed a contralateral response at central sensors starting at 50 ms and peaking at ∼140 ms of lag, followed by a bilateral response at ∼240 ms. A series of analyses highlighted that reliable tactile TRF emerged after just 3 min of stimulation. Strikingly, topographical patterns of the TRF allowed discriminating digit lateralization across hands and digit representation within each hand. Our results demonstrated for the first time the possibility of using EEG to measure the neural tracking of a naturalistic, continuous, and unpredictable stimulation in the somatosensory domain. Crucially, this approach allows the study of brain activity following individualized, idiosyncratic tactile events to the fingers.

Bioinspired adaptable multiplanar mechano-vibrotactile haptic system.

Several gaps persist in haptic device development due to the multifaceted nature of the sense of touch. Existing gaps include challenges enhancing touch feedback fidelity, providing diverse haptic sensations, and ensuring wearability for delivering tactile stimuli to the fingertips. Here, we introduce the Bioinspired Adaptable Multiplanar Haptic system, offering mechanotactile/steady and vibrotactile pulse stimuli with adjustable intensity (up to 298.1 mN) and frequencies (up to 130 Hz). This system can deliver simultaneous stimuli across multiple fingertip areas. The paper includes a full characterisation of our system. As the device can play an important role in further understanding human touch, we performed human stimuli sensitivity and differentiation experiments to evaluate the capability of delivering mechano-vibrotactile, variable intensity, simultaneous, multiplanar and operator agnostic stimuli. Our system promises to accelerate the development of touch perception devices, providing painless, operator-independent data crucial for researching and diagnosing touch-related disorders.

Integrating vision and somatosensation does not improve the accuracy and response time when estimating area and perimeter of rectangles in primary school.

BACKGROUND: Problem-solving and learning in mathematics involves sensory perception and processing. Multisensory integration may contribute by enhancing sensory estimates. This study aims to assess if combining visual and somatosensory information improves elementary students' perimeter and area estimates. METHODS: 87 4th graders compared rectangles with respect to area or perimeter either solely using visual observation or additionally with somatosensory information. Three experiments targeted different task aspects. Statistical analyses tested success rates and response times. RESULTS: Contrary to expectations, adding somatosensory information did not boost success rates for area and perimeter comparison. Response time even increased with adding somatosensory information. Children's difficulty in accurately tracing figures negatively impacted the success rate of area comparisons. DISCUSSION: Results suggest visual observation alone suffices for accurately estimating and comparing area and perimeter of rectangles in 4th graders. IMPLICATIONS: Careful deliberation on the inclusion of somatosensory information in mathematical tasks concerning perimeter and area estimations of rectangles is recommended.

Resting-state functional connectivity involved in tactile orientation processing.

BACKGROUND: Grating orientation discrimination (GOD) is commonly used to assess somatosensory spatial processing. It allows discrimination between parallel and orthogonal orientations of tactile stimuli applied to the fingertip. Despite its widespread application, the underlying mechanisms of GOD, particularly the role of cortico-cortical interactions and local brain activity in this process, remain elusive. Therefore, we aimed to investigate how a specific cortico-cortical network and inhibitory circuits within the primary somatosensory cortex (S1) and secondary somatosensory cortex (S2) contribute to GOD. METHODS: In total, 51 healthy young adults were included in our study. We recorded resting-state magnetoencephalography (MEG) and somatosensory-evoked magnetic field (SEF) in participants with open eyes. We converted the data into a source space based on individual structural magnetic resonance imaging. Next, we estimated S1- and S2-seed resting-state functional connectivity (rs-FC) at the alpha and beta bands through resting-state MEG using the amplitude envelope correlation method across the entire brain (i.e., S1/S2-seeds × 15,000 vertices × two frequencies). We assessed the inhibitory response in the S1 and S2 from SEFs using a paired-pulse paradigm. We automatically measured the GOD task in parallel and orthogonal orientations to the index finger, applying various groove widths with a custom-made device. RESULTS: We observed a specific association between the GOD threshold (all P < 0.048) and the alpha rs-FC in the S1-superior parietal lobule and S1-adjacent to the parieto-occipital sulcus (i.e., lower rs-FC values corresponded to higher performance). In contrast, no association was observed between the local responses and the threshold. DISCUSSION: The results of this study underpin the significance of specific cortico-cortical networks in recognizing variations in tactile stimuli.

Artificial embodiment displaces cortical neuromagnetic somatosensory responses.

Integrating artificial limbs as part of one's body involves complex neuroplastic changes resulting from various sensory inputs. While somatosensory feedback is crucial, plastic processes that enable embodiment remain unknown. We investigated this using somatosensory evoked fields (SEFs) in the primary somatosensory cortex (S1) following the Rubber Hand Illusion (RHI), known to quickly induce artificial limb embodiment. During electrical stimulation of the little finger and thumb, 19 adults underwent neuromagnetic recordings before and after the RHI. We found early SEF displacement, including an illusion-brain correlation between extent of embodiment and specific changes to the first cortical response at 20 ms in Area 3b, within S1. Furthermore, we observed a posteriorly directed displacement at 35 ms towards Area 1, known to be important for visual integration during touch perception. That this second displacement was unrelated to extent of embodiment implies a functional distinction between neuroplastic changes of these components and areas. The earlier shift in Area 3b may shape extent of limb ownership, while subsequent displacement into Area 1 may relate to early visual-tactile integration that initiates embodiment. Here we provide evidence for multiple neuroplastic processes in S1-lasting beyond the illusion-supporting integration of artificial limbs like prostheses within the body representation.

Haptic experience of bodies alters body perception.

Research on media's effects on body perception has mainly focused on the role of vision of extreme body types. However, haptics is a major part of the way children experience bodies. Playing with unrealistically thin dolls has been linked to the emergence of body image concerns, but the perceptual mechanisms remain unknown. We explore the effects of haptic experience of extreme body types on body perception, using adaptation aftereffects. Blindfolded participants judged whether the doll-like stimuli explored haptically were thinner or fatter than the average body before and after adaptation to an underweight or overweight doll. In a second experiment, participants underwent a traditional visual adaptation paradigm to extreme bodies, using stimuli matched to those in Experiment 1. For both modalities, after adaptation to an underweight body test bodies were judged as fatter. Adaptation to an overweight body produced opposite results. For the first time, we show adiposity aftereffects in haptic modality, analogous to those established in vision, using matched stimuli across visual and haptic paradigms.

Saccades to both vision and touch are modified following adaptation but cross-modal transfers are asymmetrical.

Adaptation of reactive saccades (RS), made toward the sudden appearance of stimuli in our environment, is a plastic mechanism thought to occur at the motor level of saccade generation. As saccadic oculomotor commands integrate multisensory information in the parietal cortex and superior colliculus, adaptation of RS should occur not only toward visual but also tactile targets. In addition, saccadic adaptation in one modality (vision or touch) should transfer cross-modally. To test these predictions, we used the double-step target paradigm to adapt rightward saccades made at two different eccentricities toward the participants' index and middle fingers, identified either visually (experiment 1) or tactually (experiment 2). In each experiment, the rate of adaptation induced for the adapted modality and the rate of adaptation transfer to the nonadapted modality were compared with that measured in a control (no adaptation) session. Results revealed that touch-triggered RS can be adapted as well as visually triggered ones. Moreover, the transfer pattern was asymmetric: visual saccadic adaptation transferred fully to tactile saccades, whereas tactile saccadic adaptation, despite full generalization to nonadapted fingers, transferred only partially to visual saccades. These findings disclose that in the case of tactile saccades, adaptation can be elicited in the absence of postsaccadic visual feedback. In addition, the asymmetric adaptation transfer across sensory modalities suggests that the adaptation locus for tactile saccades may occur in part upstream of the final motor pathway common to all saccades. These findings bring new insights both on the functional loci(us) and on the error signals of RS adaptation. NEW & NOTEWORTHY The present study revealed that, as predicted from a large literature, adaptation of visual reactive saccades transfers to tactile saccades of the same as well as neighboring amplitudes. Furthermore, in a modified double-step target paradigm, tactile saccades exposed to repeated errors adapt with a similar rate and spatial generalization as visual saccades, but this adaptation only slightly transfers to visual saccades. These findings bring new information on saccadic adaptation processes.

Neuro-cognitive effects of degraded visibility on illusory body ownership.

Based on visuo-tactile stimulation, the rubber hand illusion induces a sense of ownership for a dummy hand. Manipulating the visibility of the dummy hand during the stimulation influences cognitive aspects of the illusion, suggesting that the related brain activity may be influenced too. To test this, we analyzed brain activity (fMRI), subjective ratings, and skin conductance from 45 neurotypical participants undergoing a modified rubber hand illusion protocol where we manipulated the visibility (high, medium, and low) of a virtual hand, not the brush (virtual hand illusion; VHI). To further investigate the impact of visibility manipulations on VHI-related secondary effects (i.e. vicarious somatosensation), we recorded brain activity and skin conductance during a vicarious pain protocol (observation of painful stimulations of the virtual hand) that occurred after the VHI procedure. Results showed that, during both the VHI and vicarious pain periods, the activity of distinct visual, somatosensory, and motor brain regions was modulated by (i) visibility manipulations, (ii) coherence between visual and tactile stimulation, and (iii) time of visuo-tactile stimulation. Accordingly, embodiment-related subjective ratings of the perceived illusion were specifically influenced by visibility manipulations. These findings suggest that visibility modifications can impact the neural and cognitive effects of illusory body ownership, in that when visibility decreases the illusion is perceived as weaker and the brain activity in visual, motor, and somatosensory regions is overall lower. We interpret this evidence as a sign of the weight of vision on embodiment processes, in that the cortical and subjective aspects of illusory body ownership are weakened by a degradation of visual input during the induction of the illusion.

Oscillatory cortico-cortical connectivity during tactile discrimination between dynamic and static stimulation.

Fine sensory modalities play an essential role in perceiving the world. However, little is known about how the cortico-cortical distinguishes between dynamic and static tactile signals. This study investigated oscillatory connectivity during a tactile discrimination task of dynamic and static stimulation via electroencephalogram (EEG) recordings and the fast oscillatory networks across widespread cortical regions. While undergoing EEG recordings, the subject felt an electro-tactile presented by a 3-dot array. Each block consisted of 3 forms of stimulation: Spatio-temporal (dynamic), Spatial (static), and Control condition (lack of electrical stimulation). The average event-related potential for the Spatial and Spatio-temporal conditions exhibited statistically significant differences between 25 and 75, 81 and 121, 174 and 204 and 459 and 489 ms after stimulus onset. Based on those times, the sLORETA approach was used to reconstruct the inverse solutions of EEG. Source localization appeared superior parietal at around 25 to 75 ms, in the primary motor cortex at 81 to 121 ms, in the central prefrontal cortex at 174 to 204 and 459 to 489 ms. To better assess spectral brain functional connectivity, we selected frequency ranges with correspondingly significant differences: for static tactile stimulation, these are concentrated in the Theta, Alpha, and Gamma bands, whereas for dynamic stimulation, the relative energy change bands are focused on the Theta and Alpha bands. These nodes' functional connectivity analysis (phase lag index) showed 3 distinct distributed networks. A tactile information discrimination network linked the Occipital lobe, Prefrontal lobe, and Postcentral gyrus. A tactile feedback network linked the Prefrontal lobe, Postcentral gyrus, and Temporal lobe. A dominant motor feedforward loop network linked the Parietal cortex, Prefrontal lobe, Frontal lobe, and Parietal cortex. Processing dynamic and static tactile signals involves discriminating tactile information, motion planning, and cognitive decision processing.