Improved tactile speech perception and noise robustness using audio-to-tactile sensory substitution with amplitude envelope expansion.

Recent advances in haptic technology could allow haptic hearing aids, which convert audio to tactile stimulation, to become viable for supporting people with hearing loss. A tactile vocoder strategy for audio-to-tactile conversion, which exploits these advances, has recently shown significant promise. In this strategy, the amplitude envelope is extracted from several audio frequency bands and used to modulate the amplitude of a set of vibro-tactile tones. The vocoder strategy allows good consonant discrimination, but vowel discrimination is poor and the strategy is susceptible to background noise. In the current study, we assessed whether multi-band amplitude envelope expansion can effectively enhance critical vowel features, such as formants, and improve speech extraction from noise. In 32 participants with normal touch perception, tactile-only phoneme discrimination with and without envelope expansion was assessed both in quiet and in background noise. Envelope expansion improved performance in quiet by 10.3% for vowels and by 5.9% for consonants. In noise, envelope expansion improved overall phoneme discrimination by 9.6%, with no difference in benefit between consonants and vowels. The tactile vocoder with envelope expansion can be deployed in real-time on a compact device and could substantially improve clinical outcomes for a new generation of haptic hearing aids.

Local field potential sharp waves with diversified impact on cortical neuronal encoding of haptic input.

Cortical sensory processing is greatly impacted by internally generated activity. But controlling for that activity is difficult since the thalamocortical network is a high-dimensional system with rapid state changes. Therefore, to unwind the cortical computational architecture there is a need for physiological 'landmarks' that can be used as frames of reference for computational state. Here we use a waveshape transform method to identify conspicuous local field potential sharp waves (LFP-SPWs) in the somatosensory cortex (S1). LFP-SPW events triggered short-lasting but massive neuronal activation in all recorded neurons with a subset of neurons initiating their activation up to 20 ms before the LFP-SPW onset. In contrast, LFP-SPWs differentially impacted the neuronal spike responses to ensuing tactile inputs, depressing the tactile responses in some neurons and enhancing them in others. When LFP-SPWs coactivated with more distant cortical surface (ECoG)-SPWs, suggesting an involvement of these SPWs in global cortical signaling, the impact of the LFP-SPW on the neuronal tactile response could change substantially, including inverting its impact to the opposite. These cortical SPWs shared many signal fingerprint characteristics as reported for hippocampal SPWs and may be a biomarker for a particular type of state change that is possibly shared byboth hippocampus and neocortex.

Early attentional processing and cortical remapping strategies of tactile stimuli in adults with an early and late-onset visual impairment: A cross-sectional study.

Neuroplastic changes appear in people with visual impairment (VI) and they show greater tactile abilities. Improvements in performance could be associated with the development of enhanced early attentional processes based on neuroplasticity. Currently, the various early attentional and cortical remapping strategies that are utilized by people with early (EB) and late-onset blindness (LB) remain unclear. Thus, more research is required to develop effective rehabilitation programs and substitution devices. Our objective was to explore the differences in spatial tactile brain processing in adults with EB, LB and a sighted control group (CG). In this cross-sectional study 27 participants with VI were categorized into EB (n = 14) and LB (n = 13) groups. They were then compared with a CG (n = 15). A vibrotactile device and event-related potentials (ERPs) were utilized while participants performed a spatial tactile line recognition task. The P100 latency and cortical areas of maximal activity were analyzed during the task. The three groups had no statistical differences in P100 latency (p>0.05). All subjects showed significant activation in the right superior frontal areas. Only individuals with VI activated the left superior frontal regions. In EB subjects, a higher activation was found in the mid-frontal and occipital areas. A higher activation of the mid-frontal, anterior cingulate cortex and orbitofrontal zones was observed in LB participants. Compared to the CG, LB individuals showed greater activity in the left orbitofrontal zone, while EB exhibited greater activity in the right superior parietal cortex. The EB had greater activity in the left orbitofrontal region compared to the LB. People with VI may not have faster early attentional processing. EB subjects activate the occipital lobe and right superior parietal cortex during tactile stimulation because of an early lack of visual stimuli and a multimodal information processing. In individuals with LB and EB the orbitofrontal area is activated, suggesting greater emotional processing.

Biomimetic bimodal haptic perception using triboelectric effect.

Multimodal haptic perception is essential for enhancing perceptual experiences in augmented reality applications. To date, several artificial tactile interfaces have been developed to perceive pressure and precontact signals, while simultaneously detecting object type and softness with quantified modulus still remains challenging. Here, inspired by the campaniform sensilla on insect antennae, we proposed a hemispherical bimodal intelligent tactile sensor (BITS) array using the triboelectric effect. The system is capable of softness identification, modulus quantification, and material type recognition. In principle, due to the varied deformability of materials, the BITS generates unique triboelectric output fingerprints when in contact with the tested object. Furthermore, owing to the different electron affinities, the BITS array can accurately recognize material type (99.4% accuracy), facilitating softness recognition (100% accuracy) and modulus quantification. It is promising that the BITS based on the triboelectric effect has the potential to be miniaturized to provide real-time accurate haptic information as an artificial antenna toward applications of human-machine integration.

Functional performance of a vibrotactile sensory substitution device in people with profound vision loss.

SIGNIFICANCE: This study has shown a vibrotactile sensory substitution device (SSD) prototype, VibroSight, has the potential to improve functional outcomes (i.e., obstacle avoidance, face detection) for people with profound vision loss, even with brief familiarization (<20 minutes). PURPOSE: Mobility aids such as long canes are still the mainstay of support for most people with vision loss, but they do have limitations. Emerging technologies such as SSDs are gaining widespread interest in the low vision community. The aim of this project was to assess the efficacy of a prototype vibrotactile SSD for people with profound vision loss in the face detection and obstacle avoidance tasks. METHODS: The VibroSight device was tested in a movement laboratory setting. The first task involved obstacle avoidance, in which participants were asked to walk through an obstacle course. The second was a face detection task, in which participants were asked to step toward the first face they detected. Exit interviews were also conducted to gather user experience data. Both people with low vision (n = 7) and orientation and mobility instructors (n = 4) completed the tasks. RESULTS: In obstacle avoidance task, participants were able to use the device to detect (p<0.001) and avoid (p<0.001) the obstacles within a significantly larger range, but were slower (p<0.001), when compared with without the device. In face detection task, participants demonstrated a great level of accuracy, precision, and sensitivity when using the device. Interviews revealed a positive user experience, although participants identified that they would require a lighter and compact design for real-world use. CONCLUSIONS: Overall, the results verified the functionality of vibrotactile SSD prototype. Further research is warranted to evaluate the user performance after an extended training program and to add new features, such as object recognition software algorithms, into the device.

Healing Function for Abraded Fingerprint Ridges in Tactile Texture Sensors.

Tactile texture sensors are designed to evaluate the sensations felt when a human touches an object. Prior studies have demonstrated the necessity for these sensors to have compliant ridges on their surfaces that mimic human fingerprints. These features enable the simulation of contact phenomena, especially friction and vibration, between human fingertips and objects, enhancing the tactile sensation evaluation. However, the ridges on tactile sensors are susceptible to abrasion damage from repeated use. To date, the healing function of abraded ridges has not been proposed, and its effectiveness needs to be demonstrated. In this study, we investigated whether the signal detection capabilities of a sensor with abraded epidermal ridges could be restored by healing the ridges using polyvinyl chloride plastisol as the sensor material. We developed a prototype tactile sensor with an embedded strain gauge, which was used to repeatedly scan roughness specimens. After more than 1000 measurements, we observed significant deterioration in the sensor's output signal level. The ridges were then reshaped using a mold with a heating function, allowing the sensor to partially regain its original signal levels. This method shows potential for extending the operational lifespan of tactile texture sensors with compliant ridges.

Beyond algorithms: The human touch machine-generated titles for enhancing click-through rates on social media.

Artificial intelligence (AI) has the potential to revolutionize various domains by automating language-driven tasks. This study evaluates the effectiveness of an AI-assisted methodology, called the "POP Title AI Five-Step Optimization Method," in optimizing content titles on the RED social media platform. By leveraging advancements in natural language generation, this methodology aims to enhance the impact of titles by incorporating emotional sophistication and cultural proficiency, addressing existing gaps in AI capabilities. The methodology entails training generative models using human-authored examples that align with the aspirations of the target audience. By incorporating popular keywords derived from user searches, the relevance and discoverability of titles are enhanced. Audience-centric filtering is subsequently employed to further refine the generated outputs. Furthermore, human oversight is introduced to provide essential intuition that AI systems alone may lack. A total of one thousand titles, generated by AI, underwent linguistic and engagement analyses. Qualitatively, 65% of the titles exhibited intrigue and conveyed meaning comparable to those generated by humans. However, attaining full emotional sophistication remained a challenge. Quantitatively, titles emphasizing curiosity and contrast demonstrated positive correlations with user interactions, thus validating the efficacy of these techniques. Consequently, the machine-generated titles achieved coherence on par with 65% of human-generated titles, signifying significant progress and potential for further refinement. Nevertheless, achieving socio-cultural awareness is vital to match human understanding across diverse contexts, thus presenting a critical avenue for future improvement in the methodology. Continuous advancements in AI can enhance adaptability and reduce subjectivity by promoting flexibility instead of relying solely on manual reviews. As AI gains a deeper understanding of humanity, opportunities for its application across various industries through experiential reasoning abilities emerge. This case study exemplifies the nurturing of AI's potential by refining its skills through an evolutionary process.

Primary somatosensory cortical processing in tactile communication.

Touch is an essential form of non-verbal communication. While language and its neural basis are widely studied, tactile communication is less well understood. We used fMRI and multivariate pattern analyses in pairs of emotionally close adults to examine the neural basis of human-to-human tactile communication. In each pair, a participant was designated either as sender or as receiver. The sender was instructed to communicate specific messages by touching only the arm of the receiver, who was inside the scanner. The receiver then identified the message based on the touch expression alone. We designed two multivariate decoder algorithms-one based on the sender's intent (sender-decoder), and another based on the receiver's response (receiver-decoder). We identified several brain areas that significantly predicted behavioural accuracy of the receiver. Regarding our a priori region of interest, the receiver's primary somatosensory cortex (S1), both decoders were able to accurately differentiate the messages based on neural activity patterns here. The receiver-decoder, which relied on the receivers' interpretations of the touch expressions, outperformed the sender-decoder, which relied on the sender's intent. Our results identified a network of brain areas involved in human-to-human tactile communication and supported the notion of non-sensory factors being represented in S1. This article is part of the theme issue 'Sensing and feeling: an integrative approach to sensory processing and emotional experience'.

A review of assessment methods for measuring individual differences in oral somatosensory perception.

While taste and smell perception have been thoroughly investigated, our understanding of oral somatosensory perception remains limited. Further, assessing and measuring individual differences in oral somatosensory perception pose notable challenges. This review aimed to evaluate the existing methods to assess oral somatosensory perception by examining and comparing the strengths and limitations of each method. The review highlighted the lack of standardized assessment methods and the various procedures within each method. Tactile sensitivity can be assessed using several methods, but each method measures different tactile dimensions. Further investigations are needed to confirm its correlation with texture sensitivity. In addition, measuring a single textural attribute may not provide an overall representation of texture sensitivity. Thermal sensitivity can be evaluated using thermal-change detection or temperature discrimination tests. The chemesthetic sensitivity tests involve either localized or whole-mouth stimulation tests. The choice of an appropriate method for assessing oral somatosensory sensitivity depends on several factors, including the specific research objectives and the target population. Each method has its unique intended purpose, strengths, and limitations, so no universally superior approach exists. To overcome some of the limitations associated with certain methods, the review offers alternative or complementary approaches that could be considered. Researchers can enhance the comprehensive assessment of oral somatosensory sensitivity by carefully selecting and potentially combining methods. In addition, a standardized protocol remains necessary for each method.

Refraining from spontaneous face touch is linked to personality traits, reduced memory performance and EEG changes.

Spontaneous touches of one's face (sFST) were suggested to serve cognitive-emotional regulation processes. During the pandemic, refraining from face-touching was recommended, yet, accompanying effects and the influence of personal attributes remain unclear. Ninety participants (45 female, 45 male) filled out a questionnaire concerning personality, anxiety screening and ADHD screening. Subsequently, they performed a delayed verbal memory recall task four times. After two times, sixty participants were instructed to refrain from face-touching (experimental group). Thirty participants did not receive behavioral instructions (control group). To identify face-touches and conduct further analysis, Video, EMG, and EEG data were recorded. Two samples were formed, depending on the adherence to completely refrain from face-touching (adherent, non-adherent sample) and compared to each other and the control group. EEG analyses uncovered that refraining from face-touching is accompanied by increased beta-power at sensorimotor sites and, exclusively in the non-adherent sample, at frontal sites. Decreased memory performance was found exclusively in subsamples, who non-adherently touched their face while retaining words. In terms of questionnaire results, lower Conscientiousness and higher ADHD screening scores were revealed by the non-adherent compared to the adherent sample. No differences were found among the subsamples. The presented results indicate that refraining from face-touching is related to personal attributes, accompanied by neurophysiological shifts and for a portion of humans by lower memory performance, supporting the notion that sFST serve processes beyond sensorimotor.

An Instrumented Glove for Restoring Sensorimotor Function of the Hand Through Augmented Sensory Feedback.

The loss of sensitivity of the upper limb due to neurological injuries severely limits the ability to manipulate objects, hindering personal independence. Non-invasive augmented sensory feedback techniques are used to promote neural plasticity hence to restore the grasping function. This work presents a wearable device for restoring sensorimotor hand functions based on Discrete Event-driven Sensory Control policy. It consists of an instrumented glove that, relying on piezoelectric sensors, delivers short-lasting vibrotactile stimuli synchronously with the relevant mechanical events (i.e., contact and release) of the manipulation. We first performed a feasibility study on healthy participants (20) that showed overall good performances of the device, with touch-event detection accuracy of 96.2% and a response delay of 22 ms. Later, we pilot tested it on two participants with limited sensorimotor functions. When using the device, they improved their hand motor coordination while performing tests for hand motor coordination assessment (i.e., pick and place test, pick and lift test). In particular, they exhibited more coordinated temporal correlations between grip force and load force profiles and enhanced performances when transferring objects, quantitatively proving the effectiveness of the device.

Interleaved Multi-Contact Peripheral Nerve Stimulation to Enhance Reproduction of Tactile Sensation: A Computational Modeling Study.

Peripheral nerve stimulation (PNS) is an effective means to elicit sensation for rehabilitation of people with loss of a limb or limb function. While most current PNS paradigms deliver current through single electrode contacts to elicit each tactile percept, multi-contact extraneural electrodes offer the opportunity to deliver PNS with groups of contacts individually or simultaneously. Multi-contact PNS strategies could be advantageous in developing biomimetic PNS paradigms to recreate the natural neural activity during touch, because they may be able to selectively recruit multiple distinct neural populations. We used computational models and optimization approaches to develop a novel biomimetic PNS paradigm that uses interleaved multi-contact (IMC) PNS to approximate the critical neural coding properties underlying touch. The IMC paradigm combines field shaping, in which two contacts are active simultaneously, with pulse-by-pulse contact and parameter variations throughout the touch stimulus. We show in simulation that IMC PNS results in better neural code mimicry than single contact PNS created with the same optimization techniques, and that field steering via two-contact IMC PNS results in better neural code mimicry than one-contact IMC PNS. We also show that IMC PNS results in better neural code mimicry than existing PNS paradigms, including prior biomimetic PNS. Future clinical studies will determine if the IMC paradigm can improve the naturalness and usefulness of sensory feedback for those with neurological disorders.

Conductive block copolymer elastomers and psychophysical thresholding for accurate haptic effects.

Electrotactile stimulus is a form of sensory substitution in which an electrical signal is perceived as a mechanical sensation. The electrotactile effect could, in principle, recapitulate a range of tactile experience by selective activation of nerve endings. However, the method has been plagued by inconsistency, galvanic reactions, pain and desensitization, and unwanted stimulation of nontactile nerves. Here, we describe how a soft conductive block copolymer, a stretchable layout, and concentric electrodes, along with psychophysical thresholding, can circumvent these shortcomings. These purpose-designed materials, device layouts, and calibration techniques make it possible to generate accurate and reproducible sensations across a cohort of 10 human participants and to do so at ultralow currents (≥6 microamperes) without pain or desensitization. This material, form factor, and psychophysical approach could be useful for haptic devices and as a tool for activation of the peripheral nervous system.

How material sensory properties and individual differences influence the haptic aesthetic appeal of visually presented stimuli.

Touch plays a crucial role for humans. Despite its centrality in sensory experiences, the field of haptic aesthetics is underexplored. So far, existing research has revealed that preferences in the haptic domain are related to stimulus properties and the Gestalt laws of grouping. Additionally, haptic aesthetics is influenced by top-down processes, e.g., stimulus familiarity, and is likely to be modulated by personality and expertise. To further our understanding of these influences on haptic aesthetic appraisal, the current study investigated the imagined haptic aesthetic appeal of visually presented material surfaces, considering the role of haptic expertise, Need for touch, personality traits. The results revealed a positive influence of familiarity, simplicity, smoothness, warmth, lightness, dryness, slipperiness and a negative influence of complexity on individuals' aesthetic responses. While the study failed to support the predicted influence of Need for touch and haptic expertise on aesthetic responses, results did reveal an influence of openness to experience, conscientiousness and neuroticism. Despite the limitations related to the indirect stimuli presentation (vision only), the findings contribute to the relatively unexplored role of bottom-up and top-down features in haptic aesthetics that might be incorporated into the design of consumers' products to better meet their preferences.

A scoping review on examination approaches for identifying tactile deficits at the upper extremity in individuals with stroke.

PURPOSE: Accurate perception of tactile stimuli is essential for performing and learning activities of daily living. Through this scoping review, we sought to summarize existing examination approaches for identifying tactile deficits at the upper extremity in individuals with stroke. The goal was to identify current limitations and future research needs for designing more comprehensive examination tools. METHODS: A scoping review was conducted in accordance with the Joanna Briggs Institute methodological framework and the PRISMA for Scoping Reviews (PRISMA-ScR) guidelines. A database search for tactile examination approaches at the upper extremity of individuals with stroke was conducted using Medline (Ovid), The Cochrane Library (Wiley), CINAHL Plus with Full Text (Ebsco), Scopus (Elsevier), PsycInfo (Ebsco), and Proquest Dissertations and Theses Global. Original research and review articles that involved adults (18 years or older) with stroke, and performed tactile examinations at the upper extremity were eligible for inclusion. Data items extracted from the selected articles included: if the examination was behavioral in nature and involved neuroimaging, the extent to which the arm participated during the examination, the number of possible outcomes of the examination, the type(s) of tactile stimulation equipment used, the location(s) along the arm examined, the peripheral nerves targeted for examination, and if any comparison was made with the non-paretic arm or with the arms of individuals who are neurotypical. RESULTS: Twenty-two articles met the inclusion criteria and were accepted in this review. Most examination approaches were behavioral in nature and involved self-reporting of whether a tactile stimulus was felt while the arm remained passive (i.e., no volitional muscle activity). Typically, the number of possible outcomes with these behavioral approaches were limited (2-3), whereas the neuroimaging approaches had many more possible outcomes ( > 15 ). Tactile examinations were conducted mostly at the distal locations along the arm (finger or hand) without targeting any specific peripheral nerve. Although a majority of articles compared paretic and non-paretic arms, most did not compare outcomes to a control group of individuals who are neurotypical. DISCUSSION: Our findings noted that most upper extremity tactile examinations are behavioral approaches, which are subjective in nature, lack adequate resolution, and are insufficient to identify the underlying neural mechanisms of tactile deficits. Also, most examinations are administered at distal locations of the upper extremity when the examinee's arm is relaxed (passive). Further research is needed to develop better tactile examination tools that combine behavioral responses and neurophysiological outcomes, and allow volitional tactile exploration. Approaches that include testing of multiple body locations/nerves along the upper extremity, provide higher resolution of outcomes, and consider normative comparisons with individuals who are neurotypical may provide a more comprehensive understanding of the tactile deficits occurring following a stroke.

Tactile versus motor imagery: differences in corticospinal excitability assessed with single-pulse TMS.

Tactile Imagery (TI) remains a fairly understudied phenomenon despite growing attention to this topic in recent years. Here, we investigated the effects of TI on corticospinal excitability by measuring motor evoked potentials (MEPs) induced by single-pulse transcranial magnetic stimulation (TMS). The effects of TI were compared with those of tactile stimulation (TS) and kinesthetic motor imagery (kMI). Twenty-two participants performed three tasks in randomly assigned order: imagine finger tapping (kMI); experience vibratory sensations in the middle finger (TS); and mentally reproduce the sensation of vibration (TI). MEPs increased during both kMI and TI, with a stronger increase for kMI. No statistically significant change in MEP was observed during TS. The demonstrated differential effects of kMI, TI and TS on corticospinal excitability have practical implications for devising the imagery-based and TS-based brain-computer interfaces (BCIs), particularly the ones intended to improve neurorehabilitation by evoking plasticity changes in sensorimotor circuitry.

High frequency heart rate variability is associated with sensitivity to affective touch.

C-tactile afferents (CTs) are a class of unmyelinated, mechanosensitive nerve fibre that respond optimally to skin temperature, slow moving touch typical of a caress. They are hypothesised to signal the rewarding value of affiliative tactile interactions. While CT firing frequency is positively correlated with subjective ratings of touch pleasantness, trait differences in sensitivity to the specific hedonic value of CT targeted touch have been reported. Inter-individual differences in vagally mediated, high frequency heart rate variability (HF-HRV) have been linked to variation in visual social cognition. Thus, the aim of the present study was to examine the relationship between resting state HF-HRV and sensitivity to socially relevant CT targeted touch. 58 healthy participants first had a 5-minute electrocardiogram. They then rated the pleasantness of 5 randomly presented velocities of robotically delivered touch. Three velocities fell within (1, 3, 10 cm/s) and two outside (0.3, 30 cm/s) the CT optimal range. Each velocity was delivered twice. On a group level, affective touch ratings were described by a negative quadratic function, with CT optimal velocities rated as more pleasant than slower and faster speeds. Simple regression analysis confirmed participants' HF-HRV was significantly predicted by the quadratic curve fit of their touch ratings, with higher HF-HRV associated with a better quadratic fit. These findings indicate that, in line with previous observations that higher HF-HRV is associated with enhanced sensitivity to visual social cues, trait differences in autonomic control could account for previously reported individual differences in CT sensitivity.

An Artificial Universal Tactile Nociceptor Based on 2D Polymer Film Memristor Arrays with Tunable Resistance Switching Behaviors.

Nociceptor is an important receptor in the organism's sensory system; it can perceive harmful stimuli and send signals to the brain in order to protect the body in time. The injury degree of nociceptor can be divided into three stages: self-healing injury, treatable injury, and permanent injury. However, the current studies on nociceptor simulation are limited to the self-healing stage due to the limitation of the untunable resistance switching behavior of memristors. In this study, we constructed Al/2DPTPAK+TAPB/Ag memristor arrays with adjustable memory behaviors to emulate the nociceptor of biological neural network of all three stages. For this purpose, a PDMS/AgNWs/ITO/PET pressure sensor was assembled to mimic the tactile perception of the skin. The memristor arrays can not only simulate all the response of nociceptor, i.e., the threshold, relaxation, no adaptation, and sensitization with the self-healing injury, but can also simulate the treatable injury and the permanent injury. These behaviors are both demonstrated with a single memristor and in the form of pattern mapping of the memristor array.

Krause corpuscles are genital vibrotactile sensors for sexual behaviours.

Krause corpuscles, which were discovered in the 1850s, are specialized sensory structures found within the genitalia and other mucocutaneous tissues1-4. The physiological properties and functions of Krause corpuscles have remained unclear since their discovery. Here we report the anatomical and physiological properties of Krause corpuscles of the mouse clitoris and penis and their roles in sexual behaviour. We observed a high density of Krause corpuscles in the clitoris compared with the penis. Using mouse genetic tools, we identified two distinct somatosensory neuron subtypes that innervate Krause corpuscles of both the clitoris and penis and project to a unique sensory terminal region of the spinal cord. In vivo electrophysiology and calcium imaging experiments showed that both Krause corpuscle afferent types are A-fibre rapid-adapting low-threshold mechanoreceptors, optimally tuned to dynamic, light-touch and mechanical vibrations (40-80 Hz) applied to the clitoris or penis. Functionally, selective optogenetic activation of Krause corpuscle afferent terminals evoked penile erection in male mice and vaginal contraction in female mice, while genetic ablation of Krause corpuscles impaired intromission and ejaculation of males and reduced sexual receptivity of females. Thus, Krause corpuscles of the clitoris and penis are highly sensitive mechanical vibration detectors that mediate sexually dimorphic mating behaviours.