Improved tactile speech perception and noise robustness using audio-to-tactile sensory substitution with amplitude envelope expansion.

Recent advances in haptic technology could allow haptic hearing aids, which convert audio to tactile stimulation, to become viable for supporting people with hearing loss. A tactile vocoder strategy for audio-to-tactile conversion, which exploits these advances, has recently shown significant promise. In this strategy, the amplitude envelope is extracted from several audio frequency bands and used to modulate the amplitude of a set of vibro-tactile tones. The vocoder strategy allows good consonant discrimination, but vowel discrimination is poor and the strategy is susceptible to background noise. In the current study, we assessed whether multi-band amplitude envelope expansion can effectively enhance critical vowel features, such as formants, and improve speech extraction from noise. In 32 participants with normal touch perception, tactile-only phoneme discrimination with and without envelope expansion was assessed both in quiet and in background noise. Envelope expansion improved performance in quiet by 10.3% for vowels and by 5.9% for consonants. In noise, envelope expansion improved overall phoneme discrimination by 9.6%, with no difference in benefit between consonants and vowels. The tactile vocoder with envelope expansion can be deployed in real-time on a compact device and could substantially improve clinical outcomes for a new generation of haptic hearing aids.

A review of assessment methods for measuring individual differences in oral somatosensory perception.

While taste and smell perception have been thoroughly investigated, our understanding of oral somatosensory perception remains limited. Further, assessing and measuring individual differences in oral somatosensory perception pose notable challenges. This review aimed to evaluate the existing methods to assess oral somatosensory perception by examining and comparing the strengths and limitations of each method. The review highlighted the lack of standardized assessment methods and the various procedures within each method. Tactile sensitivity can be assessed using several methods, but each method measures different tactile dimensions. Further investigations are needed to confirm its correlation with texture sensitivity. In addition, measuring a single textural attribute may not provide an overall representation of texture sensitivity. Thermal sensitivity can be evaluated using thermal-change detection or temperature discrimination tests. The chemesthetic sensitivity tests involve either localized or whole-mouth stimulation tests. The choice of an appropriate method for assessing oral somatosensory sensitivity depends on several factors, including the specific research objectives and the target population. Each method has its unique intended purpose, strengths, and limitations, so no universally superior approach exists. To overcome some of the limitations associated with certain methods, the review offers alternative or complementary approaches that could be considered. Researchers can enhance the comprehensive assessment of oral somatosensory sensitivity by carefully selecting and potentially combining methods. In addition, a standardized protocol remains necessary for each method.

Local field potential sharp waves with diversified impact on cortical neuronal encoding of haptic input.

Cortical sensory processing is greatly impacted by internally generated activity. But controlling for that activity is difficult since the thalamocortical network is a high-dimensional system with rapid state changes. Therefore, to unwind the cortical computational architecture there is a need for physiological 'landmarks' that can be used as frames of reference for computational state. Here we use a waveshape transform method to identify conspicuous local field potential sharp waves (LFP-SPWs) in the somatosensory cortex (S1). LFP-SPW events triggered short-lasting but massive neuronal activation in all recorded neurons with a subset of neurons initiating their activation up to 20 ms before the LFP-SPW onset. In contrast, LFP-SPWs differentially impacted the neuronal spike responses to ensuing tactile inputs, depressing the tactile responses in some neurons and enhancing them in others. When LFP-SPWs coactivated with more distant cortical surface (ECoG)-SPWs, suggesting an involvement of these SPWs in global cortical signaling, the impact of the LFP-SPW on the neuronal tactile response could change substantially, including inverting its impact to the opposite. These cortical SPWs shared many signal fingerprint characteristics as reported for hippocampal SPWs and may be a biomarker for a particular type of state change that is possibly shared byboth hippocampus and neocortex.

Biomimetic bimodal haptic perception using triboelectric effect.

Multimodal haptic perception is essential for enhancing perceptual experiences in augmented reality applications. To date, several artificial tactile interfaces have been developed to perceive pressure and precontact signals, while simultaneously detecting object type and softness with quantified modulus still remains challenging. Here, inspired by the campaniform sensilla on insect antennae, we proposed a hemispherical bimodal intelligent tactile sensor (BITS) array using the triboelectric effect. The system is capable of softness identification, modulus quantification, and material type recognition. In principle, due to the varied deformability of materials, the BITS generates unique triboelectric output fingerprints when in contact with the tested object. Furthermore, owing to the different electron affinities, the BITS array can accurately recognize material type (99.4% accuracy), facilitating softness recognition (100% accuracy) and modulus quantification. It is promising that the BITS based on the triboelectric effect has the potential to be miniaturized to provide real-time accurate haptic information as an artificial antenna toward applications of human-machine integration.

Precise tactile localization on the human fingernail.

Fingernails are specialized features of the primate hand, which are believed to contribute to manual dexterity. The sensorimotor functions of fingernails, however, remain poorly understood. This study investigates the ability of humans to precisely localize touches applied to the fingernail plate. Nine different locations on the fingernail were touched and participants judged the location by clicking a mouse cursor on a photograph of their finger. Performance in this condition was compared with stimuli applied to the skin of the fingertip. The results showed that participants are able to localize touch on the fingernails at substantially higher than chance levels. Moreover, the precision of this ability is not appreciably lower than that of the fingertips. These results show that the fingernail is a highly sensitive sensory organ, which is capable of providing rich spatial information about tactile stimuli.

Beyond algorithms: The human touch machine-generated titles for enhancing click-through rates on social media.

Artificial intelligence (AI) has the potential to revolutionize various domains by automating language-driven tasks. This study evaluates the effectiveness of an AI-assisted methodology, called the "POP Title AI Five-Step Optimization Method," in optimizing content titles on the RED social media platform. By leveraging advancements in natural language generation, this methodology aims to enhance the impact of titles by incorporating emotional sophistication and cultural proficiency, addressing existing gaps in AI capabilities. The methodology entails training generative models using human-authored examples that align with the aspirations of the target audience. By incorporating popular keywords derived from user searches, the relevance and discoverability of titles are enhanced. Audience-centric filtering is subsequently employed to further refine the generated outputs. Furthermore, human oversight is introduced to provide essential intuition that AI systems alone may lack. A total of one thousand titles, generated by AI, underwent linguistic and engagement analyses. Qualitatively, 65% of the titles exhibited intrigue and conveyed meaning comparable to those generated by humans. However, attaining full emotional sophistication remained a challenge. Quantitatively, titles emphasizing curiosity and contrast demonstrated positive correlations with user interactions, thus validating the efficacy of these techniques. Consequently, the machine-generated titles achieved coherence on par with 65% of human-generated titles, signifying significant progress and potential for further refinement. Nevertheless, achieving socio-cultural awareness is vital to match human understanding across diverse contexts, thus presenting a critical avenue for future improvement in the methodology. Continuous advancements in AI can enhance adaptability and reduce subjectivity by promoting flexibility instead of relying solely on manual reviews. As AI gains a deeper understanding of humanity, opportunities for its application across various industries through experiential reasoning abilities emerge. This case study exemplifies the nurturing of AI's potential by refining its skills through an evolutionary process.

Functional performance of a vibrotactile sensory substitution device in people with profound vision loss.

SIGNIFICANCE: This study has shown a vibrotactile sensory substitution device (SSD) prototype, VibroSight, has the potential to improve functional outcomes (i.e., obstacle avoidance, face detection) for people with profound vision loss, even with brief familiarization (<20 minutes). PURPOSE: Mobility aids such as long canes are still the mainstay of support for most people with vision loss, but they do have limitations. Emerging technologies such as SSDs are gaining widespread interest in the low vision community. The aim of this project was to assess the efficacy of a prototype vibrotactile SSD for people with profound vision loss in the face detection and obstacle avoidance tasks. METHODS: The VibroSight device was tested in a movement laboratory setting. The first task involved obstacle avoidance, in which participants were asked to walk through an obstacle course. The second was a face detection task, in which participants were asked to step toward the first face they detected. Exit interviews were also conducted to gather user experience data. Both people with low vision (n = 7) and orientation and mobility instructors (n = 4) completed the tasks. RESULTS: In obstacle avoidance task, participants were able to use the device to detect (p<0.001) and avoid (p<0.001) the obstacles within a significantly larger range, but were slower (p<0.001), when compared with without the device. In face detection task, participants demonstrated a great level of accuracy, precision, and sensitivity when using the device. Interviews revealed a positive user experience, although participants identified that they would require a lighter and compact design for real-world use. CONCLUSIONS: Overall, the results verified the functionality of vibrotactile SSD prototype. Further research is warranted to evaluate the user performance after an extended training program and to add new features, such as object recognition software algorithms, into the device.

Healing Function for Abraded Fingerprint Ridges in Tactile Texture Sensors.

Tactile texture sensors are designed to evaluate the sensations felt when a human touches an object. Prior studies have demonstrated the necessity for these sensors to have compliant ridges on their surfaces that mimic human fingerprints. These features enable the simulation of contact phenomena, especially friction and vibration, between human fingertips and objects, enhancing the tactile sensation evaluation. However, the ridges on tactile sensors are susceptible to abrasion damage from repeated use. To date, the healing function of abraded ridges has not been proposed, and its effectiveness needs to be demonstrated. In this study, we investigated whether the signal detection capabilities of a sensor with abraded epidermal ridges could be restored by healing the ridges using polyvinyl chloride plastisol as the sensor material. We developed a prototype tactile sensor with an embedded strain gauge, which was used to repeatedly scan roughness specimens. After more than 1000 measurements, we observed significant deterioration in the sensor's output signal level. The ridges were then reshaped using a mold with a heating function, allowing the sensor to partially regain its original signal levels. This method shows potential for extending the operational lifespan of tactile texture sensors with compliant ridges.

Primary somatosensory cortical processing in tactile communication.

Touch is an essential form of non-verbal communication. While language and its neural basis are widely studied, tactile communication is less well understood. We used fMRI and multivariate pattern analyses in pairs of emotionally close adults to examine the neural basis of human-to-human tactile communication. In each pair, a participant was designated either as sender or as receiver. The sender was instructed to communicate specific messages by touching only the arm of the receiver, who was inside the scanner. The receiver then identified the message based on the touch expression alone. We designed two multivariate decoder algorithms-one based on the sender's intent (sender-decoder), and another based on the receiver's response (receiver-decoder). We identified several brain areas that significantly predicted behavioural accuracy of the receiver. Regarding our a priori region of interest, the receiver's primary somatosensory cortex (S1), both decoders were able to accurately differentiate the messages based on neural activity patterns here. The receiver-decoder, which relied on the receivers' interpretations of the touch expressions, outperformed the sender-decoder, which relied on the sender's intent. Our results identified a network of brain areas involved in human-to-human tactile communication and supported the notion of non-sensory factors being represented in S1. This article is part of the theme issue 'Sensing and feeling: an integrative approach to sensory processing and emotional experience'.

A tactile sensing system capable of recognizing objects based on bioinspired self-sensing soft pneumatic actuator.

Tactile sensors play an important role when robots perform contact tasks, such as physical information collection, force or displacement control to avoid collision. For these manipulations, excessive contact may cause damage while poor contact cause information loss between the robotic end-effector and the objects. Inspired by skin structure and signal transmission method, this paper proposes a tactile sensing system based on the self-sensing soft pneumatic actuator (S-SPA) capable of providing tactile sensing capability for robots. Based on the adjustable height and compliance characteristics of the S-SPA, the contact process is safe and more tactile information can be collected. And to demonstrate the feasibility and advantage of this system, a robotic hand with S-SPAs could recognize different textures and stiffness of the objects by touching and pinching behaviours to collect physical information of the various objects under the positive work states of the S-SPA. The result shows the recognition accuracy of the fifteen texture plates reaches 99.4%, and the recognition accuracy of the four stiffness cuboids reaches 100%by training a KNN model. This safe and simple tactile sensing system with high recognition accuracies based on S-SPA shows great potential in robotic manipulations and is beneficial to applications in domestic and industrial fields.

Two-Point Discrimination for Upper Extremity and Face in Healthy Young Adults: A Cross-Sectional Study.

BACKGROUND AND AIM: The threshold values of two-point discrimination (TPD) provide a numerical measure of tactile acuity. Normal reference values are needed to decide whether sensory variability is within normal sensorial limits. The study aimed to determine the upper extremity and face threshold values in healthy young adults. MATERIALS AND METHODS: Static TPD thresholds of 67 healthy young adults aged 18-35 years were assessed. Eight skin areas in the face and upper extremity on the dominant side were assessed using a "method of limits" approach with an aesthesiometer. Differences between genders were examined with the Mann-Whitney U test. The Spearman correlation analysis investigated the relationship between age and TPD measurements. RESULTS: TPD values ranged between 4.66 and 19.16 mm and 1.33-68.66 mm in the face and upper extremity, respectively, in the participants with a mean age of 23.83 ± 4.66 years. Fingertips and the area over the lateral mandibula showed the greatest sensitivity. The threshold values of TPD showed both interindividual and intraindividual variability. There was no statistical difference in the TPD values according to gender in any of the measured areas, and there was no relationship between age and TPD test values. CONCLUSIONS: The threshold values of TPD have clinical applicability in various diseases affecting the sensation of the upper extremity and/or face. These data may help the detection of early sensory loss.

Early attentional processing and cortical remapping strategies of tactile stimuli in adults with an early and late-onset visual impairment: A cross-sectional study.

Neuroplastic changes appear in people with visual impairment (VI) and they show greater tactile abilities. Improvements in performance could be associated with the development of enhanced early attentional processes based on neuroplasticity. Currently, the various early attentional and cortical remapping strategies that are utilized by people with early (EB) and late-onset blindness (LB) remain unclear. Thus, more research is required to develop effective rehabilitation programs and substitution devices. Our objective was to explore the differences in spatial tactile brain processing in adults with EB, LB and a sighted control group (CG). In this cross-sectional study 27 participants with VI were categorized into EB (n = 14) and LB (n = 13) groups. They were then compared with a CG (n = 15). A vibrotactile device and event-related potentials (ERPs) were utilized while participants performed a spatial tactile line recognition task. The P100 latency and cortical areas of maximal activity were analyzed during the task. The three groups had no statistical differences in P100 latency (p>0.05). All subjects showed significant activation in the right superior frontal areas. Only individuals with VI activated the left superior frontal regions. In EB subjects, a higher activation was found in the mid-frontal and occipital areas. A higher activation of the mid-frontal, anterior cingulate cortex and orbitofrontal zones was observed in LB participants. Compared to the CG, LB individuals showed greater activity in the left orbitofrontal zone, while EB exhibited greater activity in the right superior parietal cortex. The EB had greater activity in the left orbitofrontal region compared to the LB. People with VI may not have faster early attentional processing. EB subjects activate the occipital lobe and right superior parietal cortex during tactile stimulation because of an early lack of visual stimuli and a multimodal information processing. In individuals with LB and EB the orbitofrontal area is activated, suggesting greater emotional processing.

Effects of mother-infant skin-to-skin contact on mother-infant relationship and maternal psychology feelings: A qualitative study.

AIMS: To explore the effects of mother-infant skin-to-skin contact on mother-infant relationship and maternal psychology feelings. DESIGN: An exploratory qualitative research design using semi-structured interviews. METHODS: A total of 64 mother-infant pairs who met the inclusion criteria were selected as the experimental subjects to receive early and continuous intervention of mother-infant skin-to-skin contact (SSC). On this basis, the qualitative research method of procedural grounded theory was used to conduct semi-structured interviews with 18 puerperas before discharge from the hospital; the three-level coding method of procedural grounded theory and Graneheim & Lundman qualitative content analysis method were combined to conductinterview content analysis in Nvivo 12 software, so as to extractcore categories and condense the theme. RESULTS: (1) The data were coded to extract five core categories, namely, birth experience, role transition, contact perception, mother-infant connection and parental efficacy; (2) there were statistically significant differences in the number of coding reference points in five nodes before and after SSC, that is, mothers' positive feelings, newborns' physical characteristics noticed by their mothers, mother-infant connection, role transition and birth experience. The number of coding reference points after SSC was statistically significant greater than before SSC; (3) The coding interview results showed that SSC could promote the sense of happiness in nurturing.

C. elegans touch receptor neurons direct mechanosensory complex organization via repurposing conserved basal lamina proteins.

The sense of touch is conferred by the conjoint function of somatosensory neurons and skin cells. These cells meet across a gap filled by a basal lamina, an ancient structure found in metazoans. Using Caenorhabditis elegans, we investigate the composition and ultrastructure of the extracellular matrix at the epidermis and touch receptor neuron (TRN) interface. We show that membrane-matrix complexes containing laminin, nidogen, and the MEC-4 mechano-electrical transduction channel reside at this interface and are central to proper touch sensation. Interestingly, the dimensions and spacing of these complexes correspond with the discontinuous beam-like extracellular matrix structures observed in serial-section transmission electron micrographs. These complexes fail to coalesce in touch-insensitive extracellular matrix mutants and in dissociated neurons. Loss of nidogen reduces the density of mechanoreceptor complexes and the amplitude of the touch-evoked currents they carry. Thus, neuron-epithelium cell interfaces are instrumental in mechanosensory complex assembly and function. Unlike the basal lamina ensheathing the pharynx and body wall muscle, nidogen recruitment to the puncta along TRNs is not dependent upon laminin binding. MEC-4, but not laminin or nidogen, is destabilized by point mutations in the C-terminal Kunitz domain of the extracellular matrix component, MEC-1. These findings imply that somatosensory neurons secrete proteins that actively repurpose the basal lamina to generate special-purpose mechanosensory complexes responsible for vibrotactile sensing.

How touch helps hummingbirds hover.

Georgina Mills discusses new research looking at how hummingbirds use somatosensation to adjust their flight.

A Skin-Inspired High-Performance Tactile Sensor for Accurate Recognition of Object Softness.

High-performance tactile sensors with skin-sensing properties are crucial for intelligent perception in next-generation smart devices. However, previous studies have mainly focused on the sensitivity and response range of tactile sensation while neglecting the ability to recognize object softness. Therefore, achieving a precise perception of the softness remains a challenge. Here, we report an integrated tactile sensor consisting of a central hole gradient structure pressure sensor and a planar structure strain sensor. The recognition of softness and tactile perception is achieved through the synergistic effect of pressure sensors that sense the applied pressure and strain sensors that recognize the strain of the target object. The results indicate that the softness evaluation parameter (SC) of the integrated structural tactile sensor increases from 0.14 to 0.47 along with Young's modulus of the object decreasing from 2.74 to 0.45 MPa, demonstrating accurate softness recognition. It also exhibits a high sensitivity of 10.55 kPa-1 and an ultrawide linear range of 0-1000 kPa, showing an excellent tactile sensing capability. Further, an intelligent robotic hand system based on integrated structural tactile sensors was developed, which can identify the softness of soft foam and glass and grasp them accurately, indicating human skin-like sensing and grasping capabilities.

An Artificial Universal Tactile Nociceptor Based on 2D Polymer Film Memristor Arrays with Tunable Resistance Switching Behaviors.

Nociceptor is an important receptor in the organism's sensory system; it can perceive harmful stimuli and send signals to the brain in order to protect the body in time. The injury degree of nociceptor can be divided into three stages: self-healing injury, treatable injury, and permanent injury. However, the current studies on nociceptor simulation are limited to the self-healing stage due to the limitation of the untunable resistance switching behavior of memristors. In this study, we constructed Al/2DPTPAK+TAPB/Ag memristor arrays with adjustable memory behaviors to emulate the nociceptor of biological neural network of all three stages. For this purpose, a PDMS/AgNWs/ITO/PET pressure sensor was assembled to mimic the tactile perception of the skin. The memristor arrays can not only simulate all the response of nociceptor, i.e., the threshold, relaxation, no adaptation, and sensitization with the self-healing injury, but can also simulate the treatable injury and the permanent injury. These behaviors are both demonstrated with a single memristor and in the form of pattern mapping of the memristor array.

Can you feel the force just right? Tactile force feedback for training of minimally invasive surgery-evaluation of vibration feedback for adequate force application.

BACKGROUND: Tissue handling is a crucial skill for surgeons and is challenging to learn. The aim of this study was to develop laparoscopic instruments with different integrated tactile vibration feedback by varying different tactile modalities and assess its effect on tissue handling skills. METHODS: Standard laparoscopic instruments were equipped with a vibration effector, which was controlled by a microcomputer attached to a force sensor platform. One of three different vibration feedbacks (F1: double vibration > 2 N; F2: increasing vibration relative to force; F3: one vibration > 1.5 N and double vibration > 2 N) was applied to the instruments. In this multicenter crossover trial, surgical novices and expert surgeons performed two laparoscopic tasks (Peg transfer, laparoscopic suture, and knot) each with all the three vibration feedback modalities and once without any feedback, in a randomized order. The primary endpoint was force exertion. RESULTS: A total of 57 subjects (15 surgeons, 42 surgical novices) were included in the trial. In the Peg transfer task, there were no differences between the tactile feedback modalities in terms of force application. However, in subgroup analysis, the use of F2 resulted in a significantly lower mean-force application (p-value = 0.02) among the student group. In the laparoscopic suture and knot task, all participants exerted significantly lower mean and peak forces using F2 (p-value < 0.01). These findings remained significant after subgroup analysis for both, the student and surgeon groups individually. The condition without tactile feedback led to the highest mean and peak force exertion compared to the three other feedback modalities. CONCLUSION: Continuous tactile vibration feedback decreases the mean and peak force applied during laparoscopic training tasks. This effect is more pronounced in demanding tasks such as laparoscopic suturing and knot tying and might be more beneficial for students. Laparoscopic tasks without feedback lead to increased force application.

Krause corpuscles are genital vibrotactile sensors for sexual behaviours.

Krause corpuscles, which were discovered in the 1850s, are specialized sensory structures found within the genitalia and other mucocutaneous tissues1-4. The physiological properties and functions of Krause corpuscles have remained unclear since their discovery. Here we report the anatomical and physiological properties of Krause corpuscles of the mouse clitoris and penis and their roles in sexual behaviour. We observed a high density of Krause corpuscles in the clitoris compared with the penis. Using mouse genetic tools, we identified two distinct somatosensory neuron subtypes that innervate Krause corpuscles of both the clitoris and penis and project to a unique sensory terminal region of the spinal cord. In vivo electrophysiology and calcium imaging experiments showed that both Krause corpuscle afferent types are A-fibre rapid-adapting low-threshold mechanoreceptors, optimally tuned to dynamic, light-touch and mechanical vibrations (40-80 Hz) applied to the clitoris or penis. Functionally, selective optogenetic activation of Krause corpuscle afferent terminals evoked penile erection in male mice and vaginal contraction in female mice, while genetic ablation of Krause corpuscles impaired intromission and ejaculation of males and reduced sexual receptivity of females. Thus, Krause corpuscles of the clitoris and penis are highly sensitive mechanical vibration detectors that mediate sexually dimorphic mating behaviours.

Tactile emoticons: Conveying social emotions and intentions with manual and robotic tactile feedback during social media communications.

Touch offers important non-verbal possibilities for socioaffective communication. Yet most digital communications lack capabilities regarding exchanging affective tactile messages (tactile emoticons). Additionally, previous studies on tactile emoticons have not capitalised on knowledge about the affective effects of certain mechanoreceptors in the human skin, e.g., the C-Tactile (CT) system. Here, we examined whether gentle manual stroking delivered in velocities known to optimally activate the CT system (defined as 'tactile emoticons'), during lab-simulated social media communications could convey increased feelings of social support and other prosocial intentions compared to (1) either stroking touch at CT sub-optimal velocities, or (2) standard visual emoticons. Participants (N = 36) felt more social intent with CT-optimal compared to sub-optimal velocities, or visual emoticons. In a second, preregistered study (N = 52), we investigated whether combining visual emoticons with tactile emoticons, this time delivered at CT-optimal velocities by a soft robotic device, could enhance the perception of prosocial intentions and affect participants' physiological measures (e.g., skin conductance rate) in comparison to visual emoticons alone. Visuotactile emoticons conveyed more social intent overall and in anxious participants affected physiological measures more than visual emoticons. The results suggest that emotional social media communications can be meaningfully enhanced by tactile emoticons.