Functional performance of a vibrotactile sensory substitution device in people with profound vision loss.

SIGNIFICANCE: This study has shown a vibrotactile sensory substitution device (SSD) prototype, VibroSight, has the potential to improve functional outcomes (i.e., obstacle avoidance, face detection) for people with profound vision loss, even with brief familiarization (<20 minutes). PURPOSE: Mobility aids such as long canes are still the mainstay of support for most people with vision loss, but they do have limitations. Emerging technologies such as SSDs are gaining widespread interest in the low vision community. The aim of this project was to assess the efficacy of a prototype vibrotactile SSD for people with profound vision loss in the face detection and obstacle avoidance tasks. METHODS: The VibroSight device was tested in a movement laboratory setting. The first task involved obstacle avoidance, in which participants were asked to walk through an obstacle course. The second was a face detection task, in which participants were asked to step toward the first face they detected. Exit interviews were also conducted to gather user experience data. Both people with low vision (n = 7) and orientation and mobility instructors (n = 4) completed the tasks. RESULTS: In obstacle avoidance task, participants were able to use the device to detect (p<0.001) and avoid (p<0.001) the obstacles within a significantly larger range, but were slower (p<0.001), when compared with without the device. In face detection task, participants demonstrated a great level of accuracy, precision, and sensitivity when using the device. Interviews revealed a positive user experience, although participants identified that they would require a lighter and compact design for real-world use. CONCLUSIONS: Overall, the results verified the functionality of vibrotactile SSD prototype. Further research is warranted to evaluate the user performance after an extended training program and to add new features, such as object recognition software algorithms, into the device.

Beyond algorithms: The human touch machine-generated titles for enhancing click-through rates on social media.

Artificial intelligence (AI) has the potential to revolutionize various domains by automating language-driven tasks. This study evaluates the effectiveness of an AI-assisted methodology, called the "POP Title AI Five-Step Optimization Method," in optimizing content titles on the RED social media platform. By leveraging advancements in natural language generation, this methodology aims to enhance the impact of titles by incorporating emotional sophistication and cultural proficiency, addressing existing gaps in AI capabilities. The methodology entails training generative models using human-authored examples that align with the aspirations of the target audience. By incorporating popular keywords derived from user searches, the relevance and discoverability of titles are enhanced. Audience-centric filtering is subsequently employed to further refine the generated outputs. Furthermore, human oversight is introduced to provide essential intuition that AI systems alone may lack. A total of one thousand titles, generated by AI, underwent linguistic and engagement analyses. Qualitatively, 65% of the titles exhibited intrigue and conveyed meaning comparable to those generated by humans. However, attaining full emotional sophistication remained a challenge. Quantitatively, titles emphasizing curiosity and contrast demonstrated positive correlations with user interactions, thus validating the efficacy of these techniques. Consequently, the machine-generated titles achieved coherence on par with 65% of human-generated titles, signifying significant progress and potential for further refinement. Nevertheless, achieving socio-cultural awareness is vital to match human understanding across diverse contexts, thus presenting a critical avenue for future improvement in the methodology. Continuous advancements in AI can enhance adaptability and reduce subjectivity by promoting flexibility instead of relying solely on manual reviews. As AI gains a deeper understanding of humanity, opportunities for its application across various industries through experiential reasoning abilities emerge. This case study exemplifies the nurturing of AI's potential by refining its skills through an evolutionary process.

Healing Function for Abraded Fingerprint Ridges in Tactile Texture Sensors.

Tactile texture sensors are designed to evaluate the sensations felt when a human touches an object. Prior studies have demonstrated the necessity for these sensors to have compliant ridges on their surfaces that mimic human fingerprints. These features enable the simulation of contact phenomena, especially friction and vibration, between human fingertips and objects, enhancing the tactile sensation evaluation. However, the ridges on tactile sensors are susceptible to abrasion damage from repeated use. To date, the healing function of abraded ridges has not been proposed, and its effectiveness needs to be demonstrated. In this study, we investigated whether the signal detection capabilities of a sensor with abraded epidermal ridges could be restored by healing the ridges using polyvinyl chloride plastisol as the sensor material. We developed a prototype tactile sensor with an embedded strain gauge, which was used to repeatedly scan roughness specimens. After more than 1000 measurements, we observed significant deterioration in the sensor's output signal level. The ridges were then reshaped using a mold with a heating function, allowing the sensor to partially regain its original signal levels. This method shows potential for extending the operational lifespan of tactile texture sensors with compliant ridges.

Early attentional processing and cortical remapping strategies of tactile stimuli in adults with an early and late-onset visual impairment: A cross-sectional study.

Neuroplastic changes appear in people with visual impairment (VI) and they show greater tactile abilities. Improvements in performance could be associated with the development of enhanced early attentional processes based on neuroplasticity. Currently, the various early attentional and cortical remapping strategies that are utilized by people with early (EB) and late-onset blindness (LB) remain unclear. Thus, more research is required to develop effective rehabilitation programs and substitution devices. Our objective was to explore the differences in spatial tactile brain processing in adults with EB, LB and a sighted control group (CG). In this cross-sectional study 27 participants with VI were categorized into EB (n = 14) and LB (n = 13) groups. They were then compared with a CG (n = 15). A vibrotactile device and event-related potentials (ERPs) were utilized while participants performed a spatial tactile line recognition task. The P100 latency and cortical areas of maximal activity were analyzed during the task. The three groups had no statistical differences in P100 latency (p>0.05). All subjects showed significant activation in the right superior frontal areas. Only individuals with VI activated the left superior frontal regions. In EB subjects, a higher activation was found in the mid-frontal and occipital areas. A higher activation of the mid-frontal, anterior cingulate cortex and orbitofrontal zones was observed in LB participants. Compared to the CG, LB individuals showed greater activity in the left orbitofrontal zone, while EB exhibited greater activity in the right superior parietal cortex. The EB had greater activity in the left orbitofrontal region compared to the LB. People with VI may not have faster early attentional processing. EB subjects activate the occipital lobe and right superior parietal cortex during tactile stimulation because of an early lack of visual stimuli and a multimodal information processing. In individuals with LB and EB the orbitofrontal area is activated, suggesting greater emotional processing.

Improved tactile speech perception and noise robustness using audio-to-tactile sensory substitution with amplitude envelope expansion.

Recent advances in haptic technology could allow haptic hearing aids, which convert audio to tactile stimulation, to become viable for supporting people with hearing loss. A tactile vocoder strategy for audio-to-tactile conversion, which exploits these advances, has recently shown significant promise. In this strategy, the amplitude envelope is extracted from several audio frequency bands and used to modulate the amplitude of a set of vibro-tactile tones. The vocoder strategy allows good consonant discrimination, but vowel discrimination is poor and the strategy is susceptible to background noise. In the current study, we assessed whether multi-band amplitude envelope expansion can effectively enhance critical vowel features, such as formants, and improve speech extraction from noise. In 32 participants with normal touch perception, tactile-only phoneme discrimination with and without envelope expansion was assessed both in quiet and in background noise. Envelope expansion improved performance in quiet by 10.3% for vowels and by 5.9% for consonants. In noise, envelope expansion improved overall phoneme discrimination by 9.6%, with no difference in benefit between consonants and vowels. The tactile vocoder with envelope expansion can be deployed in real-time on a compact device and could substantially improve clinical outcomes for a new generation of haptic hearing aids.

Biomimetic bimodal haptic perception using triboelectric effect.

Multimodal haptic perception is essential for enhancing perceptual experiences in augmented reality applications. To date, several artificial tactile interfaces have been developed to perceive pressure and precontact signals, while simultaneously detecting object type and softness with quantified modulus still remains challenging. Here, inspired by the campaniform sensilla on insect antennae, we proposed a hemispherical bimodal intelligent tactile sensor (BITS) array using the triboelectric effect. The system is capable of softness identification, modulus quantification, and material type recognition. In principle, due to the varied deformability of materials, the BITS generates unique triboelectric output fingerprints when in contact with the tested object. Furthermore, owing to the different electron affinities, the BITS array can accurately recognize material type (99.4% accuracy), facilitating softness recognition (100% accuracy) and modulus quantification. It is promising that the BITS based on the triboelectric effect has the potential to be miniaturized to provide real-time accurate haptic information as an artificial antenna toward applications of human-machine integration.

Primary somatosensory cortical processing in tactile communication.

Touch is an essential form of non-verbal communication. While language and its neural basis are widely studied, tactile communication is less well understood. We used fMRI and multivariate pattern analyses in pairs of emotionally close adults to examine the neural basis of human-to-human tactile communication. In each pair, a participant was designated either as sender or as receiver. The sender was instructed to communicate specific messages by touching only the arm of the receiver, who was inside the scanner. The receiver then identified the message based on the touch expression alone. We designed two multivariate decoder algorithms-one based on the sender's intent (sender-decoder), and another based on the receiver's response (receiver-decoder). We identified several brain areas that significantly predicted behavioural accuracy of the receiver. Regarding our a priori region of interest, the receiver's primary somatosensory cortex (S1), both decoders were able to accurately differentiate the messages based on neural activity patterns here. The receiver-decoder, which relied on the receivers' interpretations of the touch expressions, outperformed the sender-decoder, which relied on the sender's intent. Our results identified a network of brain areas involved in human-to-human tactile communication and supported the notion of non-sensory factors being represented in S1. This article is part of the theme issue 'Sensing and feeling: an integrative approach to sensory processing and emotional experience'.

Local field potential sharp waves with diversified impact on cortical neuronal encoding of haptic input.

Cortical sensory processing is greatly impacted by internally generated activity. But controlling for that activity is difficult since the thalamocortical network is a high-dimensional system with rapid state changes. Therefore, to unwind the cortical computational architecture there is a need for physiological 'landmarks' that can be used as frames of reference for computational state. Here we use a waveshape transform method to identify conspicuous local field potential sharp waves (LFP-SPWs) in the somatosensory cortex (S1). LFP-SPW events triggered short-lasting but massive neuronal activation in all recorded neurons with a subset of neurons initiating their activation up to 20 ms before the LFP-SPW onset. In contrast, LFP-SPWs differentially impacted the neuronal spike responses to ensuing tactile inputs, depressing the tactile responses in some neurons and enhancing them in others. When LFP-SPWs coactivated with more distant cortical surface (ECoG)-SPWs, suggesting an involvement of these SPWs in global cortical signaling, the impact of the LFP-SPW on the neuronal tactile response could change substantially, including inverting its impact to the opposite. These cortical SPWs shared many signal fingerprint characteristics as reported for hippocampal SPWs and may be a biomarker for a particular type of state change that is possibly shared byboth hippocampus and neocortex.

A review of assessment methods for measuring individual differences in oral somatosensory perception.

While taste and smell perception have been thoroughly investigated, our understanding of oral somatosensory perception remains limited. Further, assessing and measuring individual differences in oral somatosensory perception pose notable challenges. This review aimed to evaluate the existing methods to assess oral somatosensory perception by examining and comparing the strengths and limitations of each method. The review highlighted the lack of standardized assessment methods and the various procedures within each method. Tactile sensitivity can be assessed using several methods, but each method measures different tactile dimensions. Further investigations are needed to confirm its correlation with texture sensitivity. In addition, measuring a single textural attribute may not provide an overall representation of texture sensitivity. Thermal sensitivity can be evaluated using thermal-change detection or temperature discrimination tests. The chemesthetic sensitivity tests involve either localized or whole-mouth stimulation tests. The choice of an appropriate method for assessing oral somatosensory sensitivity depends on several factors, including the specific research objectives and the target population. Each method has its unique intended purpose, strengths, and limitations, so no universally superior approach exists. To overcome some of the limitations associated with certain methods, the review offers alternative or complementary approaches that could be considered. Researchers can enhance the comprehensive assessment of oral somatosensory sensitivity by carefully selecting and potentially combining methods. In addition, a standardized protocol remains necessary for each method.

FaceTouch: Detecting hand-to-face touch with supervised contrastive learning to assist in tracing infectious diseases.

Through our respiratory system, many viruses and diseases frequently spread and pass from one person to another. Covid-19 served as an example of how crucial it is to track down and cut back on contacts to stop its spread. There is a clear gap in finding automatic methods that can detect hand-to-face contact in complex urban scenes or indoors. In this paper, we introduce a computer vision framework, called FaceTouch, based on deep learning. It comprises deep sub-models to detect humans and analyse their actions. FaceTouch seeks to detect hand-to-face touches in the wild, such as through video chats, bus footage, or CCTV feeds. Despite partial occlusion of faces, the introduced system learns to detect face touches from the RGB representation of a given scene by utilising the representation of the body gestures such as arm movement. This has been demonstrated to be useful in complex urban scenarios beyond simply identifying hand movement and its closeness to faces. Relying on Supervised Contrastive Learning, the introduced model is trained on our collected dataset, given the absence of other benchmark datasets. The framework shows a strong validation in unseen datasets which opens the door for potential deployment.

How material sensory properties and individual differences influence the haptic aesthetic appeal of visually presented stimuli.

Touch plays a crucial role for humans. Despite its centrality in sensory experiences, the field of haptic aesthetics is underexplored. So far, existing research has revealed that preferences in the haptic domain are related to stimulus properties and the Gestalt laws of grouping. Additionally, haptic aesthetics is influenced by top-down processes, e.g., stimulus familiarity, and is likely to be modulated by personality and expertise. To further our understanding of these influences on haptic aesthetic appraisal, the current study investigated the imagined haptic aesthetic appeal of visually presented material surfaces, considering the role of haptic expertise, Need for touch, personality traits. The results revealed a positive influence of familiarity, simplicity, smoothness, warmth, lightness, dryness, slipperiness and a negative influence of complexity on individuals' aesthetic responses. While the study failed to support the predicted influence of Need for touch and haptic expertise on aesthetic responses, results did reveal an influence of openness to experience, conscientiousness and neuroticism. Despite the limitations related to the indirect stimuli presentation (vision only), the findings contribute to the relatively unexplored role of bottom-up and top-down features in haptic aesthetics that might be incorporated into the design of consumers' products to better meet their preferences.

Tactile emoticons: Conveying social emotions and intentions with manual and robotic tactile feedback during social media communications.

Touch offers important non-verbal possibilities for socioaffective communication. Yet most digital communications lack capabilities regarding exchanging affective tactile messages (tactile emoticons). Additionally, previous studies on tactile emoticons have not capitalised on knowledge about the affective effects of certain mechanoreceptors in the human skin, e.g., the C-Tactile (CT) system. Here, we examined whether gentle manual stroking delivered in velocities known to optimally activate the CT system (defined as 'tactile emoticons'), during lab-simulated social media communications could convey increased feelings of social support and other prosocial intentions compared to (1) either stroking touch at CT sub-optimal velocities, or (2) standard visual emoticons. Participants (N = 36) felt more social intent with CT-optimal compared to sub-optimal velocities, or visual emoticons. In a second, preregistered study (N = 52), we investigated whether combining visual emoticons with tactile emoticons, this time delivered at CT-optimal velocities by a soft robotic device, could enhance the perception of prosocial intentions and affect participants' physiological measures (e.g., skin conductance rate) in comparison to visual emoticons alone. Visuotactile emoticons conveyed more social intent overall and in anxious participants affected physiological measures more than visual emoticons. The results suggest that emotional social media communications can be meaningfully enhanced by tactile emoticons.

Conductive block copolymer elastomers and psychophysical thresholding for accurate haptic effects.

Electrotactile stimulus is a form of sensory substitution in which an electrical signal is perceived as a mechanical sensation. The electrotactile effect could, in principle, recapitulate a range of tactile experience by selective activation of nerve endings. However, the method has been plagued by inconsistency, galvanic reactions, pain and desensitization, and unwanted stimulation of nontactile nerves. Here, we describe how a soft conductive block copolymer, a stretchable layout, and concentric electrodes, along with psychophysical thresholding, can circumvent these shortcomings. These purpose-designed materials, device layouts, and calibration techniques make it possible to generate accurate and reproducible sensations across a cohort of 10 human participants and to do so at ultralow currents (≥6 microamperes) without pain or desensitization. This material, form factor, and psychophysical approach could be useful for haptic devices and as a tool for activation of the peripheral nervous system.

A scoping review on examination approaches for identifying tactile deficits at the upper extremity in individuals with stroke.

PURPOSE: Accurate perception of tactile stimuli is essential for performing and learning activities of daily living. Through this scoping review, we sought to summarize existing examination approaches for identifying tactile deficits at the upper extremity in individuals with stroke. The goal was to identify current limitations and future research needs for designing more comprehensive examination tools. METHODS: A scoping review was conducted in accordance with the Joanna Briggs Institute methodological framework and the PRISMA for Scoping Reviews (PRISMA-ScR) guidelines. A database search for tactile examination approaches at the upper extremity of individuals with stroke was conducted using Medline (Ovid), The Cochrane Library (Wiley), CINAHL Plus with Full Text (Ebsco), Scopus (Elsevier), PsycInfo (Ebsco), and Proquest Dissertations and Theses Global. Original research and review articles that involved adults (18 years or older) with stroke, and performed tactile examinations at the upper extremity were eligible for inclusion. Data items extracted from the selected articles included: if the examination was behavioral in nature and involved neuroimaging, the extent to which the arm participated during the examination, the number of possible outcomes of the examination, the type(s) of tactile stimulation equipment used, the location(s) along the arm examined, the peripheral nerves targeted for examination, and if any comparison was made with the non-paretic arm or with the arms of individuals who are neurotypical. RESULTS: Twenty-two articles met the inclusion criteria and were accepted in this review. Most examination approaches were behavioral in nature and involved self-reporting of whether a tactile stimulus was felt while the arm remained passive (i.e., no volitional muscle activity). Typically, the number of possible outcomes with these behavioral approaches were limited (2-3), whereas the neuroimaging approaches had many more possible outcomes ( > 15 ). Tactile examinations were conducted mostly at the distal locations along the arm (finger or hand) without targeting any specific peripheral nerve. Although a majority of articles compared paretic and non-paretic arms, most did not compare outcomes to a control group of individuals who are neurotypical. DISCUSSION: Our findings noted that most upper extremity tactile examinations are behavioral approaches, which are subjective in nature, lack adequate resolution, and are insufficient to identify the underlying neural mechanisms of tactile deficits. Also, most examinations are administered at distal locations of the upper extremity when the examinee's arm is relaxed (passive). Further research is needed to develop better tactile examination tools that combine behavioral responses and neurophysiological outcomes, and allow volitional tactile exploration. Approaches that include testing of multiple body locations/nerves along the upper extremity, provide higher resolution of outcomes, and consider normative comparisons with individuals who are neurotypical may provide a more comprehensive understanding of the tactile deficits occurring following a stroke.

Tactile breathing guidance increases oxygen saturation but not alertness or hypoxia symptoms.

We investigated the effect of tactile guided slow deep breathing compared with that of spontaneous breathing on blood oxygen saturation (SpO2), alertness, and hypoxia symptoms during acute hypobaric hypoxia. We also evaluated the usability of this tactile breathing guidance. Twelve male military pilots were exposed to a simulated altitude of 4,572 m (15,000 ft) in a repeated measures study while breathing spontaneously and during tactile guided slow deep breathing. Under both breathing conditions, measurements were performed at rest and during the performance of a cognitive task. The Stanford Sleepiness Scale was used to rate alertness, and hypoxia symptoms were reported using a list of general hypoxia symptoms. Usability was evaluated in a questionnaire. Tactile guidance of slow deep breathing significantly increased (p <.001) the SpO2 - 88% (95% confidence interval (CI) [84%, 91%]) at rest and 85% (95% CI [81%, 88%]) during the cognitive task - compared with spontaneous breathing - 78% (95% CI [75%, 81%]) at rest and 78% (95% CI [76%, 80%]) during the cognitive task. This increase in SpO2 had no effect on the level of alertness and number of hypoxia symptoms. Pilots were positive about the intensity and sensation of the vibration signal, but had difficulty following the vibration pattern during the cognitive task. Pre-training may improve slow deep breathing technique during performance of cognitive tasks.

High frequency heart rate variability is associated with sensitivity to affective touch.

C-tactile afferents (CTs) are a class of unmyelinated, mechanosensitive nerve fibre that respond optimally to skin temperature, slow moving touch typical of a caress. They are hypothesised to signal the rewarding value of affiliative tactile interactions. While CT firing frequency is positively correlated with subjective ratings of touch pleasantness, trait differences in sensitivity to the specific hedonic value of CT targeted touch have been reported. Inter-individual differences in vagally mediated, high frequency heart rate variability (HF-HRV) have been linked to variation in visual social cognition. Thus, the aim of the present study was to examine the relationship between resting state HF-HRV and sensitivity to socially relevant CT targeted touch. 58 healthy participants first had a 5-minute electrocardiogram. They then rated the pleasantness of 5 randomly presented velocities of robotically delivered touch. Three velocities fell within (1, 3, 10 cm/s) and two outside (0.3, 30 cm/s) the CT optimal range. Each velocity was delivered twice. On a group level, affective touch ratings were described by a negative quadratic function, with CT optimal velocities rated as more pleasant than slower and faster speeds. Simple regression analysis confirmed participants' HF-HRV was significantly predicted by the quadratic curve fit of their touch ratings, with higher HF-HRV associated with a better quadratic fit. These findings indicate that, in line with previous observations that higher HF-HRV is associated with enhanced sensitivity to visual social cues, trait differences in autonomic control could account for previously reported individual differences in CT sensitivity.

An Instrumented Glove for Restoring Sensorimotor Function of the Hand Through Augmented Sensory Feedback.

The loss of sensitivity of the upper limb due to neurological injuries severely limits the ability to manipulate objects, hindering personal independence. Non-invasive augmented sensory feedback techniques are used to promote neural plasticity hence to restore the grasping function. This work presents a wearable device for restoring sensorimotor hand functions based on Discrete Event-driven Sensory Control policy. It consists of an instrumented glove that, relying on piezoelectric sensors, delivers short-lasting vibrotactile stimuli synchronously with the relevant mechanical events (i.e., contact and release) of the manipulation. We first performed a feasibility study on healthy participants (20) that showed overall good performances of the device, with touch-event detection accuracy of 96.2% and a response delay of 22 ms. Later, we pilot tested it on two participants with limited sensorimotor functions. When using the device, they improved their hand motor coordination while performing tests for hand motor coordination assessment (i.e., pick and place test, pick and lift test). In particular, they exhibited more coordinated temporal correlations between grip force and load force profiles and enhanced performances when transferring objects, quantitatively proving the effectiveness of the device.

Interleaved Multi-Contact Peripheral Nerve Stimulation to Enhance Reproduction of Tactile Sensation: A Computational Modeling Study.

Peripheral nerve stimulation (PNS) is an effective means to elicit sensation for rehabilitation of people with loss of a limb or limb function. While most current PNS paradigms deliver current through single electrode contacts to elicit each tactile percept, multi-contact extraneural electrodes offer the opportunity to deliver PNS with groups of contacts individually or simultaneously. Multi-contact PNS strategies could be advantageous in developing biomimetic PNS paradigms to recreate the natural neural activity during touch, because they may be able to selectively recruit multiple distinct neural populations. We used computational models and optimization approaches to develop a novel biomimetic PNS paradigm that uses interleaved multi-contact (IMC) PNS to approximate the critical neural coding properties underlying touch. The IMC paradigm combines field shaping, in which two contacts are active simultaneously, with pulse-by-pulse contact and parameter variations throughout the touch stimulus. We show in simulation that IMC PNS results in better neural code mimicry than single contact PNS created with the same optimization techniques, and that field steering via two-contact IMC PNS results in better neural code mimicry than one-contact IMC PNS. We also show that IMC PNS results in better neural code mimicry than existing PNS paradigms, including prior biomimetic PNS. Future clinical studies will determine if the IMC paradigm can improve the naturalness and usefulness of sensory feedback for those with neurological disorders.

Creation of a biological sensorimotor interface for bionic reconstruction.

Neuromuscular control of bionic arms has constantly improved over the past years, however, restoration of sensation remains elusive. Previous approaches to reestablish sensory feedback include tactile, electrical, and peripheral nerve stimulation, however, they cannot recreate natural, intuitive sensations. Here, we establish an experimental biological sensorimotor interface and demonstrate its potential use in neuroprosthetics. We transfer a mixed nerve to a skeletal muscle combined with glabrous dermal skin transplantation, thus forming a bi-directional communication unit in a rat model. Morphological analyses indicate reinnervation of the skin, mechanoreceptors, NMJs, and muscle spindles. Furthermore, sequential retrograde labeling reveals specific sensory reinnervation at the level of the dorsal root ganglia. Electrophysiological recordings show reproducible afferent signals upon tactile stimulation and tendon manipulation. The results demonstrate the possibility of surgically creating an interface for both decoding efferent motor control, as well as encoding afferent tactile and proprioceptive feedback, and may indicate the way forward regarding clinical translation of biological communication pathways for neuroprosthetic applications.