Mediated and non-mediated tactile fingerspelling: a comparative study.

In the development of communication devices for individuals who are Deafblind, a significant challenge is achieving a seamless transition from human-generated to technology-mediated communication. This study compares the intelligibility of the Australian Deafblind tactile fingerspelling alphabet rendered on the HaptiComm tactile communication device with the same alphabet articulated by a human signer. After a short training period, participants identified the 26 English alphabet letters in both the mediated (device) and non-mediated (human) conditions. Results indicated that while participants easily identified most letters in the non-mediated condition, the mediated condition was more difficult to decipher. Specifically, letters presented on the palm or near the index finger had significantly lower recognition rates. These findings highlight the need for further research on the tactile features of communication devices and emphasize the importance of refining these features to enhance the reliability and readability of mediated tactile communication produced through tactile fingerspelling.

Increased temporal binding during voluntary motor task under local anesthesia.

Temporal binding refers to a systemic bias in the perceived time interval between two related events, most frequently voluntary motor actions and a subsequent sensory effect. An inevitable component of most instrumental motor actions is tactile feedback. Yet, the role of tactile feedback within this phenomenon remains largely unexplored. Here, we used local anesthesia of the index finger to temporarily inhibit incoming sensory input from the finger itself, while participants performed an interval-estimation task in which they estimated the delay between a voluntary motor action (button press) and a second sensory event (click sound). Results were compared to a control condition with intact sensation. While clear binding was present in both conditions, the effect was significantly enhanced when tactile feedback was temporarily removed via local anesthesia. The results are discussed in light of current debates surrounding the underlying mechanisms and function of this temporal bias.

Erratum: Touching with the eyes: Oculomotor self-touch induces illusory body ownership.

[This corrects the article DOI: 10.1016/j.isci.2023.106180.].

Distributed Tactile Display with Dual Array Design.

It is well-accepted that designing and manufacturing distributed tactile displays is hard owing to difficulties associated with packing many strong actuators in a small space. We explored a new design for such displays by reducing the number of independently actuated degrees of freedom while preserving the ability to decorrelate the signals applied to small regions of the fingertip skin inside the contact area. The device comprised two independently actuated tactile arrays so the degree of correlation of the waveforms stimulating those small regions could be globally controlled. We show that for periodic signals, the degree of correlation between the displacement of the two arrays was equivalent to setting the phase relationship between the displacements or the arrays or the mix of common and differential modes motions. We found that anti-correlating the displacements of the arrays significantly increased the subjective perceived intensity for the same displacement. We discussed the factors that could explain this finding.

The knobby ball illusion.

A novel haptic illusion is described where deformations of the fingertip skin lead to subsequent misperceptions of an object's shape.

Touching with the eyes: Oculomotor self-touch induces illusory body ownership.

Self-touch plays a central role in the construction and plasticity of the bodily self. But which mechanisms support this role? Previous accounts emphasize the convergence of proprioceptive and tactile signals from the touching and the touched body parts. Here, we hypothesise that proprioceptive information is not necessary for self-touch modulation of body-ownership. Because eye movements do not rely on proprioceptive signals as limb movements do, we developed a novel oculomotor self-touch paradigm where voluntary eye movements generated corresponding tactile sensations. We then compared the effectiveness of eye versus hand self-touch movements in generating an illusion of owning a rubber hand. Voluntary oculomotor self-touch was as effective as hand-driven self-touch, suggesting that proprioception does not contribute to body ownership during self-touch. Self-touch may contribute to a unified sense of bodily self by binding voluntary actions toward our own body with their tactile consequences.

Humans sense by touch the location of objects that roll in handheld containers.

Humans use active touch to gain behaviourally relevant information from their environment, including information about contained objects. Although most common, the perceptual basis of interacting with containers remains largely unexplored. The first aim of this study was to determine how accurately people can sense, by touch only, the location of a contained rolling object. Experiment 1 used tubes containing physical balls and demonstrated a considerable degree of accuracy in estimating the rolled distance. The second aim was to identify the relative effectiveness of the various available physical cues. Experiment 2 employed virtual reality technology to present, in isolation and in various combinations, the constituent haptic cues produced by a rolling ball, which are, the mechanical noise during rolling, the jolts from an impact with an internal wall, and the intensity and timing of the jolts resulting from elastic bounces. The rolling noise was of primary importance to the perceptual estimation task suggesting that the implementation of the laws of motion is based on an analysis of the ball's movement velocity. Although estimates became more accurate when the rolling and impact cues were combined, they were not necessarily more precise. The presence of elastic bounces did not affect performance.

Artificial fast-adapting mechanoreceptor based on carbon nanotube percolating network.

Most biological sensors preferentially encode changes in a stimulus rather than the steady components. However, intrinsically phasic artificial mechanoreceptors have not yet been described. We constructed a phasic mechanoreceptor by encapsulating carbon nanotube film in a viscoelastic matrix supported by a rigid substrate. When stimulated by a spherical indenter the sensor response resembled the response of fast-adapting mammalian mechanoreceptors. We modelled these sensors from the properties of percolating conductive networks combined with nonlinear contact mechanics and discussed the implications of this finding.

Phononic Crystals Applied to Localised Surface Haptics.

Metamaterials are solid lattices with periodicities commensurate with desired wavelengths. Their geometric features can endow the bulk material with unusual properties, such as inter alia, negative indices of refraction or unique absorbing qualities. Mesoscale metamaterials and phononic crystals can be designed to cause the occurence of band gaps in the ultrasonic domain. These localised phenomena induce fixed boundary conditions that correspond to acoustic mirrors which, in turn, can be used to establish waveguides in thin plates. Ultrasonic lubrication has been successfully applied to create haptic interfaces that operate by modulating the apparent friction of a surface. In this article, we demonstrate that phononic crystals can be designed to localise the modulation of friction in specific portions of the surface of a thin plate, opening novel possibilities for the design of surface haptic interfaces.

Numerosity Identification Used to Assess Tactile Stimulation Methods for Communication.

Finger-Braille is a tactile communication method used by people who are Deafblind. Individuals communicate Finger-Braille messages with combinations of taps on three fingers of each of the hands of the person receiving the communication. Devices have been developed to produce Finger-Braille symbols using different tactile stimulation methods. Before engaging in communication studies based on technologically-mediated Finger-Braille, we evaluated the relative efficacy of these methods by comparing two devices similarly constructed; the first based on widely employed eccentric rotating-mass vibrating motors and the other using specifically designed tapping actuators. We asked volunteers to identify the numerosity of presented items and for each device we measured (1) error-rate, (2) reaction time, (3) confidence ratings, and (4) a comparison of confidence ratings to actual performance. The four measures obtained for each device showed a net advantage of the tapping stimulation method over the method of vibrations. In this article, we conclude that the tapping stimulation method is recommended for use in the design of tactile communication devices based on Finger-Braille and fingerspelling methods reliant on finger tapping actions. The results did not demonstrate clear evidence for tactile subitising with passively experienced stimulation on the fingers.

Harnessing tactile waves to measure skin-to-skin interactions.

Skin-to-skin touch is an essential form of tactile interaction, yet there is no known method to quantify how we touch our own skin or someone else's skin. Skin-to-skin touch is particularly challenging to measure objectively, since interposing an instrumented sheet, no matter how thin and flexible, between the interacting skins is not an option. To fill this gap, we explored a technique that takes advantage of the propagation of vibrations from the locus of touch to pick up a signal that contains information about skin-to-skin tactile interactions. These "tactile waves" were measured by an accelerometer sensor placed on the touching finger. Applied pressure and speed had a direct influence on measured signal power when the target of touch was the self or another person. The measurements were insensitive to changes in the location of the sensor relative to the target. Our study suggests that this method has potential for probing behaviour during skin-to-skin tactile interactions and could be a valuable technique to study social touch, self-touch, and motor control. The method is non-invasive, easy to commission, inexpensive, and robust.

Compression of dynamic tactile information in the human hand.

A key problem in the study of the senses is to describe how sense organs extract perceptual information from the physics of the environment. We previously observed that dynamic touch elicits mechanical waves that propagate throughout the hand. Here, we show that these waves produce an efficient encoding of tactile information. The computation of an optimal encoding of thousands of naturally occurring tactile stimuli yielded a compact lexicon of primitive wave patterns that sparsely represented the entire dataset, enabling touch interactions to be classified with an accuracy exceeding 95%. The primitive tactile patterns reflected the interplay of hand anatomy with wave physics. Notably, similar patterns emerged when we applied efficient encoding criteria to spiking data from populations of simulated tactile afferents. This finding suggests that the biomechanics of the hand enables efficient perceptual processing by effecting a preneuronal compression of tactile information.

Somatosensory Cortex Efficiently Processes Touch Located Beyond the Body.

The extent to which a tool is an extension of its user is a question that has fascinated writers and philosophers for centuries [1]. Despite two decades of research [2-7], it remains unknown how this could be instantiated at the neural level. To this aim, the present study combined behavior, electrophysiology and neuronal modeling to characterize how the human brain could treat a tool like an extended sensory "organ." As with the body, participants localize touches on a hand-held tool with near-perfect accuracy [7]. This behavior is owed to the ability of the somatosensory system to rapidly and efficiently use the tool as a tactile extension of the body. Using electroencephalography (EEG), we found that where a hand-held tool was touched was immediately coded in the neural dynamics of primary somatosensory and posterior parietal cortices of healthy participants. We found similar neural responses in a proprioceptively deafferented patient with spared touch perception, suggesting that location information is extracted from the rod's vibrational patterns. Simulations of mechanoreceptor responses [8] suggested that the speed at which these patterns are processed is highly efficient. A second EEG experiment showed that touches on the tool and arm surfaces were localized by similar stages of cortical processing. Multivariate decoding algorithms and cortical source reconstruction provided further evidence that early limb-based processes were repurposed to map touch on a tool. We propose that an elementary strategy the human brain uses to sense with tools is to recruit primary somatosensory dynamics otherwise devoted to the body.

Gravito-inertial ambiguity resolved through head stabilization.

It has been frequently observed that humans and animals spontaneously stabilize their heads with respect to the gravitational vertical during body movements even in the absence of vision. The interpretations of this intriguing behaviour have so far not included the need, for survival, to robustly estimate verticality. Here we use a mechanistic model of the head/otolith organ to analyse the possibility for this system to render verticality 'observable', a fundamental prerequisite to the determination of the angular position and acceleration of the head from idiothetic, inertial measurements. The intrinsically nonlinear head-vestibular dynamics is shown to generally lack observability unless the head is stabilized in orientation by feedback. Thus, our study supports the hypothesis that a central function of the physiologically costly head stabilization strategy is to enable an organism to estimate the gravitational vertical and head acceleration during locomotion. Moreover, our result exhibits a rare peculiarity of certain nonlinear systems to fortuitously alter their observability properties when feedback is applied.

Confidence is higher in touch than in vision in cases of perceptual ambiguity.

The inclination to touch objects that we can see is a surprising behaviour, given that vision often supplies relevant and sufficiently accurate sensory evidence. Here we suggest that this 'fact-checking' phenomenon could be explained if touch provides a higher level of perceptual certainty than vision. Testing this hypothesis, observers explored inverted T-shaped stimuli eliciting the Vertical-horizontal illusion in vision and touch, which included clear-cut and ambiguous cases. In separate blocks, observers judged whether the vertical bar was shorter or longer than the horizontal bar and rated the confidence in their judgments. Decisions reached by vision were objectively more accurate than those reached by touch with higher overall confidence ratings. However, while confidence was higher for vision rather than for touch in clear-cut cases, observers were more confident in touch when the stimuli were ambiguous. This relative bias as a function of ambiguity qualifies the view that confidence tracks objective accuracy and uses a comparable mapping across sensory modalities. Employing a perceptual illusion, our method disentangles objective and subjective accuracy showing how the latter is tracked by confidence and point towards possible origins for 'fact checking' by touch.

Radial trunk-centred reference frame in haptic perception.

The shape of objects is typically identified through active touch. The accrual of spatial information by the hand over time requires the continuous integration of tactile and movement information. Sensory inputs arising from one single sensory source gives rise to an infinite number of possible touched locations in space. This observation raises the question of the determination of a common reference frame that might be employed by humans to resolve spatial ambiguity. Here, we employ a paradigm where observers reconstruct the spatial attributes of a triangle from tactile inputs applied to a stationary hand correlated with the voluntary movements of the other hand. We varied the orientation of the hands with respect to one another and to the trunk, and tested three distinct hypotheses regarding a reference frame used for integration: a hand-centred, a trunk-centred or an allocentric reference frame. The results indicated strongly that the integration of movement information and tactile inputs was performed in a radial trunk-centred reference frame.

Sensing with tools extends somatosensory processing beyond the body.

The ability to extend sensory information processing beyond the nervous system1 has been observed throughout the animal kingdom; for example, when rodents palpate objects using whiskers2 and spiders localize prey using webs3. We investigated whether the ability to sense objects with tools4-9 represents an analogous information processing scheme in humans. Here we provide evidence from behavioural psychophysics, structural mechanics and neuronal modelling, which shows that tools are treated by the nervous system as sensory extensions of the body rather than as simple distal links between the hand and the environment10,11. We first demonstrate that tool users can accurately sense where an object contacts a wooden rod, just as is possible on the skin. We next demonstrate that the impact location is encoded by the modal response of the tool upon impact, reflecting a pre-neuronal stage of mechanical information processing akin to sensing with whiskers2 and webs3. Lastly, we use a computational model of tactile afferents12 to demonstrate that impact location can be rapidly re-encoded into a temporally precise spiking code. This code predicts the behaviour of human participants, providing evidence that the information encoded in motifs shapes localization. Thus, we show that this sensory capability emerges from the functional coupling between the material, biomechanical and neural levels of information processing13,14.

Why pens have rubbery grips.

The process by which human fingers gives rise to stable contacts with smooth, hard objects is surprisingly slow. Using high-resolution imaging, we found that, when pressed against glass, the actual contact made by finger pad ridges evolved over time following a first-order kinetics relationship. This evolution was the result of a two-stage coalescence process of microscopic junctions made between the keratin of the stratum corneum of the skin and the glass surface. This process was driven by the secretion of moisture from the sweat glands, since increased hydration in stratum corneum causes it to become softer. Saturation was typically reached within 20 s of loading the contact, regardless of the initial moisture state of the finger and of the normal force applied. Hence, the gross contact area, frequently used as a benchmark quantity in grip and perceptual studies, is a poor reflection of the actual contact mechanics that take place between human fingers and smooth, impermeable surfaces. In contrast, the formation of a steady-state contact area is almost instantaneous if the counter surface is soft relative to keratin in a dry state. It is for this reason that elastomers are commonly used to coat grip surfaces.

Characterizing and Imaging Gross and Real Finger Contacts under Dynamic Loading.

We describe an instrument intended to study finger contacts under tangential dynamic loading. This type of loading is relevant to the natural conditions when touch is used to discriminate and identify the properties of the surfaces of objects-it is also crucial during object manipulation. The system comprises a high performance tribometer able to accurately record in vivo the components of the interfacial forces when a finger interacts with arbitrary surfaces which is combined with a high-speed, high-definition imaging apparatus. Broadband skin excitation reproducing the dynamic contact loads previously identified can be effected while imaging the contact through a transparent window, thus closely approximating the condition when the skin interacts with a non-transparent surface during sliding. As a preliminary example of the type of phenomenon that can be identified with this apparatus, we show that traction in the range from 10 to 1000 Hz tends to decrease faster with excitation frequency for dry fingers than for moist fingers.

Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives.

In the last decade, we have witnessed a drastic change in the form factor of audio and vision technologies, from heavy and grounded machines to lightweight devices that naturally fit our bodies. However, only recently, haptic systems have started to be designed with wearability in mind. The wearability of haptic systems enables novel forms of communication, cooperation, and integration between humans and machines. Wearable haptic interfaces are capable of communicating with the human wearers during their interaction with the environment they share, in a natural and yet private way. This paper presents a taxonomy and review of wearable haptic systems for the fingertip and the hand, focusing on those systems directly addressing wearability challenges. The paper also discusses the main technological and design challenges for the development of wearable haptic interfaces, and it reports on the future perspectives of the field. Finally, the paper includes two tables summarizing the characteristics and features of the most representative wearable haptic systems for the fingertip and the hand.