The interaction between motion and texture in the sense of touch.

Besides providing information on elementary properties of objects, like texture, roughness, and softness, the sense of touch is also important in building a representation of object movement and the movement of our hands. Neural and behavioral studies shed light on the mechanisms and limits of our sense of touch in the perception of texture and motion, and of its role in the control of movement of our hands. The interplay between the geometrical and mechanical properties of the touched objects, such as shape and texture, the movement of the hand exploring the object, and the motion felt by touch, will be discussed in this article. Interestingly, the interaction between motion and textures can generate perceptual illusions in touch. For example, the orientation and the spacing of the texture elements on a static surface induces the illusion of surface motion when we move our hand on it or can elicit the perception of a curved trajectory during sliding, straight hand movements. In this work we present a multiperspective view that encompasses both the perceptual and the motor aspects, as well as the response of peripheral and central nerve structures, to analyze and better understand the complex mechanisms underpinning the tactile representation of texture and motion. Such a better understanding of the spatiotemporal features of the tactile stimulus can reveal novel transdisciplinary applications in neuroscience and haptics.

A Synergy-Based Optimally Designed Sensing Glove for Functional Grasp Recognition.

Achieving accurate and reliable kinematic hand pose reconstructions represents a challenging task. The main reason for this is the complexity of hand biomechanics, where several degrees of freedom are distributed along a continuous deformable structure. Wearable sensing can represent a viable solution to tackle this issue, since it enables a more natural kinematic monitoring. However, the intrinsic accuracy (as well as the number of sensing elements) of wearable hand pose reconstruction (HPR) systems can be severely limited by ergonomics and cost considerations. In this paper, we combined the theoretical foundations of the optimal design of HPR devices based on hand synergy information, i.e., the inter-joint covariation patterns, with textile goniometers based on knitted piezoresistive fabrics (KPF) technology, to develop, for the first time, an optimally-designed under-sensed glove for measuring hand kinematics. We used only five sensors optimally placed on the hand and completed hand pose reconstruction (described according to a kinematic model with 19 degrees of freedom) leveraging upon synergistic information. The reconstructions we obtained from five different subjects were used to implement an unsupervised method for the recognition of eight functional grasps, showing a high degree of accuracy and robustness.

Rewiring the evolution of the human hand: How the embodiment of a virtual bionic tool improves behavior.

Humans are the most versatile tool users among animals. Accordingly, our manual skills evolved alongside the shape of the hand. In the future, further evolution may take place: humans may merge with their tools, and technology may integrate into our biology in a way that blurs the line between the two. So, the question is whether humans can embody a bionic tool (i.e., experience it as part of their body) and thus if this would affect behavior. We investigated in virtual reality how the substitution of the hand with a virtual grafting of an end-effector, either non-naturalistic (a bionic tool) or naturalistic (a hand), impacts embodiment and behavior. Across four experiments, we show that the virtual grafting of a bionic tool elicits a sense of embodiment similar to or even stronger than its natural counterpart. In conclusion, the natural usage of bionic tools can rewire the evolution of human behavior.

The relativity of reaching: Motion of the touched surface alters the trajectory of hand movements.

For dexterous control of the hand, humans integrate sensory information and prior knowledge regarding their bodies and the world. We studied the role of touch in hand motor control by challenging a fundamental prior assumption-that self-motion of inanimate objects is unlikely upon contact. In a reaching task, participants slid their fingertips across a robotic interface, with their hand hidden from sight. Unbeknownst to the participants, the robotic interface remained static, followed hand movement, or moved in opposition to it. We considered two hypotheses. Either participants were able to account for surface motion or, if the stationarity assumption held, they would integrate the biased tactile cues and proprioception. Motor errors consistent with the latter hypothesis were observed. The role of visual feedback, tactile sensitivity, and friction was also investigated. Our study carries profound implications for human-machine collaboration in a world where objects may no longer conform to the stationarity assumption.

Modulating the Perceived Softness of Real Objects Through Wearable Feel-Through Haptics.

In vision, Augmented Reality (AR) allows the superposition of digital content on real-world visual information, relying on the well-established See-through paradigm. In the haptic domain, a putative Feel-through wearable device should allow to modify the tactile sensation without masking the actual cutaneous perception of the physical objects. To the best of our knowledge, a similar technology is still far to be effectively implemented. In this work, we present an approach that allows, for the first time, to modulate the perceived softness of real objects using a Feel-through wearable that uses a thin fabric as interaction surface. During the interaction with real objects, the device can modulate the growth of the contact area over the fingerpad without affecting the force experienced by the user, thus modulating the perceived softness. To this aim, the lifting mechanism of our system warps the fabric around the fingerpad in a way proportional to the force exerted on the specimen under exploration. At the same time, the stretching state of the fabric is controlled to keep a loose contact with the fingerpad. We demonstrated that different softness perceptions for the same specimens can be elicited, by suitably controlling the lifting mechanism of the system.

Multi-Cue Haptic Guidance Through Wearables for Enhancing Human Ergonomics.

Wearable haptic systems can be easily integrated with the human body and represent an effective solution for a natural and unobtrusive stimulus delivery. These characteristics can open interesting perspectives for different applications, such as haptic guidance for human ergonomics enhancement, e.g. during human-robot collaborative tasks in industrial scenarios, where the usage of the visual communication channel can be problematic. In this work, we propose a wearable multi-cue system that can be worn at the arm level on both the two upper limbs, which conveys both squeezing stimuli (provided by an armband haptic device) and vibration, to provide corrective feedback for posture balancing along the user's frontal and sagittal plane, respectively. We evaluated the effectiveness of our system in delivering directional information to control the user's center of pressure position on a balancing board. We compared the here proposed haptic guidance with visual guidance cues. Results show no statistically significant differences in terms of success rate and time for task completion for the two conditions. Furthermore, participants underwent through a Subjective Quantitative Evaluation and a NASA-TLX test, evaluating the wearable haptic system as intuitive and effective.

Masking Vibrations and Contact Force Affect the Discrimination of Slip Motion Speed in Touch.

Multiple cues contribute to the discrimination of slip motion speed by touch. In our previous article, we demonstrated that masking vibrations at various frequencies impaired the discrimination of speed. In this article, we extended the previous results to evaluate this phenomenon on a smooth glass surface, and for different values of contact force and duration of the masking stimulus. Speed discrimination was significantly impaired by masking vibrations at high but not at low contact force. Furthermore, a short pulse of masking vibrations at motion onset produced a similar effect as the long masking stimulus, delivered throughout slip motion duration. This last result suggests that mechanical events at motion onset provide important cues to the discrimination of speed.

A Novel Device Decoupling Tactile Slip and Hand Motion in Reaching Tasks: The HaptiTrack Device.

Hand reaching is a complex task that requires the integration of multiple sensory information from muscle, joints and the skin, and an internal model of the motor command. Recent studies in neuroscience highlighted the important role of touch for the control of hand movement while reaching for a target. In this article, present a novel device, the HaptiTrack device, to physically decouple tactile slip motion and hand movements. The new device generates precisely controlled 2D motion of a contact plate, measures contact forces, and provides hand and finger tracking through an external tracking system. By means of a control algorithm described in this manuscript, the velocity of tactile slip can be changed independently from the velocity of the hand sliding on the device's surface. Due to these multiple features, the device can be a powerful tool for the evaluation of tactile sense during hand reaching movements in healthy and pathological conditions.

Haptic and Somesthetic Communication in Sexual Medicine.

INTRODUCTION: The word "haptics" refers to sensory inputs arising from receptors in the skin and in the musculoskeletal system, particularly crucial in sexual economy. Haptic stimuli provide information about mechanical properties of touched objects and about the position and motion of the body. An important area in this field is the development of robotic interfaces for communication through the "haptic channel," which typically requires a collaboration between engineers, neuroscientists, and psychologists. Many aspects of human sexuality, such as arousal and intercourse, can be considered from a haptic perspective. OBJECTIVES: To review the current literature on haptics and somatosensation, and discuss potential applications of haptic interfaces in sexual medicine. METHODS: Articles for this review were collected based on the results of a bibliographic search of relevant papers in Cochrane Library, Google Scholar, Web of Science, Scopus, and EBSCO. The search terms used, including asterisks, were "haptic∗," "somatosensor∗," "sexual∗," and related terms describing the role of touch, technology, and sexuality. Additional terms included "interface∗," "touch," and "sex∗." RESULTS: We have provided a functional and anatomical description of the somatosensory system in humans, with special focus on neural structures involved in affective and erotic touch. One interesting topic is the development of haptic interfaces, which are specialized robots generating mechanical signals that stimulate our somatosensory system. We provided an overview on haptic interfaces and evaluated the role of haptics in sexual medicine. CONCLUSION: Haptics and studies on the neuroscience of the somatosensory system are expected to provide useful insights for sexual medicine and novel tools for sexual dysfunction. In the future, crosstalk between sexology and haptics may produce a novel generation of user-friendly haptic devices generating a higher level of realism and presence in providing stimuli. Moscatelli A, Nimbi FM, Ciotti S, et al. Haptic and Somesthetic Communication in Sexual Medicine. J Sex Med 2021;9:267-279.

W-FYD: A Wearable Fabric-Based Display for Haptic Multi-Cue Delivery and Tactile Augmented Reality.

Despite the importance of softness, there is no evidence of wearable haptic systems able to deliver controllable softness cues. Here, we present the Wearable Fabric Yielding Display (W-FYD), a fabric-based display for multi-cue delivery that can be worn on a user's finger and enables, for the first time, both active and passive softness exploration. It can also induce a sliding effect under the finger-pad. A given stiffness profile can be obtained by modulating the stretching state of the fabric through two motors. Furthermore, a lifting mechanism allows to put the fabric in contact with the user's finger-pad, to enable passive softness rendering. In this paper, we describe the architecture of W-FYD, and a thorough characterization of its stiffness workspace, frequency response, and softness rendering capabilities. We also computed device Just Noticeable Difference in both active and passive exploratory conditions, for linear and non-linear stiffness rendering as well as for sliding direction perception. The effect of device weight was also considered. Furthermore, performance of participants and their subjective quantitative evaluation in detecting sliding direction and softness discrimination tasks are reported. Finally, applications of W-FYD in tactile augmented reality for open palpation are discussed, opening interesting perspectives in many fields of human-machine interaction.

Postural Hand Synergies during Environmental Constraint Exploitation.

Humans are able to intuitively exploit the shape of an object and environmental constraints to achieve stable grasps and perform dexterous manipulations. In doing that, a vast range of kinematic strategies can be observed. However, in this work we formulate the hypothesis that such ability can be described in terms of a synergistic behavior in the generation of hand postures, i.e., using a reduced set of commonly used kinematic patterns. This is in analogy with previous studies showing the presence of such behavior in different tasks, such as grasping. We investigated this hypothesis in experiments performed by six subjects, who were asked to grasp objects from a flat surface. We quantitatively characterized hand posture behavior from a kinematic perspective, i.e., the hand joint angles, in both pre-shaping and during the interaction with the environment. To determine the role of tactile feedback, we repeated the same experiments but with subjects wearing a rigid shell on the fingertips to reduce cutaneous afferent inputs. Results show the persistence of at least two postural synergies in all the considered experimental conditions and phases. Tactile impairment does not alter significantly the first two synergies, and contact with the environment generates a change only for higher order Principal Components. A good match also arises between the first synergy found in our analysis and the first synergy of grasping as quantified by previous work. The present study is motivated by the interest of learning from the human example, extracting lessons that can be applied in robot design and control. Thus, we conclude with a discussion on implications for robotics of our findings.