A wirelessly programmable, skin-integrated thermo-haptic stimulator system for virtual reality.

Sensations of heat and touch produced by receptors in the skin are of essential importance for perceptions of the physical environment, with a particularly powerful role in interpersonal interactions. Advances in technologies for replicating these sensations in a programmable manner have the potential not only to enhance virtual/augmented reality environments but they also hold promise in medical applications for individuals with amputations or impaired sensory function. Engineering challenges are in achieving interfaces with precise spatial resolution, power-efficient operation, wide dynamic range, and fast temporal responses in both thermal and in physical modulation, with forms that can extend over large regions of the body. This paper introduces a wireless, skin-compatible interface for thermo-haptic modulation designed to address some of these challenges, with the ability to deliver programmable patterns of enhanced vibrational displacement and high-speed thermal stimulation. Experimental and computational investigations quantify the thermal and mechanical efficiency of a vertically stacked design layout in the thermo-haptic stimulators that also supports real-time, closed-loop control mechanisms. The platform is effective in conveying thermal and physical information through the skin, as demonstrated in the control of robotic prosthetics and in interactions with pressure/temperature-sensitive touch displays.

Electronic Skin: Opportunities and Challenges in Convergence with Machine Learning.

Recent advancements in soft electronic skin (e-skin) have led to the development of human-like devices that reproduce the skin's functions and physical attributes. These devices are being explored for applications in robotic prostheses as well as for collecting biopotentials for disease diagnosis and treatment, as exemplified by biomedical e-skins. More recently, machine learning (ML) has been utilized to enhance device control accuracy and data processing efficiency. The convergence of e-skin technologies with ML is promoting their translation into clinical practice, especially in healthcare. This review highlights the latest developments in ML-reinforced e-skin devices for robotic prostheses and biomedical instrumentations. We first describe technological breakthroughs in state-of-the-art e-skin devices, emphasizing technologies that achieve skin-like properties. We then introduce ML methods adopted for control optimization and pattern recognition, followed by practical applications that converge the two technologies. Lastly, we briefly discuss the challenges this interdisciplinary research encounters in its clinical and industrial transition.

Adaptive tactile interaction transfer via digitally embroidered smart gloves.

Human-machine interfaces for capturing, conveying, and sharing tactile information across time and space hold immense potential for healthcare, augmented and virtual reality, human-robot collaboration, and skill development. To realize this potential, such interfaces should be wearable, unobtrusive, and scalable regarding both resolution and body coverage. Taking a step towards this vision, we present a textile-based wearable human-machine interface with integrated tactile sensors and vibrotactile haptic actuators that are digitally designed and rapidly fabricated. We leverage a digital embroidery machine to seamlessly embed piezoresistive force sensors and arrays of vibrotactile actuators into textiles in a customizable, scalable, and modular manner. We use this process to create gloves that can record, reproduce, and transfer tactile interactions. User studies investigate how people perceive the sensations reproduced by our gloves with integrated vibrotactile haptic actuators. To improve the effectiveness of tactile interaction transfer, we develop a machine-learning pipeline that adaptively models how each individual user reacts to haptic sensations and then optimizes haptic feedback parameters. Our interface showcases adaptive tactile interaction transfer through the implementation of three end-to-end systems: alleviating tactile occlusion, guiding people to perform physical skills, and enabling responsive robot teleoperation.