A wirelessly programmable, skin-integrated thermo-haptic stimulator system for virtual reality.

Sensations of heat and touch produced by receptors in the skin are of essential importance for perceptions of the physical environment, with a particularly powerful role in interpersonal interactions. Advances in technologies for replicating these sensations in a programmable manner have the potential not only to enhance virtual/augmented reality environments but they also hold promise in medical applications for individuals with amputations or impaired sensory function. Engineering challenges are in achieving interfaces with precise spatial resolution, power-efficient operation, wide dynamic range, and fast temporal responses in both thermal and in physical modulation, with forms that can extend over large regions of the body. This paper introduces a wireless, skin-compatible interface for thermo-haptic modulation designed to address some of these challenges, with the ability to deliver programmable patterns of enhanced vibrational displacement and high-speed thermal stimulation. Experimental and computational investigations quantify the thermal and mechanical efficiency of a vertically stacked design layout in the thermo-haptic stimulators that also supports real-time, closed-loop control mechanisms. The platform is effective in conveying thermal and physical information through the skin, as demonstrated in the control of robotic prosthetics and in interactions with pressure/temperature-sensitive touch displays.

Closed-loop network of skin-interfaced wireless devices for quantifying vocal fatigue and providing user feedback.

Vocal fatigue is a measurable form of performance fatigue resulting from overuse of the voice and is characterized by negative vocal adaptation. Vocal dose refers to cumulative exposure of the vocal fold tissue to vibration. Professionals with high vocal demands, such as singers and teachers, are especially prone to vocal fatigue. Failure to adjust habits can lead to compensatory lapses in vocal technique and an increased risk of vocal fold injury. Quantifying and recording vocal dose to inform individuals about potential overuse is an important step toward mitigating vocal fatigue. Previous work establishes vocal dosimetry methods, that is, processes to quantify vocal fold vibration dose but with bulky, wired devices that are not amenable to continuous use during natural daily activities; these previously reported systems also provide limited mechanisms for real-time user feedback. This study introduces a soft, wireless, skin-conformal technology that gently mounts on the upper chest to capture vibratory responses associated with vocalization in a manner that is immune to ambient noises. Pairing with a separate, wirelessly linked device supports haptic feedback to the user based on quantitative thresholds in vocal usage. A machine learning-based approach enables precise vocal dosimetry from the recorded data, to support personalized, real-time quantitation and feedback. These systems have strong potential to guide healthy behaviors in vocal use.

Electronic Skin: Opportunities and Challenges in Convergence with Machine Learning.

Recent advancements in soft electronic skin (e-skin) have led to the development of human-like devices that reproduce the skin's functions and physical attributes. These devices are being explored for applications in robotic prostheses as well as for collecting biopotentials for disease diagnosis and treatment, as exemplified by biomedical e-skins. More recently, machine learning (ML) has been utilized to enhance device control accuracy and data processing efficiency. The convergence of e-skin technologies with ML is promoting their translation into clinical practice, especially in healthcare. This review highlights the latest developments in ML-reinforced e-skin devices for robotic prostheses and biomedical instrumentations. We first describe technological breakthroughs in state-of-the-art e-skin devices, emphasizing technologies that achieve skin-like properties. We then introduce ML methods adopted for control optimization and pattern recognition, followed by practical applications that converge the two technologies. Lastly, we briefly discuss the challenges this interdisciplinary research encounters in its clinical and industrial transition.

Miniaturized wireless, skin-integrated sensor networks for quantifying full-body movement behaviors and vital signs in infants.

Early identification of atypical infant movement behaviors consistent with underlying neuromotor pathologies can expedite timely enrollment in therapeutic interventions that exploit inherent neuroplasticity to promote recovery. Traditional neuromotor assessments rely on qualitative evaluations performed by specially trained personnel, mostly available in tertiary medical centers or specialized facilities. Such approaches are high in cost, require geographic proximity to advanced healthcare resources, and yield mostly qualitative insight. This paper introduces a simple, low-cost alternative in the form of a technology customized for quantitatively capturing continuous, full-body kinematics of infants during free living conditions at home or in clinical settings while simultaneously recording essential vital signs data. The system consists of a wireless network of small, flexible inertial sensors placed at strategic locations across the body and operated in a wide-bandwidth and time-synchronized fashion. The data serve as the basis for reconstructing three-dimensional motions in avatar form without the need for video recordings and associated privacy concerns, for remote visual assessments by experts. These quantitative measurements can also be presented in graphical format and analyzed with machine-learning techniques, with potential to automate and systematize traditional motor assessments. Clinical implementations with infants at low and at elevated risks for atypical neuromotor development illustrates application of this system in quantitative and semiquantitative assessments of patterns of gross motor skills, along with body temperature, heart rate, and respiratory rate, from long-term and follow-up measurements over a 3-mo period following birth. The engineering aspects are compatible for scaled deployment, with the potential to improve health outcomes for children worldwide via early, pragmatic detection methods.

Adaptive tactile interaction transfer via digitally embroidered smart gloves.

Human-machine interfaces for capturing, conveying, and sharing tactile information across time and space hold immense potential for healthcare, augmented and virtual reality, human-robot collaboration, and skill development. To realize this potential, such interfaces should be wearable, unobtrusive, and scalable regarding both resolution and body coverage. Taking a step towards this vision, we present a textile-based wearable human-machine interface with integrated tactile sensors and vibrotactile haptic actuators that are digitally designed and rapidly fabricated. We leverage a digital embroidery machine to seamlessly embed piezoresistive force sensors and arrays of vibrotactile actuators into textiles in a customizable, scalable, and modular manner. We use this process to create gloves that can record, reproduce, and transfer tactile interactions. User studies investigate how people perceive the sensations reproduced by our gloves with integrated vibrotactile haptic actuators. To improve the effectiveness of tactile interaction transfer, we develop a machine-learning pipeline that adaptively models how each individual user reacts to haptic sensations and then optimizes haptic feedback parameters. Our interface showcases adaptive tactile interaction transfer through the implementation of three end-to-end systems: alleviating tactile occlusion, guiding people to perform physical skills, and enabling responsive robot teleoperation.

Responsive materials and mechanisms as thermal safety systems for skin-interfaced electronic devices.

Soft, wireless physiological sensors that gently adhere to the skin are capable of continuous clinical-grade health monitoring in hospital and/or home settings, of particular value to critically ill infants and other vulnerable patients, but they present risks for injury upon thermal failure. This paper introduces an active materials approach that automatically minimizes such risks, to complement traditional schemes that rely on integrated sensors and electronic control circuits. The strategy exploits thin, flexible bladders that contain small volumes of liquid with boiling points a few degrees above body temperature. When the heat exceeds the safe range, vaporization rapidly forms highly effective, thermally insulating structures and delaminates the device from the skin, thereby eliminating any danger to the skin. Experimental and computational thermomechanical studies and demonstrations in a skin-interfaced mechano-acoustic sensor illustrate the effectiveness of this simple thermal safety system and suggest its applicability to nearly any class of skin-integrated device technology.

Thermally switchable, crystallizable oil and silicone composite adhesives for skin-interfaced wearable devices.

Continuous health monitoring is essential for clinical care, especially for patients in neonatal and pediatric intensive care units. Monitoring currently requires wired biosensors affixed to the skin with strong adhesives that can cause irritation and iatrogenic injuries during removal. Emerging wireless alternatives are attractive, but requirements for skin adhesives remain. Here, we present a materials strategy enabling wirelessly triggered reductions in adhesive strength to eliminate the possibility for injury during removal. The materials involve silicone composites loaded with crystallizable oils with melting temperatures close to, but above, surface body temperature. This solid/liquid phase transition occurs upon heating, reducing the adhesion at the skin interface by more than 75%. Experimental and computational studies reveal insights into effects of oil mixed randomly and patterned deterministically into the composite. Demonstrations in skin-integrated sensors that include wirelessly controlled heating and adhesion reduction illustrate the broad utility of these ideas in clinical-grade health monitoring.

A transient, closed-loop network of wireless, body-integrated devices for autonomous electrotherapy.

Temporary postoperative cardiac pacing requires devices with percutaneous leads and external wired power and control systems. This hardware introduces risks for infection, limitations on patient mobility, and requirements for surgical extraction procedures. Bioresorbable pacemakers mitigate some of these disadvantages, but they demand pairing with external, wired systems and secondary mechanisms for control. We present a transient closed-loop system that combines a time-synchronized, wireless network of skin-integrated devices with an advanced bioresorbable pacemaker to control cardiac rhythms, track cardiopulmonary status, provide multihaptic feedback, and enable transient operation with minimal patient burden. The result provides a range of autonomous, rate-adaptive cardiac pacing capabilities, as demonstrated in rat, canine, and human heart studies. This work establishes an engineering framework for closed-loop temporary electrotherapy using wirelessly linked, body-integrated bioelectronic devices.

Differential cardiopulmonary monitoring system for artifact-canceled physiological tracking of athletes, workers, and COVID-19 patients.

Soft, skin-integrated electronic sensors can provide continuous measurements of diverse physiological parameters, with broad relevance to the future of human health care. Motion artifacts can, however, corrupt the recorded signals, particularly those associated with mechanical signatures of cardiopulmonary processes. Design strategies introduced here address this limitation through differential operation of a matched, time-synchronized pair of high-bandwidth accelerometers located on parts of the anatomy that exhibit strong spatial gradients in motion characteristics. When mounted at a location that spans the suprasternal notch and the sternal manubrium, these dual-sensing devices allow measurements of heart rate and sounds, respiratory activities, body temperature, body orientation, and activity level, along with swallowing, coughing, talking, and related processes, without sensitivity to ambient conditions during routine daily activities, vigorous exercises, intense manual labor, and even swimming. Deployments on patients with COVID-19 allow clinical-grade ambulatory monitoring of the key symptoms of the disease even during rehabilitation protocols.

Stretchable, dynamic covalent polymers for soft, long-lived bioresorbable electronic stimulators designed to facilitate neuromuscular regeneration.

Bioresorbable electronic stimulators are of rapidly growing interest as unusual therapeutic platforms, i.e., bioelectronic medicines, for treating disease states, accelerating wound healing processes and eliminating infections. Here, we present advanced materials that support operation in these systems over clinically relevant timeframes, ultimately bioresorbing harmlessly to benign products without residues, to eliminate the need for surgical extraction. Our findings overcome key challenges of bioresorbable electronic devices by realizing lifetimes that match clinical needs. The devices exploit a bioresorbable dynamic covalent polymer that facilitates tight bonding to itself and other surfaces, as a soft, elastic substrate and encapsulation coating for wireless electronic components. We describe the underlying features and chemical design considerations for this polymer, and the biocompatibility of its constituent materials. In devices with optimized, wireless designs, these polymers enable stable, long-lived operation as distal stimulators in a rat model of peripheral nerve injuries, thereby demonstrating the potential of programmable long-term electrical stimulation for maintaining muscle receptivity and enhancing functional recovery.