Electronic Skin: Opportunities and Challenges in Convergence with Machine Learning.

Recent advancements in soft electronic skin (e-skin) have led to the development of human-like devices that reproduce the skin's functions and physical attributes. These devices are being explored for applications in robotic prostheses as well as for collecting biopotentials for disease diagnosis and treatment, as exemplified by biomedical e-skins. More recently, machine learning (ML) has been utilized to enhance device control accuracy and data processing efficiency. The convergence of e-skin technologies with ML is promoting their translation into clinical practice, especially in healthcare. This review highlights the latest developments in ML-reinforced e-skin devices for robotic prostheses and biomedical instrumentations. We first describe technological breakthroughs in state-of-the-art e-skin devices, emphasizing technologies that achieve skin-like properties. We then introduce ML methods adopted for control optimization and pattern recognition, followed by practical applications that converge the two technologies. Lastly, we briefly discuss the challenges this interdisciplinary research encounters in its clinical and industrial transition.

Development of a miniaturized mechanoacoustic sensor for continuous, objective cough detection, characterization and physiologic monitoring in children with cystic fibrosis.

Cough is an important symptom in children with acute and chronic respiratory disease. Daily cough is common in Cystic Fibrosis (CF) and increased cough is a symptom of pulmonary exacerbation. To date, cough assessment is primarily subjective in clinical practice and research. Attempts to develop objective, automatic cough counting tools have faced reliability issues in noisy environments and practical barriers limiting long-term use. This single-center pilot study evaluated usability, acceptability and performance of a mechanoacoustic sensor (MAS), previously used for cough classification in adults, in 36 children with CF over brief and multi-day periods in four cohorts. Children whose health was at baseline and who had symptoms of pulmonary exacerbation were included. We trained, validated, and deployed custom deep learning algorithms for accurate cough detection and classification from other vocalization or artifacts with an overall area under the receiver-operator characteristic curve (AUROC) of 0.96 and average precision (AP) of 0.93. Child and parent feedback led to a redesign of the MAS towards a smaller, more discreet device acceptable for daily use in children. Additional improvements optimized power efficiency and data management. The MAS's ability to objectively measure cough and other physiologic signals across clinic, hospital, and home settings is demonstrated, particularly aided by an AUROC of 0.97 and AP of 0.96 for motion artifact rejection. Examples of cough frequency and physiologic parameter correlations with participant-reported outcomes and clinical measurements for individual patients are presented. The MAS is a promising tool in objective longitudinal evaluation of cough in children with CF.

A wirelessly programmable, skin-integrated thermo-haptic stimulator system for virtual reality.

Sensations of heat and touch produced by receptors in the skin are of essential importance for perceptions of the physical environment, with a particularly powerful role in interpersonal interactions. Advances in technologies for replicating these sensations in a programmable manner have the potential not only to enhance virtual/augmented reality environments but they also hold promise in medical applications for individuals with amputations or impaired sensory function. Engineering challenges are in achieving interfaces with precise spatial resolution, power-efficient operation, wide dynamic range, and fast temporal responses in both thermal and in physical modulation, with forms that can extend over large regions of the body. This paper introduces a wireless, skin-compatible interface for thermo-haptic modulation designed to address some of these challenges, with the ability to deliver programmable patterns of enhanced vibrational displacement and high-speed thermal stimulation. Experimental and computational investigations quantify the thermal and mechanical efficiency of a vertically stacked design layout in the thermo-haptic stimulators that also supports real-time, closed-loop control mechanisms. The platform is effective in conveying thermal and physical information through the skin, as demonstrated in the control of robotic prosthetics and in interactions with pressure/temperature-sensitive touch displays.

A Novel Method for Tracking Neck Motions Using a Skin-Conformable Wireless Accelerometer: A Pilot Study.

Introduction: Cervical spine disease is a leading cause of pain and disability. Degenerative conditions of the spine can result in neurologic compression of the cervical spinal cord or nerve roots and may be surgically treated with an anterior cervical discectomy and fusion (ACDF) in up to 137,000 people per year in the United States. A common sequelae of ACDF is reduced cervical range of motion (CROM) with patient-based complaints of stiffness and neck pain. Currently, tools for assessment of CROM are manual, subjective, and only intermittently utilized during doctor or physical therapy visits. We propose a skin-mountable acousto-mechanic sensor (ADvanced Acousto-Mechanic sensor; ADAM) as a tool for continuous neck motion monitoring in postoperative ACDF patients. We have developed and validated a machine learning neck motion classification algorithm to differentiate between eight neck motions (right/left rotation, right/left lateral bending, flexion, extension, retraction, protraction) in healthy normal subjects and patients. Methods: Sensor data from 12 healthy normal subjects and 5 patients were used to develop and validate a Convolutional Neural Network (CNN). Results: An average algorithm accuracy of 80.0 ± 3.8% was obtained for healthy normal subjects (94% for right rotation, 98% for left rotation, 65% for right lateral bending, 87% for left lateral bending, 89% for flexion, 77% for extension, 50% for retraction, 84% for protraction). An average accuracy of 67.5 ± 5.8% was obtained for patients. Discussion: ADAM, with our algorithm, may serve as a rehabilitation tool for neck motion monitoring in postoperative ACDF patients. Sensor-captured vital signs and other events (extubation, vocalization, physical therapy, walking) are potential metrics to be incorporated into our algorithm to offer more holistic monitoring of patients after cervical spine surgery.

E-Tattoos: Toward Functional but Imperceptible Interfacing with Human Skin.

The human body continuously emits physiological and psychological information from head to toe. Wearable electronics capable of noninvasively and accurately digitizing this information without compromising user comfort or mobility have the potential to revolutionize telemedicine, mobile health, and both human-machine or human-metaverse interactions. However, state-of-the-art wearable electronics face limitations regarding wearability and functionality due to the mechanical incompatibility between conventional rigid, planar electronics and soft, curvy human skin surfaces. E-Tattoos, a unique type of wearable electronics, are defined by their ultrathin and skin-soft characteristics, which enable noninvasive and comfortable lamination on human skin surfaces without causing obstruction or even mechanical perception. This review article offers an exhaustive exploration of e-tattoos, accounting for their materials, structures, manufacturing processes, properties, functionalities, applications, and remaining challenges. We begin by summarizing the properties of human skin and their effects on signal transmission across the e-tattoo-skin interface. Following this is a discussion of the materials, structural designs, manufacturing, and skin attachment processes of e-tattoos. We classify e-tattoo functionalities into electrical, mechanical, optical, thermal, and chemical sensing, as well as wound healing and other treatments. After discussing energy harvesting and storage capabilities, we outline strategies for the system integration of wireless e-tattoos. In the end, we offer personal perspectives on the remaining challenges and future opportunities in the field.