Design and Manufacture of Multifunctional 3-D Smart Skins with Embedded Sensor Networks for Robotic Applications.

An investigation was performed to develop a process to design and manufacture a 3-D smart skin with an embedded network of distributed sensors for non-developable (or doubly curved) surfaces. A smart skin is the sensing component of a smart structure, allowing such structures to gather data from their surrounding environments to make control and maintenance decisions. Such smart skins are desired across a wide variety of domains, particularly for those devices where their surfaces require high sensitivity to external loads or environmental changes such as human-assisting robots, medical devices, wearable health components, etc. However, the fabrication and deployment of a network of distributed sensors on non-developable surfaces faces steep challenges. These challenges include the conformal coverage of a target object without causing prohibitive stresses in the sensor interconnects and ensuring positional accuracy in the skin sensor deployment positions, as well as packaging challenges resulting from the thin, flexible form factor of the skin. In this study, novel and streamlined processes for making such 3-D smart skins were developed from the initial sensor network design to the final integrated skin assembly. Specifically, the process involved the design of the network itself (for which a physical simulation-based optimization was developed), the deployment of the network to a targeted 3D surface (for which a specialized tool was designed and implemented), and the assembly of the final skin (for which a novel process based on dip coating was developed and implemented.).

Design of a Robust Tool for Deploying Large-Area Stretchable Sensor Networks from Microscale to Macroscale.

An investigation was conducted to develop an effective automated tool to deploy micro-fabricated stretchable networks of distributed sensors onto the surface of large structures at macroscale to create "smart" structures with embedded distributed sensor networks. Integrating a large network of distributed sensors with structures has been a major challenge in the design of so-called smart structures or devices for cyber-physical applications where a large amount of usage data from structures or devices can be generated for artificial intelligence applications. Indeed, many "island-and-serpentine"-type distributed sensor networks, while promising, remain difficult to deploy. This study aims to enable such networks to be deployed in a safe, automated, and efficient way. To this end, a scissor-hinge controlled system was proposed as the basis for a deployment mechanism for such stretchable sensor networks (SSNs). A model based on a kinematic scissor-hinge mechanism was developed to simulate and design the proposed system to automatically stretch a micro-scaled square network with uniformly distributed sensor nodes. A prototype of an automatic scissor-hinge stretchable tool was constructed during the study with an array of four scissor-hinge mechanisms, each belt-driven by a single stepper motor. Two micro-fabricated SSNs from a 100 mm wafer were fabricated at the Stanford Nanofabrication Facility for this deployment study. The networks were designed to be able to cover an area 100 times their manufacturing size (from a 100 mm diameter wafer to a 1 m2 active area) once stretched. It was demonstrated that the proposed deployment tool could place sensor nodes in prescribed locations efficiently within a drastically shorter time than in current labor-intensive manual deployment methods.

Static Tactile Sensing for a Robotic Electronic Skin via an Electromechanical Impedance-Based Approach.

Tactile sensing is paramount for robots operating in human-centered environments to help in understanding interaction with objects. To enable robots to have sophisticated tactile sensing capability, researchers have developed different kinds of electronic skins for robotic hands and arms in order to realize the 'sense of touch'. Recently, Stanford Structures and Composites Laboratory developed a robotic electronic skin based on a network of multi-modal micro-sensors. This skin was able to identify temperature profiles and detect arm strikes through embedded sensors. However, sensing for the static pressure load is yet to be investigated. In this work, an electromechanical impedance-based method is proposed to investigate the response of piezoelectric sensors under static normal pressure loads. The smart skin sample was firstly fabricated by embedding a piezoelectric sensor into the soft silicone. Then, a series of static pressure tests to the skin were conducted. Test results showed that the first peak of the real part impedance signal was sensitive to static pressure load, and by using the proposed diagnostic method, this test setup could detect a resolution of 0.5 N force. Numerical simulation methods were then performed to validate the experimental results. The results of the numerical simulation prove the validity of the experiments, as well as the robustness of the proposed method in detecting static pressure loads using the smart skin.

Design and Integration of a Wireless Stretchable Multimodal Sensor Network in a Composite Wing.

This article presents the development of a stretchable sensor network with high signal-to-noise ratio and measurement accuracy for real-time distributed sensing and remote monitoring. The described sensor network was designed as an island-and-serpentine type network comprising a grid of sensor "islands" connected by interconnecting "serpentines." A novel high-yield manufacturing process was developed to fabricate networks on recyclable 4-inch wafers at a low cost. The resulting stretched sensor network has 17 distributed and functionalized sensing nodes with low tolerance and high resolution. The sensor network includes Piezoelectric (PZT), Strain Gauge (SG), and Resistive Temperature Detector (RTD) sensors. The design and development of a flexible frame with signal conditioning, data acquisition, and wireless data transmission electronics for the stretchable sensor network are also presented. The primary purpose of the frame subsystem is to convert sensor signals into meaningful data, which are displayed in real-time for an end-user to view and analyze. The challenges and demonstrated successes in developing this new system are demonstrated, including (a) developing separate signal conditioning circuitry and components for all three sensor types (b) enabling simultaneous sampling for PZT sensors for impact detection and (c) configuration of firmware/software for correct system operation. The network was expanded with an in-house developed automated stretch machine to expand it to cover the desired area. The released and stretched network was laminated into an aerospace composite wing with edge-mount electronics for signal conditioning, processing, power, and wireless communication.

A Self-Adaptive 1D Convolutional Neural Network for Flight-State Identification.

The vibration of a wing structure in the air reflects coupled aerodynamic⁻mechanical responses under varying flight states that are defined by the angle of attack and airspeed. It is of great challenge to identify the flight state from the complex vibration signals. In this paper, a novel one-dimension convolutional neural network (CNN) is developed, which is able to automatically extract useful features from the structural vibration of a recently fabricated self-sensing wing through wind-tunnel experiments. The obtained signals are firstly decomposed into various subsignals with different frequency bands via dual-tree complex-wavelet packet transformation. Then, the reconstructed subsignals are selected to form the best combination for multichannel inputs of the CNN. A swarm-based evolutionary algorithm called grey-wolf optimizer is utilized to optimize a set of key parameters of the CNN, which saves considerable human efforts. Two case studies demonstrate the high identification accuracy and robustness of the proposed method over standard deep-learning methods in flight-state identification, thus providing new perspectives in self-awareness toward the next generation of intelligent air vehicles.

Flight State Identification of a Self-Sensing Wing via an Improved Feature Selection Method and Machine Learning Approaches.

In this work, a data-driven approach for identifying the flight state of a self-sensing wing structure with an embedded multi-functional sensing network is proposed. The flight state is characterized by the structural vibration signals recorded from a series of wind tunnel experiments under varying angles of attack and airspeeds. A large feature pool is created by extracting potential features from the signals covering the time domain, the frequency domain as well as the information domain. Special emphasis is given to feature selection in which a novel filter method is developed based on the combination of a modified distance evaluation algorithm and a variance inflation factor. Machine learning algorithms are then employed to establish the mapping relationship from the feature space to the practical state space. Results from two case studies demonstrate the high identification accuracy and the effectiveness of the model complexity reduction via the proposed method, thus providing new perspectives of self-awareness towards the next generation of intelligent air vehicles.

Characterization of Distributed Microfabricated Strain Gauges on Stretchable Sensor Networks for Structural Applications.

Smart structures mimic biological systems by using thousands of sensors serving as a nervous system analog. One approach to give structures this sensing ability is to develop a multifunctional sensor network. Previous work has demonstrated stretchable sensor networks consisting of temperature sensors and impact detectors for monitoring external environments and interacting with other objects. The objective of this work is to develop distributed, robust and reliable strain gauges for obtaining the strain distribution of a designated region on the target structure. Here, we report a stretchable network that has 27 rosette strain gauges, 6 resistive temperature devices and 8 piezoelectric transducers symmetrically distributed over an area of 150 × 150 mm to map and quantify multiple physical stimuli with a spatial resolution of 2.5 × 2.5 mm. We performed computational modeling of the network stretching process to improve measurement accuracy and conducted experimental characterizations of the microfabricated strain gauges to verify their gauge factor and temperature coefficient. Collectively, the results represent a robust and reliable sensing system that is able to generate a distributed strain profile of a common structure. The reported strain gauge network may find a wide range of applications in morphing wings, smart buildings, autonomous cars and intelligent robots.

Bio-Inspired Stretchable Absolute Pressure Sensor Network.

A bio-inspired absolute pressure sensor network has been developed. Absolute pressure sensors, distributed on multiple silicon islands, are connected as a network by stretchable polyimide wires. This sensor network, made on a 4'' wafer, has 77 nodes and can be mounted on various curved surfaces to cover an area up to 0.64 m × 0.64 m, which is 100 times larger than its original size. Due to Micro Electro-Mechanical system (MEMS) surface micromachining technology, ultrathin sensing nodes can be realized with thicknesses of less than 100 µm. Additionally, good linearity and high sensitivity (~14 mV/V/bar) have been achieved. Since the MEMS sensor process has also been well integrated with a flexible polymer substrate process, the entire sensor network can be fabricated in a time-efficient and cost-effective manner. Moreover, an accurate pressure contour can be obtained from the sensor network. Therefore, this absolute pressure sensor network holds significant promise for smart vehicle applications, especially for unmanned aerial vehicles.