Gesture Recognition Based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory Network for a Wearable Wrist Sensor with Multi-Walled Carbon Nanotube/Cotton Fabric Material.

Flexible pressure sensors play a crucial role in detecting human motion and facilitating human-computer interaction. In this paper, a type of flexible pressure sensor unit with high sensitivity (2.242 kPa-1), fast response time (80 ms), and remarkable stability (1000 cycles) is proposed and fabricated by the multi-walled carbon nanotube (MWCNT)/cotton fabric (CF) material based on a dip-coating method. Six flexible pressure sensor units are integrated into a flexible wristband and made into a wearable and portable wrist sensor with favorable stability. Then, seven wrist gestures (Gesture Group #1), five letter gestures (Gesture Group #2), and eight sign language gestures (Gesture Group #3) are performed by wearing the wrist sensor, and the corresponding time sequence signals of the three gesture groups (#1, #2, and #3) from the wrist sensor are collected, respectively. To efficiently recognize different gestures from the three groups detected by the wrist sensor, a fusion network model combined with a convolutional neural network (CNN) and the bidirectional long short-term memory (BiLSTM) neural network, named CNN-BiLSTM, which has strong robustness and generalization ability, is constructed. The three types of Gesture Groups were recognized based on the CNN-BiLSTM model with accuracies of 99.40%, 95.00%, and 98.44%. Twenty gestures (merged by Group #1, #2, and #3) were recognized with an accuracy of 96.88% to validate the applicability of the wrist sensor based on this model for gesture recognition. The experimental results denote that the CNN-BiLSTM model has very efficient performance in recognizing different gestures collected from the flexible wrist sensor.

Morse Code Recognition Based on a Flexible Tactile Sensor with Carbon Nanotube/Polyurethane Sponge Material by the Long Short-Term Memory Model.

Morse code recognition plays a very important role in the application of human-machine interaction. In this paper, based on the carbon nanotube (CNT) and polyurethane sponge (PUS) composite material, a flexible tactile CNT/PUS sensor with great piezoresistive characteristic is developed for detecting Morse code precisely. Thirty-six types of Morse code, including 26 letters (A-Z) and 10 numbers (0-9), are applied to the sensor. Each Morse code was repeated 60 times, and 2160 (36 × 60) groups of voltage time-sequential signals were collected to construct the dataset. Then, smoothing and normalization methods are used to preprocess and optimize the raw data. Based on that, the long short-term memory (LSTM) model with excellent feature extraction and self-adaptive ability is constructed to precisely recognize different types of Morse code detected by the sensor. The recognition accuracies of the 10-number Morse code, the 26-letter Morse code, and the whole 36-type Morse code are 99.17%, 95.37%, and 93.98%, respectively. Meanwhile, the Gated Recurrent Unit (GRU), Support Vector Machine (SVM), Multi-Layer Perceptron (MLP), and Random Forest (RF) models are built to distinguish the 36-type Morse code (letters of A-Z and numbers of 0-9) based on the same dataset and achieve the accuracies of 91.37%, 88.88%, 87.04%, and 90.97%, respectively, which are all lower than the accuracy of 93.98% based on the LSTM model. All the experimental results show that the CNT/PUS sensor can detect the Morse code's tactile feature precisely, and the LSTM model has a very efficient property in recognizing Morse code detected by the CNT/PUS sensor.