Deep learning approach to improve the recognition of hand gesture with multi force variation using electromyography signal from amputees.

Variations in muscular contraction are known to significantly impact the quality of the generated EMG signal and the output decision of a proposed classifier. This is an issue when the classifier is further implemented in prosthetic hand design. Therefore, this study aims to develop a deep learning classifier to improve the classification of hand motion gestures and investigate the effect of force variations on their accuracy on amputees. The contribution of this study showed that the resulting deep learning architecture based on DNN (deep neural network) could recognize the six gestures and robust against different force levels (18 combinations). Additionally, this study recommended several channels that most contribute to the classifier's accuracy. Also, the selected time domain features were used for a classifier to recognize 18 combinations of EMG signal patterns (6 gestures and three forces). The average accuracy of the proposed method (DNN) was also observed at 92.0 ± 6.1 %. Moreover, several other classifiers were used as comparisons, such as support vector machine (SVM), decision tree (DT), K-nearest neighbors, and Linear Discriminant Analysis (LDA). The increase in the mean accuracy of the proposed method compared to other conventional classifiers (SVM, DT, KNN, and LDA), was 17.86 %. Also, the study's implication stated that the proposed method should be applied to developing prosthetic hands for amputees that recognize multi-force gestures.

Bilateral mode exoskeleton for hand rehabilitation with wireless control using 3D printing technology based on IMU sensor.

This research aimed to develop an open-source exoskeleton for hand rehabilitation (EHR) device that can be controlled wirelessly in bilateral mode. This design has the advantage of being light and being controlled easily using WiFi-based wireless communication by non-paretic hands. This open-source EHR composed of two parts, namely the master and slave parts, each of which uses a mini ESP32 microcontroller, IMU sensor, and 3D printing. The mean RMSE obtained for all exoskeleton fingers is 9.04°. Since the EHR design is open source, the researchers can create and develop rehabilitation device for the therapeutic process of patients who are paralyzed or partially paralyzed independently using healthy hand.

Embedded Machine Learning Using a Multi-Thread Algorithm on a Raspberry Pi Platform to Improve Prosthetic Hand Performance.

High accuracy and a real-time system are priorities in the development of a prosthetic hand. This study aimed to develop and evaluate a real-time embedded time-domain feature extraction and machine learning on a system on chip (SoC) Raspberry platform using a multi-thread algorithm to operate a prosthetic hand device. The contribution of this study is that the implementation of the multi-thread in the pattern recognition improves the accuracy and decreases the computation time in the SoC. In this study, ten healthy volunteers were involved. The EMG signal was collected by using two dry electrodes placed on the wrist flexor and wrist extensor muscles. To reduce the complexity, four time-domain features were applied to extract the EMG signal. Furthermore, these features were used as the input of the machine learning. The machine learning evaluated in this study were k-nearest neighbor (k-NN), Naive Bayes (NB), decision tree (DT), and support vector machine (SVM). In the SoC implementation, the data acquisition, feature extraction, machine learning, and motor control process were implemented using a multi-thread algorithm. After the evaluation, the result showed that the pairing of the MAV feature and machine learning DT resulted in higher accuracy among other combinations (98.41%) with a computation time of ~1 ms. The implementation of the multi-thread algorithm in the pattern recognition system resulted in significant impact on the time processing.

An Improved Performance of Deep Learning Based on Convolution Neural Network to Classify the Hand Motion by Evaluating Hyper Parameter.

High accuracy in pattern recognition based on electromyography(EMG) contributes to the effectiveness of prosthetics hand development. This study aimed to improve performance and simplify the deep learning pre-processing based on the convolution neural network (CNN) algorithm for classifying ten hand motion from two raw EMG signals. The main contribution of this study is the simplicity of pre-processing stage in classifier machine. For instance, the feature extraction process is not required. Furthermore, the performance of the classifier was improved by evaluating the best hyperparameter in deep learning architecture. To validate the performance of deep learning, the public dataset from ten subjects was evaluated. The performance of the proposed method was compared to other conventional machine learning, specifically LDA, SVM, and KNN. The CNN can discriminate the ten hand-motion based on raw EMG signal without handcrafts feature extraction. The results of the evaluation showed that CNN outperformed other classifiers. The average accuracy for all motion ranges between 0.77 and 0.93. The statistical t-test between using two-channel(CH1 and CH2) and single-channel(CH2) shows that there is no significant difference in accuracy with p-value >0.05. The proposed method was useful in the study of prosthetic hand, which required the simple architecture of machine learning and high performance in the classification.