Research on MI EEG signal classification algorithm using multi-model fusion strategy coupling.

To enhance the accuracy of motor imagery(MI)EEG signal recognition, two methods, namely power spectral density and wavelet packet decomposition combined with a common spatial pattern, were employed to explore the feature information in depth in MI EEG signals. The extracted MI EEG signal features were subjected to series feature fusion, and the F-test method was used to select features with higher information content. Here regarding the accuracy of MI EEG signal classification, we further proposed the Platt Scaling probability calibration method was used to calibrate the results obtained from six basic classifiers, namely random forest (RF), support vector machines (SVM), Logistic Regression (LR), Gaussian naïve bayes (GNB), eXtreme Gradient Boosting (XGBoost), and Light Gradient Boosting Machine (LightGBM). From these 12 classifiers, three to four with higher accuracy were selected for model fusion. The proposed method was validated on Datasets 2a of the 4th International BCI Competition, achieving an average accuracy of MI EEG data of nine subjects reached 91.46%, which indicates that model fusion was an effective method to improve classification accuracy, and provides some reference value for the research on MI brain-machine interface.

π-FBG Fiber Optic Acoustic Emission Sensor for the Crack Detection of Wind Turbine Blades.

Wind power is growing rapidly as a green and clean energy source. As the core part of a wind turbine, the blades are subjected to enormous stress in harsh environments over a long period of time and are therefore extremely susceptible to damage, while at the same time, they are costly, so it is important to monitor their damage in a timely manner. This paper is based on the detection of blade damage using acoustic emission signals, which can detect early minor damage and internal damage to the blades. Instead of conventional piezoelectric sensors, we use fiber optic gratings as sensing units, which have the advantage of small size and corrosion resistance. Furthermore, the sensitivity of the system is doubled by replacing the conventional FBG (fiber Bragg grating) with a π-phase-shifted FBG. For the noise problem existing in the system, this paper combines the traditional WPD (wavelet packet decomposition) denoising method with EMD (empirical mode decomposition) to achieve a better noise reduction effect. Finally, small wind turbine blades are used in the experiment and their acoustic emission signals with different damage are collected for feature analysis, which sets the stage for the subsequent detection of different damage degrees and types.

Failure Mode Detection and Validation of a Shaft-Bearing System with Common Sensors.

Failure mode detection is essential for bearing life prediction to protect the shafts on the machinery. This work demonstrates the rolling bearing vibration measurement, signals converting and analysis, feature extraction, and machine learning with neural networks to achieve failure mode detection for a shaft bearing. Two self-designed bearing test platforms with two types of sensors conduct the bearing vibration collection in normal and abnormal states. The time-domain signals convert to the frequency domain for analysis to observe the dominant frequency between these two types of sensors. In feature extraction, principal components analysis (PCA) combines with wavelet packet decomposition (WPD) to form the two feature extraction methods: PCA-WPD and WPD-PCA for optimization. The features extracted by these two methods serve as input to the long short-term memory (LSTM) networks for classification and training to distinguish bearing states in normal, misaligned, unbalanced, and impact loads. The evaluation arguments include sensor types, vibration directions, failure modes, feature extraction methods, and neural networks. In conclusion, the developed methods with the typical lower-cost sensor can achieve 97% accuracy in bearing failure mode detection.

Motion Artifacts Correction from Single-Channel EEG and fNIRS Signals Using Novel Wavelet Packet Decomposition in Combination with Canonical Correlation Analysis.

The electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) signals, highly non-stationary in nature, greatly suffers from motion artifacts while recorded using wearable sensors. Since successful detection of various neurological and neuromuscular disorders is greatly dependent upon clean EEG and fNIRS signals, it is a matter of utmost importance to remove/reduce motion artifacts from EEG and fNIRS signals using reliable and robust methods. In this regard, this paper proposes two robust methods: (i) Wavelet packet decomposition (WPD) and (ii) WPD in combination with canonical correlation analysis (WPD-CCA), for motion artifact correction from single-channel EEG and fNIRS signals. The efficacy of these proposed techniques is tested using a benchmark dataset and the performance of the proposed methods is measured using two well-established performance matrices: (i) difference in the signal to noise ratio ( ) and (ii) percentage reduction in motion artifacts ( ). The proposed WPD-based single-stage motion artifacts correction technique produces the highest average (29.44 dB) when db2 wavelet packet is incorporated whereas the greatest average (53.48%) is obtained using db1 wavelet packet for all the available 23 EEG recordings. Our proposed two-stage motion artifacts correction technique, i.e., the WPD-CCA method utilizing db1 wavelet packet has shown the best denoising performance producing an average and values of 30.76 dB and 59.51%, respectively, for all the EEG recordings. On the other hand, for the available 16 fNIRS recordings, the two-stage motion artifacts removal technique, i.e., WPD-CCA has produced the best average (16.55 dB, utilizing db1 wavelet packet) and largest average (41.40%, using fk8 wavelet packet). The highest average and using single-stage artifacts removal techniques (WPD) are found as 16.11 dB and 26.40%, respectively, for all the fNIRS signals using fk4 wavelet packet. In both EEG and fNIRS modalities, the percentage reduction in motion artifacts increases by 11.28% and 56.82%, respectively when two-stage WPD-CCA techniques are employed in comparison with the single-stage WPD method. In addition, the average also increases when WPD-CCA techniques are used instead of single-stage WPD for both EEG and fNIRS signals. The increment in both and values is a clear indication that two-stage WPD-CCA performs relatively better compared to single-stage WPD. The results reported using the proposed methods outperform most of the existing state-of-the-art techniques.

A New Fusion Fault Diagnosis Method for Fiber Optic Gyroscopes.

The fiber optic gyroscope (FOG) is a high precision inertial navigation device, and it is necessary to ensure its reliability for effective use. However, the extracted fault features are easily distorted due to the interference of vibrations when the FOG is in operation. In order to minimize the influence of vibrations to the greatest extent, a fusion diagnosis method was proposed in this paper. It extracted features from fault data with Fast Fourier Transform (FFT) and wavelet packet decomposition (WPD), and built a strong diagnostic classifier with a sparse auto encoder (SAE) and a neural network (NN). Then, a fusion neural network model was established based on the diagnostic output probabilities of the two primary classifiers, which improved the diagnostic accuracy and the anti-vibration capability. Then, five fault types of the FOG under random vibration conditions were established. Fault data sets were collected and generated for experimental comparison with other methods. The results showed that the proposed fusion fault diagnosis method could perform effective and robust fault diagnosis for the FOG under vibration conditions with a high diagnostic accuracy.

Electroencephalogram-Based Motor Imagery Classification Using Deep Residual Convolutional Networks.

The classification of electroencephalogram (EEG) signals is of significant importance in brain-computer interface (BCI) systems. Aiming to achieve intelligent classification of motor imagery EEG types with high accuracy, a classification methodology using the wavelet packet decomposition (WPD) and the proposed deep residual convolutional networks (DRes-CNN) is proposed. Firstly, EEG waveforms are segmented into sub-signals. Then the EEG signal features are obtained through the WPD algorithm, and some selected wavelet coefficients are retained and reconstructed into EEG signals in their respective frequency bands. Subsequently, the reconstructed EEG signals were utilized as input of the proposed deep residual convolutional networks to classify EEG signals. Finally, EEG types of motor imagination are classified by the DRes-CNN classifier intelligently. The datasets from BCI Competition were used to test the performance of the proposed deep learning classifier. Classification experiments show that the average recognition accuracy of this method reaches 98.76%. The proposed method can be further applied to the BCI system of motor imagination control.

Intelligent Intraoperative Haptic-AR Navigation for COVID-19 Lung Biopsy Using Deep Hybrid Model.

A novel intelligent navigation technique for accurate image-guided COVID-19 lung biopsy is addressed, which systematically combines augmented reality (AR), customized haptic-enabled surgical tools, and deep neural network to achieve customized surgical navigation. Clinic data from 341 COVID-19 positive patients, with 1598 negative control group, have collected for the model synergy and evaluation. Biomechanics force data from the experiment are applied a WPD-CNN-LSTM (WCL) to learn a new patient-specific COVID-19 surgical model, and the ResNet was employed for the intraoperative force classification. To boost the user immersion and promote the user experience, intro-operational guiding images have combined with the haptic-AR navigational view. Furthermore, a 3-D user interface (3DUI), including all requisite surgical details, was developed with a real-time response guaranteed. Twenty-four thoracic surgeons were invited to the objective and subjective experiments for performance evaluation. The root-mean-square error results of our proposed WCL model is 0.0128, and the classification accuracy is 97%, which demonstrated that the innovative AR with deep learning (DL) intelligent model outperforms the existing perception navigation techniques with significantly higher performance. This article shows a novel framework in the interventional surgical integration for COVID-19 and opens the new research about the integration of AR, haptic rendering, and deep learning for surgical navigation.

A BCI System Based on Motor Imagery for Assisting People with Motor Deficiencies in the Limbs.

Motor deficiencies constitute a significant problem affecting millions of people worldwide. Such people suffer from a debility in daily functioning, which may lead to decreased and incoherence in daily routines and deteriorate their quality of life (QoL). Thus, there is an essential need for assistive systems to help those people achieve their daily actions and enhance their overall QoL. This study proposes a novel brain-computer interface (BCI) system for assisting people with limb motor disabilities in performing their daily life activities by using their brain signals to control assistive devices. The extraction of useful features is vital for an efficient BCI system. Therefore, the proposed system consists of a hybrid feature set that feeds into three machine-learning (ML) classifiers to classify motor Imagery (MI) tasks. This hybrid feature selection (FS) system is practical, real-time, and an efficient BCI with low computation cost. We investigate different combinations of channels to select the combination that has the highest impact on performance. The results indicate that the highest achieved accuracies using a support vector machine (SVM) classifier are 93.46% and 86.0% for the BCI competition III-IVa dataset and the autocalibration and recurrent adaptation dataset, respectively. These datasets are used to test the performance of the proposed BCI. Also, we verify the effectiveness of the proposed BCI by comparing its performance with recent studies. We show that the proposed system is accurate and efficient. Future work can apply the proposed system to individuals with limb motor disabilities to assist them and test their capability to improve their QoL. Moreover, the forthcoming work can examine the system's performance in controlling assistive devices such as wheelchairs or artificial limbs.

Identification and structure-function analyses of an allosteric inhibitor of the tyrosine phosphatase PTPN22.

Protein-tyrosine phosphatase nonreceptor type 22 (PTPN22) is a lymphoid-specific tyrosine phosphatase (LYP), and mutations in the PTPN22 gene are highly correlated with a spectrum of autoimmune diseases. However, compounds and mechanisms that specifically inhibit LYP enzymes to address therapeutic needs to manage these diseases remain to be discovered. Here, we conducted a similarity search of a commercial database for PTPN22 inhibitors and identified several LYP inhibitor scaffolds, which helped identify one highly active inhibitor, NC1. Using noncompetitive inhibition curve and phosphatase assays, we determined NC1's inhibition mode toward PTPN22 and its selectivity toward a panel of phosphatases. We found that NC1 is a noncompetitive LYP inhibitor and observed that it exhibits selectivity against other protein phosphatases and effectively inhibits LYP activity in lymphoid T cells and modulates T-cell receptor signaling. Results from site-directed mutagenesis, fragment-centric topographic mapping, and molecular dynamics simulation experiments suggested that NC1, unlike other known LYP inhibitors, concurrently binds to a "WPD" pocket and a second pocket surrounded by an LYP-specific insert, which contributes to its selectivity against other phosphatases. Moreover, using a newly developed method to incorporate the unnatural amino acid 2-fluorine-tyrosine and 19F NMR spectroscopy, we provide direct evidence that NC1 allosterically regulates LYP activity by restricting WPD-loop movement. In conclusion, our approach has identified a new allosteric binding site in LYP useful for selective LYP inhibitor development; we propose that the 19F NMR probe developed here may also be useful for characterizing allosteric inhibitors of other tyrosine phosphatases.