EMPT: a sparsity Transformer for EEG-based motor imagery recognition.

Introduction: Transformer network is widely emphasized and studied relying on its excellent performance. The self-attention mechanism finds a good solution for feature coding among multiple channels of electroencephalography (EEG) signals. However, using the self-attention mechanism to construct models on EEG data suffers from the problem of the large amount of data required and the complexity of the algorithm. Methods: We propose a Transformer neural network combined with the addition of Mixture of Experts (MoE) layer and ProbSparse Self-attention mechanism for decoding the time-frequency-spatial domain features from motor imagery (MI) EEG of spinal cord injury patients. The model is named as EEG MoE-Prob-Transformer (EMPT). The common spatial pattern and the modified s-transform method are employed for achieving the time-frequency-spatial features, which are used as feature embeddings to input the improved transformer neural network for feature reconstruction, and then rely on the expert model in the MoE layer for sparsity mapping, and finally output the results through the fully connected layer. Results: EMPT achieves an accuracy of 95.24% on the MI EEG dataset for patients with spinal cord injury. EMPT has also achieved excellent results in comparative experiments with other state-of-the-art methods. Discussion: The MoE layer and ProbSparse Self-attention inside the EMPT are subjected to visualisation experiments. The experiments prove that sparsity can be introduced to the Transformer neural network by introducing MoE and kullback-leibler divergence attention pooling mechanism, thereby enhancing its applicability on EEG datasets. A novel deep learning approach is presented for decoding EEG data based on MI.

A Light Vehicle License-Plate-Recognition System Based on Hybrid Edge-Cloud Computing.

With the world moving towards low-carbon and environmentally friendly development, the rapid growth of new-energy vehicles is evident. The utilization of deep-learning-based license-plate-recognition (LPR) algorithms has become widespread. However, existing LPR systems have difficulty achieving timely, effective, and energy-saving recognition due to their inherent limitations such as high latency and energy consumption. An innovative Edge-LPR system that leverages edge computing and lightweight network models is proposed in this paper. With the help of this technology, the excessive reliance on the computational capacity and the uneven implementation of resources of cloud computing can be successfully mitigated. The system is specifically a simple LPR. Channel pruning was used to reconstruct the backbone layer, reduce the network model parameters, and effectively reduce the GPU resource consumption. By utilizing the computing resources of the Intel second-generation computing stick, the network models were deployed on edge gateways to detect license plates directly. The reliability and effectiveness of the Edge-LPR system were validated through the experimental analysis of the CCPD standard dataset and real-time monitoring dataset from charging stations. The experimental results from the CCPD common dataset demonstrated that the network's total number of parameters was only 0.606 MB, with an impressive accuracy rate of 97%.

Self-Supervised EEG Representation Learning with Contrastive Predictive Coding for Post-Stroke Patients.

Stroke patients are prone to fatigue during the EEG acquisition procedure, and experiments have high requirements on cognition and physical limitations of subjects. Therefore, how to learn effective feature representation is very important. Deep learning networks have been widely used in motor imagery (MI) based brain-computer interface (BCI). This paper proposes a contrast predictive coding (CPC) framework based on the modified s-transform (MST) to generate MST-CPC feature representations. MST is used to acquire the temporal-frequency feature to improve the decoding performance for MI task recognition. EEG2Image is used to convert multi-channel one-dimensional EEG into two-dimensional EEG topography. High-level feature representations are generated by CPC which consists of an encoder and autoregressive model. Finally, the effectiveness of generated features is verified by the k-means clustering algorithm. It can be found that our model generates features with high efficiency and a good clustering effect. After classification performance evaluation, the average classification accuracy of MI tasks is 89% based on 40 subjects. The proposed method can obtain effective feature representations and improve the performance of MI-BCI systems. By comparing several self-supervised methods on the public dataset, it can be concluded that the MST-CPC model has the highest average accuracy. This is a breakthrough in the combination of self-supervised learning and image processing of EEG signals. It is helpful to provide effective rehabilitation training for stroke patients to promote motor function recovery.

Exploration of sleep function connection and classification strategies based on sub-period sleep stages.

Background: As a medium for developing brain-computer interface systems, EEG signals are complex and difficult to identify due to their complexity, weakness, and differences between subjects. At present, most of the current research on sleep EEG signals are single-channel and dual-channel, ignoring the research on the relationship between different brain regions. Brain functional connectivity is considered to be closely related to brain activity and can be used to study the interaction relationship between brain areas. Methods: Phase-locked value (PLV) is used to construct a functional connection network. The connection network is used to analyze the connection mechanism and brain interaction in different sleep stages. Firstly, the entire EEG signal is divided into multiple sub-periods. Secondly, Phase-locked value is used for feature extraction on the sub-periods. Thirdly, the PLV of multiple sub-periods is used for feature fusion. Fourthly, the classification performance optimization strategy is used to discuss the impact of different frequency bands on sleep stage classification performance and to find the optimal frequency band. Finally, the brain function network is constructed by using the average value of the fusion features to analyze the interaction of brain regions in different frequency bands during sleep stages. Results: The experimental results have shown that when the number of sub-periods is 30, the α (8-13 Hz) frequency band has the best classification effect, The classification result after 10-fold cross-validation reaches 92.59%. Conclusion: The proposed algorithm has good sleep staging performance, which can effectively promote the development and application of an EEG sleep staging system.