RESUMO
This study investigates the complex relationship between upper limb movement direction and macroscopic neural signals in the brain, which is critical for understanding brain-computer interfaces (BCI). Conventional BCI research has primarily focused on a local area, such as the contralateral primary motor cortex (M1), relying on the population-based decoding method with microelectrode arrays. In contrast, macroscopic approaches such as electroencephalography (EEG) and magnetoencephalography (MEG) utilize numerous electrodes to cover broader brain regions. This study probes the potential differences in the mechanisms of microscopic and macroscopic methods. It is important to determine which neural activities effectively predict movements. To investigate this, we analyzed MEG data from nine right-handed participants while performing arm-reaching tasks. We employed dynamic statistical parametric mapping (dSPM) to estimate source activity and built a decoding model composed of long short-term memory (LSTM) and a multilayer perceptron to predict movement trajectories. This model achieved a high correlation coefficient of 0.79 between actual and predicted trajectories. Subsequently, we identified brain regions sensitive to predicting movement direction using the integrated gradients (IG) method, which assesses the predictive contribution of each source activity. The resulting salience map demonstrated a distribution without significant differences across motor-related regions, including M1. Predictions based solely on M1 activity yielded a correlation coefficient of 0.42, nearly half as effective as predictions incorporating all source activities. This suggests that upper limb movements are influenced by various factors such as movement coordination, planning, body and target position recognition, and control, beyond simple muscle activity. All of the activities are needed in the decoding model using macroscopic signals. Our findings also revealed that contralateral and ipsilateral hemispheres contribute equally to movement prediction, implying that BCIs could potentially benefit patients with brain damage in the contralateral hemisphere by utilizing brain signals from the ipsilateral hemisphere. In conclusion, this study demonstrates that macroscopic activity from large brain regions significantly contributes to predicting upper limb movement. Non-invasive BCI systems would require a comprehensive collection of neural signals from multiple brain regions.
Assuntos
Interfaces Cérebro-Computador , Magnetoencefalografia , Córtex Motor , Movimento , Humanos , Córtex Motor/fisiologia , Masculino , Magnetoencefalografia/métodos , Adulto , Feminino , Movimento/fisiologia , Adulto Jovem , Mapeamento Encefálico/métodosRESUMO
Recent engineering and neuroscience applications have led to the development of brain-computer interface (BCI) systems that improve the quality of life of people with motor disabilities. In the same area, a significant number of studies have been conducted in identifying or classifying upper-limb movement intentions. On the contrary, few works have been concerned with movement intention identification for lower limbs. Notwithstanding, lower-limb neurorehabilitation is a major topic in medical settings, as some people suffer from mobility problems in their lower limbs, such as those diagnosed with neurodegenerative disorders, such as multiple sclerosis, and people with hemiplegia or quadriplegia. Particularly, the conventional pattern recognition (PR) systems are one of the most suitable computational tools for electroencephalography (EEG) signal analysis as the explicit knowledge of the features involved in the PR process itself is crucial for both improving signal classification performance and providing more interpretability. In this regard, there is a real need for outline and comparative studies gathering benchmark and state-of-art PR techniques that allow for a deeper understanding thereof and a proper selection of a specific technique. This study conducted a topical overview of specialized papers covering lower-limb motor task identification through PR-based BCI/EEG signal analysis systems. To do so, we first established search terms and inclusion and exclusion criteria to find the most relevant papers on the subject. As a result, we identified the 22 most relevant papers. Next, we reviewed their experimental methodologies for recording EEG signals during the execution of lower limb tasks. In addition, we review the algorithms used in the preprocessing, feature extraction, and classification stages. Finally, we compared all the algorithms and determined which of them are the most suitable in terms of accuracy.
Assuntos
Interfaces Cérebro-Computador , Eletroencefalografia/métodos , Humanos , Extremidade Inferior , Reconhecimento Automatizado de Padrão , Qualidade de VidaRESUMO
Electroencephalography (EEG) signal classification is a challenging task due to the low signal-to-noise ratio and the usual presence of artifacts from different sources. Different classification techniques, which are usually based on a predefined set of features extracted from the EEG band power distribution profile, have been previously proposed. However, the classification of EEG still remains a challenge, depending on the experimental conditions and the responses to be captured. In this context, the use of deep neural networks offers new opportunities to improve the classification performance without the use of a predefined set of features. Nevertheless, Deep Learning architectures include a vast number of hyperparameters on which the performance of the model relies. In this paper, we propose a method for optimizing Deep Learning models, not only the hyperparameters, but also their structure, which is able to propose solutions that consist of different architectures due to different layer combinations. The experimental results corroborate that deep architectures optimized by our method outperform the baseline approaches and result in computationally efficient models. Moreover, we demonstrate that optimized architectures improve the energy efficiency with respect to the baseline models.
Assuntos
Interfaces Cérebro-Computador , Algoritmos , Artefatos , Eletroencefalografia , Redes Neurais de Computação , Processamento de Sinais Assistido por ComputadorRESUMO
The steady-state visual evoked potential (SSVEP), which is a kind of event-related potential in electroencephalograms (EEGs), has been applied to brain-computer interfaces (BCIs). SSVEP-based BCIs currently perform the best in terms of information transfer rate (ITR) among various BCI implementation methods. Canonical component analysis (CCA) or spectrum estimation, such as the Fourier transform, and their extensions have been used to extract features of SSVEPs. However, these signal extraction methods have a limitation in the available stimulation frequency; thus, the number of commands is limited. In this paper, we propose a complex valued convolutional neural network (CVCNN) to overcome the limitation of SSVEP-based BCIs. The experimental results demonstrate that the proposed method overcomes the limitation of the stimulation frequency, and it outperforms conventional SSVEP feature extraction methods.
Assuntos
Interfaces Cérebro-Computador , Potenciais Evocados Visuais , Algoritmos , Eletroencefalografia , Redes Neurais de Computação , Estimulação LuminosaRESUMO
Research on brain-computer interfaces (BCIs) has become more democratic in recent decades, and experiments using electroencephalography (EEG)-based BCIs has dramatically increased. The variety of protocol designs and the growing interest in physiological computing require parallel improvements in processing and classification of both EEG signals and bio signals, such as electrodermal activity (EDA), heart rate (HR) or breathing. If some EEG-based analysis tools are already available for online BCIs with a number of online BCI platforms (e.g., BCI2000 or OpenViBE), it remains crucial to perform offline analyses in order to design, select, tune, validate and test algorithms before using them online. Moreover, studying and comparing those algorithms usually requires expertise in programming, signal processing and machine learning, whereas numerous BCI researchers come from other backgrounds with limited or no training in such skills. Finally, existing BCI toolboxes are focused on EEG and other brain signals but usually do not include processing tools for other bio signals. Therefore, in this paper, we describe BioPyC, a free, open-source and easy-to-use Python platform for offline EEG and biosignal processing and classification. Based on an intuitive and well-guided graphical interface, four main modules allow the user to follow the standard steps of the BCI process without any programming skills: (1) reading different neurophysiological signal data formats, (2) filtering and representing EEG and bio signals, (3) classifying them, and (4) visualizing and performing statistical tests on the results. We illustrate BioPyC use on four studies, namely classifying mental tasks, the cognitive workload, emotions and attention states from EEG signals.
Assuntos
Boidae , Interfaces Cérebro-Computador , Algoritmos , Animais , Encéfalo , Eletroencefalografia , Processamento de Sinais Assistido por ComputadorRESUMO
Neurofeedback training (NFT) has shown promising results in recent years as a tool to address the effects of age-related cognitive decline in the elderly. Since previous studies have linked reduced complexity of electroencephalography (EEG) signal to the process of cognitive decline, we propose the use of non-linear methods to characterise changes in EEG complexity induced by NFT. In this study, we analyse the pre- and post-training EEG from 11 elderly subjects who performed an NFT based on motor imagery (MI-NFT). Spectral changes were studied using relative power (RP) from classical frequency bands (delta, theta, alpha, and beta), whilst multiscale entropy (MSE) was applied to assess EEG-induced complexity changes. Furthermore, we analysed the subject's scores from Luria tests performed before and after MI-NFT. We found that MI-NFT induced a power shift towards rapid frequencies, as well as an increase of EEG complexity in all channels, except for C3. These improvements were most evident in frontal channels. Moreover, results from cognitive tests showed significant enhancement in intellectual and memory functions. Therefore, our findings suggest the usefulness of MI-NFT to improve cognitive functions in the elderly and encourage future studies to use MSE as a metric to characterise EEG changes induced by MI-NFT.
RESUMO
The oddball paradigm used in P300-based brain-computer interfaces (BCIs) intrinsically poses the issue of data imbalance between target stimuli and nontarget stimuli. Data imbalance can cause overfitting problems and, consequently, poor classification performance. The purpose of this study is to improve BCI performance by solving this data imbalance problem with sampling techniques. The sampling techniques were applied to BCI data in 15 subjects controlling a door lock, 15 subjects an electric light, and 14 subjects a Bluetooth speaker. We explored two categories of sampling techniques: oversampling and undersampling. Oversampling techniques, including random oversampling, synthetic minority oversampling technique (SMOTE), borderline-SMOTE, support vector machine (SVM) SMOTE, and adaptive synthetic sampling, were used to increase the number of samples for the class of target stimuli. Undersampling techniques, including random undersampling, neighborhood cleaning rule, Tomek's links, and weighted undersampling bagging, were used to reduce the class size of nontarget stimuli. The over- or undersampled data were classified by an SVM classifier. Overall, some oversampling techniques improved BCI performance while undersampling techniques often degraded performance. Particularly, using borderline-SMOTE yielded the highest accuracy (87.27%) and information transfer rate (8.82 bpm) across all three appliances. Moreover, borderline-SMOTE led to performance improvement, especially for poor performers. A further analysis showed that borderline-SMOTE improved SVM by generating more support vectors within the target class and enlarging margins. However, there was no difference in the accuracy between borderline-SMOTE and the method of applying the weighted regularization parameter of the SVM. Our results suggest that although oversampling improves performance of P300-based BCIs, it is not just the effect of the oversampling techniques, but rather the effect of solving the data imbalance problem.
Assuntos
Interfaces Cérebro-Computador , Máquina de Vetores de Suporte , Eletroencefalografia , HumanosRESUMO
The performance of the event-related potential (ERP)-based brain-computer interface (BCI) declines when applying it into the real environment, which limits the generality of the BCI. The sound is a common noise in daily life, and whether it has influence on this decline is unknown. This study designs a visual-auditory BCI task that requires the subject to focus on the visual interface to output commands and simultaneously count number according to an auditory story. The story is played at three speeds to cause different workloads. Data collected under the same or different workloads are used to train and test classifiers. The results show that when the speed of playing the story increases, the amplitudes of P300 and N200 potentials decrease by 0.86 µV (p = 0.0239) and 0.69 µV (p = 0.0158) in occipital-parietal area, leading to a 5.95% decline (p = 0.0101) of accuracy and 9.53 bits/min decline (p = 0.0416) of information transfer rate. The classifier that is trained by the high workload data achieves higher accuracy than the one trained by the low workload if using the high workload data to test the performance. The result indicates that the sound could affect the visual ERP-BCI by increasing the workload. The large similarity of the training data and testing data is as important as the amplitudes of the ERP on obtaining high performance, which gives us an insight on how make to the ERP-BCI generalized.
Assuntos
Interfaces Cérebro-Computador , Potenciais Evocados/fisiologia , Som , Adulto , Eletroencefalografia , Feminino , Humanos , Masculino , Adulto JovemRESUMO
BACKGROUND: Brain-computer interfacing (BCI) applications based on the classification of electroencephalographic (EEG) signals require solving high-dimensional pattern classification problems with such a relatively small number of training patterns that curse of dimensionality problems usually arise. Multiresolution analysis (MRA) has useful properties for signal analysis in both temporal and spectral analysis, and has been broadly used in the BCI field. However, MRA usually increases the dimensionality of the input data. Therefore, some approaches to feature selection or feature dimensionality reduction should be considered for improving the performance of the MRA based BCI. METHODS: This paper investigates feature selection in the MRA-based frameworks for BCI. Several wrapper approaches to evolutionary multiobjective feature selection are proposed with different structures of classifiers. They are evaluated by comparing with baseline methods using sparse representation of features or without feature selection. RESULTS AND CONCLUSION: The statistical analysis, by applying the Kolmogorov-Smirnoff and Kruskal-Wallis tests to the means of the Kappa values evaluated by using the test patterns in each approach, has demonstrated some advantages of the proposed approaches. In comparison with the baseline MRA approach used in previous studies, the proposed evolutionary multiobjective feature selection approaches provide similar or even better classification performances, with significant reduction in the number of features that need to be computed.
Assuntos
Interfaces Cérebro-Computador , Eletroencefalografia , Imagens, Psicoterapia/métodos , Atividade Motora , Processamento de Sinais Assistido por Computador , Humanos , Aprendizado de Máquina SupervisionadoRESUMO
The classification of motor imagery (MI) using Electroencephalography (EEG) plays a pivotal role in facilitating communication for individuals with physical limitations through Brain-Computer Interface (BCI) systems. Recent strides in Attention-Based Networks (ATN) have showcased remarkable performance in EEG signal classification, presenting a promising alternative to conventional Convolutional Neural Networks (CNNs). However, while CNNs have been extensively analyzed for their resilience against adversarial attacks, the susceptibility of ATNs in comparable scenarios remains largely unexplored. This paper aims to fill this gap by investigating the robustness of ATNs in adversarial contexts. We propose a high-performing attention-based deep learning model specifically designed for classifying Motor Imagery (MI) brain signals extracted from EEG data. Subsequently, we conduct a thorough series of experiments to assess various attack strategies targeting ATNs employed in EEG-based BCI tasks. Our analysis utilizes the widely recognized BCI Competition 2a dataset to demonstrate the effectiveness of attention mechanisms in BCI endeavors. Despite achieving commendable classification results in terms of accuracy (87.15%) and kappa score (0.8287), our findings reveal the vulnerability of attention-based models to adversarial manipulations (accuracy: 9.07%, kappa score: -0.21), highlighting the imperative for bolstering the robustness of attention architectures for EEG classification tasks.
Assuntos
Interfaces Cérebro-Computador , Eletroencefalografia , Imaginação , Eletroencefalografia/métodos , Humanos , Imaginação/fisiologia , Atenção/fisiologia , Redes Neurais de Computação , Aprendizado ProfundoRESUMO
Amyotrophic Lateral Sclerosis (ALS) is a neurodegenerative disease that leads to progressive muscle weakness and paralysis, ultimately resulting in the loss of ability to communicate and control the environment. EEG-based Brain-Computer Interface (BCI) methods have shown promise in providing communication and control with the aim of rehabilitating ALS patients. In particular, P300-based BCI has been widely studied and used for ALS rehabilitation. Other EEG-based BCI methods, such as Motor Imagery (MI) based BCI and Hybrid BCI, have also shown promise in ALS rehabilitation. Nonetheless, EEG-based BCI methods hold great potential for improvement. This review article introduces and reviews FFT, WPD, CSP, CSSP, CSP, and GC feature extraction methods. The Common Spatial Pattern (CSP) is an efficient and common technique for extracting data properties used in BCI systems. In addition, Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), Neural Networks (NN), and Deep Learning (DL) classification methods were introduced and reviewed. SVM is the most appropriate classifier due to its insensitivity to the curse of dimensionality. Also, DL is used in the design of BCI systems and is a good choice for BCI systems based on motor imagery with big datasets. Despite the progress made in the field, there are still challenges to overcome, such as improving the accuracy and reliability of EEG signal detection and developing more intuitive and user-friendly interfaces By using BCI, disabled patients can communicate with their caregivers and control their environment using various devices, including wheelchairs, and robotic arms.
Electroencephalography (EEG)-based Brain-Computer Interface (BCI) methods have shown promise in providing communication and control for Amyotrophic Lateral Sclerosis (ALS) patients.EEG constitutes the most significant input in BCIs and can be successfully used in the neuro-rehabilitation of patients with stroke symptoms and amyotrophic lateral sclerosis.EEG based BCIs have the potential to provide a means of communication and control for individuals with severe disabilities.a variety of EEG-based BCI methods have been developed with the aim of rehabilitating disabled patients.
RESUMO
The extraction of effective classification features from electroencephalogram (EEG) signals in motor imagery is a popular research topic. The Common Spatial Pattern (CSP) algorithm is widely employed in this field. However, the performance of the traditional CSP method depends significantly on the choice of a specific frequency band and channel number of EEG data. Furthermore, inter-class variance among these frequency bands and the limited number of available EEG channels can adversely affect the CSP algorithm's ability to extract meaningful features from the relevant signal frequency bands. We hypothesize that multiple Intrinsic Mode Functions (IMFS), into which the raw EEG signal is decomposed, can better capture the non-Gaussian characteristics of the signal, thus compensating for the limitations of the CSP algorithm when dealing with nonlinear and non-Gaussian distributed data with few channels. Therefore, this paper proposes a novel method that integrates Variational Mode Decomposition (VMD), Phase Space Reconstruction (PSR), and the CSP algorithm to address these issues. VMD is used to filter and enhance the quality of the collected data, PSR is employed to increase the effective data channels (data augmentation), and the subsequent CSP filtering can obtain signals with spatial features, which are decoded by Convolutional Neural Networks (CNN) for action decoding. This study utilizes self-collected EEG data to demonstrate that the new method can achieve a good classification accuracy of 82.30% on average, confirming the improved algorithm's effectiveness and feasibility. Furthermore, this study conducted validation on the publicly available BCI Competition IV dataset 2b, demonstrating an average classification accuracy of 87.49%.
Assuntos
Algoritmos , Eletroencefalografia , Processamento de Sinais Assistido por Computador , Humanos , Eletroencefalografia/métodos , Redes Neurais de Computação , Interfaces Cérebro-Computador , Imaginação/fisiologia , Movimento (Física)RESUMO
Currently, an important challenge in stroke rehabilitation is how to effectively restore motor functions of lower limbs. This paper presents multimodal human computer interaction (HCI) of wheelchairs supporting lower limb active rehabilitation. First, multimodal HCI incorporating motor imagery electroencephalography (EEG), electromyography (EMG) and speech is designed. Second, prototype supporting wheelchair active rehabilitation method is illustrated in details. Third, the preliminary brain-computer interfaces (BCI) and speech recognition task experiments are carried out respectively, and the results are obtained. Finally, discussion is conducted and conclusion is drawn. This study has important practical significance in auxiliary movements and neurorehabilitation for stroke patients.
RESUMO
Graph theoretic approaches in analyzing spatiotemporal dynamics of brain activities are under-studied but could be very promising directions in developing effective brain-computer interfaces (BCIs). Many existing BCI systems use electroencephalogram (EEG) signals to record and decode human neural activities noninvasively. Often, however, the features extracted from the EEG signals ignore the topological information hidden in the EEG temporal dynamics. Moreover, existing graph theoretic approaches are mostly used to reveal the topological patterns of brain functional networks based on synchronization between signals from distinctive spatial regions, instead of interdependence between states at different timestamps. In this study, we present a robust fold-wise hyperparameter optimization framework utilizing a series of conventional graph-based measurements combined with spectral graph features and investigate its discriminative performance on classification of a designed mental task in 6 participants with amyotrophic lateral sclerosis (ALS). Across all of our participants, we reached an average accuracy of 71.1%±4.5% for mental task classification by combining the global graph-based measurements and the spectral graph features, higher than the conventional non-graph based feature performance (67.1%±7.5%). Compared to using either one of the graphic features (66.3%±6.5% for the eigenvalues and 65.9%±5.2% for the global graph features), our feature combination strategy shows considerable improvement in both accuracy and robustness performance. Our results indicate the feasibility and advantage of the presented fold-wise optimization framework utilizing graph-based features in BCI systems targeted at end-users.
Assuntos
Interfaces Cérebro-Computador , Humanos , Encéfalo , Eletroencefalografia/métodos , Algoritmos , ImaginaçãoRESUMO
OBJECTIVE: Motor imagery BCI plays an increasingly important role in motor disorders rehabilitation. However, the position and duration of the discriminative segment in an EEG trial vary from subject to subject and even trial to trial, and this leads to poor performance of subject-independent motor imagery classification. Thus, determining how to detect and utilize the discriminative signal segments is crucial for improving the performance of subject-independent motor imagery BCI. APPROACH: In this paper, a shallow mirror transformer is proposed for subject-independent motor imagery EEG classification. Specifically, a multihead self-attention layer with a global receptive field is employed to detect and utilize the discriminative segment from the entire input EEG trial. Furthermore, the mirror EEG signal and the mirror network structure are constructed to improve the classification precision based on ensemble learning. Finally, the subject-independent setup was used to evaluate the shallow mirror transformer on motor imagery EEG signals from subjects existing in the training set and new subjects. MAIN RESULTS: The experiments results on BCI Competition IV datasets 2a and 2b and the OpenBMI dataset demonstrated the promising effectiveness of the proposed shallow mirror transformer. The shallow mirror transformer obtained average accuracies of 74.48% and 76.1% for new subjects and existing subjects, respectively, which were highest among the compared state-of-the-art methods. In addition, visualization of the attention score showed the ability of discriminative EEG segment detection. This paper demonstrated that multihead self-attention is effective in capturing global EEG signal information in motor imagery classification. SIGNIFICANCE: This study provides an effective model based on a multihead self-attention layer for subject-independent motor imagery-based BCIs. To the best of our knowledge, this is the shallowest transformer model available, in which a small number of parameters promotes the performance in motor imagery EEG classification for such a small sample problem.
Assuntos
Interfaces Cérebro-Computador , Eletroencefalografia , Humanos , Eletroencefalografia/métodos , Imaginação , Aprendizagem , AlgoritmosRESUMO
The common spatial patterns (CSP) technique is an effective strategy for the classification of multichannel electroencephalogram (EEG) signals. However, the objective function expression of the conventional CSP algorithm is based on the L2-norm, which makes the performance of the method easily affected by outliers and noise. In this paper, we consider a new extension to CSP, which is termed capped L21-norm-based common spatial patterns (CCSP-L21), by using the capped L21-norm rather than the L2-norm for robust modeling. L21-norm considers the L1-norm sum which largely alleviates the influence of outliers and noise for the sake of robustness. The capped norm is further used to mitigate the effects of extreme outliers whose signal amplitude is much higher than that of the normal signal. Moreover, a non-greedy iterative procedure is derived to solve the proposed objective function. The experimental results show that the proposed method achieves the highest average recognition rates on the three real data sets of BCI competitions, which are 91.67%, 85.07%, and 82.04%, respectively. Capped L21-norm-based common spatial patterns-a robust model for EEG signals classification.
Assuntos
Interfaces Cérebro-Computador , Processamento de Sinais Assistido por Computador , Algoritmos , Eletroencefalografia/métodos , ImaginaçãoRESUMO
Introduction: We investigated a slow-cortical potential (SCP) neurofeedback therapy approach for rehabilitating chronic attention deficits after stroke. This study is the first attempt to train patients who survived stroke with SCP neurofeedback therapy. Methods: We included N = 5 participants in a within-subjects follow-up design. We assessed neuropsychological and psychological performance at baseline (4 weeks before study onset), before study onset, after neurofeedback training, and at 3 months follow-up. Participants underwent 20 sessions of SCP neurofeedback training. Results: Participants learned to regulate SCPs toward negativity, and we found indications for improved attention after the SCP neurofeedback therapy in some participants. Quality of life improved throughout the study according to engagement in activities of daily living. The self-reported motivation was related to mean SCP activation in two participants. Discussion: We would like to bring attention to the potential of SCP neurofeedback therapy as a new rehabilitation method for treating post-stroke cognitive deficits. Studies with larger samples are warranted to corroborate the results.
RESUMO
It has been a challenge for solving the motor imagery classification problem in the brain informatics area. Accuracy and efficiency are the major obstacles for motor imagery analysis in the past decades since the computational capability and algorithmic availability cannot satisfy complex brain signal analysis. In recent years, the rapid development of machine learning (ML) methods has empowered people to tackle the motor imagery classification problem with more efficient methods. Among various ML methods, the Graph neural networks (GNNs) method has shown its efficiency and accuracy in dealing with inter-related complex networks. The use of GNN provides new possibilities for feature extraction from brain structure connection. In this paper, we proposed a new model called MCGNet+, which improves the performance of our previous model MutualGraphNet. In this latest model, the mutual information of the input columns forms the initial adjacency matrix for the cosine similarity calculation between columns to generate a new adjacency matrix in each iteration. The dynamic adjacency matrix combined with the spatial temporal graph convolution network (ST-GCN) has better performance than the unchanged matrix model. The experimental results indicate that MCGNet+ is robust enough to learn the interpretable features and outperforms the current state-of-the-art methods.
RESUMO
Automatic high-level feature extraction has become a possibility with the advancement of deep learning, and it has been used to optimize efficiency. Recently, classification methods for Convolutional Neural Network (CNN)-based electroencephalography (EEG) motor imagery have been proposed, and have achieved reasonably high classification accuracy. These approaches, however, use the CNN single convolution scale, whereas the best convolution scale varies from subject to subject. This limits the precision of classification. This paper proposes multibranch CNN models to address this issue by effectively extracting the spatial and temporal features from raw EEG data, where the branches correspond to different filter kernel sizes. The proposed method's promising performance is demonstrated by experimental results on two public datasets, the BCI Competition IV 2a dataset and the High Gamma Dataset (HGD). The results of the technique show a 9.61% improvement in the classification accuracy of multibranch EEGNet (MBEEGNet) from the fixed one-branch EEGNet model, and 2.95% from the variable EEGNet model. In addition, the multibranch ShallowConvNet (MBShallowConvNet) improved the accuracy of a single-scale network by 6.84%. The proposed models outperformed other state-of-the-art EEG motor imagery classification methods.
Assuntos
Interfaces Cérebro-Computador , Redes Neurais de Computação , Algoritmos , Eletroencefalografia , ImaginaçãoRESUMO
Augmented reality-based brain-computer interface (AR-BCI) has a low signal-to-noise ratio (SNR) and high real-time requirements. Classical machine learning algorithms that improve the recognition accuracy through multiple averaging significantly affect the information transfer rate (ITR) of the AR-SSVEP system. In this study, a fast recognition method based on a separable convolutional neural network (SepCNN) was developed for an AR-based P300 component (AR-P300). SepCNN achieved single extraction of AR-P300 features and improved the recognition speed. A nine-target AR-P300 single-stimulus paradigm was designed to be administered with AR holographic glasses to verify the effectiveness of SepCNN. Compared with four classical algorithms, SepCNN significantly improved the average target recognition accuracy (81.1%) and information transmission rate (57.90 bits/min) of AR-P300 single extraction. SepCNN with single extraction also attained better results than classical algorithms with multiple averaging.