Successful learning of alpha up-regulation through neurofeedback training modulates sustained attention.

As a fundamental attention function, sustained attention plays a critical role in general cognitive abilities and is closely linked to EEG alpha oscillations. Neurofeedback training (NFT) of alpha activity on different aspects of attention has been studied previously. However, it remains unclear how NFT with up- or down-regulation directions modulates sustained attention. Here we employed a counterbalanced single-blind sham-controlled crossover design, in which healthy young adults underwent one NFT session of alpha up-regulation, one NFT session of alpha down-regulation, and one sham-control NFT session over the posterior area. The session order was counterbalanced with a 7-day interval between each session. After each NFT session, the participants completed a visual continuous temporal expectancy task (vCTET) to assess their sustained attention performance. The results showed that compared to sham-control NFT, successful learning of alpha up-regulation resulted in increased reaction time at the beginning of the attention task but a slower increase over vCTET blocks. On the other hand, successful learning of alpha down-regulation had no impact on attention performance compared to sham-control NFT. These findings suggest that successful learning of alpha up-regulation through NFT could impair initial attention performance but slow down visual attention deterioration over time, i.e., alpha enhancement by NFT stabilizing visual attention.

Human factors engineering of BCI: an evaluation for satisfaction of BCI based on motor imagery.

Existing brain-computer interface (BCI) research has made great progress in improving the accuracy and information transfer rate (ITR) of BCI systems. However, the practicability of BCI is still difficult to achieve. One of the important reasons for this difficulty is that human factors are not fully considered in the research and development of BCI. As a result, BCI systems have not yet reached users' expectations. In this study, we investigate a BCI system of motor imagery for lower limb synchronous rehabilitation as an example. From the perspective of human factors engineering of BCI, a comprehensive evaluation method of BCI system development is proposed based on the concept of human-centered design and evaluation. Subjects' satisfaction ratings for BCI sensors, visual analog scale (VAS), subjects' satisfaction rating of the BCI system, and the mental workload rating for subjects manipulating the BCI system, as well as interview/follow-up comprehensive evaluation of motor imagery of BCI (MI-BCI) system satisfaction were used. The methods and concepts proposed in this study provide useful insights for the design of personalized MI-BCI. We expect that the human factors engineering of BCI could be applied to the design and satisfaction evaluation of MI-BCI, so as to promote the practical application of this kind of BCI.

[Neurofeedback technology based on functional near infrared spectroscopy imaging and its applications].

Neurofeedback (NF) technology based on electroencephalogram (EEG) data or functional magnetic resonance imaging (fMRI) has been widely studied and applied. In contrast, functional near infrared spectroscopy (fNIRS) has become a new technique in NF research in recent years. fNIRS is a neuroimaging technology based on hemodynamics, which has the advantages of low cost, good portability and high spatial resolution, and is more suitable for use in natural environments. At present, there is a lack of comprehensive review on fNIRS-NF technology (fNIRS-NF) in China. In order to provide a reference for the research of fNIRS-NF technology, this paper first describes the principle, key technologies and applications of fNIRS-NF, and focuses on the application of fNIRS-NF. Finally, the future development trend of fNIRS-NF is prospected and summarized. In conclusion, this paper summarizes fNIRS-NF technology and its application, and concludes that fNIRS-NF technology has potential practicability in neurological diseases and related fields. fNIRS can be used as a good method for NF training. This paper is expected to provide reference information for the development of fNIRS-NF technology.

[Key technology of brain-computer interaction based on speech imagery].

Speech expression is an important high-level cognitive behavior of human beings. The realization of this behavior is closely related to human brain activity. Both true speech expression and speech imagination can activate part of the same brain area. Therefore, speech imagery becomes a new paradigm of brain-computer interaction. Brain-computer interface (BCI) based on speech imagery has the advantages of spontaneous generation, no training, and friendliness to subjects, so it has attracted the attention of many scholars. However, this interactive technology is not mature in the design of experimental paradigms and the choice of imagination materials, and there are many issues that need to be discussed urgently. Therefore, in response to these problems, this article first expounds the neural mechanism of speech imagery. Then, by reviewing the previous BCI research of speech imagery, the mainstream methods and core technologies of experimental paradigm, imagination materials, data processing and so on are systematically analyzed. Finally, the key problems and main challenges that restrict the development of this type of BCI are discussed. And the future development and application perspective of the speech imaginary BCI system are prospected.

Enhanced Resting-State Functional Connectivity With Decreased Amplitude of Low-Frequency Fluctuations of the Salience Network in Mindfulness Novices.

Mindfulness and accordant interventions are often used as complementary treatments to psychological or psychosomatic problems. This has also been gradually integrated into daily lives for the promotion of psychological well-being in non-clinical populations. The experience of mindful acceptance in a non-judgmental way brought about the state, which was less interfered by a negative effect. Mindfulness practice often begins with focused attention (FA) meditation restricted to an inner experience. We postulate that the brain areas related to an interoceptive function would demonstrate an intrinsic functional change after mindfulness training for the mindful novices along with paying more attention to internal processes. To further explore the influence of mindfulness on the organization of the brain regions, both functional connectivity (FC) in the voxel and the region of interest (ROI) level were calculated. In the current study, 32 healthy volunteers, without any meditation experiences, were enrolled and randomly assigned to a mindfulness-based stress reduction group (MBSR) or control group (CON). Participants in the MBSR group completed 8 weeks of mindfulness-based stress reduction (MBSR) and rated their mindfulness skills before and after MBSR. All subjects were evaluated via resting-state functional MRI (rs-fMRI) in both baselines and after 8 weeks. They also completed a self-report measure of their state and trait anxiety as well as a positive and negative affect. Pre- and post-MBSR assessments revealed a decreased amplitude of low-frequency fluctuations (ALFF) in the right anterior cingulate gyrus (ACC.R), left anterior and posterior insula (aIC.L, pIC.L), as well as left superior medial frontal gyrus (SFGmed.L) in MBSR practitioners. Strengthened FC between right anterior cingulate cortex (ACC.R) and aIC.R was observed. The mean ALFF values of those regions were inversely and positively linked to newly acquired mindful abilities. Along with a decreased negative affect score, our results suggest that the brain regions related to attention and interoceptive function were involved at the beginning of mindfulness. This study provides new clues in elucidating the time of evaluating the brain mechanisms of mindfulness novices.

[Key technologies for intelligent brain-computer interaction based on magnetoencephalography].

Brain-computer interaction (BCI) is a transformative human-computer interaction, which aims to bypass the peripheral nerve and muscle system and directly convert the perception, imagery or thinking activities of cranial nerves into actions for further improving the quality of human life. Magnetoencephalogram (MEG) measures the magnetic field generated by the electrical activity of neurons. It has the unique advantages of non-contact measurement, high temporal and spatial resolution, and convenient preparation. It is a new BCI driving signal. MEG-BCI research has important brain science significance and potential application value. So far, few documents have elaborated the key technical issues involved in MEG-BCI. Therefore, this paper focuses on the key technologies of MEG-BCI, and details the signal acquisition technology involved in the practical MEG-BCI system, the design of the MEG-BCI experimental paradigm, the MEG signal analysis and decoding key technology, MEG-BCI neurofeedback technology and its intelligent method. Finally, this paper also discusses the existing problems and future development trends of MEG-BCI. It is hoped that this paper will provide more useful ideas for MEG-BCI innovation research.

Identification of Visual Imagery by Electroencephalography Based on Empirical Mode Decomposition and an Autoregressive Model.

The traditional imagery task for brain-computer interfaces (BCIs) consists of motor imagery (MI) in which subjects are instructed to imagine moving certain parts of their body. This kind of imagery task is difficult for subjects. In this study, we used a less studied yet more easily performed type of mental imagery-visual imagery (VI)-in which subjects are instructed to visualize a picture in their brain to implement a BCI. In this study, 18 subjects were recruited and instructed to observe one of two visual-cued pictures (one was static, while the other was moving) and then imagine the cued picture in each trial. Simultaneously, electroencephalography (EEG) signals were collected. Hilbert-Huang Transform (HHT), autoregressive (AR) models, and a combination of empirical mode decomposition (EMD) and AR were used to extract features, respectively. A support vector machine (SVM) was used to classify the two kinds of VI tasks. The average, highest, and lowest classification accuracies of HHT were 68.14 ± 3.06%, 78.33%, and 53.3%, respectively. The values of the AR model were 56.29 ± 2.73%, 71.67%, and 30%, respectively. The values obtained by the combination of the EMD and the AR model were 78.40 ± 2.07%, 87%, and 48.33%, respectively. The results indicate that multiple VI tasks were separable based on EEG and that the combination of EMD and an AR model used in VI feature extraction was better than an HHT or AR model alone. Our work may provide ideas for the construction of a new online VI-BCI.

A novel strategy for driving car brain-computer interfaces: Discrimination of EEG-based visual-motor imagery.

A brain-computer interface (BCI) based on kinesthetic motor imagery has a potential of becoming a groundbreaking technology in a clinical setting. However, few studies focus on a visual-motor imagery (VMI) paradigm driving BCI. The VMI-BCI feature extraction methods are yet to be explored in depth. In this study, a novel VMI-BCI paradigm is proposed to execute four VMI tasks: imagining a car moving forward, reversing, turning left, and turning right. These mental strategies can naturally control a car or robot to move forward, backward, left, and right. Electroencephalogram (EEG) data from 25 subjects were collected. After the raw EEG signal baseline was corrected, the alpha band was extracted using bandpass filtering. The artifacts were removed by independent component analysis. Then, the EEG average instantaneous energy induced by VMI (VMI-EEG) was calculated using the Hilbert-Huang transform (HHT). The autoregressive model was extracted to construct a 12-dimensional feature vector to a support vector machine suitable for small sample classification. This was classified into two-class tasks: visual imagination of driving the car forward versus reversing, driving forward versus turning left, driving forward versus turning right, reversing versus turning left, reversing versus turning right, and turning left versus turning right. The results showed that the average classification accuracy of these two-class tasks was 62.68 ± 5.08%, and the highest classification accuracy was 73.66 ± 6.80%. The study showed that EEG features of O1 and O2 electrodes in the occipital region extracted by HHT were separable for these VMI tasks.

[Execution, assessment and improvement methods of motor imagery for brain-computer interface].

Motor imagery (MI) is an important paradigm of driving brain computer interface (BCI). However, MI is not easy to control or acquire, and the performance of MI-BCI depends heavily on the performance of the subjects' MI. Therefore, the correct execution of MI mental activities, ability evaluation and improvement methods play important and even critical roles in the improvement and application of MI-BCI system's performance. However, in the research and development of MI-BCI, the existing researches mainly focus on the decoding algorithm of MI, but do not pay enough attention to the above three aspects of MI mental activities. In this paper, these problems of MI-BCI are discussed in detail, and it is pointed out that the subjects tend to use visual motor imagery as kinesthetic motor imagery. In the future, we need to develop some objective, quantitatively visualized MI ability evaluation methods, and develop some effective and less time-consumption training methods to improve MI ability. It is also necessary to solve the differences and commonness of MI problems between and within individuals and MI-BCI illiteracy to a certain extent.

A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery.

Objective: Tangent Space Mapping (TSM) using the geometric structure of the covariance matrices is an effective method to recognize multiclass motor imagery (MI). Compared with the traditional CSP method, the Riemann geometric method based on TSM takes into account the nonlinear information contained in the covariance matrix, and can extract more abundant and effective features. Moreover, the method is an unsupervised operation, which can reduce the time of feature extraction. However, EEG features induced by MI mental activities of different subjects are not the same, so selection of subject-specific discriminative EEG frequency components play a vital role in the recognition of multiclass MI. In order to solve the problem, a discriminative and multi-scale filter bank tangent space mapping (DMFBTSM) algorithm is proposed in this article to design the subject-specific Filter Bank (FB) so as to effectively recognize multiclass MI tasks. Methods: On the 4-class BCI competition IV-2a dataset, first, a non-parametric method of multivariate analysis of variance (MANOVA) based on the sum of squared distances is used to select discriminative frequency bands for a subject; next, a multi-scale FB is generated according to the range of these frequency bands, and then decompose multi-channel EEG of the subject into multiple sub-bands combined with several time windows. Then TSM algorithm is used to estimate Riemannian tangent space features in each sub-band and finally a liner Support Vector Machines (SVM) is used for classification. Main Results: The analysis results show that the proposed discriminative FB enhances the multi-scale TSM algorithm, improves the classification accuracy and reduces the execution time during training and testing. On the 4-class BCI competition IV-2a dataset, the average session to session classification accuracy of nine subjects reached 77.33 ± 12.3%. When the training time and the test time are similar, the average classification accuracy is 2.56% higher than the latest TSM method based on multi-scale filter bank analysis technology. When the classification accuracy is similar, the training speed is increased by more than three times, and the test speed is increased two times more. Compared with Supervised Fisher Geodesic Minimum Distance to the Mean (Supervised FGMDRM), another new variant based on Riemann geometry classifier, the average accuracy is 3.36% higher, we also compared with the latest Deep Learning method, and the average accuracy of 10-fold cross validation improved by 2.58%. Conclusion: Research shows that the proposed DMFBTSM algorithm can improve the classification accuracy of MI tasks. Significance: Compared with the MFBTSM algorithm, the algorithm proposed in this article is expected to select frequency bands with good separability for specific subject to improve the classification accuracy of multiclass MI tasks and reduce the feature dimension to reduce training time and testing time.

Decoding of Walking Imagery and Idle State Using Sparse Representation Based on fNIRS.

OBJECTIVES: Brain-computer interface (BCI) based on functional near-infrared spectroscopy (fNIRS) is expected to provide an optional active rehabilitation training method for patients with walking dysfunction, which will affect their quality of life seriously. Sparse representation classification (SRC) oxyhemoglobin (HbO) concentration was used to decode walking imagery and idle state to construct fNIRS-BCI based on walking imagery. METHODS: 15 subjects were recruited and fNIRS signals were collected during walking imagery and idle state. Firstly, band-pass filtering and baseline drift correction for HbO signal were carried out, and then the mean value, peak value, and root mean square (RMS) of HbO and their combinations were extracted as classification features; SRC was used to identify the extracted features and the result of SRC was compared with those of support vector machine (SVM), K-Nearest Neighbor (KNN), linear discriminant analysis (LDA), and logistic regression (LR). RESULTS: The experimental results showed that the average classification accuracy for walking imagery and idle state by SRC using three features combination was 91.55±3.30%, which was significantly higher than those of SVM, KNN, LDA, and LR (86.37±4.42%, 85.65±5.01%, 86.43±4.41%, and 76.14±5.32%, respectively), and the classification accuracy of other combined features was higher than that of single feature. CONCLUSIONS: The study showed that introducing SRC into fNIRS-BCI can effectively identify walking imagery and idle state. It also showed that different time windows for feature extraction have an impact on the classification results, and the time window of 2-8 s achieved a better classification accuracy (94.33±2.60%) than other time windows. Significance. The study was expected to provide a new and optional active rehabilitation training method for patients with walking dysfunction. In addition, the experiment was also a rare study based on fNIRS-BCI using SRC to decode walking imagery and idle state.

[Design and experiment of a multi-modal electroencephalogram-near infrared spectroscopy helmet for simultaneously acquiring at the same brain area].

Multi-modal brain-computer interface and multi-modal brain function imaging are developing trends for the present and future. Aiming at multi-modal brain-computer interface based on electroencephalogram-near infrared spectroscopy (EEG-NIRS) and in order to simultaneously acquire the brain activity of motor area, an acquisition helmet by NIRS combined with EEG was designed and verified by the experiment. According to the 10-20 system or 10-20 extended system, the diameter and spacing of NIRS probe and EEG electrode, NIRS probes were aligned with C3 and C4 as the reference electrodes, and NIRS probes were placed in the middle position between EEG electrodes to simultaneously measure variations of NIRS and the corresponding variation of EEG in the same functional brain area. The clamp holder and near infrared probe were coupled by tightening a screw. To verify the feasibility and effectiveness of the multi-modal EEG-NIRS helmet, NIRS and EEG signals were collected from six healthy subjects during six mental tasks involving the right hand clenching force and speed motor imagery. These signals may reflect brain activity related to hand clenching force and speed motor imagery in a certain extent. The experiment showed that the EEG-NIRS helmet designed in the paper was feasible and effective. It not only could provide support for the multi-modal motor imagery brain-computer interface based on EEG-NIRS, but also was expected to provide support for multi-modal brain functional imaging based on EEG-NIRS.

[Control of intelligent car based on electroencephalogram and neurofeedback].

To improve the performance of brain-controlled intelligent car based on motor imagery (MI), a method based on neurofeedback (NF) with electroencephalogram (EEG) for controlling intelligent car is proposed. A mental strategy of MI in which the energy column diagram of EEG features related to the mental activity is presented to subjects with visual feedback in real time to train them to quickly master the skills of MI and regulate their EEG activity, and combination of multi-features fusion of MI and multi-classifiers decision were used to control the intelligent car online. The average, maximum and minimum accuracy of identifying instructions achieved by the trained group (trained by the designed feedback system before the experiment) were 85.71%, 90.47% and 76.19%, respectively and the corresponding accuracy achieved by the control group (untrained) were 73.32%, 80.95% and 66.67%, respectively. For the trained group, the average, longest and shortest time consuming were 92 s, 101 s, and 85 s, respectively, while for the control group the corresponding time were 115.7 s, 120 s, and 110 s, respectively. According to the results described above, it is expected that this study may provide a new idea for the follow-up development of brain-controlled intelligent robot by the neurofeedback with EEG related to MI.