Task Transfer Learning for EEG Classification in Motor Imagery-Based BCI System.

The motor-imagery brain-computer interface system (MI-BCI) has a board prospect for development. However, long calibration time and lack of enough MI commands limit its use in practice. In order to enlarge the command set, we add the combinations of traditional MI commands as new commands into the command set. We also design an algorithm based on transfer learning so as to decrease the calibration time for collecting EEG signal and training model. We create feature extractor based on data from traditional commands and transfer patterns through the data from new commands. Through the comparison of the average accuracy between our algorithm and traditional algorithms and the visualization of spatial patterns in our algorithm, we find that the accuracy of our algorithm is much higher than traditional algorithms, especially as for the low-quality datasets. Besides, the visualization of spatial patterns is meaningful. The algorithm based on transfer learning takes the advantage of the information from source data. We enlarge the command set while shortening the calibration time, which is of significant importance to the MI-BCI application.

Multi-class motor imagery EEG classification using collaborative representation-based semi-supervised extreme learning machine.

Both labeled and unlabeled data have been widely used in electroencephalographic (EEG)-based brain-computer interface (BCI). However, labeled EEG samples are generally scarce and expensive to collect, while unlabeled samples are considered to be abundant in real applications. Although the semi-supervised learning (SSL) allows us to utilize both labeled and unlabeled data to improve the classification performance as against supervised algorithms, it has been reported that unlabeled data occasionally undermine the performance of SSL in some cases. To overcome this challenge, we propose a collaborative representation-based semi-supervised extreme learning machine (CR-SSELM) algorithm to evaluate the risk of unlabeled samples by a new safety-control mechanism. Specifically, the ELM model is firstly used to predict unlabeled samples and then the collaborative representation (CR) approach is employed to reconstruct the unlabeled samples according to the obtained prediction results, from which the risk degree of unlabeled sample is defined. A risk-based regularization term is then constructed accordingly and embedded into the objective function of the SS-ELM. Experiments conducted on benchmark and EEG datasets demonstrate that the proposed method outperforms the ELM and SS-ELM algorithm. Moreover, the proposed CR-SSELM even offers the best performance while SS-ELM yields worse performance compared with its supervised counterpart (ELM). Graphical abstract This paper proposes a collaborative representation-based semi-supervised extreme learning machine (CR-SSELM) algorithm to evaluate the risk of unlabeled samples by a new safety-control mechanism. It is aim to solve the safety problem of SS-ELM method that SS-ELM yields worse performance than ELM. With the help of safety mechanism, the performance of our method is still better than supervised ELM method.

Stimuli and Feature Extraction Algorithms for Brain-Computer Interfaces: A Systematic Comparison.

A brain-computer interface (BCI) is a system that allows communication between the central nervous system and an external device. The BCIs developed by various research groups differ in their main features and the comparison across studies is therefore challenging. Here, in the same group of 19 healthy participants, we investigate three different tasks (SSVEP, P300, and hybrid) that allowed four choices to the user without previous neurofeedback training. We used the same 64-channel EEG equipment to acquire data, while participants performed each of the tasks. We systematically compared the participants' offline performance on the following parameters: 1) accuracy; 2) BCI Utility (in bits/min); and 3) inefficiency/illiteracy. In addition, we evaluated the accuracy as a function of the number of electrodes. In this paper, the SSVEP task outperformed the other tasks in bit rate, reaching an average and maximum BCI Utility of 63.4 and 91.3 bits/min, respectively. All participants achieved an accuracy level above70% on both SSVEP and P300 tasks. Furthermore, the average accuracy of all tasks was highest if a reduced subset with 4-12 electrodes was used. These results are relevant for the development of online BCIs intended for the real-life applications.

Enhancing clinical communication assessments using an audiovisual BCI for patients with disorders of consciousness.

OBJECTIVE: The JFK coma recovery scale-revised (JFK CRS-R), a behavioral observation scale, is widely used in the clinical diagnosis/assessment of patients with disorders of consciousness (DOC). However, the JFK CRS-R is associated with a high rate of misdiagnosis (approximately 40%) because DOC patients cannot provide sufficient behavioral responses. A brain-computer interface (BCI) that detects command/intention-specific changes in electroencephalography (EEG) signals without the need for behavioral expression may provide an alternative method. APPROACH: In this paper, we proposed an audiovisual BCI communication system based on audiovisual 'yes' and 'no' stimuli to supplement the JFK CRS-R for assessing the communication ability of DOC patients. Specifically, patients were given situation-orientation questions as in the JFK CRS-R and instructed to select the answers using the BCI. MAIN RESULTS: Thirteen patients (eight vegetative state (VS) and five minimally conscious state (MCS)) participated in our experiments involving both the BCI- and JFK CRS-R-based assessments. One MCS patient who received a score of 1 in the JFK CRS-R achieved an accuracy of 86.5% in the BCI-based assessment. Seven patients (four VS and three MCS) obtained unresponsive results in the JFK CRS-R-based assessment but responsive results in the BCI-based assessment, and 4 of those later improved scores in the JFK CRS-R-based assessment. Five patients (four VS and one MCS) obtained usresponsive results in both assessments. SIGNIFICANCE: The experimental results indicated that the audiovisual BCI could provide more sensitive results than the JFK CRS-R and therefore supplement the JFK CRS-R.

Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration.

BACKGROUND: People with chronic tetraplegia, due to high-cervical spinal cord injury, can regain limb movements through coordinated electrical stimulation of peripheral muscles and nerves, known as functional electrical stimulation (FES). Users typically command FES systems through other preserved, but unrelated and limited in number, volitional movements (eg, facial muscle activity, head movements, shoulder shrugs). We report the findings of an individual with traumatic high-cervical spinal cord injury who coordinated reaching and grasping movements using his own paralysed arm and hand, reanimated through implanted FES, and commanded using his own cortical signals through an intracortical brain-computer interface (iBCI). METHODS: We recruited a participant into the BrainGate2 clinical trial, an ongoing study that obtains safety information regarding an intracortical neural interface device, and investigates the feasibility of people with tetraplegia controlling assistive devices using their cortical signals. Surgical procedures were performed at University Hospitals Cleveland Medical Center (Cleveland, OH, USA). Study procedures and data analyses were performed at Case Western Reserve University (Cleveland, OH, USA) and the US Department of Veterans Affairs, Louis Stokes Cleveland Veterans Affairs Medical Center (Cleveland, OH, USA). The study participant was a 53-year-old man with a spinal cord injury (cervical level 4, American Spinal Injury Association Impairment Scale category A). He received two intracortical microelectrode arrays in the hand area of his motor cortex, and 4 months and 9 months later received a total of 36 implanted percutaneous electrodes in his right upper and lower arm to electrically stimulate his hand, elbow, and shoulder muscles. The participant used a motorised mobile arm support for gravitational assistance and to provide humeral abduction and adduction under cortical control. We assessed the participant's ability to cortically command his paralysed arm to perform simple single-joint arm and hand movements and functionally meaningful multi-joint movements. We compared iBCI control of his paralysed arm with that of a virtual three-dimensional arm. This study is registered with ClinicalTrials.gov, number NCT00912041. FINDINGS: The intracortical implant occurred on Dec 1, 2014, and we are continuing to study the participant. The last session included in this report was Nov 7, 2016. The point-to-point target acquisition sessions began on Oct 8, 2015 (311 days after implant). The participant successfully cortically commanded single-joint and coordinated multi-joint arm movements for point-to-point target acquisitions (80-100% accuracy), using first a virtual arm and second his own arm animated by FES. Using his paralysed arm, the participant volitionally performed self-paced reaches to drink a mug of coffee (successfully completing 11 of 12 attempts within a single session 463 days after implant) and feed himself (717 days after implant). INTERPRETATION: To our knowledge, this is the first report of a combined implanted FES+iBCI neuroprosthesis for restoring both reaching and grasping movements to people with chronic tetraplegia due to spinal cord injury, and represents a major advance, with a clear translational path, for clinically viable neuroprostheses for restoration of reaching and grasping after paralysis. FUNDING: National Institutes of Health, Department of Veterans Affairs.

A novel method for concentration evaluation of reading behaviors with electrical activity recorded on the scalp.

In this paper, a concentration evaluation of reading behaviors with electrical signal detection on the head is presented. The electrode signal is extracted by brain-computer-interface (BCI) to monitor the user's degree of concentration, where the user is reminded by sound to concentrate, or teaching staffs are reminded to help users improve reading habits, in order to facilitate the user's ability to concentrate. The digital signal processing methods, such as the Kalman Filter, Fast Fourier Transform, the Hamming window, the average value of the total energy of a frame, correlation coefficient, and novel judgment algorithm are used to obtain the corresponding parameters of concentration evaluation. Users can correct their manner of reading with reminders. The repeated test results may be expected to lie with a probability of 95%. Such model training results in better learning effect.

Modified CC-LR algorithm with three diverse feature sets for motor imagery tasks classification in EEG based brain-computer interface.

Motor imagery (MI) tasks classification provides an important basis for designing brain-computer interface (BCI) systems. If the MI tasks are reliably distinguished through identifying typical patterns in electroencephalography (EEG) data, a motor disabled people could communicate with a device by composing sequences of these mental states. In our earlier study, we developed a cross-correlation based logistic regression (CC-LR) algorithm for the classification of MI tasks for BCI applications, but its performance was not satisfactory. This study develops a modified version of the CC-LR algorithm exploring a suitable feature set that can improve the performance. The modified CC-LR algorithm uses the C3 electrode channel (in the international 10-20 system) as a reference channel for the cross-correlation (CC) technique and applies three diverse feature sets separately, as the input to the logistic regression (LR) classifier. The present algorithm investigates which feature set is the best to characterize the distribution of MI tasks based EEG data. This study also provides an insight into how to select a reference channel for the CC technique with EEG signals considering the anatomical structure of the human brain. The proposed algorithm is compared with eight of the most recently reported well-known methods including the BCI III Winner algorithm. The findings of this study indicate that the modified CC-LR algorithm has potential to improve the identification performance of MI tasks in BCI systems. The results demonstrate that the proposed technique provides a classification improvement over the existing methods tested.

Neurophysiological substrates of stroke patients with motor imagery-based Brain-Computer Interface training.

We investigated the efficacy of motor imagery-based Brain Computer Interface (MI-based BCI) training for eight stroke patients with severe upper extremity paralysis using longitudinal clinical assessments. The results were compared with those of a control group (n = 7) that only received FES (Functional Electrical Stimulation) treatment besides conventional therapies. During rehabilitation training, changes in the motor function of the upper extremity and in the neurophysiologic electroencephalographic (EEG) were observed for two groups. After 8 weeks of training, a significant improvement in the motor function of the upper extremity for the BCI group was confirmed (p < 0.05 for ARAT), simultaneously with the activation of bilateral cerebral hemispheres. Additionally, event-related desynchronization (ERD) of the affected sensorimotor cortexes (SMCs) was significantly enhanced when compared to the pretraining course, which was only observed in the BCI group (p < 0.05). Furthermore, the activation of affected SMC and parietal lobe were determined to contribute to motor function recovery (p < 0.05). In brief, our findings demonstrate that MI-based BCI training can enhance the motor function of the upper extremity for stroke patients by inducing the optimal cerebral motor functional reorganization.