Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model.

Motor imagery (MI) is a cognitive process wherein an individual mentally rehearses a specific movement without physically executing it. Recently, MI-based brain-computer interface (BCI) has attracted widespread attention. However, accurate decoding of MI and understanding of neural mechanisms still face huge challenges. These seriously hinder the clinical application and development of BCI systems based on MI. Thus, it is very necessary to develop new methods to decode MI tasks. In this work, we propose a multi-branch convolutional neural network (MBCNN) with a temporal convolutional network (TCN), an end-to-end deep learning framework to decode multi-class MI tasks. We first used MBCNN to capture the MI electroencephalography signals information on temporal and spectral domains through different convolutional kernels. Then, we introduce TCN to extract more discriminative features. The within-subject cross-session strategy is used to validate the classification performance on the dataset of BCI Competition IV-2a. The results showed that we achieved 75.08% average accuracy for 4-class MI task classification, outperforming several state-of-the-art approaches. The proposed MBCNN-TCN-Net framework successfully captures discriminative features and decodes MI tasks effectively, improving the performance of MI-BCIs. Our findings could provide significant potential for improving the clinical application and development of MI-based BCI systems.

Endovascular Brain-Computer Interfaces in Poststroke Paralysis.

Stroke is a leading cause of paralysis, most frequently affecting the upper limbs and vocal folds. Despite recent advances in care, stroke recovery invariably reaches a plateau, after which there are permanent neurological impairments. Implantable brain-computer interface devices offer the potential to bypass permanent neurological lesions. They function by (1) recording neural activity, (2) decoding the neural signal occurring in response to volitional motor intentions, and (3) generating digital control signals that may be used to control external devices. While brain-computer interface technology has the potential to revolutionize neurological care, clinical translation has been limited. Endovascular arrays present a novel form of minimally invasive brain-computer interface devices that have been deployed in human subjects during early feasibility studies. This article provides an overview of endovascular brain-computer interface devices and critically evaluates the patient with stroke as an implant candidate. Future opportunities are mapped, along with the challenges arising when decoding neural activity following infarction. Limitations arise when considering intracerebral hemorrhage and motor cortex lesions; however, future directions are outlined that aim to address these challenges.

Macroscopic brain dynamics beyond contralateral primary motor cortex for movement prediction.

This study investigates the complex relationship between upper limb movement direction and macroscopic neural signals in the brain, which is critical for understanding brain-computer interfaces (BCI). Conventional BCI research has primarily focused on a local area, such as the contralateral primary motor cortex (M1), relying on the population-based decoding method with microelectrode arrays. In contrast, macroscopic approaches such as electroencephalography (EEG) and magnetoencephalography (MEG) utilize numerous electrodes to cover broader brain regions. This study probes the potential differences in the mechanisms of microscopic and macroscopic methods. It is important to determine which neural activities effectively predict movements. To investigate this, we analyzed MEG data from nine right-handed participants while performing arm-reaching tasks. We employed dynamic statistical parametric mapping (dSPM) to estimate source activity and built a decoding model composed of long short-term memory (LSTM) and a multilayer perceptron to predict movement trajectories. This model achieved a high correlation coefficient of 0.79 between actual and predicted trajectories. Subsequently, we identified brain regions sensitive to predicting movement direction using the integrated gradients (IG) method, which assesses the predictive contribution of each source activity. The resulting salience map demonstrated a distribution without significant differences across motor-related regions, including M1. Predictions based solely on M1 activity yielded a correlation coefficient of 0.42, nearly half as effective as predictions incorporating all source activities. This suggests that upper limb movements are influenced by various factors such as movement coordination, planning, body and target position recognition, and control, beyond simple muscle activity. All of the activities are needed in the decoding model using macroscopic signals. Our findings also revealed that contralateral and ipsilateral hemispheres contribute equally to movement prediction, implying that BCIs could potentially benefit patients with brain damage in the contralateral hemisphere by utilizing brain signals from the ipsilateral hemisphere. In conclusion, this study demonstrates that macroscopic activity from large brain regions significantly contributes to predicting upper limb movement. Non-invasive BCI systems would require a comprehensive collection of neural signals from multiple brain regions.

Filter bank second-order underdamped stochastic resonance analysis for implementing a short-term high-speed SSVEP detection.

OBJECTIVE: The progression of brain-computer interfaces (BCIs) has been propelled by breakthroughs in neuroscience, signal processing, and machine learning, marking it as a dynamic field of study over the past few decades. Nevertheless, the nonlinear and non-stationary characteristics of steady-state visual evoked potentials (SSVEPs), coupled with the incongruity between frequently employed linear techniques and nonlinear signal attributes, resulted in the subpar performance of mainstream non-training algorithms like canonical correlation analysis (CCA), multivariate synchronization index (MSI), and filter bank CCA (FBCCA) in short-term SSVEP detection. METHODS: To tackle this problem, the novel fusions of common filter bank analysis, CCA dimensionality reduction methods, USSR models, and MSI recognition models are used in SSVEP signal recognition. RESULTS: Unlike conventional linear techniques such as CCA, MSI, and FBCCA, the filter bank second-order underdamped stochastic resonance (FBUSSR) analysis demonstrates superior efficacy in the detection of short-term high-speed SSVEPs. CONCLUSION: This research enlists 32 subjects and uses a public dataset to assess the proposed approach, and the experimental outcomes indicate that the non-training method can attain greater recognition precision and stability. Furthermore, under the conditions of the newly proposed fusion method and light stimulation, the USSR model exhibits the most optimal enhancement effect. SIGNIFICANCE: The findings of this study underscore the expansive potential for the application of BCI systems in the realm of neuroscience and signal processing.

Direct electrical brain stimulation of human memory: lessons learnt and future perspectives.

Modulation of cognitive functions supporting human declarative memory is one of the grand challenges of neuroscience, and of vast importance for a variety of neuropsychiatric, neurodegenerative and neurodevelopmental diseases. Despite a recent surge of successful attempts at improving performance in a range of memory tasks, the optimal approaches and parameters for memory enhancement have yet to be determined. On a more fundamental level, it remains elusive as to how delivering electrical current in a given brain area leads to enhanced memory processing. Starting from the local and distal physiological effects on neural populations, the mechanisms of enhanced memory encoding, maintenance, consolidation or recall in response to direct electrical stimulation are only now being unravelled. With the advent of innovative neurotechnologies for concurrent recording and stimulation intracranially in the human brain, it becomes possible to study both acute and chronic effects of stimulation on memory performance and the underlying neural activities. In this review, we summarize the effects of various invasive stimulation approaches for modulating memory functions. We first outline the challenges that were faced in the initial studies of memory enhancement and the lessons learnt. Electrophysiological biomarkers are then reviewed as more objective measures of the stimulation effects than behavioural outcomes. Finally, we classify the various stimulation approaches into continuous and phasic modulation with an open or closed loop for responsive stimulation based on analysis of the recorded neural activities. Although the potential advantage of closed-loop responsive stimulation over the classic open-loop approaches is inconclusive, we foresee the emerging results from ongoing longitudinal studies and clinical trials will shed light on both the mechanisms and optimal strategies for improving declarative memory. Adaptive stimulation based on the biomarker analysis over extended periods of time is proposed as a future direction for obtaining lasting effects on memory functions. Chronic tracking and modulation of neural activities intracranially through adaptive stimulation opens tantalizing new avenues to continually monitor and treat memory and cognitive deficits in a range of brain disorders. Brain co-processors created with machine-learning tools and wireless bi-directional connectivity to seamlessly integrate implanted devices with smartphones and cloud computing are poised to enable real-time automated analysis of large data volumes and adaptively tune electrical stimulation based on electrophysiological biomarkers of behavioural states. Next-generation implantable devices for high-density recording and stimulation of electrophysiological activities, and technologies for distributed brain-computer interfaces are presented as selected future perspectives for modulating human memory and associated mental processes.

A Modified Hybrid Brain-Computer Interface Speller Based on Steady-State Visual Evoked Potentials and Electromyogram.

BACKGROUND: To enhance the information transfer rate (ITR) of a steady-state visual evoked potential (SSVEP)-based speller, more characters with flickering symbols should be used. Increasing the number of symbols might reduce the classification accuracy. A hybrid brain-computer interface (BCI) improves the overall performance of a BCI system by taking advantage of two or more control signals. In a simultaneous hybrid BCI, various modalities work with each other simultaneously, which enhances the ITR. METHODS: In our proposed speller, simultaneous combination of electromyogram (EMG) and SSVEP was applied to increase the ITR. To achieve 36 characters, only nine stimulus symbols were used. Each symbol allowed the selection of four characters based on four states of muscle activity. The SSVEP detected which symbol the subject was focusing on and the EMG determined the target character out of the four characters dedicated to that symbol. The frequency rate for character encoding was applied in the EMG modality and latency was considered in the SSVEP modality. Online experiments were carried out on 10 healthy subjects. RESULTS: The average ITR of this hybrid system was 96.1 bit/min with an accuracy of 91.2%. The speller speed was 20.9 char/min. Different subjects had various latency values. We used an average latency of 0.2 s across all subjects. Evaluation of each modality showed that the SSVEP classification accuracy varied for different subjects, ranging from 80% to 100%, while the EMG classification accuracy was approximately 100% for all subjects. CONCLUSIONS: Our proposed hybrid BCI speller showed improved system speed compared with state-of-the-art systems based on SSVEP or SSVEP-EMG, and can provide a user-friendly, practical system for speller applications.

Brain Wearables: Validation Toolkit for Ear-Level EEG Sensors.

EEG-enabled earbuds represent a promising frontier in brain activity monitoring beyond traditional laboratory testing. Their discrete form factor and proximity to the brain make them the ideal candidate for the first generation of discrete non-invasive brain-computer interfaces (BCIs). However, this new technology will require comprehensive characterization before we see widespread consumer and health-related usage. To address this need, we developed a validation toolkit that aims to facilitate and expand the assessment of ear-EEG devices. The first component of this toolkit is a desktop application ("EaR-P Lab") that controls several EEG validation paradigms. This application uses the Lab Streaming Layer (LSL) protocol, making it compatible with most current EEG systems. The second element of the toolkit introduces an adaptation of the phantom evaluation concept to the domain of ear-EEGs. Specifically, it utilizes 3D scans of the test subjects' ears to simulate typical EEG activity around and inside the ear, allowing for controlled assessment of different ear-EEG form factors and sensor configurations. Each of the EEG paradigms were validated using wet-electrode ear-EEG recordings and benchmarked against scalp-EEG measurements. The ear-EEG phantom was successful in acquiring performance metrics for hardware characterization, revealing differences in performance based on electrode location. This information was leveraged to optimize the electrode reference configuration, resulting in increased auditory steady-state response (ASSR) power. Through this work, an ear-EEG evaluation toolkit is made available with the intention to facilitate the systematic assessment of novel ear-EEG devices from hardware to neural signal acquisition.

A Brain-Controlled and User-Centered Intelligent Wheelchair: A Feasibility Study.

Recently, due to physical aging, diseases, accidents, and other factors, the population with lower limb disabilities has been increasing, and there is consequently a growing demand for wheelchair products. Modern product design tends to be more intelligent and multi-functional than in the past, with the popularization of intelligent concepts. This supports the design of a new, fully functional, intelligent wheelchair that can assist people with lower limb disabilities in their day-to-day life. Based on the UCD (user-centered design) concept, this study focused on the needs of people with lower limb disabilities. Accordingly, the demand for different functions of intelligent wheelchair products was studied through a questionnaire survey, interview survey, literature review, expert consultation, etc., and the function and appearance of the intelligent wheelchair were then defined. A brain-machine interface system was developed for controlling the motion of the intelligent wheelchair, catering to the needs of disabled individuals. Furthermore, ergonomics theory was used as a guide to determine the size of the intelligent wheelchair seat, and eventually, a new intelligent wheelchair with the features of climbing stairs, posture adjustment, seat elevation, easy interaction, etc., was developed. This paper provides a reference for the design upgrade of the subsequently developed intelligent wheelchair products.

Multiclass Classification of Visual Electroencephalogram Based on Channel Selection, Minimum Norm Estimation Algorithm, and Deep Network Architectures.

This work addresses the challenge of classifying multiclass visual EEG signals into 40 classes for brain-computer interface applications using deep learning architectures. The visual multiclass classification approach offers BCI applications a significant advantage since it allows the supervision of more than one BCI interaction, considering that each class label supervises a BCI task. However, because of the nonlinearity and nonstationarity of EEG signals, using multiclass classification based on EEG features remains a significant challenge for BCI systems. In the present work, mutual information-based discriminant channel selection and minimum-norm estimate algorithms were implemented to select discriminant channels and enhance the EEG data. Hence, deep EEGNet and convolutional recurrent neural networks were separately implemented to classify the EEG data for image visualization into 40 labels. Using the k-fold cross-validation approach, average classification accuracies of 94.8% and 89.8% were obtained by implementing the aforementioned network architectures. The satisfactory results obtained with this method offer a new implementation opportunity for multitask embedded BCI applications utilizing a reduced number of both channels (<50%) and network parameters (<110 K).

In-Car Environment Control Using an SSVEP-Based Brain-Computer Interface with Visual Stimuli Presented on Head-Up Display: Performance Comparison with a Button-Press Interface.

Controlling the in-car environment, including temperature and ventilation, is necessary for a comfortable driving experience. However, it often distracts the driver's attention, potentially causing critical car accidents. In the present study, we implemented an in-car environment control system utilizing a brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP). In the experiment, four visual stimuli were displayed on a laboratory-made head-up display (HUD). This allowed the participants to control the in-car environment by simply staring at a target visual stimulus, i.e., without pressing a button or averting their eyes from the front. The driving performances in two realistic driving tests-obstacle avoidance and car-following tests-were then compared between the manual control condition and SSVEP-BCI control condition using a driving simulator. In the obstacle avoidance driving test, where participants needed to stop the car when obstacles suddenly appeared, the participants showed significantly shorter response time (1.42 ± 0.26 s) in the SSVEP-BCI control condition than in the manual control condition (1.79 ± 0.27 s). No-response rate, defined as the ratio of obstacles that the participants did not react to, was also significantly lower in the SSVEP-BCI control condition (4.6 ± 14.7%) than in the manual control condition (20.5 ± 25.2%). In the car-following driving test, where the participants were instructed to follow a preceding car that runs at a sinusoidally changing speed, the participants showed significantly lower speed difference with the preceding car in the SSVEP-BCI control condition (15.65 ± 7.04 km/h) than in the manual control condition (19.54 ± 11.51 km/h). The in-car environment control system using SSVEP-based BCI showed a possibility that might contribute to safer driving by keeping the driver's focus on the front and thereby enhancing the overall driving performance.

"Your Thoughts are (were) Free!": Brain-Computer-Interfaces, Neurofeedback, Detection of Deception, and the Future of Mind-Reading.

This review describes the historical developement and rationale of clinically relevant research on neurophysiological "mind reading" paradims: Brain- Computer-Interfaces, detection of deception, brain stimulation and neurofeedback and the clinical applications in drug resistant epilepsy, chronic stroke, and communication with paralyzed locked-in persons. The emphasis lies on completely locked-in patients with amyotrophic lateral sclerosis using non-invasive and invasive brain computer interfaces and neurofeedback to restore verbal communication with the social environment. In the second part of the article we argue that success and failure of neurophysiological "mind reading" paradigms may be explained with a motor theory of thinking and emotion in combination with learning theory. The ethical implications of brain computer interface and neurofeedback approaches, particularly for severe chronic paralysis and loss of communication diseases and decisions on hastened death and euthanasia are discussed.

Decentralising the Self - Ethical Considerations in Utilizing Decentralised Web Technology for Direct Brain Interfaces.

The rapidly advancing field of brain-computer (BCI) and brain-to-brain interfaces (BBI) is stimulating interest across various sectors including medicine, entertainment, research, and military. The developers of large-scale brain-computer networks, sometimes dubbed 'Mindplexes' or 'Cloudminds', aim to enhance cognitive functions by distributing them across expansive networks. A key technical challenge is the efficient transmission and storage of information. One proposed solution is employing blockchain technology over Web 3.0 to create decentralised cognitive entities. This paper explores the potential of a decentralised web for coordinating large brain-computer constellations, and its associated benefits, focusing in particular on the conceptual and ethical challenges this innovation may pose pertaining to (1) Identity, (2) Sovereignty (encompassing Autonomy, Authenticity, and Ownership), (3) Responsibility and Accountability, and (4) Privacy, Safety, and Security. We suggest that while a decentralised web can address some concerns and mitigate certain risks, underlying ethical issues persist. Fundamental questions about entity definition within these networks, the distinctions between individuals and collectives, and responsibility distribution within and between networks, demand further exploration.

Nine decades of electrocorticography: A comparison between epidural and subdural recordings.

In recent years, electrocorticography (ECoG) has arisen as a neural signal recording tool in the development of clinically viable neural interfaces. ECoG electrodes are generally placed below the dura mater (subdural) but can also be placed on top of the dura (epidural). In deciding which of these modalities best suits long-term implants, complications and signal quality are important considerations. Conceptually, epidural placement may present a lower risk of complications as the dura is left intact but also a lower signal quality due to the dura acting as a signal attenuator. The extent to which complications and signal quality are affected by the dura, however, has been a matter of debate. To improve our understanding of the effects of the dura on complications and signal quality, we conducted a literature review. We inventorized the effect of the dura on signal quality, decodability and longevity of acute and chronic ECoG recordings in humans and non-human primates. Also, we compared the incidence and nature of serious complications in studies that employed epidural and subdural ECoG. Overall, we found that, even though epidural recordings exhibit attenuated signal amplitude over subdural recordings, particularly for high-density grids, the decodability of epidural recorded signals does not seem to be markedly affected. Additionally, we found that the nature of serious complications was comparable between epidural and subdural recordings. These results indicate that both epidural and subdural ECoG may be suited for long-term neural signal recordings, at least for current generations of clinical and high-density ECoG grids.

Correlation between the ERD in grasp/open tasks of BCIs and hand function of stroke patients: a cross-sectional study.

BACKGROUND AND AIMS: Brain-computer interfaces (BCIs) are emerging as a promising tool for upper limb recovery after stroke, and motor tasks are an essential part of BCIs for patient training and control of rehabilitative/assistive BCIs. However, the correlation between brain activation with different levels of motor impairment and motor tasks in BCIs is still not so clear. Thus, we aim to compare the brain activation of different levels of motor impairment in performing the hand grasping and opening tasks in BCIs. METHODS: We instructed stroke patients to perform motor attempts (MA) to grasp and open the affected hand for 30 trials, respectively. During this period, they underwent EEG acquisition and BCIs accuracy recordings. They also received detailed history records and behavioral scale assessments (the Fugl-Meyer assessment of upper limb, FMA-UE). RESULTS: The FMA-UE was negatively correlated with the event-related desynchronization (ERD) of the affected hemisphere during open MA (R = - 0.423, P = 0.009) but not with grasp MA (R = - 0.058, P = 0.733). Then we divided the stroke patients into group 1 (Brunnstrom recovery stages between I to II, n = 19) and group 2 (Brunnstrom recovery stages between III to VI, n = 23). No difference during the grasping task (t = 0.091, P = 0.928), but a significant difference during the open task (t = 2.156, P = 0.037) was found between the two groups on the affected hemisphere. No significant difference was found in the unaffected hemisphere. CONCLUSIONS: The study indicated that brain activation is positively correlated with the hand function of stroke in open-hand tasks. In the grasping task, the patients in the different groups have a similar brain response, while in the open task, mildly injured patients have more brain activation in open the hand than the poor hand function patients.

Association between lesion location and sensorimotor rhythms in stroke - a systematic review with narrative synthesis.

BACKGROUND: Stroke causes alterations in the sensorimotor rhythms (SMRs) of the brain. However, little is known about the influence of lesion location on the SMRs. Understanding this relationship is relevant for the use of SMRs in assistive and rehabilitative therapies, such as Brain-Computer Interfaces (BCIs).. METHODS: We reviewed current evidence on the association between stroke lesion location and SMRs through systematically searching PubMed and Embase and generated a narrative synthesis of findings. RESULTS: We included 12 articles reporting on 161 patients. In resting-state studies, cortical and pontine damage were related to an overall decrease in alpha (∼8-12 Hz) and increase in delta (∼1-4 Hz) power. In movement paradigm studies, attenuated alpha and beta (∼15-25 Hz) event-related desynchronization (ERD) was shown in stroke patients during (attempted) paretic hand movement, compared to controls. Stronger reductions in alpha and beta ERD in the ipsilesional, compared to contralesional hemisphere, were observed for cortical lesions. Subcortical stroke was found to affect bilateral ERD and ERS, but results were highly variable. CONCLUSIONS: Findings suggest a link between stroke lesion location and SMR alterations, but heterogeneity across studies and limited lesion location descriptions precluded a meta-analysis. SIGNIFICANCE: Future research would benefit from more uniformly defined outcome measures, homogeneous methodologies, and improved lesion location reporting.

Applications of brain-computer interfaces in neurodegenerative diseases.

Brain-computer interfaces (BCIs) provide the central nervous system with channels of direct communication to the outside world, without having to go through the peripheral nervous system. Neurodegenerative diseases (NDs) are notoriously incurable and burdensome medical conditions that will result in progressive deterioration of the nervous system. The applications of BCIs in NDs have been studied for decades now through different approaches, resulting in a considerable amount of literature in all related areas. In this study, we begin by introducing BCIs and proceed by explaining the principles of BCI-based neurorehabilitation. Then, we go through four specific types of NDs, including amyotrophic lateral sclerosis, Parkinson's disease, Alzheimer's disease, and spinal muscular atrophy, and review some of the applications of BCIs in the neural rehabilitation of these diseases. We conclude with a discussion of the characteristics, challenges, and future possibilities of research in the field. Going through the uses of BCIs in NDs, we can see that approaches and strategies employed to tackle the wide range of limitations caused by NDs are numerous and diverse. Furthermore, NDs can fall under different categories based on the target area of neurodegeneration and thus require different methods of BCI-based rehabilitation. In recent years, neurotechnology companies have substantially invested in research on BCIs, focusing on commercializing BCIs and bringing BCI-based technologies from bench to bedside. This can mean the beginning of a new era for BCI-based neurorehabilitation, with an anticipated spike in interest among researchers, practitioners, engineers, and entrepreneurs alike.

Design and Validation of a Low-Cost Mobile EEG-Based Brain-Computer Interface.

Objective: We designed and validated a wireless, low-cost, easy-to-use, mobile, dry-electrode headset for scalp electroencephalography (EEG) recordings for closed-loop brain-computer (BCI) interface and internet-of-things (IoT) applications. Approach: The EEG-based BCI headset was designed from commercial off-the-shelf (COTS) components using a multi-pronged approach that balanced interoperability, cost, portability, usability, form factor, reliability, and closed-loop operation. Main Results: The adjustable headset was designed to accommodate 90% of the population. A patent-pending self-positioning dry electrode bracket allowed for vertical self-positioning while parting the user's hair to ensure contact of the electrode with the scalp. In the current prototype, five EEG electrodes were incorporated in the electrode bracket spanning the sensorimotor cortices bilaterally, and three skin sensors were included to measure eye movement and blinks. An inertial measurement unit (IMU) provides monitoring of head movements. The EEG amplifier operates with 24-bit resolution up to 500 Hz sampling frequency and can communicate with other devices using 802.11 b/g/n WiFi. It has high signal-to-noise ratio (SNR) and common-mode rejection ratio (CMRR) (121 dB and 110 dB, respectively) and low input noise. In closed-loop BCI mode, the system can operate at 40 Hz, including real-time adaptive noise cancellation and 512 MB of processor memory. It supports LabVIEW as a backend coding language and JavaScript (JS), Cascading Style Sheets (CSS), and HyperText Markup Language (HTML) as front-end coding languages and includes training and optimization of support vector machine (SVM) neural classifiers. Extensive bench testing supports the technical specifications and human-subject pilot testing of a closed-loop BCI application to support upper-limb rehabilitation and provides proof-of-concept validation for the device's use at both the clinic and at home. Significance: The usability, interoperability, portability, reliability, and programmability of the proposed wireless closed-loop BCI system provides a low-cost solution for BCI and neurorehabilitation research and IoT applications.

A Brain-Controlled Quadruped Robot: A Proof-of-Concept Demonstration.

Coupling brain-computer interfaces (BCIs) and robotic systems in the future can enable seamless personal assistant systems in everyday life, with the requests that can be performed in a discrete manner, using one's brain activity only. These types of systems might be of a particular interest for people with locked-in syndrome (LIS) or amyotrophic lateral sclerosis (ALS) because they can benefit from communicating with robotic assistants using brain sensing interfaces. In this proof-of-concept work, we explored how a wireless and wearable BCI device can control a quadruped robot-Boston Dynamics' Spot. The device measures the user's electroencephalography (EEG) and electrooculography (EOG) activity of the user from the electrodes embedded in the glasses' frame. The user responds to a series of questions with YES/NO answers by performing a brain-teaser activity of mental calculus. Each question-answer pair has a pre-configured set of actions for Spot. For instance, Spot was prompted to walk across a room, pick up an object, and retrieve it for the user (i.e., bring a bottle of water) when a sequence resolved to a YES response. Our system achieved at a success rate of 83.4%. To the best of our knowledge, this is the first integration of wireless, non-visual-based BCI systems with Spot in the context of personal assistant use cases. While this BCI quadruped robot system is an early prototype, future iterations may embody friendly and intuitive cues similar to regular service dogs. As such, this project aims to pave a path towards future developments in modern day personal assistant robots powered by wireless and wearable BCI systems in everyday living conditions.

Human Recognition Using Deep Neural Networks and Spatial Patterns of SSVEP Signals.

Brain biometrics have received increasing attention from the scientific community due to their unique properties compared to traditional biometric methods. Many studies have shown that EEG features are distinct across individuals. In this study, we propose a novel approach by considering spatial patterns of the brain's responses due to visual stimulation at specific frequencies. More specifically, we propose, for the identification of the individuals, to combine common spatial patterns with specialized deep-learning neural networks. The adoption of common spatial patterns gives us the ability to design personalized spatial filters. In addition, with the help of deep neural networks, the spatial patterns are mapped into new (deep) representations where the discrimination between individuals is performed with a high correct recognition rate. We conducted a comprehensive comparison between the performance of the proposed method and several classical methods on two steady-state visual evoked potential datasets consisting of thirty-five and eleven subjects, respectively. Furthermore, our analysis includes a large number of flickering frequencies in the steady-state visual evoked potential experiment. Experiments on these two steady-state visual evoked potential datasets showed the usefulness of our approach in terms of person identification and usability. The proposed method achieved an averaged correct recognition rate of 99% over a large number of frequencies for the visual stimulus.

A Sparse Representation Classification Scheme for the Recognition of Affective and Cognitive Brain Processes in Neuromarketing.

In this work, we propose a novel framework to recognize the cognitive and affective processes of the brain during neuromarketing-based stimuli using EEG signals. The most crucial component of our approach is the proposed classification algorithm that is based on a sparse representation classification scheme. The basic assumption of our approach is that EEG features from a cognitive or affective process lie on a linear subspace. Hence, a test brain signal can be represented as a linear (or weighted) combination of brain signals from all classes in the training set. The class membership of the brain signals is determined by adopting the Sparse Bayesian Framework with graph-based priors over the weights of linear combination. Furthermore, the classification rule is constructed by using the residuals of linear combination. The experiments on a publicly available neuromarketing EEG dataset demonstrate the usefulness of our approach. For the two classification tasks offered by the employed dataset, namely affective state recognition and cognitive state recognition, the proposed classification scheme manages to achieve a higher classification accuracy compared to the baseline and state-of-the art methods (more than 8% improvement in classification accuracy).