Comparison of recognition methods for an asynchronous (un-cued) BCI system: an investigation with 40-class SSVEP dataset.

Steady-state visual evoked potential (SSVEP)-based brain-computer Interface (BCI) has demonstrated the potential to manage multi-command targets to achieve high-speed communication. Recent studies on multi-class SSVEP-based BCI have focused on synchronous systems, which rely on predefined time and task indicators; thus, these systems that use passive approaches may be less suitable for practical applications. Asynchronous systems recognize the user's intention (whether or not the user is willing to use systems) from brain activity; then, after recognizing the user's willingness, they begin to operate by switching swiftly for real-time control. Consequently, various methodologies have been proposed to capture the user's intention. However, in-depth investigation of recognition methods in asynchronous BCI system is lacking. Thus, in this work, three recognition methods (power spectral density analysis, canonical correlation analysis (CCA), and support vector machine (SVM)) used widely in asynchronous SSVEP BCI systems were explored to compare their performance. Further, we categorized asynchronous systems into two approaches (1-stage and 2-stage) based upon the recognition process's design, and compared their performance. To do so, a 40-class SSVEP dataset collected from 40 subjects was introduced. Finally, we found that the CCA-based method in the 2-stage approach demonstrated statistically significantly higher performance with a sensitivity of 97.62 ± 02.06%, specificity of 76.50 ± 23.50%, and accuracy of 75.59 ± 10.09%. Thus, it is expected that the 2-stage approach together with CCA-based recognition and FB-CCA classification have good potential to be implemented in practical asynchronous SSVEP BCI systems.

Signal alignment for cross-datasets in P300 brain-computer interfaces.

Objective.Transfer learning has become an important issue in the brain-computer interface (BCI) field, and studies on subject-to-subject transfer within the same dataset have been performed. However, few studies have been performed on dataset-to-dataset transfer, including paradigm-to-paradigm transfer. In this study, we propose a signal alignment (SA) for P300 event-related potential (ERP) signals that is intuitive, simple, computationally less expensive, and can be used for cross-dataset transfer learning.Approach.We proposed a linear SA that uses the P300's latency, amplitude scale, and reverse factor to transform signals. For evaluation, four datasets were introduced (two from conventional P300 Speller BCIs, one from a P300 Speller with face stimuli, and the last from a standard auditory oddball paradigm).Results.Although the standard approach without SA had an average precision (AP) score of 25.5%, the approach demonstrated a 35.8% AP score, and we observed that the number of subjects showing improvement was 36.0% on average. Particularly, we confirmed that the Speller dataset with face stimuli was more comparable with other datasets.Significance.We proposed a simple and intuitive way to align ERP signals that uses the characteristics of ERP signals. The results demonstrated the feasibility of cross-dataset transfer learning even between datasets with different paradigms.

Effect of Dynamic Binaural Beats on Sleep Quality: A Proof-of-Concept Study with Questionnaire and Biosignals.

Binaural beat (BB) has been investigated as a potential modality to enhance sleep quality. In this study, we introduce a new form of BB, referred to as dynamic BB (DBB), which incorporates dynamically changing carrier frequency differences between the left and right ears. Specifically, the carrier frequency of the right ear varied between 100 and 103 Hz over a period, while the left ear remained fixed at 100 Hz, yielding a frequency difference range of 0 to 3 Hz. The objective of this study was to examine the effect of DBB on sleep quality. Ten healthy participants were included in a cross-over design, where they experienced both DBB and a SHAM (absence of sound) condition across two consecutive nights, with polysomnography evaluation. DBB was administrated during pre-sleep initiation, sleep onset, and transition from rapid-eye-movement (REM) to non-REM stage. DBB significantly reduced sleep latency compared to the SHAM condition. Electrocardiogram analysis revealed that exposure to DBB led to diminished heart rate variability during the pre-sleep initiation and sleep onset periods, accompanied by a decrease in low frequency power of heart rate during the sleep onset period. DBB might be effective in improving the sleep quality, suggesting its possible application in insomnia treatments.

Copper Alloy Design for Preventing Sulfur-Induced Embrittlement in Copper.

This study presents an experimental approach to address sulfur-induced embrittlement in copper alloys. Building on recent theoretical insights, we identified specific solute elements, such as silicon and silver, known for their strong binding affinity with vacancies. Through experimental validation, we demonstrated the effectiveness of Si and Ag in preventing sulfur-induced embrittlement in copper, even though they are not typical sulfide formers such as zirconium. Additionally, our findings highlight the advantages of these elements over traditional solutes, such as their high solubility and propensity to accumulate along grain boundaries. This approach may have the potential to be applied to other metals prone to sulfur-induced embrittlement, including nickel, iron, and cobalt, offering broader implications for materials engineering strategies and alloy development.

Corrigendum: Review of public motor imagery and execution datasets in brain-computer interfaces.

[This corrects the article DOI: 10.3389/fnhum.2023.1134869.].

Can vibrotactile stimulation and tDCS help inefficient BCI users?

Brain-computer interface (BCI) has helped people by allowing them to control a computer or machine through brain activity without actual body movement. Despite this advantage, BCI cannot be used widely because some people cannot achieve controllable performance. To solve this problem, researchers have proposed stimulation methods to modulate relevant brain activity to improve BCI performance. However, multiple studies have reported mixed results following stimulation, and the comparative study of different stimulation modalities has been overlooked. Accordingly, this study was designed to compare vibrotactile stimulation and transcranial direct current stimulation's (tDCS) effects on brain activity modulation and motor imagery BCI performance among inefficient BCI users. We recruited 44 subjects and divided them into sham, vibrotactile stimulation, and tDCS groups, and low performers were selected from each stimulation group. We found that the latter's BCI performance in the vibrotactile stimulation group increased significantly by 9.13% (p < 0.01), and while the tDCS group subjects' performance increased by 5.13%, it was not significant. In contrast, sham group subjects showed no increased performance. In addition to BCI performance, pre-stimulus alpha band power and the phase locking values (PLVs) averaged over sensory motor areas showed significant increases in low performers following stimulation in the vibrotactile stimulation and tDCS groups, while sham stimulation group subjects and high performers showed no significant stimulation effects across all groups. Our findings suggest that stimulation effects may differ depending upon BCI efficiency, and inefficient BCI users have greater plasticity than efficient BCI users.

Review of public motor imagery and execution datasets in brain-computer interfaces.

The demand for public datasets has increased as data-driven methodologies have been introduced in the field of brain-computer interfaces (BCIs). Indeed, many BCI datasets are available in various platforms or repositories on the web, and the studies that have employed these datasets appear to be increasing. Motor imagery is one of the significant control paradigms in the BCI field, and many datasets related to motor tasks are open to the public already. However, to the best of our knowledge, these studies have yet to investigate and evaluate the datasets, although data quality is essential for reliable results and the design of subject- or system-independent BCIs. In this study, we conducted a thorough investigation of motor imagery/execution EEG datasets recorded from healthy participants published over the past 13 years. The 25 datasets were collected from six repositories and subjected to a meta-analysis. In particular, we reviewed the specifications of the recording settings and experimental design, and evaluated the data quality measured by classification accuracy from standard algorithms such as Common Spatial Pattern (CSP) and Linear Discriminant Analysis (LDA) for comparison and compatibility across the datasets. As a result, we found that various stimulation types, such as text, figure, or arrow, were used to instruct subjects what to imagine and the length of each trial also differed, ranging from 2.5 to 29 s with a mean of 9.8 s. Typically, each trial consisted of multiple sections: pre-rest (2.38 s), imagination ready (1.64 s), imagination (4.26 s, ranging from 1 to 10 s), the post-rest (3.38 s). In a meta-analysis of the total of 861 sessions from all datasets, the mean classification accuracy of the two-class (left-hand vs. right-hand motor imagery) problem was 66.53%, and the population of the BCI poor performers, those who are unable to reach proficiency in using a BCI system, was 36.27% according to the estimated accuracy distribution. Further, we analyzed the CSP features and found that each dataset forms a cluster, and some datasets overlap in the feature space, indicating a greater similarity among them. Finally, we checked the minimal essential information (continuous signals, event type/latency, and channel information) that should be included in the datasets for convenient use, and found that only 71% of the datasets met those criteria. Our attempts to evaluate and compare the public datasets are timely, and these results will contribute to understanding the dataset's quality and recording settings as well as the use of using public datasets for future work on BCIs.

Quantification of Movement Error from Spiral Drawing Test.

Parkinson's disease is a neurodegenerative disease that often comes with symptoms such as muscle stiffness, slowness of movement, and tremors at rest. Since this disease negatively influences the quality of life in patients, an early and accurate diagnosis is important for slowing the progression of the disease and providing effective treatment to patients. One of the quick and easy methods for diagnosing is the spiral drawing test and the differences between the target spiral picture and the drawing by patients can be used as an indicator of movement error. Simply, the average distance between paired samples of the target spiral and the drawing can be easily calculated and used as the level of movement error. However, finding the correct pair of samples between the target spiral and the drawing is relatively difficult, and the accurate algorithm to quantify the movement error has not been thoroughly studied. In this study, we propose algorithms applicable to the spiral drawing test, that ultimately can be used to measure the level of movement error in Parkinson's disease patients. They are equivalent inter-point distance (ED), shortest distance (SD), varying inter-point distance (VD), and equivalent angle (EA). To evaluate the performance and sensitivity of the methods, we collected data from simulation and experiments with healthy subjects and evaluated the four methods. As a result, in normal (good drawing) and severe symptom (poor drawing) conditions, the calculated errors were 3.67/5.48 from ED, 0.11/1.21 from SD, 0.38/1.46 from VD and 0.01/0.02 from EA, meaning that ED, SD, and VD measure movement error with high noise while EA is sensitive to even small symptom levels. Similarly, in the experiment data, only EA shows the linear increase of error distance to changing symptom levels from 1 to 3. In summary, we found that EA is the most effective algorithm in finding the correct pair of samples between the spiral and the drawing, and consequently yields low errors and high sensitivity to symptom levels.

EEG Dataset for RSVP and P300 Speller Brain-Computer Interfaces.

As attention to deep learning techniques has grown, many researchers have attempted to develop ready-to-go brain-computer interfaces (BCIs) that include automatic processing pipelines. However, to do so, a large and clear dataset is essential to increase the model's reliability and performance. Accordingly, our electroencephalogram (EEG) dataset for rapid serial visual representation (RSVP) and P300 speller may contribute to increasing such BCI research. We validated our dataset with respect to features and accuracy. For the RSVP, the participants (N = 50) achieved about 92% mean target detection accuracy. At the feature level, we observed notable ERPs (at 315 ms in the RSVP; at 262 ms in the P300 speller) during target events compared to non-target events. Regarding P300 speller performance, the participants (N = 55) achieved about 92% mean accuracy. In addition, P300 speller performance over trial repetitions up to 15 was explored. The presented dataset could potentially improve P300 speller applications. Further, it may be used to evaluate feature extraction and classification algorithm effectively, such as for cross-subjects/cross-datasets, and even for the cross-paradigm BCI model.

P300 Brain-Computer Interface-Based Drone Control in Virtual and Augmented Reality.

Since the emergence of head-mounted displays (HMDs), researchers have attempted to introduce virtual and augmented reality (VR, AR) in brain-computer interface (BCI) studies. However, there is a lack of studies that incorporate both AR and VR to compare the performance in the two environments. Therefore, it is necessary to develop a BCI application that can be used in both VR and AR to allow BCI performance to be compared in the two environments. In this study, we developed an opensource-based drone control application using P300-based BCI, which can be used in both VR and AR. Twenty healthy subjects participated in the experiment with this application. They were asked to control the drone in two environments and filled out questionnaires before and after the experiment. We found no significant (p > 0.05) difference in online performance (classification accuracy and amplitude/latency of P300 component) and user experience (satisfaction about time length, program, environment, interest, difficulty, immersion, and feeling of self-control) between VR and AR. This indicates that the P300 BCI paradigm is relatively reliable and may work well in various situations.

An Open Source-Based BCI Application for Virtual World Tour and Its Usability Evaluation.

Brain-computer interfaces can provide a new communication channel and control functions to people with restricted movements. Recent studies have indicated the effectiveness of brain-computer interface (BCI) applications. Various types of applications have been introduced so far in this field, but the number of those available to the public is still insufficient. Thus, there is a need to expand the usability and accessibility of BCI applications. In this study, we introduce a BCI application for users to experience a virtual world tour. This software was built on three open-source environments and is publicly available through the GitHub repository. For a usability test, 10 healthy subjects participated in an electroencephalography (EEG) experiment and evaluated the system through a questionnaire. As a result, all the participants successfully played the BCI application with 96.6% accuracy with 20 blinks from two sessions and gave opinions on its usability (e.g., controllability, completeness, comfort, and enjoyment) through the questionnaire. We believe that this open-source BCI world tour system can be used in both research and entertainment settings and hopefully contribute to open science in the BCI field.

Selective Subject Pooling Strategy to Improve Model Generalization for a Motor Imagery BCI.

Brain-computer interfaces (BCIs) facilitate communication for people who cannot move their own body. A BCI system requires a lengthy calibration phase to produce a reasonable classifier. To reduce the duration of the calibration phase, it is natural to attempt to create a subject-independent classifier with all subject datasets that are available; however, electroencephalogram (EEG) data have notable inter-subject variability. Thus, it is very challenging to achieve subject-independent BCI performance comparable to subject-specific BCI performance. In this study, we investigate the potential for achieving better subject-independent motor imagery BCI performance by conducting comparative performance tests with several selective subject pooling strategies (i.e., choosing subjects who yield reasonable performance selectively and using them for training) rather than using all subjects available. We observed that the selective subject pooling strategy worked reasonably well with public MI BCI datasets. Finally, based upon the findings, criteria to select subjects for subject-independent BCIs are proposed here.

Alpha and high gamma phase amplitude coupling during motor imagery and weighted cross-frequency coupling to extract discriminative cross-frequency patterns.

Motor imagery modulates specific neural oscillations like actual movement does. Representatively, suppression of the alpha power (e.g., event-related desynchronization [ERD]) is the typical pattern of motor imagery in the motor cortex. However, in addition to this amplitude-based feature, the coupling across frequencies includes important information about the brain functions and the existence of such complex information has been reported in various invasive studies. Yet, the interaction across multiple frequencies during motor imagery processing is still unclear and has not been widely studied, particularly concerning the non-invasive signals. In this study, we provide empirical evidence of the comodulation between the phase of alpha rhythm and the amplitude of high gamma rhythm during the motor imagery process. We used electroencephalography (EEG) in our investigation during the imagination of left- or right-hand movement recorded from 52 healthy subjects, and quantified the ERD of alpha and phase-amplitude coupling (PAC) which is a relative change of modulation index to the base line period (before the cue). As a result, we found that the coupling between the phase of alpha (8-12 Hz) and the amplitude of high gamma (70-120 Hz) and this PAC decreases during motor imagery and then rebounds to the baseline like alpha ERD (r = 0.29 to 0.42). This correlation between PAC and ERD was particularly stronger in the ipsilateral area. In addition, trials that demonstrated higher alpha power during the ready period (before the cue) showed a larger ERD during motor imagery and similarly, trials with higher modulation index during the ready period yielded a greater decrease in PAC during imagery. In the classification analysis, we found that the effective phase frequency that showed better decoding accuracy in left and right-hand imagery, varied across subjects. Motivated by result, we proposed a weighted cross-frequency coupling (WCFC) method that extracts the maximal discriminative feature by combining band power and CFC. In the evaluation, WCFC with only two electrodes yielded a performance comparable to the conventional algorithm with 64 electrodes in classifying left and right-hand motor imagery. These results indicate that the phase-amplitude frequency plays an important role in motor imagery, and that optimizing this frequency ranges is crucial for extracting information features to decode the motor imagery types.

Diagnostic Classification and Biomarker Identification of Alzheimer's Disease with Random Forest Algorithm.

Random Forest (RF) is a bagging ensemble model and has many important advantages, such as robustness to noise, an effective structure for complex multimodal data and parallel computing, and also provides important features that help investigate biomarkers. Despite these benefits, RF is not used actively to predict Alzheimer's disease (AD) with brain MRIs. Recent studies have reported RF's effectiveness in predicting AD, but the test sample sizes were too small to draw any solid conclusions. Thus, it is timely to compare RF with other learning model methods, including deep learning, particularly with large amounts of data. In this study, we tested RF and various machine learning models with regional volumes from 2250 brain MRIs: 687 normal controls (NC), 1094 mild cognitive impairment (MCI), and 469 AD that ADNI (Alzheimer's Disease Neuroimaging Initiative database) provided. Three types of features sets (63, 29, and 22 features) were selected, and classification accuracies were computed with RF, Support vector machine (SVM), Multi-layer perceptron (MLP), and Convolutional neural network (CNN). As a result, RF, MLP, and CNN showed high performances of 90.2%, 89.6%, and 90.5% with 63 features. Interestingly, when 22 features were used, RF showed the smallest decrease in accuracy, -3.8%, and the standard deviation did not change significantly, while MLP and CNN yielded decreases in accuracy of -6.8% and -4.5% with changes in the standard deviation from 3.3% to 4.0% for MLP and 2.1% to 7.0% for CNN, indicating that RF predicts AD more reliably with fewer features. In addition, we investigated the importance of the features that RF provides, and identified the hippocampus, amygdala, and inferior lateral ventricle as the major contributors in classifying NC, MCI, and AD. On average, AD showed smaller hippocampus and amygdala volumes and a larger volume of inferior lateral ventricle than those of MCI and NC.

Rapid motor fluctuations reveal short-timescale neurophysiological biomarkers of Parkinson's disease.

OBJECTIVE: Identifying neural activity biomarkers of brain disease is essential to provide objective estimates of disease burden, obtain reliable feedback regarding therapeutic efficacy, and potentially to serve as a source of control for closed-loop neuromodulation. In Parkinson's disease (PD), microelectrode recordings (MER) are routinely performed in the basal ganglia to guide electrode implantation for deep brain stimulation (DBS). While pathologically-excessive oscillatory activity has been observed and linked to PD motor dysfunction broadly, the extent to which these signals provide quantitative information about disease expression and fluctuations, particularly at short timescales, is unknown. Furthermore, the degree to which informative signal features are similar or different across patients has not been rigorously investigated. We sought to determine the extent to which motor error in PD across patients can be decoded on a rapid timescale using spectral features of neural activity. APPROACH: Here, we recorded neural activity from the subthalamic nucleus (STN) of subjects with PD undergoing awake DBS surgery while they performed an objective, continuous behavioral assessment that synthesized heterogenous PD motor manifestations to generate a scalar measure of motor dysfunction at short timescales. We then leveraged natural motor performance variations as a 'ground truth' to identify corresponding neurophysiological biomarkers. MAIN RESULTS: Support vector machines using multi-spectral decoding of neural signals from the STN succeeded in tracking the degree of motor impairment at short timescales (as short as one second). Spectral power across a wide range of frequencies, beyond the classic 'ß' oscillations, contributed to this decoding, and multi-spectral models consistently outperformed those generated using more isolated frequency bands. While generalized decoding models derived across subjects were able to estimate motor impairment, patient-specific models typically performed better. SIGNIFICANCE: These results demonstrate that quantitative information about short-timescale PD motor dysfunction is available in STN neural activity, distributed across various patient-specific spectral components, such that an individualized approach will be critical to fully harness this information for optimal disease tracking and closed-loop neuromodulation.

P300 Speller Performance Predictor Based on RSVP Multi-feature.

Brain-computer interface (BCI) systems were developed so that people can control computers or machines through their brain activity without moving their limbs. The P300 speller is one of the BCI applications used most commonly, as is very simple and reliable and can achieve satisfactory performance. However, like other BCIs, the P300 speller still has room for improvements in terms of its practical use, for example, selecting the best compromise between spelling accuracy and information transfer rate (ITR; speed) so that the P300 speller can maintain high accuracy while increasing spelling speed. Therefore, seeking correlates of, and predicting, the P300 speller's performance is necessary to understand and improve the technique. In this work, we investigated the correlations between rapid serial visual presentation (RSVP) task features and the P300 speller's performance. Fifty-five subjects participated in the RSVP and conventional matrix P300 speller tasks and RSVP behavioral and electroencephalography (EEG) features were compared in the P300's speller performance. We found that several of the RSVP's event-related potential (ERP) and behavioral features were correlated with the P300 speller's offline binary classification accuracy. Using these features, we propose a simple multi-feature performance predictor (r = 0.53, p = 0.0001) that outperforms any single feature performance predictor, including that of the conventional RSVP T1% predictor (r = 0.28, p = 0.06). This result demonstrates that selective multi-features can predict BCI performance better than a single feature alone.

A low-cost solution for quantification of movement during DBS surgery.

BACKGROUND: During the deep brain stimulation (DBS) electrode implantation operation with microelectrode recordings (MER) in awake patients, somatotopic testing and test stimulation are performed to improve electrode placement and provide the most beneficial symptom reduction possible, while minimizing side effects. As this procedure is commonly used to alleviate abnormal movements associated with Parkinson's disease (PD) and Essential Tremor (ET), intraoperative assessment of a patient's movements is critical to optimizing surgical benefit. However, despite its importance, movement assessment is typically subjective and qualitative. NEW METHOD: Here, we present a detailed description of a low-cost, open-source system as a solution. RESULTS: The described system measures movements intraoperatively and in synchrony with neurophysiological recordings for both online visualization and offline analysis. COMPARISON WITH EXISTING METHOD(S): Few movement quantification systems are designed to interface with intraoperative neurophysiological recordings; the widespread application of such systems may be limited by their cost and proprietary, closed-source nature. The system presented provides a low-cost, open-source alternative. CONCLUSIONS: The system outlined in this work may improve the DBS procedure by adding valuable objectivity in movement quantification.

User's Self-Prediction of Performance in Motor Imagery Brain-Computer Interface.

Performance variation is a critical issue in motor imagery brain-computer interface (MI-BCI), and various neurophysiological, psychological, and anatomical correlates have been reported in the literature. Although the main aim of such studies is to predict MI-BCI performance for the prescreening of poor performers, studies which focus on the user's sense of the motor imagery process and directly estimate MI-BCI performance through the user's self-prediction are lacking. In this study, we first test each user's self-prediction idea regarding motor imagery experimental datasets. Fifty-two subjects participated in a classical, two-class motor imagery experiment and were asked to evaluate their easiness with motor imagery and to predict their own MI-BCI performance. During the motor imagery experiment, an electroencephalogram (EEG) was recorded; however, no feedback on motor imagery was given to subjects. From EEG recordings, the offline classification accuracy was estimated and compared with several questionnaire scores of subjects, as well as with each subject's self-prediction of MI-BCI performance. The subjects' performance predictions during motor imagery task showed a high positive correlation (r = 0.64, p < 0.01). Interestingly, it was observed that the self-prediction became more accurate as the subjects conducted more motor imagery tasks in the Correlation coefficient (pre-task to 2nd run: r = 0.02 to r = 0.54, p < 0.01) and root mean square error (pre-task to 3rd run: 17.7% to 10%, p < 0.01). We demonstrated that subjects may accurately predict their MI-BCI performance even without feedback information. This implies that the human brain is an active learning system and, by self-experiencing the endogenous motor imagery process, it can sense and adopt the quality of the process. Thus, it is believed that users may be able to predict MI-BCI performance and results may contribute to a better understanding of low performance and advancing BCI.