Multimodal fusion for anticipating human decision performance.

Anticipating human decisions while performing complex tasks remains a formidable challenge. This study proposes a multimodal machine-learning approach that leverages image features and electroencephalography (EEG) data to predict human response correctness in a demanding visual searching task. Notably, we extract a novel set of image features pertaining to object relationships using the Segment Anything Model (SAM), which enhances prediction accuracy compared to traditional features. Additionally, our approach effectively utilizes a combination of EEG signals and image features to streamline the feature set required for the Random Forest Classifier (RFC) while maintaining high accuracy. The findings of this research hold substantial potential for developing advanced fault alert systems, particularly in critical decision-making environments such as the medical and defence sectors.

A user-friendly visual brain-computer interface based on high-frequency steady-state visual evoked fields recorded by OPM-MEG.

Objective. Magnetoencephalography (MEG) shares a comparable time resolution with electroencephalography. However, MEG excels in spatial resolution, enabling it to capture even the subtlest and weakest brain signals for brain-computer interfaces (BCIs). Leveraging MEG's capabilities, specifically with optically pumped magnetometers (OPM-MEG), proves to be a promising avenue for advancing MEG-BCIs, owing to its exceptional sensitivity and portability. This study harnesses the power of high-frequency steady-state visual evoked fields (SSVEFs) to build an MEG-BCI system that is flickering-imperceptible, user-friendly, and highly accurate.Approach.We have constructed a nine-command BCI that operates on high-frequency SSVEF (58-62 Hz with a 0.5 Hz interval) stimulation. We achieved this by placing the light source inside and outside the magnetic shielding room, ensuring compliance with non-magnetic and visual stimulus presentation requirements. Five participants took part in offline experiments, during which we collected six-channel multi-dimensional MEG signals along both the vertical (Z-axis) and tangential (Y-axis) components. Our approach leveraged the ensemble task-related component analysis algorithm for SSVEF identification and system performance evaluation.Main Results.The offline average accuracy of our proposed system reached an impressive 92.98% when considering multi-dimensional conjoint analysis using data from both theZandYaxes. Our method achieved a theoretical average information transfer rate (ITR) of 58.36 bits min-1with a data length of 0.7 s, and the highest individual ITR reached an impressive 63.75 bits min-1.Significance.This study marks the first exploration of high-frequency SSVEF-BCI based on OPM-MEG. These results underscore the potential and feasibility of MEG in detecting subtle brain signals, offering both theoretical insights and practical value in advancing the development and application of MEG in BCI systems.

Extracting Stress-Related EEG Patterns From Pre-Sleep EEG for Forecasting Slow-Wave Sleep Deficiency.

Sleep is vital to our daily activity. Lack of proper sleep can impair functionality and overall health. While stress is known for its detrimental impact on sleep quality, the precise effect of pre-sleep stress on subsequent sleep structure remains unknown. This study introduced a novel approach to study the pre-sleep stress effect on sleep structure, specifically slow-wave sleep (SWS) deficiency. To achieve this, we selected forehead resting EEG immediately before and upon sleep onset to extract stress-related neurological markers through power spectra and entropy analysis. These markers include beta/delta correlation, alpha asymmetry, fuzzy entropy (FuzzEn) and spectral entropy (SpEn). Fifteen subjects were included in this study. Our results showed that subjects lacking SWS often exhibited signs of stress in EEG, such as an increased beta/delta correlation, higher alpha asymmetry, and increased FuzzEn in frontal EEG. Conversely, individuals with ample SWS displayed a weak beta/delta correlation and reduced FuzzEn. Finally, we employed several supervised learning models and found that the selected neurological markers can predict subsequent SWS deficiency. Our investigation demonstrated that the classifiers could effectively predict varying levels of slow-wave sleep (SWS) from pre-sleep EEG segments, achieving a mean balanced accuracy surpassing 0.75. The SMOTE-Tomek resampling method could improve the performance to 0.77. This study suggests that stress-related neurological markers derived from pre-sleep EEG can effectively predict SWS deficiency. Such information can be integrated with existing sleep-improving techniques to provide a personalized sleep forecasting and improvement solution.

Activation network improves spatiotemporal modelling of human brain communication processes.

Dynamic functional networks (DFN) have considerably advanced modelling of the brain communication processes. The prevailing implementation capitalizes on the system and network-level correlations between time series. However, this approach does not account for the continuous impact of non-dynamic dependencies within the statistical correlation, resulting in relatively stable connectivity patterns of DFN over time with limited sensitivity for communication dynamic between brain regions. Here, we propose an activation network framework based on the activity of functional connectivity (AFC) to extract new types of connectivity patterns during brain communication process. The AFC captures potential time-specific fluctuations associated with the brain communication processes by eliminating the non-dynamic dependency of the statistical correlation. In a simulation study, the positive correlation (r=0.966,p<0.001) between the extracted dynamic dependencies and the simulated "ground truth" validates the method's dynamic detection capability. Applying to autism spectrum disorders (ASD) and COVID-19 datasets, the proposed activation network extracts richer topological reorganization information, which is largely invisible to the DFN. Detailed, the activation network exhibits significant inter-regional connections between function-specific subnetworks and reconfigures more efficiently in the temporal dimension. Furthermore, the DFN fails to distinguish between patients and healthy controls. However, the proposed method reveals a significant decrease (p<0.05) in brain information processing abilities in patients. Finally, combining two types of networks successfully classifies ASD (83.636 % ± 11.969 %,mean±std) and COVID-19 (67.333 % ± 5.398 %). These findings suggest the proposed method could be a potential analytic framework for elucidating the neural mechanism of brain dynamics.

Almost free of calibration for SSVEP-based brain-computer interfaces.

Objective. Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) is a promising technology that can achieve high information transfer rate (ITR) with supervised algorithms such as ensemble task-related component analysis (eTRCA) and task-discriminant component analysis (TDCA). However, training individual models requires a tedious and time-consuming calibration process, which hinders the real-life use of SSVEP-BCIs. A recent data augmentation method, called source aliasing matrix estimation (SAME), can generate new EEG samples from a few calibration trials. But SAME does not exploit the information across stimuli as well as only reduces the number of calibration trials per command, so it still has some limitations.Approach. This study proposes an extended version of SAME, called multi-stimulus SAME (msSAME), which exploits the similarity of the aliasing matrix across frequencies to enhance the performance of SSVEP-BCI with insufficient calibration trials. We also propose a semi-supervised approach based on msSAME that can further reduce the number of SSVEP frequencies needed for calibration. We evaluate our method on two public datasets, Benchmark and BETA, and an online experiment.Main results. The results show that msSAME outperforms SAME for both eTRCA and TDCA on the public datasets. Moreover, the semi-supervised msSAME-based method achieves comparable performance to the fully calibrated methods and outperforms the conventional free-calibrated methods. Remarkably, our method only needs 24 s to calibrate 40 targets in the online experiment and achieves an average ITR of 213.8 bits min-1with a peak of 242.6 bits min-1.Significance. This study significantly reduces the calibration effort for individual SSVEP-BCIs, which is beneficial for developing practical plug-and-play SSVEP-BCIs.

Cross-dataset transfer learning for motor imagery signal classification via multi-task learning and pre-training.

Objective.Deep learning (DL) models have been proven to be effective in decoding motor imagery (MI) signals in Electroencephalogram (EEG) data. However, DL models' success relies heavily on large amounts of training data, whereas EEG data collection is laborious and time-consuming. Recently, cross-dataset transfer learning has emerged as a promising approach to meet the data requirements of DL models. Nevertheless, transferring knowledge across datasets involving different MI tasks remains a significant challenge in cross-dataset transfer learning, limiting the full utilization of valuable data resources. APPROACH: This study proposes a pre-training-based cross-dataset transfer learning method inspired by Hard Parameter Sharing in multi-task learning. Different datasets with distinct MI paradigms are considered as different tasks, classified with shared feature extraction layers and individual task-specific layers to allow cross-dataset classification with one unified model. Then, Pre-training and fine-tuning are employed to transfer knowledge across datasets. We also designed four fine-tuning schemes and conducted extensive experiments on them. MAIN RESULTS: The results showed that compared to models without pre-training, models with pre-training achieved a maximum increase in accuracy of 7.76%. Moreover, when limited training data were available, the pre-training method significantly improved DL model's accuracy by 27.34% at most. The experiments also revealed that pre-trained models exhibit faster convergence and remarkable robustness. The training time per subject could be reduced by up to 102.83 s, and the variance of classification accuracy decreased by 75.22% at best. SIGNIFICANCE: This study represents the first comprehensive investigation of the cross-dataset transfer learning method between two datasets with different MI tasks. The proposed pre-training method requires only minimal fine-tuning data when applying DL models to new MI paradigms, making MI-Brain-computer interface more practical and user-friendly.

A data expansion technique based on training and testing sample to boost the detection of SSVEPs for brain-computer interfaces.

Objective.Currently, steady-state visual evoked potentials (SSVEPs)-based brain-computer interfaces (BCIs) have achieved the highest interaction accuracy and speed among all BCI paradigms. However, its decoding efficacy depends deeply on the number of training samples, and the system performance would have a dramatic drop when the training dataset decreased to a small size. To date, no study has been reported to incorporate the unsupervised learning information from testing trails into the construction of supervised classification model, which is a potential way to mitigate the overfitting effect of limited samples.Approach.This study proposed a novel method for SSVEPs detection, i.e. cyclic shift trials (CSTs), which could combine unsupervised learning information from test trials and supervised learning information from train trials. Furthermore, since SSVEPs are time-locked and phase-locked to the onset of specific flashes, CST could also expand training samples on the basis of its regularity and periodicity. In order to verify the effectiveness of CST, we designed an online SSVEP-BCI system, and tested this system combined CST with two common classification algorithms, i.e. extended canonical correlation analysis and ensemble task-related component analysis.Main results.CST could significantly enhance the signal to noise ratios of SSVEPs and improve the performance of systems especially for the condition of few training samples and short stimulus time. The online information transfer rate could reach up to 236.19 bits min-1using 36 s calibration time of only one training sample for each category.Significance.The proposed CST method can take full advantages of supervised learning information from training samples and unsupervised learning information of testing samples. Furthermore, it is a data expansion technique, which can enhance the SSVEP characteristics and reduce dependence on sample size. Above all, CST is a promising method to improve the performance of SSVEP-based BCI without any additional experimental burden.

Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems.

Objective. The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions.Approach.To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days.Main results. Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation.Significance.Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications.

Design and Test of Spatial Cognitive Training and Evaluation System Based on Virtual Reality Head-Mounted Display With EEG Recording.

The field of spatial cognitive training and evaluation has rapidly evolved. However, the low learning motivation and engagement of the subjects hinder the widespread use of spatial cognitive training. This study designed a home-based spatial cognitive training and evaluation system (SCTES), which aimed to train subjects on spatial cognitive tasks for 20 days, and compared the brain activities before and after the training. This study also evaluated the feasibility of using a portable all-in-one prototype for cognitive training that combined a virtual reality (VR) head-mounted display with high-quality electroencephalogram (EEG) recording. During the course of training, the length of the navigation path and the distance between the starting position and the platform position revealed significant behavioral differences. In the testing sessions, the subjects showed significant behavioral differences in the time it took to complete the test task before and after training. After only four days of training, the subjects demonstrated significant differences in the Granger causality analysis (GCA) characteristics of brain regions in the δ , θ , α1 , ß2 , and γ frequency bands of the EEG, as well as significant differences in the GCA of the EEG in the ß1 , ß2 , and γ frequency bands between the two test sessions. The proposed SCTES used a compact and all-in-one form factor to train and evaluate spatial cognition and collect EEG signals and behavioral data simultaneously. The recorded EEG data can be used to quantitatively assess the efficacy of spatial training in patients with spatial cognitive impairments.

Stimulus Design for Visual Evoked Potential Based Brain-Computer Interfaces.

Visual stimuli design plays an important role in brain-computer interfaces (BCIs) based on visual evoked potentials (VEPs). Variations in stimulus parameters have been shown to affect both decoding accuracy and subjective perception experience, implying the need for a trade-off in design. In this study, we comprehensively and systematically compared various combinations of amplitude contrast and spectral content parameters in the stimulus design to quantify their impact on decoding performance and subject comfort. Specifically, three parameters were investigated: 1) contrast level, 2) temporal pattern (periodic steady-state or pseudo-random code-modulated), and 3) frequency range. We collected electroencephalogram (EEG) data and subjective perception ratings from ten subjects and evaluated the decoding accuracy and subject comfort rating for different combinations of the stimulus parameters. Our results indicate that while high-frequency steady-state VEP (SSVEP) stimuli were rated the most comfortable, they also had the lowest decoding accuracy. Conversely, low-frequency SSVEP stimuli were rated the least comfortable but had the highest decoding accuracy. Standard and high-frequency M-sequence code-modulated VEPs (c-VEPs) produced intermediates between the two. We observed a consistent trade-off relationship between decoding accuracy and subjective comfort level across all parameters. Based on our findings, we offer c-VEP as a preferable stimulus for achieving reliable decoding accuracy while maintaining a reasonable level of comfortability.

Modulation of rhythmic visual stimulation on left-right attentional asymmetry.

The rhythmic visual stimulation (RVS)-induced oscillatory brain responses, namely steady-state visual evoked potentials (SSVEPs), have been widely used as a biomarker in studies of neural processing based on the assumption that they would not affect cognition. However, recent studies have suggested that the generation of SSVEPs might be attributed to neural entrainment and thus could impact brain functions. But their neural and behavioral effects are yet to be explored. No study has reported the SSVEP influence on functional cerebral asymmetry (FCA). We propose a novel lateralized visual discrimination paradigm to test the SSVEP effects on visuospatial selective attention by FCA analyses. Thirty-eight participants covertly shifted their attention to a target triangle appearing in either the lower-left or -right visual field (LVF or RVF), and judged its orientation. Meanwhile, participants were exposed to a series of task-independent RVSs at different frequencies, including 0 (no RVS), 10, 15, and 40-Hz. As a result, it showed that target discrimination accuracy and reaction time (RT) varied significantly across RVS frequency. Furthermore, attentional asymmetries differed for the 40-Hz condition relative to the 10-Hz condition as indexed by enhanced RT bias to the right visual field, and larger Pd EEG component for attentional suppression. Our results demonstrated that RVSs had frequency-specific effects on left-right attentional asymmetries in both behavior and neural activities. These findings provided new insights into the functional role of SSVEP on FCAs.

EEG-Based Brain-Computer Interfaces are Vulnerable to Backdoor Attacks.

Research and development of electroencephalogram (EEG) based brain-computer interfaces (BCIs) have advanced rapidly, partly due to deeper understanding of the brain and wide adoption of sophisticated machine learning approaches for decoding the EEG signals. However, recent studies have shown that machine learning algorithms are vulnerable to adversarial attacks. This paper proposes to use narrow period pulse for poisoning attack of EEG-based BCIs, which makes adversarial attacks much easier to implement. One can create dangerous backdoors in the machine learning model by injecting poisoning samples into the training set. Test samples with the backdoor key will then be classified into the target class specified by the attacker. What most distinguishes our approach from previous ones is that the backdoor key does not need to be synchronized with the EEG trials, making it very easy to implement. The effectiveness and robustness of the backdoor attack approach is demonstrated, highlighting a critical security concern for EEG-based BCIs and calling for urgent attention to address it.

Using EEG signals to assess workload during memory retrieval in a real-world scenario.

Objective. The electroencephalogram (EEG) is gaining popularity as a physiological measure for neuroergonomics in human factor studies because it is objective, less prone to bias, and capable of assessing the dynamics of cognitive states. This study investigated the associations between memory workload and EEG during participants' typical office tasks on a single-monitor and dual-monitor arrangement. We expect a higher memory workload for the single-monitor arrangement.Approach. We designed an experiment that mimics the scenario of a subject performing some office work and examined whether the subjects experienced various levels of memory workload in two different office setups: (1) a single-monitor setup and (2) a dual-monitor setup. We used EEG band power, mutual information, and coherence as features to train machine learning models to classify high versus low memory workload states.Main results. The study results showed that these characteristics exhibited significant differences that were consistent across all participants. We also verified the robustness and consistency of these EEG signatures in a different data set collected during a Sternberg task in a prior study.Significance. The study found the EEG correlates of memory workload across individuals, demonstrating the effectiveness of using EEG analysis in conducting real-world neuroergonomic studies.

Data Augmentation of SSVEPs Using Source Aliasing Matrix Estimation for Brain-Computer Interfaces.

OBJECTIVE: Currently, ensemble task-related component analysis (eTRCA) and task discriminative component analysis (TDCA) are the state-of-the-art algorithms for steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). However, training the BCIs requires multiple calibration trials. With insufficient calibration data, the accuracy of the BCI will degrade, or even become invalid with only one calibration trial. However, collecting a large amount of electroencephalography (EEG) data for calibration is a time-consuming and laborious process, which hinders the practical use of eTRCA and TDCA. METHODS: This study proposed a novel method, namely Source Aliasing Matrix Estimation (SAME), to augment the calibration data for SSVEP-BCIs. SAME could generate artificial EEG trials with the featured SSVEPs. Its effectiveness was evaluated using two public datasets (i.e., Benchmark, BETA). RESULTS: When combined with SAME, both eTRCA and TDCA had significantly improved performance with a limited number of calibration data. Specifically, SAME increased the average accuracy of eTRCA and TDCA by about 12% and 3%, respectively, with as few as two calibration trials. Notably, SAME enabled eTRCA and TDCA to work well with a single calibration trial, achieving an average accuracy >90% for the Benchmark dataset and >70% for the BETA dataset with 1-second EEG. CONCLUSION: SAME is an effective method for SSVEP-BCIs to augment the calibration data, thereby significantly enhancing the performance of eTRCA and TDCA. SIGNIFICANCE: We propose a new data-augmentation method that is compatible with the state-of-the-art algorithms of SSVEP-based BCIs. It can significantly reduce the efforts required to calibrate SSVEP-BCIs, which is promising for the development of practical BCIs.

Diversity and Suitability of the State-of-the-Art Wearable and Wireless EEG Systems Review.

Wireless electroencephalography (EEG) systems have been attracting increasing attention in recent times. Both the number of articles discussing wireless EEG and their proportion relative to general EEG publications have increased over years. These trends indicate that wireless EEG systems could be more accessible to researchers and the research community has recognized the potential of wireless EEG systems. To explore the development and diverse applications of wireless EEG systems, this review highlights the trends in wearable and wireless EEG systems over the past decade and compares the specifications and research applications of the major wireless systems marketed by 16 companies. For each product, five parameters (number of channels, sampling rate, cost, battery life, and resolution) were assessed for comparison. Currently, these wearable and portable wireless EEG systems have three main application areas: consumer, clinical, and research. To address this multitude of options, the article also discussed the thought process to find a suitable device that meets personalization and use cases specificities. These investigations suggest that low-price and convenience are key factors for consumer applications, wireless EEG systems with FDA or CE-certification may be more suitable for clinical settings, and devices that provide raw EEG data with high-density channels are important for laboratory research. This article presents an overview of the current state of the wireless EEG systems specifications and possible applications and serves as a guide point as it is expected that more influential and novel research will cyclically promote the development of such EEG systems.

Enhancing Detection of Multi-Frequency-Modulated SSVEP Using Phase Difference Constrained Canonical Correlation Analysis.

OBJECTIVE: Multi-frequency-modulated visual stimulation scheme has been shown effective for the steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) recently, especially in increasing the visual target number with less stimulus frequencies and mitigating the visual fatigue. However, the existing calibration-free recognition algorithms based on the traditional canonical correlation analysis (CCA) cannot provide the merited performance. APPROACH: To improve the recognition performance, this study proposes a phase difference constrained CCA (pdCCA), which assumes that the multi-frequency-modulated SSVEPs share a common spatial filter over different frequencies and have a specified phase difference. Specifically, during the CCA computation, the phase differences of the spatially filtered SSVEPs are constrained using the temporal concatenation of the sine-cosine reference signals with the pre-defined initial phases. MAIN RESULTS: We evaluate the performance of the proposed pdCCA-based method on three representative multi-frequency-modulated visual stimulation paradigms (i.e., based on the multi-frequency sequential coding, the dual-frequency, and the amplitude modulation). The evaluation results on four SSVEP datasets (Dataset Ia, Ib, II, and III) show that the pdCCA-based method can significantly outperform the current CCA method in terms of recognition accuracy. It improves the accuracy by 22.09% in Dataset Ia, 20.86% in Dataset Ib, 8.61% in Dataset II, and 25.85% in Dataset III. SIGNIFICANCE: The pdCCA-based method, which actively controls the phase difference of the multi-frequency-modulated SSVEPs after spatial filtering, is a new calibration-free method for multi-frequency-modulated SSVEP-based BCIs.

Novel Moving Steady-State Visual Evoked Potential Stimulus to Assess Afferent and Efferent Dysfunction in Multiple Sclerosis.

Afferent and efferent visual dysfunction are prominent features of multiple sclerosis (MS). Visual outcomes have been shown to be robust biomarkers of the overall disease state. Unfortunately, precise measurement of afferent and efferent function is typically limited to tertiary care facilities, which have the equipment and analytical capacity to make these measurements, and even then, only a few centers can accurately quantify both afferent and efferent dysfunction. These measurements are currently unavailable in acute care facilities (ER, hospital floors). We aimed to develop a moving multifocal steady-state visual evoked potential (mfSSVEP) stimulus to simultaneously assess afferent and efferent dysfunction in MS for application on a mobile platform. The brain-computer interface (BCI) platform consists of a head-mounted virtual-reality headset with electroencephalogram (EEG) and electrooculogram (EOG) sensors. To evaluate the platform, we recruited consecutive patients who met the 2017 MS McDonald diagnostic criteria and healthy controls for a pilot cross-sectional study. Nine MS patients (mean age 32.7 years, SD 4.33) and ten healthy controls (24.9 years, SD 7.2) completed the research protocol. The afferent measures based on mfSSVEPs showed a significant difference between the groups (signal-to-noise ratio of mfSSVEPs for controls: 2.50 ± 0.72 vs. MS: 2.04 ± 0.47) after controlling for age (p = 0.049). In addition, the moving stimulus successfully induced smooth pursuit movement that can be measured by the EOG signals. There was a trend for worse smooth pursuit tracking in cases vs. controls, but this did not reach nominal statistical significance in this small pilot sample. This study introduces a novel moving mfSSVEP stimulus for a BCI platform to evaluate neurologic visual function. The moving stimulus showed a reliable capability to assess both afferent and efferent visual functions simultaneously.

Human Brain Dynamics and Coordination Reflect the Task Difficulty of Optical Image Relational Reasoning.

Despite advances in neuroscience, the mechanisms by which human brain resolve optical image formation through relational reasoning remain unclear, particularly its relationships with task difficulty. Therefore, this study explores the underlying brain dynamics involved in optical image formation tasks at various difficulty levels, including those with a single convex lens and a single mirror. Compared to single convex lens relational reasoning with high task difficulty, the single mirror relational reasoning exhibited significantly higher response accuracy and shorter latency. As compared to single mirror tasks, single convex tasks exhibited greater frontal midline theta augmentation and right parietal alpha suppression during phase I and earlier phase II, and augmentation of frontal midline theta, right parietal-occipital alpha, and left mu alpha suppression during late phase II. Moreover, the frontal midline theta power in late phase II predicts the likelihood of solving single convex tasks the best, while the parietal alpha power in phase I is most predictive. In addition, frontal midline theta power exhibited stronger synchronization with right parietal alpha, right occipital alpha, and mu alpha power when solving single convex tasks than single mirror tasks. In summary, having stronger brain dynamics and coordination is vital for achieving optical image formation with greater difficulty.

A high-speed hybrid brain-computer interface with more than 200 targets.

Objective. Brain-computer interfaces (BCIs) have recently made significant strides in expanding their instruction set, which has attracted wide attention from researchers. The number of targets and commands is a key indicator of how well BCIs can decode the brain's intentions. No studies have reported a BCI system with over 200 targets.Approach. This study developed the first high-speed BCI system with up to 216 targets that were encoded by a combination of electroencephalography features, including P300, motion visual evoked potential (mVEP), and steady-state visual evoked potential (SSVEP). Specifically, the hybrid BCI paradigm used the time-frequency division multiple access strategy to elaborately tag targets with P300 and mVEP of different time windows, along with SSVEP of different frequencies. The hybrid features were then decoded by task-discriminant component analysis and linear discriminant analysis. Ten subjects participated in the offline and online cued-guided spelling experiments. Other ten subjects took part in online free-spelling experiments.Main results.The offline results showed that the mVEP and P300 components were prominent in the central, parietal, and occipital regions, while the most distinct SSVEP feature was in the occipital region. The online cued-guided spelling and free-spelling results showed that the proposed BCI system achieved an average accuracy of 85.37% ± 7.49% and 86.00% ± 5.98% for the 216-target classification, resulting in an average information transfer rate (ITR) of 302.83 ± 39.20 bits min-1and 204.47 ± 37.56 bits min-1, respectively. Notably, the peak ITR could reach up to 367.83 bits min-1.Significance.This study developed the first high-speed BCI system with more than 200 targets, which holds promise for extending BCI's application scenarios.