Improving SSVEP-BCI Performance Through Repetitive Anodal tDCS-Based Neuromodulation: Insights From Fractal EEG and Brain Functional Connectivity.

This study embarks on a comprehensive investigation of the effectiveness of repetitive transcranial direct current stimulation (tDCS)-based neuromodulation in augmenting steady-state visual evoked potential (SSVEP) brain-computer interfaces (BCIs), alongside exploring pertinent electroencephalography (EEG) biomarkers for assessing brain states and evaluating tDCS efficacy. EEG data were garnered across three distinct task modes (eyes open, eyes closed, and SSVEP stimulation) and two neuromodulation patterns (sham-tDCS and anodal-tDCS). Brain arousal and brain functional connectivity were measured by extracting features of fractal EEG and information flow gain, respectively. Anodal-tDCS led to diminished offsets and enhanced information flow gains, indicating improvements in both brain arousal and brain information transmission capacity. Additionally, anodal-tDCS markedly enhanced SSVEP-BCIs performance as evidenced by increased amplitudes and accuracies, whereas sham-tDCS exhibited lesser efficacy. This study proffers invaluable insights into the application of neuromodulation methods for bolstering BCI performance, and concurrently authenticates two potent electrophysiological markers for multifaceted characterization of brain states.

A robotic arm control system with simultaneous and sequential modes combining eye-tracking with steady-state visual evoked potential in virtual reality environment.

At present, single-modal brain-computer interface (BCI) still has limitations in practical application, such as low flexibility, poor autonomy, and easy fatigue for subjects. This study developed an asynchronous robotic arm control system based on steady-state visual evoked potentials (SSVEP) and eye-tracking in virtual reality (VR) environment, including simultaneous and sequential modes. For simultaneous mode, target classification was realized by decision-level fusion of electroencephalography (EEG) and eye-gaze. The stimulus duration for each subject was non-fixed, which was determined by an adjustable window method. Subjects could autonomously control the start and stop of the system using triple blink and eye closure, respectively. For sequential mode, no calibration was conducted before operation. First, subjects' gaze area was obtained through eye-gaze, and then only few stimulus blocks began to flicker. Next, target classification was determined using EEG. Additionally, subjects could reject false triggering commands using eye closure. In this study, the system effectiveness was verified through offline experiment and online robotic-arm grasping experiment. Twenty subjects participated in offline experiment. For simultaneous mode, average ACC and ITR at the stimulus duration of 0.9 s were 90.50% and 60.02 bits/min, respectively. For sequential mode, average ACC and ITR at the stimulus duration of 1.4 s were 90.47% and 45.38 bits/min, respectively. Fifteen subjects successfully completed the online tasks of grabbing balls in both modes, and most subjects preferred the sequential mode. The proposed hybrid brain-computer interface (h-BCI) system could increase autonomy, reduce visual fatigue, meet individual needs, and improve the efficiency of the system.

ERP and Pupillometry Synchronization Analysis on Rapid Serial Visual Presentation of Words, Numbers, Pictures.

Hybrid brain-computer interfaces (HBCI) combining eye-tracker has attracted the attentions of researchers in target recognition. However, there are still many issues to be addressed in rapid sequence visual presentation (RSVP) tasks, such as the effect of presentation rates and target types on event-related potentials (ERP) and pupillometry, synchronization analysis of electroencephalography (EEG) and eye-tracking, and so on. In this study, the RSVP experiments with three different target types of pictures, words and numbers at the presentation rates of 100 and 200 ms were conducted. EEG data and pupillometry data were synchronously collected from 20 university students. The results of ERP analysis showed that, among three different target types at the presentation rate of 100 ms, the picture P300 component had the largest amplitude and the longest latency. From the 100 ms presentation rates to 200 ms one for the three target types, the P300 amplitudes became smaller, and the P300 latencies became shorter. The results of pupillometry analysis showed that, at the presentation rates of 100 and 200 ms, the pupil dilation of pictures had the smallest amplitude and the shortest latency. At the two presentation rates, no significant differences of pupil size and latency were found for the three target types. For the early pupil dilation within 1000 ms, the picture pupil size was significantly smaller than the other ones, and the picture pupil acceleration had the largest average amplitude and the shortest latency. These pupillometry features within 1000 ms combining with the P300 features could be taken as the effective ones for target classification. Through synchronization analysis of the EEG data and pupillometry data, the effects of target type and presentation rate on ERP and pupil dilation were different. These results could contribute to developing the fusion methods between EEG and eye-tracking, and provide valuable references for the multi-target recognition of hybrid BCI based on eye-tracking.

Transcranial Direct Current Stimulation-based Neuromodulation Improves the Performance of Brain-Computer Interfaces Based on Steady-State Visual Evoked Potential.

The study of brain state estimation and intervention methods is of great significance for the utility of brain-computer interfaces (BCIs). In this paper, a neuromodulation technology using transcranial direct current stimulation (tDCS) is explored to improve the performance of steady-state visual evoked potential (SSVEP)-based BCIs. The effects of pre-stimulation, sham-tDCS and anodal-tDCS are analyzed through a comparison of the EEG oscillations and fractal component characteristics. In addition, in this study, a novel brain state estimation method is introduced to assess neuromodulation-induced changes in brain arousal for SSVEP-BCIs. The results suggest that tDCS, and anodal-tDCS in particular, can be used to increase SSVEP amplitude and further improve the performance of SSVEP-BCIs. Furthermore, evidence from fractal features further validates that tDCS-based neuromodulation induces an increased level of brain state arousal. The findings of this study provide insights into the improvement of BCI performance based on personal state interventions and provide an objective method for quantitative brain state monitoring that may be used for EEG modeling of SSVEP-BCIs.

Assembling global and local spatial-temporal filters to extract discriminant information of EEG in RSVP task.

Objective.Brain-computer interface (BCI) system has developed rapidly in the past decade. And rapid serial visual presentation (RSVP) is an important BCI paradigm to detect the targets in high-speed image streams. For decoding electroencephalography (EEG) in RSVP task, the ensemble-model methods have better performance than the single-model ones.Approach.This study proposed a method based on ensemble learning to extract discriminant information of EEG. An extreme gradient boosting framework was utilized to sequentially generate the sub models, including one global spatial-temporal filter and a group of local ones. EEG was reshaped into a three-dimensional form by remapping the electrode dimension into a 2D array to learn the spatial-temporal features from real local space.Main results.A benchmark RSVP EEG dataset was utilized to evaluate the performance of the proposed method, where EEG data of 63 subjects were analyzed. Compared with several state-of-the-art methods, the spatial-temporal patterns of proposed method were more consistent with P300, and the proposed method can provide significantly better classification performance.Significance.The ensemble model in this study was end-to-end optimized, which can avoid error accumulation. The sub models optimized by gradient boosting theory can extract discriminant information complementarily and non-redundantly.

Humanoid Robot Walking in Maze Controlled by SSVEP-BCI Based on Augmented Reality Stimulus.

The application study of robot control based brain-computer interface (BCI) not only helps to promote the practicality of BCI but also helps to promote the advancement of robot technology, which is of great significance. Among the many obstacles, the importability of the stimulator brings much inconvenience to the robot control task. In this study, augmented reality (AR) technology was employed as the visual stimulator of steady-state visual evoked potential (SSVEP)-BCI and the robot walking experiment in the maze was designed to testify the applicability of the AR-BCI system. The online experiment was designed to complete the robot maze walking task and the robot walking commands were sent out by BCI system, in which human intentions were decoded by Filter Bank Canonical Correlation Analysis (FBCCA) algorithm. The results showed that all the 12 subjects could complete the robot walking task in the maze, which verified the feasibility of the AR-SSVEP-NAO system. This study provided an application demonstration for the robot control base on brain-computer interface, and further provided a new method for the future portable BCI system.

Visual field inhomogeneous in brain-computer interfaces based on rapid serial visual presentation.

Objective. Visual attention is not homogeneous across the visual field, while how to mine the effective electroencephalogram (EEG) characteristics that are sensitive to the inhomogeneous of visual attention and further explore applications such as the performance of brain-computer interface (BCI) are still distressing explorative scientists.Approach. Images were encoded into a rapid serial visual presentation (RSVP) paradigm, and were presented in three visuospatial patterns (central, left/right, upper/lower) at the stimulation frequencies of 10, 15 and 20 Hz. The comparisons among different visual fields were conducted in the dimensions of subjective behavioral and EEG characteristics. Furthermore, the effective features (e.g. steady-state visual evoked potential (SSVEP), N2-posterior-contralateral (N2pc) and P300) that sensitive to visual-field asymmetry were also explored.Main results. The visual fields had significant influences on the performance of RSVP target detection, in which the performance of central was better than that of peripheral visual field, the performance of horizontal meridian was better than that of vertical meridian, the performance of left visual field was better than that of right visual field, and the performance of upper visual field was better than that of lower visual field. Furthermore, stimuli of different visual fields had significant effects on the spatial distributions of EEG, in which N2pc and P300 showed left-right asymmetry in occipital and frontal regions, respectively. In addition, the evidences of SSVEP characteristics indicated that there was obvious overlap of visual fields on the horizontal meridian, but not on the vertical meridian.Significance. The conclusions of this study provide insights into the relationship between visual field inhomogeneous and EEG characteristics. In addition, this study has the potential to achieve precise positioning of the target's spatial orientation in RSVP-BCIs.

Modulation of brain states on fractal and oscillatory power of EEG in brain-computer interfaces.

Objective. Electroencephalogram (EEG) is an objective reflection of the brain activities, which provides potential possibilities for brain state estimation based on EEG characteristics. However, how to mine the effective EEG characteristics is still a distressing problem in brain state monitoring.Approach. The phase-scrambled method was used to generate images with different noise levels. Images were encoded into a rapid serial visual presentation paradigm. N-back working memory method was employed to induce and assess fatigue state. The irregular-resampling auto-spectral analysis method was adopted to extract and parameterize (exponent and offset) the characteristics of EEG fractal components, which were analyzed in the four dimensions: fatigue, sustained attention, visual noise and experimental tasks.Main results. The degree of fatigue and visual noise level had positive effects on exponent and offset in the prefrontal lobe, and the ability of sustained attention negatively affected exponent and offset. Compared with visual stimuli task, rest task induced even larger values of exponent and offset and statistically significant in the most cerebral cortex. In addition, the steady-state visual evoked potential amplitudes were negatively and positively affected by the degree of fatigue and noise levels, respectively.Significance. The conclusions of this study provide insights into the relationship between brain states and EEG characteristics. In addition, this study has the potential to provide objective methods for brain states monitoring and EEG modeling.

A Benchmark Dataset for RSVP-Based Brain-Computer Interfaces.

This paper reports on a benchmark dataset acquired with a brain-computer interface (BCI) system based on the rapid serial visual presentation (RSVP) paradigm. The dataset consists of 64-channel electroencephalogram (EEG) data from 64 healthy subjects (sub1,…, sub64) while they performed a target image detection task. For each subject, the data contained two groups ("A" and "B"). Each group contained two blocks, and each block included 40 trials that corresponded to 40 stimulus sequences. Each sequence contained 100 images presented at 10 Hz (10 images per second). The stimulus images were street-view images of two categories: target images with human and non-target images without human. Target images were presented randomly in the stimulus sequence with a probability of 1∼4%. During the stimulus presentation, subjects were asked to search for the target images and ignore the non-target images in a subjective manner. To keep all original information, the dataset was the raw continuous data without any processing. On one hand, the dataset can be used as a benchmark dataset to compare the algorithms for target identification in RSVP-based BCIs. On the other hand, the dataset can be used to design new system diagrams and evaluate their BCI performance without collecting any new data through offline simulation. Furthermore, the dataset also provides high-quality data for characterizing and modeling event-related potentials (ERPs) and steady-state visual evoked potentials (SSVEPs) in RSVP-based BCIs. The dataset is freely available from http://bci.med.tsinghua.edu.cn/download.html.

The Spatio-Temporal Equalization for Evoked or Event-Related Potential Detection in Multichannel EEG Data.

GOAL: Evoked or Event-Related Potential (EP/ERP) detection is a major area of interest within the domain of EEG (electroencephalography) signal processing. While traditional methods of EEG processing have mostly focused on enhancing signal components, few have explored background noise suppression techniques. Optimizing the suppression of background noise can play a critical role in improving the performance of EP/ERP detection. METHODS: In this study, a spatio-temporal equalization (STE) method was proposed based on the Multivariate Autoregressive (MVAR) model, which has been shown to suppress the spatio-temporal correlation of background noise and improve the EEG signal detection performance. RESULTS: For practical applications, two optimization schemes based on the spatio-temporal equalization method were designed to solve two common challenges in EEG signal detection: P300 and steady state visual evoked potentials. Our results demonstrated that the STE method effectively improves recognition performance of evoked or event-related potential detection. Additionally, the STE method offers fewer parameters, lower computational complexity, and easier implementation. CONCLUSION: These attributes allow the STE approach to be extended as a preprocessing method which can be used in combination with existing techniques.

Effects of stimulation frequency and stimulation waveform on steady-state visual evoked potentials using a computer monitor.

OBJECTIVE: A visual stimulator plays a vital part in brain-computer interfaces (BCIs) based on steady-state visual evoked potential (SSVEP). The properties of visual stimulation, such as frequency, color, and waveform, will influence SSVEP-based BCI performance to some extent. Recently, the computer monitor serves as a visual stimulator that is widespread in SSVEP-based BCIs because of its great flexibility in generating visual stimuli. However, stimulation properties based on a computer monitor have received very little attention. For a better comprehension of SSVEPs, this study explored the stimulation effects of waveforms and frequencies, when evoking SSVEPs through a computer monitor. APPROACH: This study utilized the approximation methods to realize sine- and square-wave temporal modulations at 18 stimulation frequencies ranging from 6 to 40 Hz on a conventional 120 Hz LCD screen. We collected electroencephalogram (EEG) datasets from 12 healthy subjects and compared the signal-to-noise ratios (SNRs), amplitudes, and topographic mapping of SSVEPs evoked by these two temporal modulation flickers (sine- and square-wave). In addition, a BCI experiment with two nine-target BCIs (i.e. low-frequency BCI and high-frequency BCI) was implemented to compare the two stimulation waveforms in terms of BCI performance. MAIN RESULTS: For both sine- and square-wave stimulation conditions, strong SSVEPs over the occipital area were observed for each stimulation frequency. SSVEP amplitudes at the stimulation frequency exhibited a global peak in the low-frequency band. The second harmonic SSVEP frequency-response functions showed the largest amplitude at 6 Hz and fell sharply for higher frequencies. In the BCI experiment, the classification performance of the square-wave stimuli was notably higher than that of the sine-wave stimuli when using shorter data lengths. SIGNIFICANCE: These results suggested that the square-wave flicker was more efficient at implementing high-speed BCIs based on SSVEP when using a computer monitor as a visual stimulator.

The effect of visual stimuli noise and fatigue on steady-state visual evoked potentials.

OBJECTIVE: In many cases, noise in visual stimuli plays an active role in brain information processing. Electroencephalogram (EEG) provides an objective mean to measure brain cognition and information processing, and studies on the effect of noise on EEG can help us better understand the mechanisms involved in information processing. APPROACH: In this study, visual stimuli, consisting of images with different noise levels, were created using the phase-scrambled method. EEG data evoked by these images were then obtained using the rapid serial visual presentation (RSVP) paradigm and the N-back method was used to induce and assess the fatigue state of subjects. The effect of differing noise modulation levels on EEG in different fatigue states was studied by analyzing the differences in the characteristics of steady-state visual evoked potential (SSVEP). MAIN RESULTS: The study results demonstrated that an image's noise level had a significant impact on the evoked SSVEP characteristics. The amplitude and time delay of induced SSVEP were effectively enhanced by moderately increasing the noise of the visual stimulus images. Fatigue also appeared to affect SSVEP, and the difference in SSVEP characteristics induced by images with different noise levels decreased when the subject was fatigued. SIGNIFICANCE: The conclusions of this study provide insights into the relationship between visual stimuli noise and SSVEP characteristics under different fatigue states. This might provide a basis for the study of the brain's mechanisms in regulating attention resources and the stochastic resonance phenomenon. In addition, this study has the potential to provide an objective method for rapid fatigue detection based on EEG.

Enhancing Detection of SSVEPs with Intermodulation Frequencies Using Individual Calibration Data.

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have potential to realize high-speed communication between human brain and external devices. Recently, we proposed an intermodulation frequency-based stimulation approach to increase the number of visual stimuli that can be presented on a computer monitor. Although our recent studies have demonstrated that this approach can encode more visual stimuli by only one flickering frequency, the performance of the intermodulation frequency-based SSVEP BCI remains poor and needs further improvement. This study aims to incorporate filter bank analysis and individual SSVEP calibration data into canonical correlation analysis (CCA) to improve the detection of SSVEPs with intermodulation frequencies. Results on classification accuracy and information transfer rate (ITR) suggest that the employment of individual calibration data can significantly improve the performance of the intermodulation frequency-based SSVEP BCI.

A study on dynamic model of steady-state visual evoked potentials.

OBJECTIVE: Significant progress has been made in the past two decades to considerably improve the performance of steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI). However, there are still some unsolved problems that may help us to improve BCI performance, one of which is that our understanding of the dynamic process of SSVEP is still superficial, especially for the transient-state response. APPROACH: This study introduced an antiphase stimulation method (antiphase: phase [Formula: see text]), which can simultaneously separate and extract SSVEP and event-related potential (ERP) signals from EEG, and eliminate the interference of ERP to SSVEP. Based on the SSVEP signals obtained by the antiphase stimulation method, the envelope of SSVEP was extracted by the Hilbert transform, and the dynamic model of SSVEP was quantitatively studied by mathematical modeling. The step response of a second-order linear system was used to fit the envelope of SSVEP, and its characteristics were represented by four parameters with physical and physiological meanings: one was amplitude related, one was latency related and two were frequency related. This study attempted to use pre-stimulation paradigms to modulate the dynamic model parameters, and quantitatively analyze the results by applying the dynamic model to further explore the pre-stimulation methods that had the potential to improve BCI performance. MAIN RESULTS: The results showed that the dynamic model had good fitting effect with SSVEP under three pre-stimulation paradigms. The test results revealed that the parameters of SSVEP dynamic models could be modulated by the pre-stimulation baseline luminance, and the gray baseline luminance pre-stimulation obtained the highest performance. SIGNIFICANCE: This study proposed a dynamic model which was helpful to understand and utilize the transient characteristics of SSVEP. This study also found that pre-stimulation could be used to adjust the parameters of SSVEP model, and had the potential to improve the performance of SSVEP-BCI.

A novel stimulation method for multi-class SSVEP-BCI using intermodulation frequencies.

OBJECTIVE: Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) has been widely investigated because of its easy system configuration, high information transfer rate (ITR) and little user training. However, due to the limitations of brain responses and the refresh rate of a monitor, the available stimulation frequencies for practical BCI application are generally restricted. APPROACH: This study introduced a novel stimulation method using intermodulation frequencies for SSVEP-BCIs that had targets flickering at the same frequency but with different additional modulation frequencies. The additional modulation frequencies were generated on the basis of choosing desired flickering frequencies. The conventional frame-based 'on/off' stimulation method was used to realize the desired flickering frequencies. All visual stimulation was present on a conventional LCD screen. A 9-target SSVEP-BCI based on intermodulation frequencies was implemented for performance evaluation. To optimize the stimulation design, three approaches (C: chromatic; L: luminance; CL: chromatic and luminance) were evaluated by online testing and offline analysis. MAIN RESULTS: SSVEP-BCIs with different paradigms (C, L, and CL) enabled us not only to encode more targets, but also to reliably evoke intermodulation frequencies. The online accuracies for the three paradigms were 91.67% (C), 93.98% (L), and 96.41% (CL). The CL condition achieved the highest classification performance. SIGNIFICANCE: These results demonstrated the efficacy of three approaches (C, L, and CL) for eliciting intermodulation frequencies for multi-class SSVEP-BCIs. The combination of chromatic and luminance characteristics of the visual stimuli is the most efficient way for the intermodulation frequency coding method.