Deep Coupling Recurrent Auto-Encoder with Multi-Modal EEG and EOG for Vigilance Estimation.

Vigilance estimation of drivers is a hot research field of current traffic safety. Wearable devices can monitor information regarding the driver's state in real time, which is then analyzed by a data analysis model to provide an estimation of vigilance. The accuracy of the data analysis model directly affects the effect of vigilance estimation. In this paper, we propose a deep coupling recurrent auto-encoder (DCRA) that combines electroencephalography (EEG) and electrooculography (EOG). This model uses a coupling layer to connect two single-modal auto-encoders to construct a joint objective loss function optimization model, which consists of single-modal loss and multi-modal loss. The single-modal loss is measured by Euclidean distance, and the multi-modal loss is measured by a Mahalanobis distance of metric learning, which can effectively reflect the distance between different modal data so that the distance between different modes can be described more accurately in the new feature space based on the metric matrix. In order to ensure gradient stability in the long sequence learning process, a multi-layer gated recurrent unit (GRU) auto-encoder model was adopted. The DCRA integrates data feature extraction and feature fusion. Relevant comparative experiments show that the DCRA is better than the single-modal method and the latest multi-modal fusion. The DCRA has a lower root mean square error (RMSE) and a higher Pearson correlation coefficient (PCC).

Contrastive fine-grained domain adaptation network for EEG-based vigilance estimation.

Vigilance state is crucial for the effective performance of users in brain-computer interface (BCI) systems. Most vigilance estimation methods rely on a large amount of labeled data to train a satisfactory model for the specific subject, which limits the practical application of the methods. This study aimed to build a reliable vigilance estimation method using a small amount of unlabeled calibration data. We conducted a vigilance experiment in the designed BCI-based cursor-control task. Electroencephalogram (EEG) signals of eighteen participants were recorded in two sessions on two different days. And, we proposed a contrastive fine-grained domain adaptation network (CFGDAN) for vigilance estimation. Here, an adaptive graph convolution network (GCN) was built to project the EEG data of different domains into a common space. The fine-grained feature alignment mechanism was designed to weight and align the feature distributions across domains at the EEG channel level, and the contrastive information preservation module was developed to preserve the useful target-specific information during the feature alignment. The experimental results show that the proposed CFGDAN outperforms the compared methods in our BCI vigilance dataset and SEED-VIG dataset. Moreover, the visualization results demonstrate the efficacy of the designed feature alignment mechanisms. These results indicate the effectiveness of our method for vigilance estimation. Our study is helpful for reducing calibration efforts and promoting the practical application potential of vigilance estimation methods.

Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems.

Objective. The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions.Approach.To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days.Main results. Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation.Significance.Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications.

Vigilance estimation using truncated l1 distance kernel-based sparse representation regression with physiological signals.

BACKGROUND: With a large number of accidents caused by the decline in the vigilance of operators, finding effective automatic vigilance monitoring methods is a work of great significance in recent years. Based on physiological signals and machine learning algorithms, researchers have opened up a path for objective vigilance estimation. METHODS: Sparse representation (SR)-based recognition algorithms with excellent performance and simple models are very promising approaches in this field. This paper aims to study the adaptability and performance improvement of truncated l1 distance (TL1) kernel on SR-based algorithm in the context of physiological signal vigilance estimation. Compared with the traditional radial basis function (RBF), the TL1 kernel has good adaptiveness to nonlinearity and is suitable for the discrimination of complex physiological signals. A recognition framework based on TL1 and SR theory is proposed. Firstly, the inseparable physiological features are mapped to the reproducing kernel Krein space through the infinite-dimensional projection of the TL1 kernel. Then the obtained kernel matrix is converted into the symmetric positive definite matrix according to the eigenspectrum approaches. Finally, the final prediction result is obtained through the sparse representation regression process. RESULTS: We verified the performance of the proposed framework on the popular SEED-VIG dataset containing physiological signals (electroencephalogram and electrooculogram) associated with vigilance. In the experimental results, the TL1 kernel is superior to the RBF kernel in both performance and kernel parameter stability. CONCLUSIONS: This demonstrates the effectiveness of the TL1 kernel in distinguishing physiological signals and the excellent vigilance estimation capability of the proposed framework. Moreover, the contribution of our research motivates the development of physiological signal recognition based on kernel methods.