RESUMEN
Sleep quality is heavily influenced by sleep posture, with research indicating that a supine posture can worsen obstructive sleep apnea (OSA) while lateral postures promote better sleep. For patients confined to beds, regular changes in posture are crucial to prevent the development of ulcers and bedsores. This study presents a novel sparse sensor-based spatiotemporal convolutional neural network (S3CNN) for detecting sleep posture. This S3CNN holistically incorporates a pair of spatial convolution neural networks to capture cardiorespiratory activity maps and a pair of temporal convolution neural networks to capture the heart rate and respiratory rate. Sleep data were collected in actual sleep conditions from 22 subjects using a sparse sensor array. The S3CNN was then trained to capture the spatial pressure distribution from the cardiorespiratory activity and temporal cardiopulmonary variability from the heart and respiratory data. Its performance was evaluated using three rounds of 10 fold cross-validation on the 8583 data samples collected from the subjects. The results yielded 91.96% recall, 92.65% precision, and 93.02% accuracy, which are comparable to the state-of-the-art methods that use significantly more sensors for marginally enhanced accuracy. Hence, the proposed S3CNN shows promise for sleep posture monitoring using sparse sensors, demonstrating potential for a more cost-effective approach.
Asunto(s)
Frecuencia Cardíaca , Redes Neurales de la Computación , Postura , Sueño , Humanos , Postura/fisiología , Sueño/fisiología , Frecuencia Cardíaca/fisiología , Monitoreo Fisiológico/métodos , Monitoreo Fisiológico/instrumentación , Masculino , Femenino , Adulto , Frecuencia Respiratoria/fisiología , Apnea Obstructiva del Sueño/diagnóstico , Apnea Obstructiva del Sueño/fisiopatología , Polisomnografía/métodos , Polisomnografía/instrumentaciónRESUMEN
BACKGROUND: Metabolic syndrome score in children assesses the risk of developing cardiovascular disease in future. We aim to probe the role of the caudate in relation to the metabolic syndrome score. Furthermore, using both functional and structural neuroimaging, we aim to examine the interplay between functional and structural measures. METHODS: A longitudinal birth cohort study with functional and structural neuroimaging data obtained at 4.5, 6.0 and 7.5 years and metabolic syndrome scores at 8.0 years was used. Pearson correlation and linear regression was used to test for correlation fractional anisotropy (FA) and fractional amplitude of low frequency fluctuations (fALFF) of the caudate with metabolic syndrome scores. Mediation analysis was used to test if later brain measures mediated the relation between earlier brain measures and metabolic syndrome scores. Inhibitory control was also tested as a mediator of the relation between caudate brain measures and metabolic syndrome scores. RESULTS: FA at 4.5 years and fALFF at 7.5 years of the left caudate was significantly correlated with metabolic syndrome scores. Post-hoc mediation analysis showed that fALFF at 7.5 years fully mediated the relation between FA at 4.5 years and metabolic syndrome scores. Inhibitory control was significantly correlated with fALFF at 7.5 years, but did not mediate the relation between fALFF at 7.5 years and metabolic syndrome scores. CONCLUSIONS: We found that variations in caudate microstructure at 4.5 years predict later variation in functional activity at 7.5 years. This later variation in functional activity fully mediates the relation between microstructural changes in early childhood and metabolic syndrome scores at 8.0 years.
Asunto(s)
Imagen por Resonancia Magnética , Síndrome Metabólico , Preescolar , Niño , Humanos , Imagen por Resonancia Magnética/métodos , Estudios de Cohortes , Síndrome Metabólico/diagnóstico por imagen , Encéfalo/diagnóstico por imagen , Mapeo Encefálico/métodosRESUMEN
OBJECTIVE: To investigate the efficacy and effects of transcranial direct current stimulation (tDCS) on motor imagery brain-computer interface (MI-BCI) with robotic feedback for stroke rehabilitation. DESIGN: A sham-controlled, randomized controlled trial. SETTING: Patients recruited through a hospital stroke rehabilitation program. PARTICIPANTS: Subjects (N=19) who incurred a stroke 0.8 to 4.3 years prior, with moderate to severe upper extremity functional impairment, and passed BCI screening. INTERVENTIONS: Ten sessions of 20 minutes of tDCS or sham before 1 hour of MI-BCI with robotic feedback upper limb stroke rehabilitation for 2 weeks. Each rehabilitation session comprised 8 minutes of evaluation and 1 hour of therapy. MAIN OUTCOME MEASURES: Upper extremity Fugl-Meyer Motor Assessment (FMMA) scores measured end-intervention at week 2 and follow-up at week 4, online BCI accuracies from the evaluation part, and laterality coefficients of the electroencephalogram (EEG) from the therapy part of the 10 rehabilitation sessions. RESULTS: FMMA score improved in both groups at week 4, but no intergroup differences were found at any time points. Online accuracies of the evaluation part from the tDCS group were significantly higher than those from the sham group. The EEG laterality coefficients from the therapy part of the tDCS group were significantly higher than those of the sham group. CONCLUSIONS: The results suggest a role for tDCS in facilitating motor imagery in stroke.
Asunto(s)
Interfaces Cerebro-Computador , Rehabilitación de Accidente Cerebrovascular , Estimulación Transcraneal de Corriente Directa/métodos , Extremidad Superior , Adulto , Anciano , Electroencefalografía , Femenino , Humanos , Imágenes en Psicoterapia , Masculino , Persona de Mediana Edad , Modalidades de Fisioterapia , Recuperación de la Función , RobóticaRESUMEN
Emotions are a series of subconscious, fleeting, and sometimes elusive manifestations of the human innate system. They play crucial roles in everyday life-influencing the way we evaluate ourselves, our surroundings, and how we interact with our world. To date, there has been an abundance of research on the domains of neuroscience and affective computing, with experimental evidence and neural network models, respectively, to elucidate the neural circuitry involved in and neural correlates for emotion recognition. Recent advances in affective computing neural network models often relate closely to evidence and perspectives gathered from neuroscience to explain the models. Specifically, there has been growing interest in the area of EEG-based emotion recognition to adopt models based on the neural underpinnings of the processing, generation, and subsequent collection of EEG data. In this respect, our review focuses on providing neuroscientific evidence and perspectives to discuss how emotions potentially come forth as the product of neural activities occurring at the level of subcortical structures within the brain's emotional circuitry and the association with current affective computing models in recognizing emotions. Furthermore, we discuss whether such biologically inspired modeling is the solution to advance the field in EEG-based emotion recognition and beyond.
RESUMEN
Objective.Motor imagery (MI) brain-computer interfaces (BCIs) based on electroencephalogram (EEG) have been developed primarily for stroke rehabilitation, however, due to limited stroke data, current deep learning methods for cross-subject classification rely on healthy data. This study aims to assess the feasibility of applying MI-BCI models pre-trained using data from healthy individuals to detect MI in stroke patients.Approach.We introduce a new transfer learning approach where features from two-class MI data of healthy individuals are used to detect MI in stroke patients. We compare the results of the proposed method with those obtained from analyses within stroke data. Experiments were conducted using Deep ConvNet and state-of-the-art subject-specific machine learning MI classifiers, evaluated on OpenBMI two-class MI-EEG data from healthy subjects and two-class MI versus rest data from stroke patients.Main results.Results of our study indicate that through domain adaptation of a model pre-trained using healthy subjects' data, an average MI detection accuracy of 71.15% (±12.46%) can be achieved across 71 stroke patients. We demonstrate that the accuracy of the pre-trained model increased by 18.15% after transfer learning (p<0.001). Additionally, the proposed transfer learning method outperforms the subject-specific results achieved by Deep ConvNet and FBCSP, with significant enhancements of 7.64% (p<0.001) and 5.55% (p<0.001) in performance, respectively. Notably, the healthy-to-stroke transfer learning approach achieved similar performance to stroke-to-stroke transfer learning, with no significant difference (p>0.05). Explainable AI analyses using transfer models determined channel relevance patterns that indicate contributions from the bilateral motor, frontal, and parietal regions of the cortex towards MI detection in stroke patients.Significance.Transfer learning from healthy to stroke can enhance the clinical use of BCI algorithms by overcoming the challenge of insufficient clinical data for optimal training.
Asunto(s)
Interfaces Cerebro-Computador , Aprendizaje Profundo , Accidente Cerebrovascular , Humanos , Voluntarios Sanos , Accidente Cerebrovascular/diagnóstico , Imágenes en Psicoterapia , Electroencefalografía/métodos , Algoritmos , ImaginaciónRESUMEN
Detecting stress is important for improving human health and potential, because moderate levels of stress may motivate people towards better performance at cognitive tasks, while chronic stress exposure causes impaired performance and health risks. We propose a Brain-Computer Interface (BCI) system to detect stress in the context of high-pressure work environments. The BCI system includes an electroencephalogram (EEG) headband with dry electrodes and an electrocardiogram (ECG) chest belt. We collected EEG and ECG data from 40 participants during two stressful cognitive tasks: the Cognitive Vigilance Task (CVT), and the Multi-Modal Integration Task (MMIT) we designed. We also recorded self-reported stress levels using the Dundee Stress State Questionnaire (DSSQ). The DSSQ results indicated that performing the MMIT led to significant increases in stress, while performing the CVT did not. Subsequently, we trained two different models to classify stress from non-stress states, one using EEG features, and the other using heart rate variability (HRV) features extracted from the ECG. Our EEG-based model achieved an overall accuracy of 81.0% for MMIT and 77.2% for CVT. However, our HRV-based model only achieved 62.1% accuracy for CVT and 56.0% for MMIT. We conclude that EEG is an effective predictor of stress in the context of stressful cognitive tasks. Our proposed BCI system shows promise in evaluating mental stress in high-pressure work environments, particularly when utilizing an EEG-based BCI.
RESUMEN
A major challenge in EEG-based brain-computer interfaces (BCIs) is the intersession nonstationarity in the EEG data that often leads to deteriorated BCI performances. To address this issue, this letter proposes a novel data space adaptation technique, EEG data space adaptation (EEG-DSA), to linearly transform the EEG data from the target space (evaluation session), such that the distribution difference to the source space (training session) is minimized. Using the Kullback-Leibler (KL) divergence criterion, we propose two versions of the EEG-DSA algorithm: the supervised version, when labeled data are available in the evaluation session, and the unsupervised version, when labeled data are not available. The performance of the proposed EEG-DSA algorithm is evaluated on the publicly available BCI Competition IV data set IIa and a data set recorded from 16 subjects performing motor imagery tasks on different days. The results show that the proposed EEG-DSA algorithm in both the supervised and unsupervised versions significantly outperforms the results without adaptation in terms of classification accuracy. The results also show that for subjects with poor BCI performances when no adaptation is applied, the proposed EEG-DSA algorithm in both the supervised and unsupervised versions significantly outperforms the unsupervised bias adaptation algorithm (PMean).
Asunto(s)
Adaptación Fisiológica/fisiología , Ondas Encefálicas/fisiología , Interfaces Cerebro-Computador , Encéfalo/fisiología , Percepción Espacial/fisiología , Algoritmos , Simulación por Computador , Electroencefalografía , HumanosRESUMEN
Effective learning and recovery of relevant source brain activity patterns is a major challenge to brain-computer interface using scalp EEG. Various spatial filtering solutions have been developed. Most current methods estimate an instantaneous demixing with the assumption of uncorrelatedness of the source signals. However, recent evidence in neuroscience suggests that multiple brain regions cooperate, especially during motor imagery, a major modality of brain activity for brain-computer interface. In this sense, methods that assume uncorrelatedness of the sources become inaccurate. Therefore, we are promoting a new methodology that considers both volume conduction effect and signal propagation between multiple brain regions. Specifically, we propose a novel discriminative algorithm for joint learning of propagation and spatial pattern with an iterative optimization solution. To validate the new methodology, we conduct experiments involving 16 healthy subjects and perform numerical analysis of the proposed algorithm for EEG classification in motor imagery brain-computer interface. Results from extensive analysis validate the effectiveness of the new methodology with high statistical significance.
Asunto(s)
Aprendizaje Discriminativo/fisiología , Electroencefalografía/estadística & datos numéricos , Imaginación/fisiología , Movimiento/fisiología , Algoritmos , Inteligencia Artificial , Interfaces Cerebro-Computador , Interpretación Estadística de Datos , Humanos , Aprendizaje , Modelos Estadísticos , Neurociencias , Procesamiento de Señales Asistido por ComputadorRESUMEN
The brain criticality hypothesis suggests that neural networks and multiple aspects of brain activity self-organize into a critical state, and criticality marks the transition between ordered and disordered states. This hypothesis is appealing from computer science perspective because neural networks at criticality exhibit optimal processing and computing properties while having implications in clinical applications to neurological disorders. In this paper, we introduced brain criticality analysis to track neurodevelopment from childhood to adolescence using the electroencephalogram (EEG) data of 662 subjects aged 5 to 16 years from the Child Mind Institute. We computed brain criticality from long-range temporal correlation (LRTC) using detrended fluctuation analysis (DFA). We also compared the brain criticality analysis with standard EEG power analysis. The results showed a statistically significant increase in brain criticality from childhood to adolescence in the alpha band. A decreasing trend was observed in theta band from EEG power analysis, but a much higher variance was observed compared to the brain criticality analysis. However, the significant results were only observed in some EEG channels, and not observed if the analysis were performed separately with eyes-open and eyes-close condition. Nonetheless, the results suggest that brain criticality may serve as a biomarker of brain development and maturation, but further research is needed to improve brain criticality algorithms and EEG analysis methods.Clinical Relevance- The brain criticality analysis may be used to characterize and predict neurodevelopment in early childhood.
Asunto(s)
Encéfalo , Electroencefalografía , Niño , Humanos , Preescolar , Adolescente , Electroencefalografía/métodos , Redes Neurales de la Computación , OjoRESUMEN
Research has shown the effectiveness of motor imagery in patient motor rehabilitation. Transcranial electrical stimulation has also demonstrated to improve patient motor and non-motor performance. However, mixed findings from motor imagery studies that involved transcranial electrical stimulation suggest that current experimental protocols can be further improved towards a unified design for consistent and effective results. This paper aims to review, with some clinical and neuroscientific findings from literature as support, studies of motor imagery coupled with different types of transcranial electrical stimulation and their experiments onhealthy and patient subjects. This review also includes the cognitive domains of working memory, attention, and fatigue, which are important for designing consistent and effective therapy protocols. Finally, we propose a theoretical all-inclusive framework that synergizes the three cognitive domains with motor imagery and transcranial electrical stimulation for patient rehabilitation, which holds promise of benefiting patients suffering from neuromuscular and cognitive disorders.
RESUMEN
Functional near-infrared spectroscopy (fNIRS) is a neuroimaging method that measures oxygenated hemoglobin (HbO) levels in the brain to infer neural activity using near-infrared light. Measured HbO levels are directly affected by a person's respiration. Hence, respiration cycles tend to confound fNIRS readings in motor imagery-based fNIRS Brain-Computer Interfaces (BCI). To reduce this confounding effect, we propose a method of synchronizing the motor imagery cue timing with the subject's respiration cycle using a breathing sensor. We conducted an experiment to collect 160 single trials from 10 subjects performing motor imagery using an fNIRS-based BCI and the breathing sensor. We then compared the HbO levels in trials with and without respiration synchronization. The results showed that respiration synchronization yielded HbO levels that were less dispersed across trials, and a negative correlation between the dispersion index of HbO levels with MI decoding accuracies was found across the 10 subjects. This showed that synchronizing motor imagery cues to respiration can yield increased HbO level consistency leading to better MI performance. Hence, the proposed method holds promise to improve the decoding performance of fNIRS-BCI by reducing the confounding effects of respiration.
Asunto(s)
Interfaces Cerebro-Computador , Humanos , Señales (Psicología) , Espectroscopía Infrarroja Corta/métodos , Imaginación , RespiraciónRESUMEN
Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remains a technical challenge due to considerable variability of complex multi-muscle activation patterns in terms of volatile spatio-temporal characteristics. To address this issue, we first hypothesize that the inherent variability of the idle state immediately preceding the motion initiation needs to be addressed explicitly. We therefore design a hierarchical dynamic Bayesian learning network model that integrates an array of Gaussian mixture model - hidden Markov models (GMM-HMMs), where each GMM-HMM learns the multi-sEMG processes either during the idle state, or during the motion initiation phase of a particular motion task. To test the hypothesis and evaluate the new learning network, we design and build a upper-limb sEMG-joystick motion study system, and collect data from 11 healthy volunteers. The data collection protocol adapted from the psychomotor vigilance task includes repeated and randomized binary hand motion tasks (push or pull) starting from either of two designated idle states: relaxed (with minimal muscle tones), or prepared (with muscle tones). We run a series of cross-validation tests to examine the performance of the method in comparison with the conventional techniques. The results suggest that the idle state recognition favors the dynamic Bayesian model over a static classification model. The results also show a statistically significant improvement in motion prediction accuracy by the proposed method (93.83±6.41%) in comparison with the conventional GMM-HMM method (89.71±8.98%) that does not explicitly account for the idle state. Moreover, we examine the progress of prediction accuracy over the course of motion initiation and identify the important hidden states that warrant future research.
Asunto(s)
Intención , Extremidad Superior , Humanos , Teorema de Bayes , Mano , Electromiografía/métodos , Movimiento/fisiología , AlgoritmosRESUMEN
Current motor imagery-based brain-computer interface (BCI) systems require a long calibration time at the beginning of each session before they can be used with adequate levels of classification accuracy. In particular, this issue can be a significant burden for long term BCI users. This article proposes a novel transfer learning algorithm, called r-KLwDSA, to reduce the BCI calibration time for long-term users. The proposed r-KLwDSA algorithm aligns the user's EEG data collected in previous sessions to the few EEG trials collected in the current session, using a novel linear alignment method. Thereafter, the aligned EEG trials from the previous sessions and the few EEG trials from the current sessions are fused through a weighting mechanism before they are used for calibrating the BCI model. To validate the proposed algorithm, a large dataset containing the EEG data from 11 stroke patients, each performing 18 BCI sessions, was used. The proposed framework demonstrated a significant improvement in the classification accuracy, of over 4% compared to the session-specific algorithm, when there were as few as two trials per class available from the current session. The proposed algorithm was particularly successful in improving the BCI accuracy of the sessions that had initial session-specific accuracy below 60%, with an average improvement of around 10% in the accuracy, leading to more stroke patients having meaningful BCI rehabilitation.
RESUMEN
Implanted microelectrode arrays can directly pick up electrode signals from the primary motor cortex (M1) during movement, and brain-machine interfaces (BMIs) can decode these signals to predict the directions of contemporaneous movements. However, it is not well known how much each individual input is responsible for the overall performance of a BMI decoder. In this paper, we seek to quantify how much each channel contributes to an artificial neural network (ANN)-based decoder, by measuring how much the removal of each individual channel degrades the accuracy of the output. If information on movement direction was equally distributed among channels, then the removal of one would have a minimal effect on decoder accuracy. On the other hand, if that information was distributed sparsely, then the removal of specific information-rich channels would significantly lower decoder accuracy. We found that for most channels, their removal did not significantly affect decoder performance. However, for a subset of channels (16 out of 61), removing them significantly reduced the decoder accuracy. This suggests that information is not uniformly distributed among the recording channels. We propose examining these channels further to optimize BMIs more effectively, as well as understand how M1 functions at the neuronal level.
Asunto(s)
Interfaces Cerebro-Computador , Redes Neurales de la Computación , Microelectrodos , Movimiento , Extremidad SuperiorRESUMEN
Brain-computer interfaces (BCIs) have recently been shown to be clinically effective as a novel method of stroke rehabilitation. In many BCI-based studies, the activation of the ipsilesional hemisphere was considered a key factor required for motor recovery after stroke. However, emerging evidence suggests that the contralesional hemisphere also plays a role in motor function rehabilitation. The objective of this study is to investigate the effectiveness of the BCI in detecting motor imagery of the affected hand from contralesional hemisphere. We analyzed a large EEG dataset from 136 stroke patients who performed motor imagery of their stroke-impaired hand. BCI features were extracted from channels covering either the ipsilesional, contralesional or bilateral hemisphere, and the offline BCI accuracy was computed using 10 [Formula: see text] 10-fold cross-validations. Our results showed that most stroke patients can operate the BCI using either their contralesional or ipsilesional hemisphere. Those with the ipsilesional BCI accuracy of less than 60% had significantly higher motor impairments than those with the ipsilesional BCI accuracy above 80%. Interestingly, those with the ipsilesional BCI accuracy of less than 60% achieved a significantly higher contralesional BCI accuracy, whereas those with the ipsilesional BCI accuracy more than 80% had significantly poorer contralesional BCI accuracy. This study suggests that contralesional BCI may be a useful approach for those with a high motor impairment who cannot accurately generate signals from ipsilesional hemisphere to effectively operate BCI.
Asunto(s)
Interfaces Cerebro-Computador , Rehabilitación de Accidente Cerebrovascular , Accidente Cerebrovascular , Humanos , Rehabilitación de Accidente Cerebrovascular/métodos , Sobrevivientes , Extremidad SuperiorRESUMEN
Background. A number of recent randomized controlled trials reported the efficacy of brain-computer interface (BCI) for upper-limb stroke rehabilitation compared with other therapies. Despite the encouraging results reported, there is a significant variance in the reported outcomes. This paper aims to investigate the effectiveness of different BCI designs on poststroke upper-limb rehabilitation. Methods. The effect sizes of pooled and individual studies were assessed by computing Hedge's g values with a 95% confidence interval. Subgroup analyses were also performed to examine the impact of different BCI designs on the treatment effect. Results. The study included 12 clinical trials involving 298 patients. The analysis showed that the BCI yielded significant superior short-term and long-term efficacy in improving the upper-limb motor function compared to the control therapies (Hedge's g = 0.73 and 0.33, respectively). Based on our subgroup analyses, the BCI studies that used the intention of movement had a higher effect size compared to those used motor imagery (Hedge's g = 1.21 and 0.55, respectively). The BCI studies using band power features had a significantly higher effect size than those using filter bank common spatial patterns features (Hedge's g = 1.25 and - 0.23, respectively). Finally, the studies that used functional electrical stimulation as the BCI feedback had the highest effect size compared to other devices (Hedge's g = 1.2). Conclusion. This meta-analysis confirmed the effectiveness of BCI for upper-limb rehabilitation. Our findings support the use of band power features, the intention of movement, and the functional electrical stimulation in future BCI designs for poststroke upper-limb rehabilitation.
Asunto(s)
Interfaces Cerebro-Computador , Rehabilitación de Accidente Cerebrovascular , Accidente Cerebrovascular , Electroencefalografía , Humanos , Ensayos Clínicos Controlados Aleatorios como Asunto , Recuperación de la Función , Extremidad SuperiorRESUMEN
Although brain-computer interface (BCI) shows promising prospects to help post-stroke patients recover their motor function, its decoding accuracy is still highly dependent on feature extraction methods. Most current feature extractors in BCI are classification-based methods, yet very few works from literature use metric learning based methods to learn representations for BCI. To circumvent this shortage, we propose a deep metric learning based method, Weighted Convolutional Siamese Network (WCSN) to learn representations from electroencephalogram (EEG) signal. This approach can enhance the decoding accuracy by learning a low dimensional embedding to extract distance-based representations from pair-wise EEG data. To enhance training efficiency and algorithm performance, a temporal-spectral distance weighted sampling method is proposed to select more informative input samples. In addition, an adaptive training strategy is adopted to address the session-to-session non-stationarity by progressively updating the subject-specific model. The proposed method is applied on both upper limb and lower limb neurorehabilitation datasets acquired from 33 stroke patients, with a total of 358 sessions. Results indicate that using k-Nearest Neighbor as the classification algorithm, the proposed method yielded 72.8% and 66.0% accuracies for the two datasets respectively, significantly better than the other state-of-the-arts ( ). Without losing generality, we also evaluated the proposed method on two publicly available datasets acquired from healthy subjects, wherein the proposed algorithm demonstrated superior performance at most cases as well. Our results support, for the first time, the use of a metric learning based feature extractor to learn representations from non-stationary EEG signals for BCI-assisted post-stroke rehabilitation.
Asunto(s)
Interfaces Cerebro-Computador , Rehabilitación de Accidente Cerebrovascular , Accidente Cerebrovascular , Humanos , Electroencefalografía/métodos , AlgoritmosRESUMEN
Affective Computing is a multidisciplinary area of research that allows computers to perform human emotion recognition, with potential applications in areas such as healthcare, gaming and intuitive human computer interface design. Hence, this paper proposes an affective interaction system using dry EEG-based Brain-Computer Interface and Virtual Reality (BCI-VR). The proposed BCI-VR system integrates existing low-cost consumer devices such as an EEG headband with frontal and temporal dry electrodes for brain signal acquisition, and a low-cost VR headset that houses an Android handphone. The handphone executes an in-house developed software that connects wirelessly to the headband, processes the acquired EEG signals, and displays VR content to elicit emotional responses. The proposed BCI-VR system was used to collect EEG data from 13 subjects while they watched VR content that elicits positive or negative emotional responses. EEG bandpower features were extracted to train Linear Discriminant and Support Vector Machine classifiers. The classification performances of these classifiers on this dataset and the results of a public dataset (SEED-IV) are then evaluated. The results in classifying positive vs negative emotions in both datasets (~66% for 2-class) show promise that positive and negative emotions can be detected by the proposed low cost BCIVR system, yielding nearly the same performance on the public dataset that used wet EEG electrodes. Hence the results show promise of the proposed BCI-VR system for real-time affective interaction applications in future.
Asunto(s)
Interfaces Cerebro-Computador , Realidad Virtual , Encéfalo , Electroencefalografía , Humanos , Máquina de Vectores de SoporteRESUMEN
There is a strong demand for acquisition, processing and understanding of a variety of physiological and behavioral signals from the measurements in human-robot interface (HRI). However, multiple data streams from these measurements bring considerable challenges for their synchronizations, either for offline analysis or for online HRI applications, especially when the sensors are wirelessly connected, without synchronization mechanisms, such as a network-time-protocol. In this paper, we presented a full wireless multi-modality sensor system comprising biopotential measurements such as EEG, EMG and inertial parameter data of articulated body-limb motions. In the paper, we propose two methods to synchronize and calibrate the transmission latencies from different wireless channels. The first method employs the traditional artificial electrical timing signal. The other one employs the force-acceleration relationship governed by Newton's Second Law to facilitate reconstruction of the sample-to-sample alignment between the two wireless sensors. The measured latencies are investigated and the result show that they could be determined consistently and accurately by the devised techniques.
Asunto(s)
Aceleración , Humanos , Movimiento (Física)RESUMEN
The performance of a classifier in a brain-computer interface (BCI) system is highly dependent on the quality and quantity of training data. Typically, the training data are collected in a laboratory where the users perform tasks in a controlled environment. However, users' attention may be diverted in real-life BCI applications and this may decrease the performance of the classifier. To improve the robustness of the classifier, additional data can be acquired in such conditions, but it is not practical to record electroencephalogram (EEG) data over several long calibration sessions. A potentially time- and cost-efficient solution is artificial data generation. Hence, in this study, we proposed a framework based on the deep convolutional generative adversarial networks (DCGANs) for generating artificial EEG to augment the training set in order to improve the performance of a BCI classifier. To make a comparative investigation, we designed a motor task experiment with diverted and focused attention conditions. We used an end-to-end deep convolutional neural network for classification between movement intention and rest using the data from 14 subjects. The results from the leave-one subject-out (LOO) classification yielded baseline accuracies of 73.04% for diverted attention and 80.09% for focused attention without data augmentation. Using the proposed DCGANs-based framework for augmentation, the results yielded a significant improvement of 7.32% for diverted attention ( ) and 5.45% for focused attention ( ). In addition, we implemented the method on the data set IVa from BCI competition III to distinguish different motor imagery tasks. The proposed method increased the accuracy by 3.57% ( ). This study shows that using GANs for EEG augmentation can significantly improve BCI performance, especially in real-life applications, whereby users' attention may be diverted.