Exploration of Human Activity Recognition Using a Single Sensor for Stroke Survivors and Able-Bodied People.

Commonly used sensors like accelerometers, gyroscopes, surface electromyography sensors, etc., which provide a convenient and practical solution for human activity recognition (HAR), have gained extensive attention. However, which kind of sensor can provide adequate information in achieving a satisfactory performance, or whether the position of a single sensor would play a significant effect on the performance in HAR are sparsely studied. In this paper, a comparative study to fully investigate the performance of the aforementioned sensors for classifying four activities (walking, tooth brushing, face washing, drinking) is explored. Sensors are spatially distributed over the human body, and subjects are categorized into three groups (able-bodied people, stroke survivors, and the union of both). Performances of using accelerometer, gyroscope, sEMG, and their combination in each group are evaluated by adopting the Support Vector Machine classifier with the Leave-One-Subject-Out Cross-Validation technique, and the optimal sensor position for each kind of sensor is presented based on the accuracy. Experimental results show that using the accelerometer could obtain the best performance in each group. The highest accuracy of HAR involving stroke survivors was 95.84 ± 1.75% (mean ± standard error), achieved by the accelerometer attached to the extensor carpi ulnaris. Furthermore, taking the practical application of HAR into consideration, a novel approach to distinguish various activities of stroke survivors based on a pre-trained HAR model built on healthy subjects is proposed, the highest accuracy of which is 77.89 ± 4.81% (mean ± standard error) with the accelerometer attached to the extensor carpi ulnaris.

Residual self-calibrated network with multi-scale channel attention for accurate EOG-based eye movement classification.

Recently, Electrooculography-based Human-Computer Interaction (EOG-HCI) technology has gained widespread attention in industrial areas, including assistive robots, augmented reality in gaming, etc. However, as the fundamental step of EOG-HCI, accurate eye movement classification (EMC) still faces a significant challenge, where their constraints in extracting discriminative features limit the performance of most existing works. To address this issue, a Residual Self-Calibrated Network with Multi-Scale Channel Attention (RSCA), focusing on efficient feature extraction and enhancement is proposed. The RSCA network first employs three self-calibrated convolution blocks within a hierarchical residual framework to fully extract the discriminative multi-scale features. Then, a multi-scale channel attention module adaptively weights the learned features to screen out the discriminative representation by aggregating the multi-scale context information along the channel dimension, thus further boosting the performance. Comprehensive experiments were performed using 5 public datasets and 7 prevailing methods for comparative validation. The results confirm that the RSCA network outperforms all other methods significantly, establishing a state-of-the-art benchmark for EOG-based EMC. Furthermore, thorough ablation analyses confirm the effectiveness of the employed modules within the RSCA network, providing valuable insights for the design of EOG-based deep models.

A Robust Gaze Estimation Approach via Exploring Relevant Electrooculogram Features and Optimal Electrodes Placements.

Gaze estimation, as a technique that reflects individual attention, can be used for disability assistance and assisting physicians in diagnosing diseases such as autism spectrum disorder (ASD), Parkinson's disease, and attention deficit hyperactivity disorder (ADHD). Various techniques have been proposed for gaze estimation and achieved high resolution. Among these approaches, electrooculography (EOG)-based gaze estimation, as an economical and effective method, offers a promising solution for practical applications. OBJECTIVE: In this paper, we systematically investigated the possible EOG electrode locations which are spatially distributed around the orbital cavity. Afterward, quantities of informative features to characterize physiological information of eye movement from the temporal-spectral domain are extracted from the seven differential channels. METHODS AND PROCEDURES: To select the optimum channels and relevant features, and eliminate irrelevant information, a heuristical search algorithm (i.e., forward stepwise strategy) is applied. Subsequently, a comparative analysis of the impacts of electrode placement and feature contributions on gaze estimation is evaluated via 6 classic models with 18 subjects. RESULTS: Experimental results showed that the promising performance was achieved both in the Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) within a wide gaze that ranges from -50° to +50°. The MAE and RMSE can be improved to 2.80° and 3.74° ultimately, while only using 10 features extracted from 2 channels. Compared with the prevailing EOG-based techniques, the performance improvement of MAE and RMSE range from 0.70° to 5.48° and 0.66° to 5.42°, respectively. CONCLUSION: We proposed a robust EOG-based gaze estimation approach by systematically investigating the optimal channel/feature combination. The experimental results indicated not only the superiority of the proposed approach but also its potential for clinical application. Clinical and translational impact statement: Accurate gaze estimation is a key step for assisting disabilities and accurate diagnosis of various diseases including ASD, Parkinson's disease, and ADHD. The proposed approach can accurately estimate the points of gaze via EOG signals, and thus has the potential for various related medical applications.

KL Divergence-based transfer learning for cross-subject eye movement recognition with EOG signals.

Human-machine interfaces (HMIs) based on Electro-oculogram (EOG) signals have been widely explored. However, due to the individual variability, it is still challenging for an EOG-based eye movement recognition model to achieve favorable results among cross-subjects. The classical transfer learning methods such as CORrelation Alignment (CORAL), Transfer Component Analysis (TCA), and Joint Distribution Adaptation (JDA) are mainly based on feature transformation and distribution alignment, which do not consider similarities/dissimilarities between target subject and source subjects. In this paper, the Kullback-Leibler (KL) divergence of the log-Power Spectral Density (log-PSD) features of horizontal EOG (HEOG) between the target subject and each source subject is calculated for adaptively selecting partial subjects that suppose to have similar distribution with target subject for further training. It not only consider the similarity but also reduce computational consumption. The results show that the proposed approach is superior to the baseline and classical transfer learning methods, and significantly improves the performance of target subjects who have poor performance with the primary classifiers. The best improvement of Support Vector Machines (SVM) classifier has improved by 13.1% for subject 31 compared with baseline result. The preliminary results of this study demonstrate the effectiveness of the proposed transfer framework and provide a promising tool for implementing cross-subject eye movement recognition models in real-life scenarios.

Prognostic Analysis of KCNQ2 Patients via Combining EEG Deep Features and Machine Learning Classifiers.

Pathogenic variants of the KCNQ2 gene often induces neonatal epilepsy in clinical. For better treatment, infants with confirmed KCNQ2 pathogenic variant and epilepsy symptoms need to adjust their treatment plans according to the outcome after taking antiseizure medicines (ASMs). This process is often time-consuming and requires long-term follow-up, which undoubtedly causes unnecessary psychological and economic burdens. In this study, we investigate the feasibility to predict the outcome of KCNQ2 patients via Electroencephalogram (EEG). By using the combination of deep networks and classical classifiers, the abnormal brain pathological activities recorded in EEGs can be encoded into deep features and decoded into specific KCNQ2 outcomes, thus taking the advantage of both powerful feature extraction capability from deep networks and stronger classification ability from classical classifiers. Specifically, we acquire 10-channel EEG signals from 33 infants with KCNQ2 pathogenic variants after taking ASMs. Two well-trained models (Resnet-50 and Resnet-18) are employed to extract deep features from the EEG spectrums. We achieve an accuracy of 78.7% to predict the KCNQ2 outcome of each infant. To our best knowledge, this is the first study to employ potential EEG pathological differences to predict the outcomes of KCNQ2 patients. The investigation of automatic KCNQ2 outcome prediction may contribute to a more convenient diagnosis mechanism for KCNQ2 patients.

Unsupervised Transfer Learning Approach With Adaptive Reweighting and Resampling Strategy for Inter-subject EOG-based Gaze Angle Estimation.

Gaze estimation based on electrooculograms (EOGs) has been widely explored. However, the inter-subject variability of EOGs still leaves a significant challenge for practical applications. It contributes to performance degradation when handling inter-subject issues. In this paper, an unsupervised transfer learning approach with an adaptive reweighting and resampling (ARR) strategy to fully consider individual variability is proposed for EOG-based gaze angle estimation. It allows quantifying domain shifts by leveraging the source-target similarities, reweighting and resampling the source data to retain relevant instances and disregard irrelevant instances during adaptation. Specifically, our proposed methodology first assesses the domain shifts via decomposing transformation matrices, which are estimated between the training subjects (denoted as multi-source domains) and the test subject (denoted as target domain). Then, the multi-domain shifts are assigned as weighted indicators to resample the multi-source domains for model training. Comparative experiments with several prevailing transfer learning methods including CORrelation ALignment (CORAL), Geodesic Flow Kernel (GFK), Joint Distribution Adaptation (JDA), Transfer component analysis (TCA), and Balanced distribution adaption (BDA) using two different normalization processes were conducted on a realistic scenario across 18 subjects. Experimental results demonstrate that the ARR strategy can significantly improve performance (mean absolute error (MAE) reduction: 7.0%, root mean square error (RMSE) reduction: 6.3%), outperforming the prevailing methods. Besides, the impacts of data diversity and data size on ARR strategy are further investigated. It exhibits that data size is more important than data diversity for EOG-based gaze angle estimation, and also presents the benefits of the ARR strategy for dealing with practical scenarios.

The Masking Impact of Intra-Artifacts in EEG on Deep Learning-Based Sleep Staging Systems: A Comparative Study.

Elimination of intra-artifacts in EEG has been overlooked in most of the existing sleep staging systems, especially in deep learning-based approaches. Whether intra-artifacts, originated from the eye movement, chin muscle firing, or heart beating, etc., in EEG signals would lead to a positive or a negative masking effect on deep learning-based sleep staging systems was investigated in this paper. We systematically analyzed several traditional pre-processing methods involving fast Independent Component Analysis (FastICA), Information Maximization (Infomax), and Second-order Blind Source Separation (SOBI). On top of these methods, a SOBI-WT method based on the joint use of the SOBI and Wavelet Transform (WT) is proposed. It offered an effective solution for suppressing artifact components while retaining residual informative data. To provide a comprehensive comparative analysis, these pre-processing methods were applied to eliminate the intra-artifacts and the processed signals were fed to two ready-to-use deep learning models, namely two-step hierarchical neural network (THNN) and SimpleSleepNet for automatic sleep staging. The evaluation was performed on two widely used public datasets, Montreal Archive of Sleep Studies (MASS) and Sleep-EDF Expanded, and a clinical dataset that was collected in Huashan Hospital of Fudan University, Shanghai, China (HSFU). The proposed SOBI-WT method increased the accuracy from 79.0% to 81.3% on MASS, 83.3% to 85.7% on Sleep-EDF Expanded, and 75.5% to 77.1% on HSFU compared with the raw EEG signal, respectively. Experimental results demonstrate that the intra-artifacts bring out a masking negative impact on the deep learning-based sleep staging systems and the proposed SOBI-WT method has the best performance in diminishing this negative impact compared with other artifact elimination methods.

Epileptic Seizure Detection by Cascading Isolation Forest-Based Anomaly Screening and EasyEnsemble.

The electroencephalogram (EEG), for measuring the electrophysiological activity of the brain, has been widely applied in automatic detection of epilepsy seizures. Various EEG-based seizure detection algorithms have already yielded high sensitivity, but training those algorithms requires a large amount of labelled data. Data labelling is often done with a lot of human efforts, which is very time-consuming. In this study, we propose a hybrid system integrating an unsupervised learning (UL) module and a supervised learning (SL) module, where the UL module can significantly reduce the workload of data labelling. For preliminary seizure screening, UL synthesizes amplitude-integrated EEG (aEEG) extraction, isolation forest-based anomaly detection, adaptive segmentation, and silhouette coefficient-based anomaly detection evaluation. The UL module serves to quickly locate the determinate subjects (seizure segments and seizure-free segments) and the indeterminate subjects (potential seizure candidates). Afterwards, more robust seizure detection for the indeterminate subjects is performed by the SL using an EasyEnsemble algorithm. EasyEnsemble, as a class-imbalance learning method, can potentially decrease the generalization error of the seizure-free segments. The proposed method can significantly reduce the workload of data labelling while guaranteeing satisfactory performance. The proposed seizure detection system is evaluated using the Children's Hospital Boston-Massachusetts Institute of Technology (CHB-MIT) scalp EEG dataset, and it achieves a mean accuracy of 92.62%, a mean sensitivity of 95.55%, and a mean specificity of 92.57%. To the best of our knowledge, this is the first epilepsy seizure detection study employing the integration of both the UL and the SL modules, achieving a competitive performance superior or similar to that of the state-of-the-art methods.

Novel Active ECG Electrode and Membrane Pressure Sensor-based Unconstrained Cardiorespiratory System for Sleep Monitoring.

In this paper, an unconstrained cardiorespiratory system for monitoring of ECG and respiration during sleep is presented. A novel active dry ECG electrode, which based on the conductive flexible and stretchable Ag NWs/PDMS composite material is designed to acquire the electrocardiographic potentials through the cloth. Meanwhile, a membrane pressure sensor is applied to obtain the respiratory signal, which can avoid the intervention in the sleep process. Combining the novel active ECG electrode and the membrane pressure sensor, the followed signal acquisition circuit is designed to monitor the ECG and respiratory signals simultaneously without fixing any external sensor to the human body. To verify the performance of the proposed system, a comprehensive test protocol is presented. Firstly, we characterized the electrical properties and the signal sensing capability of the proposed sensor. Furthermore, the performance of the entire system is assessed to verify the effects caused by different clothing materials and sleep postures to the ECG signal and the respiratory signal acquisition. The average Pearson correlation coefficient of the RR interval that extracted from the ECG signal obtained by the proposed system and the commercial PSG device can reach over 0.9 of different clothes and postures. As for the respiration acquisition, the accuracy of the respiration rate in different postures can reach 95% during the 2 hours monitoring process. The experimental results are promising, which demonstrate that the proposed system can achieve favorable signal quality and satisfy the basic requirements of the cardiorespiratory monitoring during sleep. Moreover, the proposed system can be extended to the office environment to monitor the health status of the individual.

A Multichannel EEG Acquisition System With Novel Ag NWs/PDMS Flexible Dry Electrodes.

In this paper, a multichannel reconfigurable EEG acquisition system with novel flexible dry electrodes is proposed. The novel electrode is designed to overcome the limitations of conventional wet electrodes such as skin irritation, skin preparation, and conductive gel requirements. It is based on the conductive and stretchable Ag NWs/PDMS composite material and produced by 3D printing technology. Meanwhile, a portable reconfigurable 8-channel EEG acquisition system based on the analog front end ADS1299 is proposed to overcome the drawbacks of traditional EEG acquisition system such as, large in size, difficult to configure, and complicated to use. It can be reconfigured by adjusting the gain of system and sampling rate. To verify the performance of proposed electrodes, a comprehensive test including electrode characterization and signal quality measurement is performed in comparison with Ag/AgCl electrode and Gold Cup electrode. Experiments reveal that proposed electrode achieves favorably results with wet electrodes. Furthermore, the proposed EEG acquisition system with novel dry electrodes is evaluated and compared with the commercial product. The evoked EEG signals (the steady-state visual evoked potentials, SSVEP) acquisition tasks of the proposed system are also conducted. Experimental results exhibit that proposed system satisfies the requirements of multi-channel EEG acquisition and provides a portable and comfortable way for EEG acquisition. With the high-quality sensing ability of the novel electrodes and the programmable gain amplifier of the proposed system, it can be expected to acquire the physiological signals like the electrocardiogram (ECG) and electromyogram (EMG) in the future.