Gait Training-Based Motor Imagery and EEG Neurofeedback in Lokomat: A Clinical Intervention With Complete Spinal Cord Injury Individuals.

Robotic systems, such as Lokomat® have shown promising results in people with severe motor impairments, who suffered a stroke or other neurological damage. Robotic devices have also been used by people with more challenging damages, such as Spinal Cord Injury (SCI), using feedback strategies that provide information about the brain activity in real-time. This study proposes a novel Motor Imagery (MI)-based Electroencephalogram (EEG) Visual Neurofeedback (VNFB) system for Lokomat® to teach individuals how to modulate their own µ (8-12 Hz) and ß (15-20 Hz) rhythms during passive walking. Two individuals with complete SCI tested our VNFB system completing a total of 12 sessions, each on different days. For evaluation, clinical outcomes before and after the intervention and brain connectivity were analyzed. As findings, the sensitivity related to light touch and painful discrimination increased for both individuals. Furthermore, an improvement in neurogenic bladder and bowel functions was observed according to the American Spinal Injury Association Impairment Scale, Neurogenic Bladder Symptom Score, and Gastrointestinal Symptom Rating Scale. Moreover, brain connectivity between different EEG locations significantly ( [Formula: see text]) increased, mainly in the motor cortex. As other highlight, both SCI individuals enhanced their µ rhythm, suggesting motor learning. These results indicate that our gait training approach may have substantial clinical benefits in complete SCI individuals.

Evaluation of temporal, spatial and spectral filtering in CSP-based methods for decoding pedaling-based motor tasks using EEG signals.

Stroke is a neurological syndrome that usually causes a loss of voluntary control of lower/upper body movements, making it difficult for affected individuals to perform Activities of Daily Living (ADLs). Brain-Computer Interfaces (BCIs) combined with robotic systems, such as Motorized Mini Exercise Bikes (MMEB), have enabled the rehabilitation of people with disabilities by decoding their actions and executing a motor task. However, Electroencephalography (EEG)-based BCIs are affected by the presence of physiological and non-physiological artifacts. Thus, movement discrimination using EEG become challenging, even in pedaling tasks, which have not been well explored in the literature. In this study, Common Spatial Patterns (CSP)-based methods were proposed to classify pedaling motor tasks. To address this, Filter Bank Common Spatial Patterns (FBCSP) and Filter Bank Common Spatial-Spectral Patterns (FBCSSP) were implemented with different spatial filtering configurations by varying the time segment with different filter bank combinations for the three methods to decode pedaling tasks. An in-house EEG dataset during pedaling tasks was registered for 8 participants. As results, the best configuration corresponds to a filter bank with two filters (8-19 Hz and 19-30 Hz) using a time window between 1.5 and 2.5 s after the cue and implementing two spatial filters, which provide accuracy of approximately 0.81, False Positive Rates lower than 0.19, andKappaindex of 0.61. This work implies that EEG oscillatory patterns during pedaling can be accurately classified using machine learning. Therefore, our method can be applied in the rehabilitation context, such as MMEB-based BCIs, in the future.

Unraveling Transformative Effects after tDCS and BCI Intervention in Chronic Post-Stroke Patient Rehabilitation-An Alternative Treatment Design Study.

Stroke is a debilitating clinical condition resulting from a brain infarction or hemorrhage that poses significant challenges for motor function restoration. Previous studies have shown the potential of applying transcranial direct current stimulation (tDCS) to improve neuroplasticity in patients with neurological diseases or disorders. By modulating the cortical excitability, tDCS can enhance the effects of conventional therapies. While upper-limb recovery has been extensively studied, research on lower limbs is still limited, despite their important role in locomotion, independence, and good quality of life. As the life and social costs due to neuromuscular disability are significant, the relatively low cost, safety, and portability of tDCS devices, combined with low-cost robotic systems, can optimize therapy and reduce rehabilitation costs, increasing access to cutting-edge technologies for neuromuscular rehabilitation. This study explores a novel approach by utilizing the following processes in sequence: tDCS, a motor imagery (MI)-based brain-computer interface (BCI) with virtual reality (VR), and a motorized pedal end-effector. These are applied to enhance the brain plasticity and accelerate the motor recovery of post-stroke patients. The results are particularly relevant for post-stroke patients with severe lower-limb impairments, as the system proposed here provides motor training in a real-time closed-loop design, promoting cortical excitability around the foot area (Cz) while the patient directly commands with his/her brain signals the motorized pedal. This strategy has the potential to significantly improve rehabilitation outcomes. The study design follows an alternating treatment design (ATD), which involves a double-blind approach to measure improvements in both physical function and brain activity in post-stroke patients. The results indicate positive trends in the motor function, coordination, and speed of the affected limb, as well as sensory improvements. The analysis of event-related desynchronization (ERD) from EEG signals reveals significant modulations in Mu, low beta, and high beta rhythms. Although this study does not provide conclusive evidence for the superiority of adjuvant mental practice training over conventional therapy alone, it highlights the need for larger-scale investigations.

EEG motor imagery classification using deep learning approaches in naïve BCI users.

Motor Imagery (MI)-Brain Computer-Interfaces (BCI) illiteracy defines that not all subjects can achieve a good performance in MI-BCI systems due to different factors related to the fatigue, substance consumption, concentration, and experience in the use. To reduce the effects of lack of experience in the use of BCI systems (naïve users), this paper presents the implementation of three Deep Learning (DL) methods with the hypothesis that the performance of BCI systems could be improved compared with baseline methods in the evaluation of naïve BCI users. The methods proposed here are based on Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM)/Bidirectional Long Short-Term Memory (BiLSTM), and a combination of CNN and LSTM used for upper limb MI signal discrimination on a dataset of 25 naïve BCI users. The results were compared with three widely used baseline methods based on the Common Spatial Pattern (CSP), Filter Bank Common Spatial Pattern (FBCSP), and Filter Bank Common Spatial-Spectral Pattern (FBCSSP), in different temporal window configurations. As results, the LSTM-BiLSTM-based approach presented the best performance, according to the evaluation metrics of Accuracy, F-score, Recall, Specificity, Precision, and ITR, with a mean performance of 80% (maximum 95%) and ITR of 10 bits/min using a temporal window of 1.5 s. The DL Methods represent a significant increase of 32% compared with the baseline methods (p< 0.05). Thus, with the outcomes of this study, it is expected to increase the controllability, usability, and reliability of the use of robotic devices in naïve BCI users.

Lower-limb kinematic reconstruction during pedaling tasks from EEG signals using Unscented Kalman filter.

Kinematic reconstruction of lower-limb movements using electroencephalography (EEG) has been used in several rehabilitation systems. However, the nonlinear relationship between neural activity and limb movement may challenge decoders in real-time Brain-Computer Interface (BCI) applications. This paper proposes a nonlinear neural decoder using an Unscented Kalman Filter (UKF) to infer lower-limb kinematics from EEG signals during pedaling. The results demonstrated maximum decoding accuracy using slow cortical potentials in the delta band (0.1-4 Hz) of 0.33 for Pearson's r-value and 8 for the signal-to-noise ratio (SNR). This leaves an open door to the development of closed-loop EEG-based BCI systems for kinematic monitoring during pedaling rehabilitation tasks.

Robust Motor Imagery Tasks Classification Approach Using Bayesian Neural Network.

The development of Brain-Computer Interfaces based on Motor Imagery (MI) tasks is a relevant research topic worldwide. The design of accurate and reliable BCI systems remains a challenge, mainly in terms of increasing performance and usability. Classifiers based on Bayesian Neural Networks are proposed in this work by using the variational inference, aiming to analyze the uncertainty during the MI prediction. An adaptive threshold scheme is proposed here for MI classification with a reject option, and its performance on both datasets 2a and 2b from BCI Competition IV is compared with other approaches based on thresholds. The results using subject-specific and non-subject-specific training strategies are encouraging. From the uncertainty analysis, considerations for reducing computational cost are proposed for future work.

EEG changes during passive movements improve the motor imagery feature extraction in BCIs-based sensory feedback calibration.

Objective.This work proposes a method for two calibration schemes based on sensory feedback to extract reliable motor imagery (MI) features, and provide classification outputs more correlated to the user's intention.Method.After filtering the raw electroencephalogram (EEG), a two-step method for spatial feature extraction by using the Riemannian covariance matrices (RCM) method and common spatial patterns is proposed here. It uses EEG data from trials providing feedback, in an intermediate step composed of bothkth nearest neighbors and probability analyses, to find periods of time in which the user probably performed well the MI task without feedback. These periods are then used to extract features with better separability, and train a classifier for MI recognition. For evaluation, an in-house dataset with eight healthy volunteers and two post-stroke patients that performed lower-limb MI, and consequently received passive movements as feedback was used. Other popular public EEG datasets (such as BCI Competition IV dataset IIb, among others) from healthy subjects that executed upper-and lower-limbs MI tasks under continuous visual sensory feedback were further used.Results.The proposed system based on the Riemannian geometry method in two-steps (RCM-RCM) outperformed significantly baseline methods, reaching average accuracy up to 82.29%. These findings show that EEG data on periods providing passive movement can be used to contribute greatly during MI feature extraction.Significance.Unconscious brain responses elicited over the sensorimotor areas may be avoided or greatly reduced by applying our approach in MI-based brain-computer interfaces (BCIs). Therefore, BCI's outputs more correlated to the user's intention can be obtained.

Towards Multimodal Equipment to Help in the Diagnosis of COVID-19 Using Machine Learning Algorithms.

COVID-19 occurs due to infection through respiratory droplets containing the SARS-CoV-2 virus, which are released when someone sneezes, coughs, or talks. The gold-standard exam to detect the virus is Real-Time Polymerase Chain Reaction (RT-PCR); however, this is an expensive test and may require up to 3 days after infection for a reliable result, and if there is high demand, the labs could be overwhelmed, which can cause significant delays in providing results. Biomedical data (oxygen saturation level-SpO2, body temperature, heart rate, and cough) are acquired from individuals and are used to help infer infection by COVID-19, using machine learning algorithms. The goal of this study is to introduce the Integrated Portable Medical Assistant (IPMA), which is a multimodal piece of equipment that can collect biomedical data, such as oxygen saturation level, body temperature, heart rate, and cough sound, and helps infer the diagnosis of COVID-19 through machine learning algorithms. The IPMA has the capacity to store the biomedical data for continuous studies and can be used to infer other respiratory diseases. Quadratic kernel-free non-linear Support Vector Machine (QSVM) and Decision Tree (DT) were applied on three datasets with data of cough, speech, body temperature, heart rate, and SpO2, obtaining an Accuracy rate (ACC) and Area Under the Curve (AUC) of approximately up to 88.0% and 0.85, respectively, as well as an ACC up to 99% and AUC = 0.94, respectively, for COVID-19 infection inference. When applied to the data acquired with the IMPA, these algorithms achieved 100% accuracy. Regarding the easiness of using the equipment, 36 volunteers reported that the IPMA has a high usability, according to results from two metrics used for evaluation: System Usability Scale (SUS) and Post Study System Usability Questionnaire (PSSUQ), with scores of 85.5 and 1.41, respectively. In light of the worldwide needs for smart equipment to help fight the COVID-19 pandemic, this new equipment may help with the screening of COVID-19 through data collected from biomedical signals and cough sounds, as well as the use of machine learning algorithms.

A deep learning approach to estimate pulse rate by remote photoplethysmography.

Objective.This study proposes a U-net shaped Deep Neural Network (DNN) model to extract remote photoplethysmography (rPPG) signals from skin color signals to estimate Pulse Rate (PR).Approach.Three input window sizes are used in the DNN: 256 samples (5.12 s), 512 samples (10.24 s), and 1024 (20.48 s). A data augmentation algorithm based on interpolation is also used here to artificially increase the number of training samples.Main results.The proposed model outperformed a prior-knowledge rPPG method by using input signals with window of 256 and 512 samples. Also, it was found that the data augmentation procedure only increased the performance for the window of 1024 samples. The trained model achieved a Mean Absolute Error (MAE) of 3.97 Beats per Minute (BPM) and Root Mean Squared Error (RMSE) of 6.47 BPM, for the 256 samples window, and MAE of 3.00 BPM and RMSE of 5.45 BPM for the window of 512 samples. On the other hand, the prior-knowledge rPPG method got a MAE of 8.04 BPM and RMSE of 16.63 BPM for the window of 256 samples, and MAE of 3.49 BPM and RMSE of 7.92 BPM for the window of 512 samples. For the longest window (1024 samples), the concordance of the predicted PRs from the DNNs and the true PRs was higher when applying the data augmentation procedure.Significance.These results demonstrate a big potential of this technique for PR estimation, showing that the DNN proposed here may generate reliable rPPG signals even with short window lengths (5.12 s and 10.24 s), suggesting that it needs less data for a faster rPPG measurement and PR estimation.

Monte Carlo Dropout for Uncertainty Estimation and Motor Imagery Classification.

Motor Imagery (MI)-based Brain-Computer Interfaces (BCIs) have been widely used as an alternative communication channel to patients with severe motor disabilities, achieving high classification accuracy through machine learning techniques. Recently, deep learning techniques have spotlighted the state-of-the-art of MI-based BCIs. These techniques still lack strategies to quantify predictive uncertainty and may produce overconfident predictions. In this work, methods to enhance the performance of existing MI-based BCIs are proposed in order to obtain a more reliable system for real application scenarios. First, the Monte Carlo dropout (MCD) method is proposed on MI deep neural models to improve classification and provide uncertainty estimation. This approach was implemented using Shallow Convolutional Neural Network (SCNN-MCD) and with an ensemble model (E-SCNN-MCD). As another contribution, to discriminate MI task predictions of high uncertainty, a threshold approach is introduced and tested for both SCNN-MCD and E-SCNN-MCD approaches. The BCI Competition IV Databases 2a and 2b were used to evaluate the proposed methods for both subject-specific and non-subject-specific strategies, obtaining encouraging results for MI recognition.

Effect of a Brain-Computer Interface Based on Pedaling Motor Imagery on Cortical Excitability and Connectivity.

Recently, studies on cycling-based brain-computer interfaces (BCIs) have been standing out due to their potential for lower-limb recovery. In this scenario, the behaviors of the sensory motor rhythms and the brain connectivity present themselves as sources of information that can contribute to interpreting the cortical effect of these technologies. This study aims to analyze how sensory motor rhythms and cortical connectivity behave when volunteers command reactive motor imagery (MI) BCI that provides passive pedaling feedback. We studied 8 healthy subjects who performed pedaling MI to command an electroencephalography (EEG)-based BCI with a motorized pedal to receive passive movements as feedback. The EEG data were analyzed under the following four conditions: resting, MI calibration, MI online, and receiving passive pedaling (on-line phase). Most subjects produced, over the foot area, significant event-related desynchronization (ERD) patterns around Cz when performing MI and receiving passive pedaling. The sharpest decrease was found for the low beta band. The connectivity results revealed an exchange of information between the supplementary motor area (SMA) and parietal regions during MI and passive pedaling. Our findings point to the primary motor cortex activation for most participants and the connectivity between SMA and parietal regions during pedaling MI and passive pedaling.

Shoulder Flexion Pre-Movement Recognition Through Subject-Specific Brain Regions to Command an Upper Limb Exoskeleton.

This work presents two brain-computer interfaces (BCIs) for shoulder pre-movement recognition using: 1) manual strategy for Electroencephalography (EEG) channels selection, and 2) subject-specific channels selection by applying non-negative factorization matrix (NMF). Besides, the proposed BCIs compute spatial features extracted from filtered EEG signals through Riemannian covariance matrices and a linear discriminant analysis (LDA) to discriminate both shoulder pre-movement and rest states. We studied on twenty-one healthy subjects different frequency ranges looking the best frequency band for shoulder pre-movement recognition. As a result, our BCI located automatically EEG channels on the contralateral moved limb, and enhancing the pre-movement recognition (ACC = 71.39 ± 12.68%, κ = 0.43 ± 0.25%). The ability of the proposed BCIs to select specific EEG locations more cortically related to the moved limb could benefit the neuro-rehabilitation process.

Trends in Compressive Sensing for EEG Signal Processing Applications.

The tremendous progress of big data acquisition and processing in the field of neural engineering has enabled a better understanding of the patient's brain disorders with their neural rehabilitation, restoration, detection, and diagnosis. An integration of compressive sensing (CS) and neural engineering emerges as a new research area, aiming to deal with a large volume of neurological data for fast speed, long-term, and energy-saving purposes. Furthermore, electroencephalography (EEG) signals for brain-computer interfaces (BCIs) have shown to be very promising, with diverse neuroscience applications. In this review, we focused on EEG-based approaches which have benefited from CS in achieving fast and energy-saving solutions. In particular, we examine the current practices, scientific opportunities, and challenges of CS in the growing field of BCIs. We emphasized on summarizing major CS reconstruction algorithms, the sparse basis, and the measurement matrix used in CS to process the EEG signal. This literature review suggests that the selection of a suitable reconstruction algorithm, sparse basis, and measurement matrix can help to improve the performance of current CS-based EEG studies. In this paper, we also aim at providing an overview of the reconstruction free CS approach and the related literature in the field. Finally, we discuss the opportunities and challenges that arise from pushing the integration of the CS framework for BCI applications.

Assessment of an Assistive Control Approach Applied in an Active Knee Orthosis Plus Walker for Post-Stroke Gait Rehabilitation.

The goal of this study is the assessment of an assistive control approach applied to an active knee orthosis plus a walker for gait rehabilitation. The study evaluates post-stroke patients and healthy subjects (control group) in terms of kinematics, kinetics, and muscle activity. Muscle and gait information of interest were acquired from their lower limbs and trunk, and a comparison was conducted between patients and control group. Signals from plantar pressure, gait phase, and knee angle and torque were acquired during gait, which allowed us to verify that the stance control strategy proposed here was efficient at improving the patients' gaits (comparing their results to the control group), without the necessity of imposing a fixed knee trajectory. An innovative evaluation of trunk muscles related to the maintenance of dynamic postural equilibrium during gait assisted by our active knee orthosis plus walker was also conducted through inertial sensors. An increase in gait cycle (stance phase) was also observed when comparing the results of this study to our previous work. Regarding the kinematics, the maximum knee torque was lower for patients when compared to the control group, which implies that our orthosis did not demand from the patients a knee torque greater than that for healthy subjects. Through surface electromyography (sEMG) analysis, a significant reduction in trunk muscle activation and fatigability, before and during the use of our orthosis by patients, was also observed. This suggest that our orthosis, together with the assistive control approach proposed here, is promising and could be considered to complement post-stroke patient gait rehabilitation.

A Low-Cost Lower-Limb Brain-Machine Interface Triggered by Pedaling Motor Imagery for Post-Stroke Patients Rehabilitation.

A low-cost Brain-Machine Interface (BMI) based on electroencephalography for lower-limb motor recovery of post-stroke patients is proposed here, which provides passive pedaling as feedback, when patients trigger a Mini-Motorized Exercise Bike (MMEB) by executing pedaling motor imagery (MI). This system was validated in an On-line phase by eight healthy subjects and two post-stroke patients, which felt a closed-loop commanding the MMEB due to the fast response of our BMI. It was developed using methods of low-computational cost, such as Riemannian geometry for feature extraction, Pair-Wise Feature Proximity (PWFP) for feature selection, and Linear Discriminant Analysis (LDA) for pedaling imagery recognition. The On-line phase was composed of two sessions, where each participant completed a total of 12 trials per session executing pedaling MI for triggering the MMEB. As a result, the MMEB was successfully triggered by healthy subjects for almost all trials (ACC up to 100%), while the two post-stroke patients, PS1 and PS2, achieved their best performance (ACC of 41.67% and 91.67%, respectively) in Session #2. These patients improved their latency (2.03 ± 0.42 s and 1.99 ± 0.35 s, respectively) when triggering the MMEB, and their performance suggests the hypothesis that our system may be used with chronic stroke patients for lower-limb recovery, providing neural relearning and enhancing neuroplasticity.

Subject-specific EEG channel selection using non-negative matrix factorization for lower-limb motor imagery recognition.

OBJECTIVE: This study aims to propose and validate a subject-specific approach to recognize two different cognitive neural states (relax and pedaling motor imagery (MI)) by selecting the relevant electroencephalogram (EEG) channels. The main aims of the proposed work are: (i) to reduce the computational complexity of the BCI systems during MI detection by selecting the relevant EEG channels, (ii) to reduce the amount of data overfitting that may arise due to unnecessary channels and redundant features, and (iii) to reduce the classification time for real-time BCI applications. APPROACH: The proposed method selects subject-specific EEG channels and features based on their MI. In this work, we make use of non-negative matrix factorization to extract the weight of the EEG channels based on their contribution to MI detection. Further, the neighborhood component analysis is used for subject-specific feature selection. MAIN RESULTS: We executed the experiments using EEG signals recorded for MI where ten healthy subjects performed MI movement of the lower limb to generate motor commands. An average accuracy of 96.66%, average true positive rate (TPR) of 97.77%, average false positives rate of 4.44%, and average Kappa of 93.33% were obtained. The proposed subject-specific EEG channel selection based MI recognition system provides 13.20% improvement in detection accuracy, and 27% improvement in Kappa value with less number of EEG channels compared to the results obtained using all EEG channels. SIGNIFICANCE: The proposed subject-specific BCI system has been found significantly advantageous compared to the typical approach of using a fixed channel configuration. This work shows that fewer EEG channels not only reduce computational complexity and processing time (two times faster) but also improve the MI detection performance. The proposed method selects EEG locations related to the foot movement, which may be relevant for neuro-rehabilitation using lower-limb movements that may provide a real-time and more natural interface between patient and robotic device.

Assessment of high-frequency steady-state visual evoked potentials from below-the-hairline areas for a brain-computer interface based on Depth-of-Field.

BACKGROUND AND OBJECTIVE: Recently, a promising Brain-Computer Interface based on Steady-State Visual Evoked Potential (SSVEP-BCI) was proposed, which composed of two stimuli presented together in the center of the subject's field of view, but at different depth planes (Depth-of-Field setup). Thus, users were easily able to select one of them by shifting their eye focus. However, in that work, EEG signals were collected through electrodes placed on occipital and parietal regions (hair-covered areas), which demanded a long preparation time. Also, that work used low-frequency stimuli, which can produce visual fatigue and increase the risk of photosensitive epileptic seizures. In order to improve the practicality and visual comfort, this work proposes a BCI based on Depth-of-Field using the high-frequency SSVEP response measured from below-the-hairline areas (behind-the-ears). METHODS: Two high-frequency stimuli (31 Hz and 32 Hz) were used in a Depth-of-Field setup to study the SSVEP response from behind-the-ears (TP9 and TP10). Multivariate Spectral F-test (MSFT) method was used to verify the elicited response. Afterwards, a BCI was proposed to command a mobile robot in a virtual reality environment. The commands were recognized through Temporally Local Multivariate Synchronization Index (TMSI) method. RESULTS: The data analysis reveal that the focused stimuli elicit distinguishable SSVEP response when measured from hairless areas, in spite of the fact that the non-focused stimulus is also present in the field of view. Also, our BCI shows a satisfactory result, reaching average accuracy of 91.6% and Information Transfer Rate (ITR) of 5.3 bits/min. CONCLUSION: These findings contribute to the development of more safe and practical BCI.

Visual and Thermal Image Processing for Facial Specific Landmark Detection to Infer Emotions in a Child-Robot Interaction.

Child-Robot Interaction (CRI) has become increasingly addressed in research and applications. This work proposes a system for emotion recognition in children, recording facial images by both visual (RGB-red, green and blue) and Infrared Thermal Imaging (IRTI) cameras. For this purpose, the Viola-Jones algorithm is used on color images to detect facial regions of interest (ROIs), which are transferred to the thermal camera plane by multiplying a homography matrix obtained through the calibration process of the camera system. As a novelty, we propose to compute the error probability for each ROI located over thermal images, using a reference frame manually marked by a trained expert, in order to choose that ROI better placed according to the expert criteria. Then, this selected ROI is used to relocate the other ROIs, increasing the concordance with respect to the reference manual annotations. Afterwards, other methods for feature extraction, dimensionality reduction through Principal Component Analysis (PCA) and pattern classification by Linear Discriminant Analysis (LDA) are applied to infer emotions. The results show that our approach for ROI locations may track facial landmarks with significant low errors with respect to the traditional Viola-Jones algorithm. These ROIs have shown to be relevant for recognition of five emotions, specifically disgust, fear, happiness, sadness, and surprise, with our recognition system based on PCA and LDA achieving mean accuracy (ACC) and Kappa values of 85.75% and 81.84%, respectively. As a second stage, the proposed recognition system was trained with a dataset of thermal images, collected on 28 typically developing children, in order to infer one of five basic emotions (disgust, fear, happiness, sadness, and surprise) during a child-robot interaction. The results show that our system can be integrated to a social robot to infer child emotions during a child-robot interaction.

Emotion analysis in children through facial emissivity of infrared thermal imaging.

Physiological signals may be used as objective markers to identify emotions, which play relevant roles in social and daily life. To measure these signals, the use of contact-free techniques, such as Infrared Thermal Imaging (IRTI), is indispensable to individuals who have sensory sensitivity. The goal of this study is to propose an experimental design to analyze five emotions (disgust, fear, happiness, sadness and surprise) from facial thermal images of typically developing (TD) children aged 7-11 years using emissivity variation, as recorded by IRTI. For the emotion analysis, a dataset considered emotional dimensions (valence and arousal), facial bilateral sides and emotion classification accuracy. The results evidence the efficiency of the experimental design with interesting findings, such as the correlation between the valence and the thermal decrement in nose; disgust and happiness as potent triggers of facial emissivity variations; and significant emissivity variations in nose, cheeks and periorbital regions associated with different emotions. Moreover, facial thermal asymmetry was revealed with a distinct thermal tendency in the cheeks, and classification accuracy reached a mean value greater than 85%. From the results, the emissivity variations were an efficient marker to analyze emotions in facial thermal images, and IRTI was confirmed to be an outstanding technique to study emotions. This study contributes a robust dataset to analyze the emotions of 7-11-year-old TD children, an age range for which there is a gap in the literature.

System based on subject-specific bands to recognize pedaling motor imagery: towards a BCI for lower-limb rehabilitation.

OBJECTIVE: The aim of this study is to propose a recognition system of pedaling motor imagery for lower-limb rehabilitation, which uses unsupervised methods to improve the feature extraction, and consequently the class discrimination of EEG patterns. APPROACH: After applying a spectrogram based on short-time Fourier transform (SSTFT), both sparseness constraints and total power are used on the time-frequency representation to automatically locate the subject-specific bands that pack the highest power during pedaling motor imagery. The output frequency bands are employed in the recognition system to automatically adjust the cut-off frequency of a low-pass filter (Butterworth, 2nd order). Riemannian geometry is also used to extract spatial features, which are further analyzed through a fast version of neighborhood component analysis to increase the class separability. MAIN RESULTS: For ten healthy subjects, our recognition system based on subject-specific bands achieved mean accuracy of [Formula: see text] and mean Kappa of [Formula: see text]. SIGNIFICANCE: Our approach can be used to obtain a low-cost robotic rehabilitation system based on motorized pedal, as pedaling exercises have shown great potential for improving the muscular performance of post-stroke survivors.