Wearable Technologies for Electrodermal and Cardiac Activity Measurements: A Comparison between Fitbit Sense, Empatica E4 and Shimmer GSR3.

The capability of measuring specific neurophysiological and autonomic parameters plays a crucial role in the objective evaluation of a human's mental and emotional states. These human aspects are commonly known in the scientific literature to be involved in a wide range of processes, such as stress and arousal. These aspects represent a relevant factor especially in real and operational environments. Neurophysiological autonomic parameters, such as Electrodermal Activity (EDA) and Photoplethysmographic data (PPG), have been usually investigated through research-graded devices, therefore resulting in a high degree of invasiveness, which could negatively interfere with the monitored user's activity. For such a reason, in the last decade, recent consumer-grade wearable devices, usually designed for fitness-tracking purposes, are receiving increasing attention from the scientific community, and are characterized by a higher comfort, ease of use and, therefore, by a higher compatibility with daily-life environments. The present preliminary study was aimed at assessing the reliability of a consumer wearable device, i.e., the Fitbit Sense, with respect to a research-graded wearable, i.e., the Empatica E4 wristband, and a laboratory device, i.e., the Shimmer GSR3+. EDA and PPG data were collected among 12 participants while they performed multiple resting conditions. The results demonstrated that the EDA- and PPG-derived features computed through the wearable and research devices were positively and significantly correlated, while the reliability of the consumer device was significantly lower.

A Neuroergonomic Approach Fostered by Wearable EEG for the Multimodal Assessment of Drivers Trainees.

When assessing trainees' progresses during a driving training program, instructors can only rely on the evaluation of a trainee's explicit behavior and their performance, without having any insight about the training effects at a cognitive level. However, being able to drive does not imply knowing how to drive safely in a complex scenario such as the road traffic. Indeed, the latter point involves mental aspects, such as the ability to manage and allocate one's mental effort appropriately, which are difficult to assess objectively. In this scenario, this study investigates the validity of deploying an electroencephalographic neurometric of mental effort, obtained through a wearable electroencephalographic device, to improve the assessment of the trainee. The study engaged 22 young people, without or with limited driving experience. They were asked to drive along five different but similar urban routes, while their brain activity was recorded through electroencephalography. Moreover, driving performance, subjective and reaction times measures were collected for a multimodal analysis. In terms of subjective and performance measures, no driving improvement could be detected either through the driver's subjective measures or through their driving performance. On the other side, through the electroencephalographic neurometric of mental effort, it was possible to catch their improvement in terms of mental performance, with a decrease in experienced mental demand after three repetitions of the driving training tasks. These results were confirmed by the analysis of reaction times, that significantly improved from the third repetition as well. Therefore, being able to measure when a task is less mentally demanding, and so more automatic, allows to deduce the degree of users training, becoming capable of handling additional tasks and reacting to unexpected events.

A Review on Mental Stress Assessment Methods Using EEG Signals.

Mental stress is one of the serious factors that lead to many health problems. Scientists and physicians have developed various tools to assess the level of mental stress in its early stages. Several neuroimaging tools have been proposed in the literature to assess mental stress in the workplace. Electroencephalogram (EEG) signal is one important candidate because it contains rich information about mental states and condition. In this paper, we review the existing EEG signal analysis methods on the assessment of mental stress. The review highlights the critical differences between the research findings and argues that variations of the data analysis methods contribute to several contradictory results. The variations in results could be due to various factors including lack of standardized protocol, the brain region of interest, stressor type, experiment duration, proper EEG processing, feature extraction mechanism, and type of classifier. Therefore, the significant part related to mental stress recognition is choosing the most appropriate features. In particular, a complex and diverse range of EEG features, including time-varying, functional, and dynamic brain connections, requires integration of various methods to understand their associations with mental stress. Accordingly, the review suggests fusing the cortical activations with the connectivity network measures and deep learning approaches to improve the accuracy of mental stress level assessment.

An EEG-Based Transfer Learning Method for Cross-Subject Fatigue Mental State Prediction.

Fatigued driving is one of the main causes of traffic accidents. The electroencephalogram (EEG)-based mental state analysis method is an effective and objective way of detecting fatigue. However, as EEG shows significant differences across subjects, effectively "transfering" the EEG analysis model of the existing subjects to the EEG signals of other subjects is still a challenge. Domain-Adversarial Neural Network (DANN) has excellent performance in transfer learning, especially in the fields of document analysis and image recognition, but has not been applied directly in EEG-based cross-subject fatigue detection. In this paper, we present a DANN-based model, Generative-DANN (GDANN), which combines Generative Adversarial Networks (GAN) to enhance the ability by addressing the issue of different distribution of EEG across subjects. The comparative results show that in the analysis of cross-subject tasks, GDANN has a higher average accuracy of 91.63% in fatigue detection across subjects than those of traditional classification models, which is expected to have much broader application prospects in practical brain-computer interaction (BCI).

The Sample Size Matters: To What Extent the Participant Reduction Affects the Outcomes of a Neuroscientific Research. A Case-Study in Neuromarketing Field.

The sample size is a crucial concern in scientific research and even more in behavioural neurosciences, where besides the best practice it is not always possible to reach large experimental samples. In this study we investigated how the outcomes of research change in response to sample size reduction. Three indices computed during a task involving the observations of four videos were considered in the analysis, two related to the brain electroencephalographic (EEG) activity and one to autonomic physiological measures, i.e., heart rate and skin conductance. The modifications of these indices were investigated considering five subgroups of sample size (32, 28, 24, 20, 16), each subgroup consisting of 630 different combinations made by bootstrapping n (n = sample size) out of 36 subjects, with respect to the total population (i.e., 36 subjects). The correlation analysis, the mean squared error (MSE), and the standard deviation (STD) of the indexes were studied at the participant reduction and three factors of influence were considered in the analysis: the type of index, the task, and its duration (time length). The findings showed a significant decrease of the correlation associated to the participant reduction as well as a significant increase of MSE and STD (p < 0.05). A threshold of subjects for which the outcomes remained significant and comparable was pointed out. The effects were to some extents sensitive to all the investigated variables, but the main effect was due to the task length. Therefore, the minimum threshold of subjects for which the outcomes were comparable increased at the reduction of the spot duration.

InstanceEasyTL: An Improved Transfer-Learning Method for EEG-Based Cross-Subject Fatigue Detection.

Electroencephalogram (EEG) is an effective indicator for the detection of driver fatigue. Due to the significant differences in EEG signals across subjects, and difficulty in collecting sufficient EEG samples for analysis during driving, detecting fatigue across subjects through using EEG signals remains a challenge. EasyTL is a kind of transfer-learning model, which has demonstrated better performance in the field of image recognition, but not yet been applied in cross-subject EEG-based applications. In this paper, we propose an improved EasyTL-based classifier, the InstanceEasyTL, to perform EEG-based analysis for cross-subject fatigue mental-state detection. Experimental results show that InstanceEasyTL not only requires less EEG data, but also obtains better performance in accuracy and robustness than EasyTL, as well as existing machine-learning models such as Support Vector Machine (SVM), Transfer Component Analysis (TCA), Geodesic Flow Kernel (GFK), and Domain-adversarial Neural Networks (DANN), etc.

Correlation and Similarity between Cerebral and Non-Cerebral Electrical Activity for User's States Assessment.

Human tissues own conductive properties, and the electrical activity produced by human organs can propagate throughout the body due to neuro transmitters and electrolytes. Therefore, it might be reasonable to hypothesize correlations and similarities between electrical activities among different parts of the body. Since no works have been found in this direction, the proposed study aimed at overcoming this lack of evidence and seeking analogies between the brain activity and the electrical activity of non-cerebral locations, such as the neck and wrists, to determine if i) cerebral parameters can be estimated from non-cerebral sites, and if ii) non-cerebral sensors can replace cerebral sensors for the evaluation of the users under specific experimental conditions, such as eyes open or closed. In fact, the use of cerebral sensors requires high-qualified personnel, and reliable recording systems, which are still expensive. Therefore, the possibility to use cheaper and easy-to-use equipment to estimate cerebral parameters will allow making some brain-based applications less invasive and expensive, and easier to employ. The results demonstrated the occurrence of significant correlations and analogies between cerebral and non-cerebral electrical activity. Furthermore, the same discrimination and classification accuracy were found in using the cerebral or non-cerebral sites for the user's status assessment.

The Dry Revolution: Evaluation of Three Different EEG Dry Electrode Types in Terms of Signal Spectral Features, Mental States Classification and Usability.

One century after the first recording of human electroencephalographic (EEG) signals, EEG has become one of the most used neuroimaging techniques. The medical devices industry is now able to produce small and reliable EEG systems, enabling a wide variety of applications also with no-clinical aims, providing a powerful tool to neuroscientific research. However, these systems still suffer from a critical limitation, consisting in the use of wet electrodes, that are uncomfortable and require expertise to install and time from the user. In this context, dozens of different concepts of EEG dry electrodes have been recently developed, and there is the common opinion that they are reaching traditional wet electrodes quality standards. However, although many papers have tried to validate them in terms of signal quality and usability, a comprehensive comparison of different dry electrode types from multiple points of view is still missing. The present work proposes a comparison of three different dry electrode types, selected among the main solutions at present, against wet electrodes, taking into account several aspects, both in terms of signal quality and usability. In particular, the three types consisted in gold-coated single pin, multiple pins and solid-gel electrodes. The results confirmed the great standards achieved by dry electrode industry, since it was possible to obtain results comparable to wet electrodes in terms of signals spectra and mental states classification, but at the same time drastically reducing the time of montage and enhancing the comfort. In particular, multiple-pins and solid-gel electrodes overcome gold-coated single-pin-based ones in terms of comfort.

Interhemispheric Connectivity Characterizes Cortical Reorganization in Motor-Related Networks After Cerebellar Lesions.

Although cerebellar-cortical interactions have been studied extensively in animal models and humans using modern neuroimaging techniques, the effects of cerebellar stroke and focal lesions on cerebral cortical processing remain unknown. In the present study, we analyzed the large-scale functional connectivity at the cortical level by combining high-density electroencephalography (EEG) and source imaging techniques to evaluate and quantify the compensatory reorganization of brain networks after cerebellar damage. The experimental protocol comprised a repetitive finger extension task by 10 patients with unilateral focal cerebellar lesions and 10 matched healthy controls. A graph theoretical approach was used to investigate the functional reorganization of cortical networks. Our patients, compared with controls, exhibited significant differences at global and local topological level of their brain networks. An abnormal rise in small-world network efficiency was observed in the gamma band (30-40 Hz) during execution of the task, paralleled by increased long-range connectivity between cortical hemispheres. Our findings show that a pervasive reorganization of the brain network is associated with cerebellar focal damage and support the idea that the cerebellum boosts or refines cortical functions. Clinically, these results suggest that cortical changes after cerebellar damage are achieved through an increase in the interactions between remote cortical areas and that rehabilitation should aim to reshape functional activation patterns. Future studies should determine whether these hypotheses are limited to motor tasks or if they also apply to cerebro-cerebellar dysfunction in general.

Time-varying effective connectivity of the cortical neuroelectric activity associated with behavioural microsleeps.

An episode of complete failure to respond during an attentive task accompanied by behavioural signs of sleep is called a behavioural microsleep. We proposed a combination of high-resolution EEG and an advanced method for time-varying effective connectivity estimation for reconstructing the temporal evolution of the causal relations between cortical regions when microsleeps occur during a continuous visuomotor task. We found connectivity patterns involving left-right frontal, left-right parietal, and left-frontal/right-parietal connections commencing in the interval [-500; -250] ms prior to the onset of microsleeps and disappearing at the end of the microsleeps. Our results from global graph indices derived from effective connectivity analysis have revealed EEG-based biomarkers of all stages of microsleeps (preceding, onset, pre-recovery, recovery). In particular, this raises the possibility of being able to predict microsleeps in real-world tasks and initiate a 'wake-up' intervention to avert the microsleeps and, hence, prevent injurious and even multi-fatality accidents.

Quantitative Assessment of the Training Improvement in a Motor-Cognitive Task by Using EEG, ECG and EOG Signals.

Generally, the training evaluation methods consist in experts supervision and qualitative check of the operator's skills improvement by asking them to perform specific tasks and by verifying the final performance. The aim of this work is to find out if it is possible to obtain quantitative information about the degree of the learning process throughout the training period by analyzing neuro-physiological signals, such as the electroencephalogram, the electrocardiogram and the electrooculogram. In fact, it is well known that such signals correlate with a variety of cognitive processes, e.g. attention, information processing, and working memory. A group of 10 subjects have been asked to train daily with the NASA multi-attribute-task-battery. During such training period the neuro-physiological, behavioral and subjective data have been collected. In particular, the neuro-physiological signals have been recorded on the first (T1), on the third (T3) and on the last training day (T5), while the behavioral and subjective data have been collected every day. Finally, all these data have been compared for a complete overview of the learning process and its relations with the neuro-physiological parameters. It has been shown how the integration of brain activity, in the theta and alpha frequency bands, with the autonomic parameters of heart rate and eyeblink rate could be used as metric for the evaluation of the learning progress, as well as the final training level reached by the subjects, in terms of request of cognitive resources.

Investigating Driver Fatigue versus Alertness Using the Granger Causality Network.

Driving fatigue has been identified as one of the main factors affecting drivers' safety. The aim of this study was to analyze drivers' different mental states, such as alertness and drowsiness, and find out a neurometric indicator able to detect drivers' fatigue level in terms of brain networks. Twelve young, healthy subjects were recruited to take part in a driver fatigue experiment under different simulated driving conditions. The Electroencephalogram (EEG) signals of the subjects were recorded during the whole experiment and analyzed by using Granger-Causality-based brain effective networks. It was that the topology of the brain networks and the brain's ability to integrate information changed when subjects shifted from the alert to the drowsy stage. In particular, there was a significant difference in terms of strength of Granger causality (GC) in the frequency domain and the properties of the brain effective network i.e., causal flow, global efficiency and characteristic path length between such conditions. Also, some changes were more significant over the frontal brain lobes for the alpha frequency band. These findings might be used to detect drivers' fatigue levels, and as reference work for future studies.

Neurophysiological correlates of embodiment and motivational factors during the perception of virtual architectural environments.

The recent efforts aimed at providing neuroscientific explanations of how people perceive and experience architectural environments have largely justified the initial belief in the value of neuroscience for architecture. However, a systematic development of a coherent theoretical and experimental framework is missing. To investigate the neurophysiological reactions related to the appreciation of ambiances, we recorded the electroencephalographic (EEG) signals in an immersive virtual reality during the appreciation of interior designs. Such data have been analyzed according to the working hypothesis that appreciated environments involve embodied simulation mechanisms and circuits mediating approaching stimuli. EEG recordings of 12 healthy subjects have been performed during the perception of three-dimensional interiors that have been simulated in a CAVE system and judged according to dimensions of familiarity, novelty, comfort, pleasantness, arousal and presence. A correlation analysis on personal judgments returned that scores of novelty, pleasantness and comfort are positively correlated, while familiarity and novelty are in negative way. Statistical spectral maps reveal that pleasant, novel and comfortable interiors produce a de-synchronization of the mu rhythm over left sensorimotor areas. Interiors judged more pleasant and less familiar generate an activation of left frontal areas (theta and alpha bands), along an involvement of areas devoted to spatial navigation. An increase in comfort returns an enhancement of the theta frontal midline activity. Cerebral activations underlying appreciation of architecture could involve different mechanisms regulating corporeal, emotional and cognitive reactions. Therefore, it might be suggested that people's experience of architectural environments is intrinsically structured by the possibilities for action.

Two are better than one: Differences in cortical EEG patterns during auditory and visual verbal working memory processing between Unilateral and Bilateral Cochlear Implanted children.

Despite the proven effectiveness of cochlear implant (CI) in the hearing restoration of deaf or hard-of-hearing (DHH) children, to date, extreme variability in verbal working memory (VWM) abilities is observed in both unilateral and bilateral CI user children (CIs). Although clinical experience has long observed deficits in this fundamental executive function in CIs, the cause to date is still unknown. Here, we have set out to investigate differences in brain functioning regarding the impact of monaural and binaural listening in CIs compared with normal hearing (NH) peers during a three-level difficulty n-back task undertaken in two sensory modalities (auditory and visual). The objective of this pioneering study was to identify electroencephalographic (EEG) marker pattern differences in visual and auditory VWM performances in CIs compared to NH peers and possible differences between unilateral cochlear implant (UCI) and bilateral cochlear implant (BCI) users. The main results revealed differences in theta and gamma EEG bands. Compared with hearing controls and BCIs, UCIs showed hypoactivation of theta in the frontal area during the most complex condition of the auditory task and a correlation of the same activation with VWM performance. Hypoactivation in theta was also observed, again for UCIs, in the left hemisphere when compared to BCIs and in the gamma band in UCIs compared to both BCIs and NHs. For the latter two, a correlation was found between left hemispheric gamma oscillation and performance in the audio task. These findings, discussed in the light of recent research, suggest that unilateral CI is deficient in supporting auditory VWM in DHH. At the same time, bilateral CI would allow the DHH child to approach the VWM benchmark for NH children. The present study suggests the possible effectiveness of EEG in supporting, through a targeted approach, the diagnosis and rehabilitation of VWM in DHH children.

Bridging the Gap between Psychophysiological and Audiological Factors in the Assessment of Tinnitus: An EEG Investigation in the Beta Band.

BACKGROUND: Despite substantial progress in investigating its psychophysical complexity, tinnitus remains a scientific and clinical enigma. The present study, through an ecological and multidisciplinary approach, aims to identify associations between electroencephalographic (EEG) and psycho-audiological variables. METHODS: EEG beta activity, often related to stress and anxiety, was acquired from 12 tinnitus patients (TIN group) and 7 controls (CONT group) during an audio cognitive task and at rest. We also investigated psychological (SCL-90-R; STAI-Y; BFI-10) and audiological (THI; TQ12-I; Hyperacusis) variables using non-parametric statistics to assess differences and relationships between and within groups. RESULTS: In the TIN group, frontal beta activity positively correlated with hyperacusis, parietal activity, and trait anxiety; the latter is also associated with depression in CONT. Significant differences in paranoid ideation and openness were found between groups. CONCLUSIONS: The connection between anxiety trait, beta activity in the fronto-parietal cortices and hyperacusis provides insights into brain functioning in tinnitus patients, offering quantitative descriptions for clinicians and new multidisciplinary treatment hypotheses.

A Novel EEG-Based Assessment of Distraction in Simulated Driving under Different Road and Traffic Conditions.

The drivers' distraction plays a crucial role in road safety as it is one of the main impacting causes of road accidents. The phenomenon of distraction encompasses both psychological and environmental factors and, therefore, addressing the complex interplay contributing to human distraction in automotive is crucial for developing technologies and interventions for improving road safety. In scientific literature, different works were proposed for the distraction characterization in automotive, but there is still the lack of a univocal measure to assess the degree of distraction, nor a gold-standard tool that allows to "detect" eventual events, road traffic, and additional driving tasks that might contribute to the drivers' distraction. Therefore, the present study aimed at developing an EEG-based "Distraction index" obtained by the combination of the driver's mental workload and attention neurometrics and investigating and validating its reliability by analyzing together subjective and behavioral measures. A total of 25 licensed drivers were involved in this study, where they had to drive in two different scenarios, i.e., City and Highway, while different secondary tasks were alternatively proposed in addition to the main one to modulate the driver's attentional demand. The statistical analysis demonstrated the reliability of the proposed EEG-based distraction index in identifying the drivers' distraction when driving along different roads and traffic conditions (all p < 0.001). More importantly, the proposed index was demonstrated to be reliable in identifying which are the most impacting additional driving tasks on the drivers' distraction (all p < 0.01).

Reducing flight upset risk and startle response: A study of the wake vortex alert with licensed commercial pilots.

The study aimed at investigating the impact of an innovative Wake Vortex Alert (WVA) avionics on pilots' operation and mental states, intending to improve aviation safety by mitigating the risks associated with wake vortex encounters (WVEs). Wake vortices, generated by jet aircraft, pose a significant hazard to trailing or crossing aircrafts. Despite existing separation rules, incidents involving WVEs continue to occur, especially affecting smaller aircrafts like business jets, resulting in aircraft upsets and occasional cabin injuries. To address these challenges, the study focused on developing and validating an alert system that can be presented to air traffic controllers, enabling them to warn flight crews. This empowers the flight crews to either avoid the wake vortex or secure the cabin to prevent injuries. The research employed a multidimensional approach including an analysis of human performance and human factors (HF) issues to determine the potential impact of the alert on pilots' roles, tasks, and mental states. It also utilizes Human Assurance Levels (HALs) to evaluate the necessary human factors support based on the safety criticality of the new system. Realistic flight simulations were conducted to collect data of pilots' behavioural, subjective and neurophysiological responses during WVEs. The data allowed for an objective evaluation of the WVA impact on pilots' operation, behaviour and mental states (mental workload, stress levels and arousal). In particular, the results highlighted the effectiveness of the alert system in facilitating pilots' preparation, awareness and crew resource management (CRM). The results also highlighted the importance of avionics able to enhance aviation safety and reducing risks associated with wake vortex encounters. In particular, we demonstrated how providing timely information and improving situational awareness, the WVA will minimize the occurrence of WVEs and contribute to safer aviation operations.

Multiscale topological properties of functional brain networks during motor imagery after stroke.

In recent years, network analyses have been used to evaluate brain reorganization following stroke. However, many studies have often focused on single topological scales, leading to an incomplete model of how focal brain lesions affect multiple network properties simultaneously and how changes on smaller scales influence those on larger scales. In an EEG-based experiment on the performance of hand motor imagery (MI) in 20 patients with unilateral stroke, we observed that the anatomic lesion affects the functional brain network on multiple levels. In the beta (13-30 Hz) frequency band, the MI of the affected hand (Ahand) elicited a significantly lower smallworldness and local efficiency (Eloc) versus the unaffected hand (Uhand). Notably, the abnormal reduction in Eloc significantly depended on the increase in interhemispheric connectivity, which was in turn determined primarily by the rise of regional connectivity in the parieto-occipital sites of the affected hemisphere. Further, in contrast to the Uhand MI, in which significantly high connectivity was observed for the contralateral sensorimotor regions of the unaffected hemisphere, the regions with increased connectivity during the Ahand MI lay in the frontal and parietal regions of the contralaterally affected hemisphere. Finally, the overall sensorimotor function of our patients, as measured by Fugl-Meyer Assessment (FMA) index, was significantly predicted by the connectivity of their affected hemisphere. These results improve on our understanding of stroke-induced alterations in functional brain networks.

High-resolution EEG analysis of power spectral density maps and coherence networks in a proportional reasoning task.

Proportional reasoning is very important logical skill required in mathematics and science problem solving as well as in everyday life decisions. However, there is a lack of studies on neurophysiological correlates of proportional reasoning. To explore the brain activity of healthy adults while performing a balance scale task, we used high-resolution EEG techniques and graph-theory based connectivity analysis. After unskilled subjects learned how to properly solve the task, their cortical power spectral density (PSD) maps revealed an increased parietal activity in the beta band. This indicated that subjects started to perform calculations. In addition, the number of inter-hemispheric connections decreased after learning, implying a rearrangement of the brain activity. Repeated performance of the task led to the PSD decrease in the beta and gamma bands among parietal and frontal regions along with a synchronization of lower frequencies. These findings suggest that repetition led to a more automatic task performance. Subjects were also divided in two groups according to their scores on the test of logical thinking (TOLT). Although no group differences in the accuracy and reaction times were found, EEG data showed higher activity in the beta and gamma bands for the group that scored better on TOLT. Learning and repetition induced changes in the pattern of functional connectivity were evident for all frequency bands. Overall, the results indicated that higher frequency oscillations in frontal and parietal regions are particularly important for proportional reasoning.

Automatic and direct identification of blink components from scalp EEG.

Eye blink is an important and inevitable artifact during scalp electroencephalogram (EEG) recording. The main problem in EEG signal processing is how to identify eye blink components automatically with independent component analysis (ICA). Taking into account the fact that the eye blink as an external source has a higher sum of correlation with frontal EEG channels than all other sources due to both its location and significant amplitude, in this paper, we proposed a method based on correlation index and the feature of power distribution to automatically detect eye blink components. Furthermore, we prove mathematically that the correlation between independent components and scalp EEG channels can be translating directly from the mixing matrix of ICA. This helps to simplify calculations and understand the implications of the correlation. The proposed method doesn't need to select a template or thresholds in advance, and it works without simultaneously recording an electrooculography (EOG) reference. The experimental results demonstrate that the proposed method can automatically recognize eye blink components with a high accuracy on entire datasets from 15 subjects.