Prediction of cognitive conflict during unexpected robot behavior under different mental workload conditions in a physical human-robot collaboration.

Objective. Brain-computer interface (BCI) technology is poised to play a prominent role in modern work environments, especially a collaborative environment where humans and machines work in close proximity, often with physical contact. In a physical human robot collaboration (pHRC), the robot performs complex motion sequences. Any unexpected robot behavior or faulty interaction might raise safety concerns. Error-related potentials, naturally generated by the brain when a human partner perceives an error, have been extensively employed in BCI as implicit human feedback to adapt robot behavior to facilitate a safe and intuitive interaction. However, the integration of BCI technology with error-related potential for robot control demands failure-free integration of highly uncertain electroencephalography (EEG) signals, particularly influenced by the physical and cognitive state of the user. As a higher workload on the user compromises their access to cognitive resources needed for error awareness, it is crucial to study how mental workload variations impact the error awareness as it might raise safety concerns in pHRC. In this study, we aim to study how cognitive workload affects the error awareness of a human user engaged in a pHRC.Approach. We designed a blasting task with an abrasive industrial robot and manipulated the mental workload with a secondary arithmetic task of varying difficulty. EEG data, perceived workload, task and physical performance were recorded from 24 participants moving the robot arm. The error condition was achieved by the unexpected stopping of the robot in 33% of trials.Main results. We observed a diminished amplitude for the prediction error negativity (PEN) and error positivity (Pe), indicating reduced error awareness with increasing mental workload. We further observed an increased frontal theta power and increasing trend in the central alpha and central beta power after the unexpected robot stopping compared to when the robot stopped correctly at the target. We also demonstrate that a popular convolution neural network model, EEGNet, could predict the amplitudes of PEN and Pe from the EEG data prior to the error.Significance. This prediction model could be instrumental in developing an online prediction model that could forewarn the system and operators of the diminished error awareness of the user, alluding to a potential safety breach in error-related potential-based BCI system for pHRC. Therefore, our work paves the way for embracing BCI technology in pHRC to optimally adapt the robot behavior for personalized user experience using real-time brain activity, enriching the quality of the interaction.

Brain Connectivity Changes During Bimanual and Rotated Motor Imagery.

Motor imagery-based brain-computer interface (MI-BCI) currently represents a new trend in rehabilitation. However, individual differences in the responsive frequency bands and a poor understanding of the communication between the ipsilesional motor areas and other regions limit the use of MI-BCI therapy. Objective: Bimanual training has recently attracted attention as it achieves better outcomes as compared to repetitive one-handed training. This study compared the effects of three MI tasks with different visual feedback. Methods: Fourteen healthy subjects performed single hand motor imagery tasks while watching single static hand (traditional MI), single hand with rotation movement (rmMI), and bimanual coordination with a hand pedal exerciser (bcMI). Functional connectivity is estimated by Transfer Entropy (TE) analysis for brain information flow. Results: Brain connectivity of conducting three MI tasks showed that the bcMI demonstrated increased communications from the parietal to the bilateral prefrontal areas and increased contralateral connections between motor-related zones and spatial processing regions. Discussion/Conclusion: The results revealed bimanual coordination operation events increased spatial information and motor planning under the motor imagery task. And the proposed bimanual coordination MI-BCI (bcMI-BCI) can also achieve the effect of traditional motor imagery tasks and promotes more effective connections with different brain regions to better integrate motor-cortex functions for aiding the development of more effective MI-BCI therapy. Clinical and Translational Impact Statement The proposed bcMI-BCI provides more effective connections with different brain areas and integrates motor-cortex functions to promote motor imagery rehabilitation for patients' impairment.

Unraveling the Physiological Correlates of Mental Workload Variations in Tracking and Collision Prediction Tasks.

Modern work environments have extensive interactions with technology and greater cognitive complexity of the tasks, which results in human operators experiencing increased mental workload. Air traffic control operators routinely work in such complex environments, and we designed tracking and collision prediction tasks to emulate their elementary tasks. The physiological response to the workload variations in these tasks was elucidated to untangle the impact of workload variations experienced by operators. Electroencephalogram (EEG), eye activity, and heart rate variability (HRV) data were recorded from 24 participants performing tracking and collision prediction tasks with three levels of difficulty. Our findings indicate that variations in task load in both these tasks are sensitively reflected in EEG, eye activity and HRV data. Multiple regression results also show that operators' performance in both tasks can be predicted using the corresponding EEG, eye activity and HRV data. The results also demonstrate that the brain dynamics during each of these tasks can be estimated from the corresponding eye activity, HRV and performance data. Furthermore, the markedly distinct neurometrics of workload variations in the tracking and collision prediction tasks indicate that neurometrics can provide insights on the type of mental workload. These findings have applicability to the design of future mental workload adaptive systems that integrate neurometrics in deciding not just "when" but also "what" to adapt. Our study provides compelling evidence in the viability of developing intelligent closed-loop mental workload adaptive systems that ensure efficiency and safety in complex work environments.

Comparing the Differences in Brain Activities and Neural Comodulations Associated With Motion Sickness Between Drivers and Passengers.

It is common to believe that passengers are more adversely affected by motion sickness than drivers. However, no study has compared passengers and drivers' neural activities and drivers experiencing motion sickness (MS). Therefore, this study attempts to explore brain dynamics in motion sickness among passengers and drivers. Eighteen volunteers participated in simulating the driving winding road experiment while their subjective motion sickness levels and electroencephalogram (EEG) signals were simultaneously recorded. Independent Component Analysis (ICA) was employed to isolate MS-related independent components (ICs) from EEG. Furthermore, comodulation analysis was applied to decompose spectra of interest ICs, related to MS, to find the specific spectra-related temporally independent modulators (IMs). The results showed that passengers' alpha band (8-12 Hz) power increased in correlation with the MS level in the parietal, occipital midline and left and right motor areas, and drivers' alpha band (8-12 Hz) power showed relatively smaller increases than those in the passenger. Further, the results also indicate that the enhanced activation of alpha IMs in the passenger than the driver is due to a higher degree of motion sickness. In conclusion, compared to the driver, the passenger experience more conflicts among multimodal sensory systems and demand neuro-physiological regulation.

The Impact of Vigorous Cycling Exercise on Visual Attention: A Study With the BR8 Wireless Dry EEG System.

Many studies have reported that exercise can influence cognitive performance. But advancing our understanding of the interrelations between psychology and physiology in sports neuroscience requires the study of real-time brain dynamics during exercise in the field. Electroencephalography (EEG) is one of the most powerful brain imaging technologies. However, the limited portability and long preparation time of traditional wet-sensor systems largely limits their use to laboratory settings. Wireless dry-sensor systems are emerging with much greater potential for practical application in sports. Hence, in this paper, we use the BR8 wireless dry-sensor EEG system to measure P300 brain dynamics while cycling at various intensities. The preparation time was mostly less than 2 min as BR8 system's dry sensors were able to attain the required skin-sensor interface impedance, enabling its operation without any skin preparation or application of conductive gel. Ten participants performed four sessions of a 3 min rapid serial visual presentation (RSVP) task while resting and while cycling. These four sessions were pre-CE (RSVP only), low-CE (RSVP in 40-50% of max heart rate), vigorous-CE (RSVP in 71-85% of max heart rate) and post-CE (RSVP only). The recorded brain signals demonstrate that the P300 amplitudes, observed at the Pz channel, for the target and non-target responses were significantly different in all four sessions. The results also show decreased reaction times to the visual attention task during vigorous exercise, enriching our understanding of the ways in which exercise can enhance cognitive performance. Even though only a single channel was evaluated in this study, the quality and reliability of the measurement using these dry sensor-based EEG systems is clearly demonstrated by our results. Further, the smooth implementation of the experiment with a dry system and the success of the data analysis demonstrate that wireless dry EEG devices can open avenues for real-time measurement of cognitive functions in athletes outside the laboratory.

Identification of EEG Dynamics During Freezing of Gait and Voluntary Stopping in Patients With Parkinson's Disease.

Mobility is severely impacted in patients with Parkinson's disease (PD), who often experience involuntary stopping from the freezing of gait (FOG). Understanding the neurophysiological difference between "voluntary stopping" and "involuntary stopping" caused by FOG is vital for the detection of and potential intervention for FOG in the daily lives of patients. This study characterised the electroencephalographic (EEG) signature associated with FOG in contrast to voluntary stopping. The protocol consisted of a timed up-and-go (TUG) task and an additional TUG task with a voluntary stopping component, where participants reacted to verbal "stop" and "walk" instructions by voluntarily stopping or walking. Event-related spectral perturbation (ERSP) analysis was performed to study the dynamics of the EEG spectra induced by different walking phases, including normal walking, voluntary stopping and episodes of involuntary stopping (FOG), as well as the transition windows between normal walking and voluntary stopping or FOG. These results demonstrate for the first time that the EEG signal during the transition from walking to voluntary stopping is distinguishable from that during the transition to involuntary stopping caused by FOG. The EEG signature of voluntary stopping exhibits a significantly decreased power spectrum compared with that of FOG episodes, with distinctly different patterns in the delta and low-beta power in the central area. These findings suggest the possibility of a practical EEG-based tool that can accurately predict FOG episodes, excluding the potential confounding of voluntary stopping.

Computer-Based CPR Simulation Towards Validation of AHA/ERC Guidelines.

As per the AHA 2015 and ERC 2015 guidelines for resuscitation, chest compression depth should be between 5 and 6 cm with a rate of 100-120 compressions per minute. Theoretical validation of these guidelines is still elusive. We developed a computer model of the cardiopulmonary resuscitation (CPR) system to validate these guidelines. A lumped element computer model of the cardiovascular system was developed to simulate cardiac arrest and CPR. Cardiac output was compared for a range of compression pressures and frequencies. It was observed from our investigation that there is an optimum compression pressure and rate. The maximum cardiac output occurred at 100 mmHg, which is approximately 5.7 cm, and in the range of 100 to 120 compressions per minute with an optimum value at 110 compressions per minute, validating the guidelines. Increasing the pressure or the depth of compression beyond the optimum, limits the blood flow by depleting the volume in the cardiac chambers and not allowing for an effective stroke volume. Similarly increasing the compression rate beyond the optimum degrades the ability of the chambers to pump blood. The results also bring out the importance of complete recoil of the chest after each compression with more than 400% increase in cardiac output from 90% recoil to 100% recoil. Our simulation predicts that the recommendation to compress harder and faster is not the best counsel as there is an optimum compression pressure and rate for high-quality CPR.