Biosensor Real-Time Affective Analytics in Virtual and Mixed Reality Medical Education Serious Games: Cohort Study.

BACKGROUND: The role of emotion is crucial to the learning process, as it is linked to motivation, interest, and attention. Affective states are expressed in the brain and in overall biological activity. Biosignals, like heart rate (HR), electrodermal activity (EDA), and electroencephalography (EEG) are physiological expressions affected by emotional state. Analyzing these biosignal recordings can point to a person's emotional state. Contemporary medical education has progressed extensively towards diverse learning resources using virtual reality (VR) and mixed reality (MR) applications. OBJECTIVE: This paper aims to study the efficacy of wearable biosensors for affect detection in a learning process involving a serious game in the Microsoft HoloLens VR/MR platform. METHODS: A wearable array of sensors recording HR, EDA, and EEG signals was deployed during 2 educational activities conducted by 11 participants of diverse educational level (undergraduate, postgraduate, and specialist neurosurgeon doctors). The first scenario was a conventional virtual patient case used for establishing the personal biosignal baselines for the participant. The second was a case in a VR/MR environment regarding neuroanatomy. The affective measures that we recorded were EEG (theta/beta ratio and alpha rhythm), HR, and EDA. RESULTS: Results were recorded and aggregated across all 3 groups. Average EEG ratios of the virtual patient (VP) versus the MR serious game cases were recorded at 3.49 (SD 0.82) versus 3.23 (SD 0.94) for students, 2.59 (SD 0.96) versus 2.90 (SD 1.78) for neurosurgeons, and 2.33 (SD 0.26) versus 2.56 (SD 0.62) for postgraduate medical students. Average alpha rhythm of the VP versus the MR serious game cases were recorded at 7.77 (SD 1.62) µV versus 8.42 (SD 2.56) µV for students, 7.03 (SD 2.19) µV versus 7.15 (SD 1.86) µV for neurosurgeons, and 11.84 (SD 6.15) µV versus 9.55 (SD 3.12) µV for postgraduate medical students. Average HR of the VP versus the MR serious game cases were recorded at 87 (SD 13) versus 86 (SD 12) bpm for students, 81 (SD 7) versus 83 (SD 7) bpm for neurosurgeons, and 81 (SD 7) versus 77 (SD 6) bpm for postgraduate medical students. Average EDA of the VP versus the MR serious game cases were recorded at 1.198 (SD 1.467) µS versus 4.097 (SD 2.79) µS for students, 1.890 (SD 2.269) µS versus 5.407 (SD 5.391) µS for neurosurgeons, and 0.739 (SD 0.509) µS versus 2.498 (SD 1.72) µS for postgraduate medical students. The variations of these metrics have been correlated with existing theoretical interpretations regarding educationally relevant affective analytics, such as engagement and educational focus. CONCLUSIONS: These results demonstrate that this novel sensor configuration can lead to credible affective state detection and can be used in platforms like intelligent tutoring systems for providing real-time, evidence-based, affective learning analytics using VR/MR-deployed medical education resources.

Current trends and future perspectives of space neuroscience towards preparation for interplanetary missions.

This review addresses central nervous system (CNS) physiological changes during inter-planetary missions, specifically sensorimotor processing and sleep disorders. Isolation, confinement and induced stress factors also have a detrimental effect on cognitive and mental well-being, which could jeopardize mission accomplishment. Although countermeasures have been proposed, they mostly focus on cardiovascular and/or musculoskeletal systems. Long-term space flights require optimal cognitive performance of crew members during weightlessness for longer time periods independent of ground support. The present study describes various countermeasures trends in neuroscientific data acquisition and future perspectives of advanced analysis through functional connectivity and graph theory. These could be used to identify early deterioration patterns and evaluate the robustness of countermeasures employed.

The Pattern of Mu Rhythm Modulation During Emotional Destination Memory: Comparison Between Mild Cognitive Impairment Patients and Healthy Controls.

Leading theories of affect development and empirical studies suggest that emotion can enhance memory in older adults. Destination memory which is defined as the ability to remember to whom we told a piece of information is being found to be compromised in aging. In the present study, we sought to assess destination memory using emotional stimuli (Emotional Destination Memory, EDM) in 16 older adults with mild cognitive impairment (MCI) and 16 healthy controls and shed light onto its potential neurophysiological aspects. We measured Mu suppression in frontal and temporal regions via EEG in real time while participants performed the task of EDM. Results showed no group differences in task performance but significant differences in fronto-temporal activations, specifically in electrodes F7 and F8. Differential Mu rhythm pattern was observed between healthy controls and MCI with the first exhibiting Mu suppression and the last Mu enhancement. Furthermore, Mu enhancement in temporal electrodes within the MCI group was associated with lower scores on EDM. The absence of group differences in the task can be explained by the fact that even if there are underlying structural or functional deficits in the MCI group, these deficits are manifested only at neurophysiological level and not at a behavioral level, which is a common pattern in the process of cognitive decline in its initial phases. The overall findings reveal that, even if there are not any behavioral decrements in MCI patients, they show reduced activations in fronto-temporal regions and this can be attributed to general impairment in emotional destination memory due to possible mirror neuron deficiency.