TPRO-NET: an EEG-based emotion recognition method reflecting subtle changes in emotion.

Emotion recognition based on Electroencephalogram (EEG) has been applied in various fields, including human-computer interaction and healthcare. However, for the popular Valence-Arousal-Dominance emotion model, researchers often classify the dimensions into high and low categories, which cannot reflect subtle changes in emotion. Furthermore, there are issues with the design of EEG features and the efficiency of transformer. To address these issues, we have designed TPRO-NET, a neural network that takes differential entropy and enhanced differential entropy features as input and outputs emotion categories through convolutional layers and improved transformer encoders. For our experiments, we categorized the emotions in the DEAP dataset into 8 classes and those in the DREAMER dataset into 5 classes. On the DEAP and the DREAMER datasets, TPRO-NET achieved average accuracy rates of 97.63%/97.47%/97.88% and 98.18%/98.37%/98.40%, respectively, on the Valence/Arousal/Dominance dimension for the subject-dependent experiments. Compared to other advanced methods, TPRO-NET demonstrates superior performance.

Intelligence Sparse Sensor Network for Automatic Early Evaluation of General Movements in Infants.

General movements (GMs) have been widely used for the early clinical evaluation of infant brain development, allowing immediate evaluation of potential development disorders and timely rehabilitation. The infants' general movements can be captured digitally, but the lack of quantitative assessment and well-trained clinical pediatricians presents an obstacle for many years to achieve wider deployment, especially in low-resource settings. There is a high potential to explore wearable sensors for movement analysis due to outstanding privacy, low cost, and easy-to-use features. This work presents a sparse sensor network with soft wireless IMU devices (SWDs) for automatic early evaluation of general movements in infants. The sparse network consisting of only five sensor nodes (SWDs) with robust mechanical properties and excellent biocompatibility continuously and stably captures full-body motion data. The proof-of-the-concept clinical testing with 23 infants showcases outstanding performance in recognizing neonatal activities, confirming the reliability of the system. Taken together with a tiny machine learning algorithm, the system can automatically identify risky infants based on the GMs, with an accuracy of up to 100% (99.9%). The wearable sparse sensor network with an artificial intelligence-based algorithm facilitates intelligent evaluation of infant brain development and early diagnosis of development disorders.

Classification and Analysis of Human Body Movement Characteristics Associated with Acrophobia Induced by Virtual Reality Scenes of Heights.

Acrophobia (fear of heights), a prevalent psychological disorder, elicits profound fear and evokes a range of adverse physiological responses in individuals when exposed to heights, which will lead to a very dangerous state for people in actual heights. In this paper, we explore the behavioral influences in terms of movements in people confronted with virtual reality scenes of extreme heights and develop an acrophobia classification model based on human movement characteristics. To this end, we used wireless miniaturized inertial navigation sensors (WMINS) network to obtain the information of limb movements in the virtual environment. Based on these data, we constructed a series of data feature processing processes, proposed a system model for the classification of acrophobia and non-acrophobia based on human motion feature analysis, and realized the classification recognition of acrophobia and non-acrophobia through the designed integrated learning model. The final accuracy of acrophobia dichotomous classification based on limb motion information reached 94.64%, which has higher accuracy and efficiency compared with other existing research models. Overall, our study demonstrates a strong correlation between people's mental state during fear of heights and their limb movements at that time.

Gated Recurrent Unit Network for Psychological Stress Classification Using Electrocardiograms from Wearable Devices.

In recent years, research on human psychological stress using wearable devices has gradually attracted attention. However, the physical and psychological differences among individuals and the high cost of data collection are the main challenges for further research on this problem. In this work, our aim is to build a model to detect subjects' psychological stress in different states through electrocardiogram (ECG) signals. Therefore, we design a VR high-altitude experiment to induce psychological stress for the subject to obtain the ECG signal dataset. In the experiment, participants wear smart ECG T-shirts with embedded sensors to complete different tasks so as to record their ECG signals synchronously. Considering the temporal continuity of individual psychological stress, a deep, gated recurrent unit (GRU) neural network is developed to capture the mapping relationship between subjects' ECG signals and stress in different states through heart rate variability features at different moments, so as to build a neural network model from the ECG signal to psychological stress detection. The experimental results show that compared with all comparison methods, our method has the best classification performance on the four stress states of resting, VR scene adaptation, VR task and recovery, and it can be a remote stress monitoring solution for some special industries.