Assessment of Valance Emotional State Using EEG-EDA Coupling and Explainable Classifiers.

ABSTRACT

Emotion influences human life and impacts daily life activities. During emotional processes, physiological signals interact with each other instead of functioning separately. Although unimodal and multimodal approaches have been explored for emotion classification, there is a lack of inclusion of central and peripheral nervous system signal interaction-based approaches. In this study, an attempt has been made to characterize valance emotional states using Electroencephalogram (EEG)- Electrodermal activity (EDA) based coupling. For this, multimodal signals are obtained from the publicly available DEAP database (n=32 subjects). The EEG signals are decomposed into θ, α, ß, and bands and EDA signals are decomposed into phasic and tonic components. Then two EEG, three EDA, and two EEG-EDA coupling-based features are extracted and applied to three classifiers namely Random Forest (RF), Linear discriminant analysis, and Adaptive boosting. In addition, SHAP analysis is performed to explain classifiers' performance with respect to features. The result shows that the proposed approach is able to classify valence emotional states. The feature combination of EEG, EDA, and EEG-EDA coupling-based features with an RF classifier performs best with an F1-score of 68.21%. SHAP analysis in frontal electrodes with γ band obtained better discrimination among different valance states. This study underscores the significance of the coupling studies of EEG with EDA in classifying emotion. Therefore, the proposed approach can be extended to emotional state assessment in clinical settings.