Decoding emotions: Exploring the validity of sentiment analysis in psychotherapy.

OBJECTIVE: Given the importance of emotions in psychotherapy, valid measures are essential for research and practice. As emotions are expressed at different levels, multimodal measurements are needed for a nuanced assessment. Natural Language Processing (NLP) could augment the measurement of emotions. The study explores the validity of sentiment analysis in psychotherapy transcripts. METHOD: We used a transformer-based NLP algorithm to analyze sentiments in 85 transcripts from 35 patients. Construct and criterion validity were evaluated using self- and therapist reports and process and outcome measures via correlational, multitrait-multimethod, and multilevel analyses. RESULTS: The results provide indications in support of the sentiments' validity. For example, sentiments were significantly related to self- and therapist reports of emotions in the same session. Sentiments correlated significantly with in-session processes (e.g., coping experiences), and an increase in positive sentiments throughout therapy predicted better outcomes after treatment termination. DISCUSSION: Sentiment analysis could serve as a valid approach to assessing the emotional tone of psychotherapy sessions and may contribute to the multimodal measurement of emotions. Future research could combine sentiment analysis with automatic emotion recognition in facial expressions and vocal cues via the Nonverbal Behavior Analyzer (NOVA). Limitations (e.g., exploratory study with numerous tests) and opportunities are discussed.

Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling.

We aim to use topic modeling, an approach for discovering clusters of related words ("topics"), to predict symptom severity and therapeutic alliance in psychotherapy transcripts, while also identifying the most important topics and overarching themes for prediction. We analyzed 552 psychotherapy transcripts from 124 patients. Using BERTopic (Grootendorst, 2022), we extracted 250 topics each for patient and therapist speech. These topics were used to predict symptom severity and alliance with various competing machine-learning methods. Sensitivity analyses were calculated for a model based on 50 topics, LDA-based topic modeling, and a bigram model. Additionally, we grouped topics into themes using qualitative analysis and identified key topics and themes with eXplainable Artificial Intelligence (XAI). Symptom severity could be predicted with highest accuracy by patient topics ( r =0.45, 95%-CI 0.40, 0.51), whereas alliance was better predicted by therapist topics ( r =0.20, 95%-CI 0.16, 0.24). Drivers for symptom severity were themes related to health and negative experiences. Lower alliance was correlated with various themes, especially psychotherapy framework, income, and everyday life. This analysis shows the potential of using topic modeling in psychotherapy research allowing to predict several treatment-relevant metrics with reasonable accuracy. Further, the use of XAI allows for an analysis of the individual predictive value of topics and themes. Limitations entail heterogeneity across different topic modeling hyperparameters and a relatively small sample size.

Precision Mental Health and Data-Informed Decision Support in Psychological Therapy: An Example.

Outcome measurement including data-informed decision support for therapists in psychological therapy has developed impressively over the past two decades. New technological developments such as computerized data assessment, and feedback tools have facilitated advanced implementation in several seetings. Recent developments try to improve the clinical decision-making process by connecting clinical practice better with empirical data. For example, psychometric data can be used by clinicians to personalize the selection of therapeutic programs, strategies or modules and to monitor a patient's response to therapy in real time. Furthermore, clinical support tools can be used to improve the treatment for patients at risk for a negative outcome. Therefore, measurement-based care can be seen as an important and integral part of clinical competence, practice, and training. This is comparable to many other areas in the healthcare system, where continuous monitoring of health indicators is common in day-to-day clinical practice (e.g., fever, blood pressure). In this paper, we present the basic concepts of a data-informed decision support system for tailoring individual psychological interventions to specific patient needs, and discuss the implications for implementing this form of precision mental health in clinical practice.

Emotion dynamics of clients with test anxiety before and after an imagery-based treatment.

BACKGROUND AND OBJECTIVES: Imagery-based techniques have become a promising means in the treatment of test anxiety (TA). Although previous studies have demonstrated the effectiveness of imagery-based treatment, not all clients seem to benefit from it. The present study compares clients' pre- as well as post-treatment emotion dynamics between responders and non-responders. Furthermore, it examines treatment-related changes in emotion dynamics in both subgroups. METHODS: The results are based on 44 clients suffering from TA who underwent a six-session imagery-based treatment and include Ecological Momentary Assessment (EMA). Emotions were assessed with the Profile of Mood States four times a day over the course of two weeks before and after the treatment. Temporal networks were computed to index emotion dynamics. RESULTS: Pre-treatment emotion dynamics differed between responders and non-responders. Similarly, post-treatment emotion dynamics differed as well between both groups. Some changes were also observed between pre-treatment and post-treatment networks: for responders, fatigue no longer predicted anger, and depression predicted itself; for non-responders, calmness predicted fatigue, anger, depression, contentment, and anxiety. In addition, fatigue no longer predicted itself and anxiety predicted vigor. LIMITATIONS: The investigation is marked by several limitations: a liberal inclusion threshold of at least a 50% response to EMA prompts, and a relatively homogenous sample. CONCLUSION: These results provide first evidence for the idea that emotion dynamics may be associated with response to treatment for TA. Furthermore, effective imagery-based treatments may be tied to changes within these dynamics.

From Theory to Practice: A Transtheoretical Treatment and Training Model (4TM).

Background: In this paper, we present the conceptual background and clinical implications of a research-based transtheoretical treatment and training model (4TM). Method: The model implements findings from psychotherapy outcome, process, and feedback research into a clinical and training framework that is open to future research. Results: The framework is based on interventions targeting patient processes on a behavioral, cognitive, emotional, motivational, interpersonal, and systemic/socio-cultural level. The 4TM also includes a data-based decision support and feedback system called the Trier Treatment Navigator (TTN). Conclusion: We discuss important problems associated with clinical orientations solely based on one school of thought. We then contrast these concerns with a clinical and training framework that embraces ongoing research, serving as a guiding structure for process-based transtheoretical interventions. Such research-based psychological therapy can take both traditional and novel clinical developments as well as findings from psychotherapy research into account and be adaptively disseminated to a variety of patient populations.

Validation and application of the Non-Verbal Behavior Analyzer: An automated tool to assess non-verbal emotional expressions in psychotherapy.

Background: Emotions play a key role in psychotherapy. However, a problem with examining emotional states via self-report questionnaires is that the assessment usually takes place after the actual emotion has been experienced which might lead to biases and continuous human ratings are time and cost intensive. Using the AI-based software package Non-Verbal Behavior Analyzer (NOVA), video-based emotion recognition of arousal and valence can be applied in naturalistic psychotherapeutic settings. In this study, four emotion recognition models (ERM) each based on specific feature sets (facial: OpenFace, OpenFace-Aureg; body: OpenPose-Activation, OpenPose-Energy) were developed and compared in their ability to predict arousal and valence scores correlated to PANAS emotion scores and processes of change (interpersonal experience, coping experience, affective experience) as well as symptoms (depression and anxiety in HSCL-11). Materials and methods: A total of 183 patient therapy videos were divided into a training sample (55 patients), a test sample (50 patients), and a holdout sample (78 patients). The best ERM was selected for further analyses. Then, ERM based arousal and valence scores were correlated with patient and therapist estimates of emotions and processes of change. Furthermore, using regression models arousal and valence were examined as predictors of symptom severity in depression and anxiety. Results: The ERM based on OpenFace produced the best agreement to the human coder rating. Arousal and valence correlated significantly with therapists' ratings of sadness, shame, anxiety, and relaxation, but not with the patient ratings of their own emotions. Furthermore, a significant negative correlation indicates that negative valence was associated with higher affective experience. Negative valence was found to significantly predict higher anxiety but not depression scores. Conclusion: This study shows that emotion recognition with NOVA can be used to generate ERMs associated with patient emotions, affective experiences and symptoms. Nevertheless, limitations were obvious. It seems necessary to improve the ERMs using larger databases of sessions and the validity of ERMs needs to be further investigated in different samples and different applications. Furthermore, future research should take ERMs to identify emotional synchrony between patient and therapists into account.