Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling.

We aim to use topic modeling, an approach for discovering clusters of related words ("topics"), to predict symptom severity and therapeutic alliance in psychotherapy transcripts, while also identifying the most important topics and overarching themes for prediction. We analyzed 552 psychotherapy transcripts from 124 patients. Using BERTopic (Grootendorst, 2022), we extracted 250 topics each for patient and therapist speech. These topics were used to predict symptom severity and alliance with various competing machine-learning methods. Sensitivity analyses were calculated for a model based on 50 topics, LDA-based topic modeling, and a bigram model. Additionally, we grouped topics into themes using qualitative analysis and identified key topics and themes with eXplainable Artificial Intelligence (XAI). Symptom severity could be predicted with highest accuracy by patient topics ( r =0.45, 95%-CI 0.40, 0.51), whereas alliance was better predicted by therapist topics ( r =0.20, 95%-CI 0.16, 0.24). Drivers for symptom severity were themes related to health and negative experiences. Lower alliance was correlated with various themes, especially psychotherapy framework, income, and everyday life. This analysis shows the potential of using topic modeling in psychotherapy research allowing to predict several treatment-relevant metrics with reasonable accuracy. Further, the use of XAI allows for an analysis of the individual predictive value of topics and themes. Limitations entail heterogeneity across different topic modeling hyperparameters and a relatively small sample size.

Decoding emotions: Exploring the validity of sentiment analysis in psychotherapy.

OBJECTIVE: Given the importance of emotions in psychotherapy, valid measures are essential for research and practice. As emotions are expressed at different levels, multimodal measurements are needed for a nuanced assessment. Natural Language Processing (NLP) could augment the measurement of emotions. The study explores the validity of sentiment analysis in psychotherapy transcripts. METHOD: We used a transformer-based NLP algorithm to analyze sentiments in 85 transcripts from 35 patients. Construct and criterion validity were evaluated using self- and therapist reports and process and outcome measures via correlational, multitrait-multimethod, and multilevel analyses. RESULTS: The results provide indications in support of the sentiments' validity. For example, sentiments were significantly related to self- and therapist reports of emotions in the same session. Sentiments correlated significantly with in-session processes (e.g., coping experiences), and an increase in positive sentiments throughout therapy predicted better outcomes after treatment termination. DISCUSSION: Sentiment analysis could serve as a valid approach to assessing the emotional tone of psychotherapy sessions and may contribute to the multimodal measurement of emotions. Future research could combine sentiment analysis with automatic emotion recognition in facial expressions and vocal cues via the Nonverbal Behavior Analyzer (NOVA). Limitations (e.g., exploratory study with numerous tests) and opportunities are discussed.

Where it all begins: Predicting initial therapeutic skills before clinical training in cognitive behavior therapy.

To train novice students adequately, it is crucial to understand where they start and how they develop their skills. This study examined the impact of novice students' characteristics on their initial clinical micro-skills when treating simulated patients with cognitive behavior therapy. The sample consisted of 44 graduate psychology students treating seven simulated patients. Clinical micro-skills were measured both using video-based ratings in reaction to short video clips of simulated patients (via the Facilitative Interpersonal Skills (FIS) performance task) and by using video-based ratings within a session with a simulated patient (using the Inventory of Therapeutic Interventions and Skills; ITIS). Two separate LASSO regressions were performed using machine learning to select potential predictors for both skills assessments. Subsequently, a bootstrapping algorithm with 10,000 iterations was used to examine the variability of regression coefficients. Using LASSO regression, we identified two predictors for clinical micro-skills in standardized scenarios: extraversion (b = 0.10) and resilience (b = 0.09), both were not significantly associated with clinical micro-skills. Together, they explained 15% of the skill variation. Bootstrapping confirmed the stability of these predictors. For clinical micro-skills in sessions, only competitiveness was excluded by LASSO regression, and all predictors showed significant instability. The results provide initial evidence that trainees' resilience and extraversion should be promoted in the clinical training of cognitive behavior therapy. More studies on clinical micro-skills and training with larger sample sizes are needed to fully understand clinical development.

Precision Mental Health and Data-Informed Decision Support in Psychological Therapy: An Example.

Outcome measurement including data-informed decision support for therapists in psychological therapy has developed impressively over the past two decades. New technological developments such as computerized data assessment, and feedback tools have facilitated advanced implementation in several seetings. Recent developments try to improve the clinical decision-making process by connecting clinical practice better with empirical data. For example, psychometric data can be used by clinicians to personalize the selection of therapeutic programs, strategies or modules and to monitor a patient's response to therapy in real time. Furthermore, clinical support tools can be used to improve the treatment for patients at risk for a negative outcome. Therefore, measurement-based care can be seen as an important and integral part of clinical competence, practice, and training. This is comparable to many other areas in the healthcare system, where continuous monitoring of health indicators is common in day-to-day clinical practice (e.g., fever, blood pressure). In this paper, we present the basic concepts of a data-informed decision support system for tailoring individual psychological interventions to specific patient needs, and discuss the implications for implementing this form of precision mental health in clinical practice.

On the current psychotherapeutic situation for persons with pornography use disorder in Germany.

Background and aims: For the first time, the ICD-11 provides the diagnosis compulsive sexual behavior disorder (CSBD) that can be assigned for pornography use disorder (PUD). This study aimed to estimate the prevalence of PUD and associated consequences in Germany, to identify the psychotherapy demand among likely PUD (lPUD) cases and the treatment supply in different psychotherapeutic settings, to survey psychotherapists' level of expertise regarding PUD, and to identify predictors for psychotherapy demand. Methods: Four studies were conducted: 1. Online study in the general population (n = 2070; m = 48.9%, f = 50.8%, d = 0.2%), 2. Survey among practicing psychotherapists (n = 983), 3. Survey of psychotherapists in psychotherapeutic outpatient clinics (n = 185), 4. Interviews with psychotherapeutic inpatient clinics (n = 28). Results: The estimated prevalence of lPUD in the online study was 4.7% and men were 6.3 times more often affected than women. Compared to individuals without PUD, individuals with lPUD more often indicated negative consequences in performance-related areas. Among lPUD cases, 51.2% of men and 64.3% of women were interested in a specialized PUD treatment. Psychotherapists reported 1.2%-2.9% of lPUD cases among their patients. 43.2%-61.5% of psychotherapists stated to be poorly informed about PUD. Only 7% of psychotherapeutic inpatient clinics provided specific treatments to patients with PUD. While, among other factors, negative consequences attributed to lPUD were predictive for psychotherapy demand, weekly pornography consumption, subjective well-being, and religious attachment were not. Discussion and conclusions: Although PUD occurs quite often in Germany, availability of mental health care services for PUD is poor. Specific PUD treatments are urgently needed.

Within and between associations of clinical microskills and correct application of techniques/strategies: A longitudinal multilevel approach.

OBJECTIVE: The therapist effect has been demonstrated in various studies. However, studies on putative therapist characteristics show heterogeneous results. Although the majority of studies have solely examined effects between therapists, a growing interest in effects within therapists has emerged. However, it remains unclear whether therapist characteristics are rather a state-like than a trait-like phenomenon. The main aim of the present study is to test whether clinical microskills as well as correct application of techniques and strategies (both between and within therapists) predict across-session change of symptom severity in a large naturalistic data set. METHOD: The results are based on 398 patients and 48 therapists who treated 5-17 patients each. Clinical microskills and correct application of techniques/strategies were rated using the Inventory of Therapeutic Interventions and Skills, and symptom severity was assessed with the Hopkins Symptom Checklist-11. RESULTS: Results demonstrated significant within- and between-therapist variability in clinical microskills and correct application of techniques/strategies, and no change over the course of treatment in both variables. Moreover, correct application of techniques/strategies was significantly associated with symptom improvement within, but not between therapists. In addition, higher treatment difficulty as well as an interaction between treatment difficulty and correct application of techniques/strategies were significantly associated with symptom improvement. Clinical microskills were neither predictive of symptom improvement within nor between therapists. CONCLUSIONS: These results provide initial evidence that not the therapist's average correct application of techniques/strategies is important, but rather how correctly they use a technique with a specific patient. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The Trier Treatment Navigator (TTN) in action: Clinical case study on data-informed psychological therapy.

BACKGROUND: Although psychotherapy has shown to be effective for most patients, about one-third of patients do not benefit or deteriorate during treatment. Technical progress has allowed the integration of routine outcome monitoring (ROM) into treatment, helping therapists detect patients at risk for a nonresponse or poor outcome early on. Psychological therapy can be enhanced by providing therapists with individual treatment recommendations for these at-risk patients. One example of such a comprehensive feedback system is the Trier Treatment Navigator (TTN). OBJECTIVE/METHOD: This clinical case study aims to illustrate the implementation of the TTN in a cognitive behavioral therapy (CBT) outpatient clinic in the treatment of a 30-year-old patient called Ms. Daun, who has a recurrent depressive disorder. Based on this case, the benefits of applying information from ROM in psychotherapy, important context factors, and possible implementation issues are discussed. RESULTS/CONCLUSION: We conclude by encouraging practitioners to integrate ROM into their clinical thinking and daily practice.