Individual treatment selection for patients with post-traumatic stress disorder: External validation of a personalised advantage index.

OBJECTIVE: To test the predictive accuracy and generalisability of a personalised advantage index (PAI) model designed to support treatment selection for Post-Traumatic Stress Disorder (PTSD). METHOD: A PAI model developed by Deisenhofer et al. (2018) was used to predict treatment outcomes in a statistically independent dataset including archival records for N = 152 patients with PSTD who accessed either trauma-focussed cognitive behavioural therapy or eye movement desensitisation and reprocessing in routine care. Outcomes were compared between patients who received their PAI-indicated optimal treatment versus those who received their suboptimal treatment. RESULTS: The model did not yield treatment specific predictions and patients who had received their PAI-indicated optimal treatment did not have better treatment outcomes in this external validation sample. CONCLUSION: This PAI model did not generalise to an external validation sample.

Love yourself as a therapist, doubt yourself as an institution? Therapist and institution effects on outcome, treatment length, and dropout.

OBJECTIVE: Research suggests that some therapists achieve better outcomes than others. However, an overlooked area of study is how institution differences impact patient outcomes independent of therapist variance. This study aimed to examine the role of institution and therapist differences in adult outpatient psychotherapy. METHOD: The study included 1428 patients who were treated by 196 therapists at 10 clinics. Two- and three-level hierarchical linear regression models were employed to investigate the effects of therapists and institutions on three dependent patient variables: (1) symptom change, (2) treatment duration, and (3) dropout. Level three explanatory variables were tested. RESULTS: The results showed that therapist effects (TE) were significant for all three types of treatment outcome (7.8%-18.2%). When a third level (institution) was added to the model, the differences between therapists decreased, and significant institution effects (IE) were found: 6.3% for symptom change, 10.6% for treatment duration, and 6.5% for dropout. The exploratory analyses found no predictors able to explain the systematic variation at the institution level. DISCUSSION: TE on psychotherapy outcomes remain a relevant factor but may have been overestimated in previous studies due to not properly distinguishing them from differences at the institution level.

[Convergence of Scales to Measure Social Anxiety: An IRT Linking Approach]. / Konvergenz von Skalen zur Erfassung sozialer Ängste: Ein IRT-Linking Ansatz.

OBJECTIVE: The Liebowitz Social Anxiety Scale (LSAS) and the Social Phobia Inventory (SPIN) are established measures in the investigation of social anxiety. Furthermore, the subscale Interpersonal Sensitivity of the Brief Symptom Inventory (BSI-53) is frequently used to screen social anxiety. All three scales claim to capture the same construct, which raises the question of the convergence of these scales. To make research findings comparable by a cross-questionnaire factor (common factor), an item response theory (IRT) linking approach is used in the present study. METHODS: 64 German-speaking psychiatric patients and 295 healthy subjects completed the three questionnaires. Different IRT models, including Graded Response Models (GRM), were constructed, and their model fit compared. Regression analyses were performed based on the best-fit model. The common factor was predicted from the questionnaire total values. RESULTS: The relationship between the different scales was best explained by a bifactor GRM with one common factor and three domain-specific factors (RMSEA=0.036, CFI=0.977, WRMR=1.061). Based on the results of the regression analyses, three equations were derived for the transformation of questionnaire's total values. CONCLUSION: The IRT linking approach allows the derivation of a general factor of social anxiety, taking into account commonalities and differences between the instruments used. This has advantages for both research and practice. A replication of this study as well as the implementation of further instruments are recommended to verify the validity of this approach and to generalize the results.

Are some therapists better at facilitating and consolidating sudden gains than others?

BACKGROUND: Changes during psychotherapy often include sudden symptom improvements, called sudden gains (SGs), which have been identified as being superior to gradual symptom change with regard to treatment success. This study investigates the role of therapists in initiating and/or consolidating SGs. METHODS: The analyses are based on a sample of patients (N = 1937) who were seen by 155 therapists and received individual psychotherapy at a university outpatient clinic. First, the therapist effect (TE) on SG was investigated using multilevel modeling (MLM). Second, MLM was used to explore the relative importance of patient and therapist variability in SGs as they relate to outcome. RESULTS: The TE on SGs accounted for 1.8% of variance, meaning that therapists are accountable for inter-individual differences in their patients' likelihood to experience SGs. Furthermore, results revealed a significant effect of SGs on outcome for both levels, while therapist differences regarding the consolidation of SGs were not significant. CONCLUSIONS: The analyses indicated that some therapists are better in facilitating and initiating SGs. The process of triggering SGs seems to be a therapist skill or competence, which opens up an additional pathway to positive outcomes that could be used to improve clinical training.

For whom should psychotherapy focus on problem coping? A machine learning algorithm for treatment personalization.

OBJECTIVE: We aimed to develop and test an algorithm for individual patient predictions of problem coping experiences (PCE) (i.e., patients' understanding and ability to deal with their problems) effects in cognitive-behavioral therapy. Method: In an outpatient sample with a variety of diagnoses (n=1010), we conducted Dynamic Structural Equation Modelling to estimate within-patient cross-lagged PCE effects on outcome during the first ten sessions. In a randomly selected training sample (2/3 of the cases), we tried different machine learning algorithms (i.e., ridge regression, LASSO, elastic net, and random forest) to predict PCE effects (i.e., the degree to which PCE was a time-lagged predictor of symptoms), using baseline demographic, diagnostic, and clinically-relevant patient features. Then, we validated the best algorithm on a test sample (1/3 of the cases). RESULTS: The random forest algorithm performed best, explaining 14.7% of PCE effects variance in the training set. The results remained stable in the test set, explaining 15.4% of PCE effects variance. CONCLUSIONS: The results show the suitability to perform individual predictions of process effects, based on patients' initial information. If the results are replicated, the algorithm might have the potential to be implemented in clinical practice by integrating it into monitoring and therapist feedback systems.

The influence of extra-therapeutic social support on the association between therapeutic bond and treatment outcome.

Objective: Both good therapeutic bond as well as extra-therapeutic social support seem to enhance treatment outcomes. Some features of the therapeutic bond are similar to experiences in extra-therapeutic relationships (e.g., feelings of trust or belongingness). Patients with a lack of social support might benefit particularly from a good therapeutic bond, because a well-formed bond can partly substitute relationship needs. This study replicates former research (main effects of bond and social support) and investigates the hypothesized interaction between both constructs. Method: Data from 1206 adult patients receiving cognitive-behavioral outpatient therapy were analyzed. Patients rated early therapeutic bond, their impairment, as well as their social support. Multilevel regression analyses were applied to test for main effects and interactions between bond and social support predicting therapy outcome post treatment. Results: Consistent with prior research, both therapeutic bond and social support predicted therapy outcome. Among patients with high social support, the impact of the therapeutic bond was minimal, while patients with low social support benefited most from a good therapeutic bond. Conclusions: Results suggest that both the therapeutic bond and social support play a role in therapy outcomes and that good therapeutic bond quality might be especially important if a patient lacks social support.

Assessing treatment integrity in personalized CBT: the inventory of therapeutic interventions and skills.

The third wave of cognitive behavioral therapy (CBT) has increased the heterogeneity of today's CBT practice, while developments in patient-focused research are paving the road to the empirical personalization of CBT. This paper presents the development and psychometric properties of a therapy video rating instrument, which was designed to adequately assess the treatment integrity (adherence and competence) of modern, personalized CBT. The Inventory of Therapeutic Interventions and Skills (ITIS) was developed based on two existing CBT adherence and competence scales and augmented with third wave content and overarching therapeutic strategies. The instrument was then applied by graduate students and post-graduate clinicians to rate N = 185 therapy videos from N = 70 patients treated at a university outpatient clinic. Descriptive results, inter-rater reliability, item structure, and associations with session outcome and alliance were examined. Average inter-rater reliability was excellent for Interventions items and good for Skills items. Intercorrelations were low between Interventions items, but higher and significant between Skills items, which loaded on a single factor. Several ITIS items were shown to be predictive of session outcome and alliance, even after controlling for the nested data structure. Implications of these results for future research and clinical training are discussed.

Patterns of early change in interpersonal problems and their relationship to nonverbal synchrony and multidimensional outcome.

Early change is an increasing area of investigation in psychotherapy research. In this study, we analyzed patterns of early change in interpersonal problems and their relationship to nonverbal synchrony and multiple outcome measures for the first time. We used growth mixture modeling to identify different latent classes of early change in interpersonal problems with 212 patients who underwent cognitive-behavioral treatment including interpersonal and emotion-focused elements. Furthermore, videotaped sessions were analyzed using motion energy analysis, providing values for the calculation of nonverbal synchrony to predict early change in interpersonal problems. The relationship between early change patterns and symptoms as well as overall change in interpersonal problems was also investigated. Three latent subgroups were identified: 1 class with slow improvement (n = 145), 1 class with fast improvement (n = 12), and 1 early deterioration class (n = 55). Lower levels of early nonverbal synchrony were significantly related to fast improvement in interpersonal change patterns. Furthermore, such patterns predicted treatment outcome in symptoms and interpersonal problems. The results suggest that nonverbal synchrony is associated with early change patterns in interpersonal problems, which are also predictive of treatment outcome. Limitations of the applied methods as well as possible applications in routine care are discussed. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Associations between movement synchrony and outcome in patients with social anxiety disorder: Evidence for treatment specific effects.

Background: Studies with heterogeneous samples in naturalistic treatment settings suggest that movement synchrony (MS) between therapists and patients correlates with therapeutic success. In this study, we examined a homogeneous sample of patients with social anxiety disorder and investigated whether MS in sessions 3 and 8 would be associated with therapy outcome and therapeutic alliance, and whether these associations depend on the therapeutic approach. Methods: The patients (N = 267) were treated with either manual-guided cognitive behavior therapy (CBT), manual-guided psychodynamic therapy (PDT), or naturalistic CBT. The Helping Alliance Questionnaire (HAQ), the Inventory of Interpersonal Problems (IIP) and the Beck-Depression-Inventory (BDI) were used as measures. Body motions were coded with motion energy analysis. MS was quantified using time series analysis methods. Results: MS was observed more frequently in both CBT conditions than in PDT. In both CBT groups, more synchrony was predictive of lower IIP scores at the end of therapy. If the patient lead synchrony more often than the therapist, higher IIP and BDI scores were observed at the end of treatment. PDT showed the largest effect size for the synchrony-alliance-association. Conclusion: Movement synchrony and therapeutic success are associated. The effect of therapeutic approach and leading/following are relevant for this association.

Working Towards the Development and Implementation of Precision Mental Healthcare: An Example.

Leonard Bickman's (2020) Festschrift paper in the special issue "The Future of Children's Mental Health Services" on improving mental health services is an impressive reflection of his career, highlighting his major insights and the development of mental health services research as a whole. Five major difficulties in this field's current research and practice are attentively delineated: poor diagnostics, measurement problems, disadvantages of randomized controlled trials (RCTs), lack of feedback and personalized treatments. Dr. Bickman recommends possible solutions based on his extensive experience and empirical findings. We agree with his thoughts and illustrate how we, challenged with the same problems, have attempted to develop clinically informed research and evidence-based clinical practice. A comprehensive feedback system that deals with the aforementioned problems is briefly described. It includes pre-treatment recommendations for treatment strategies and an empirically informed dropout prediction based on a variety of data sources. In addition to treatment recommendations, continuous feedback as well as individualized treatment adaptation tools are provided during ongoing therapy. New projects are being implemented to further improve the system by including new data assessment strategies and sources, e.g., ecological momentary assessment (EMA) and automated video analysis.

What happens when the therapist leaves? The impact of therapy transfer on the therapeutic alliance and symptoms.

BACKGROUND: The therapeutic alliance is an important factor in psychotherapy, affecting both therapy processes and outcome. Therapy transfers may impair the quality of the therapeutic alliance and increase symptom severity. The aim of this study is to investigate the impact of patient transfers in cognitive behavioural therapy on alliance and symptoms in the sessions after the transfer. METHOD: Patient- and therapist-rated therapeutic alliance and patient-reported symptom severity were measured session-to-session. Differences in the levels of alliance and symptom severity before (i.e., with the original therapist) and after (i.e., with the new therapist) the transfer session were analysed. The development of alliance and symptom severity was explored using multilevel growth models. RESULTS: A significant drop in the alliance was found after the transfer, whereas no differences were found with regard to symptom severity. After an average of 2.93 sessions, the therapeutic alliance as rated by patients reached pretransfer levels, whereas it took an average of 5.05 sessions for therapist-rated alliance levels to be at a similar level as before the transfer. Inter-individual differences were found with regard to the development of the therapeutic alliance over time. CONCLUSIONS: Therapy transfers have no long lasting negative effects on either symptom impairment or the therapeutic alliance.

Quantification of nonverbal synchrony using linear time series analysis methods: Lack of convergent validity and evidence for facets of synchrony.

Nonverbal synchrony describes coordination of the nonverbal behavior of two interacting partners. Additionally, it seems to be important in human interactions, such as during psychotherapy. Currently, there are several options for the automated determination of synchrony based on linear time series analysis methods (TSAMs). However, investigations into whether the different methods measure the same construct have been missing. In this study, N = 84 patient-therapist dyads were videotaped during psychotherapy sessions. Motion energy analysis was used to assess body movements. We applied seven different TSAMs and recorded multiple output scores (average synchrony, maximum synchrony, and frequency of synchrony; in total, N = 16 scores). Convergent validity was examined using correlations of the output scores and exploratory factor analysis. Additionally, two criterion-based validations were conducted: investigations of concordant validity with a more generalized nonlinear method, and of the predictive validity of the synchrony scores for improvement in interpersonal problems at the end of therapy. We found that the synchrony measures only partially correlated with each other. The factor analysis did not support a common-factor model. A three-factor model with a second-order synchrony variable showed the best fit for eight of the selected synchrony scores. Only some synchrony scores were able to predict improvement at the end of therapy. We concluded that the considered TSAMs do not measure the same synchrony construct, but different facets of synchrony: the strength of synchrony of the total interaction, the strength of synchrony during synchronization intervals, and the frequency of synchrony.

Individual treatment selection for patients with posttraumatic stress disorder.

BACKGROUND: Trauma-focused cognitive behavioral therapy (Tf-CBT) and eye movement desensitization and reprocessing (EMDR) are two highly effective treatment options for posttraumatic stress disorder (PTSD). Yet, on an individual level, PTSD patients vary substantially in treatment response. The aim of the paper is to test the application of a treatment selection method based on a personalized advantage index (PAI). METHOD: The study used clinical data for patients accessing treatment for PTSD in a primary care mental health service in the north of England. PTSD patients received either EMDR (N = 75) or Tf-CBT (N = 242). The Patient Health Questionnaire (PHQ-9) was used as an outcome measure for depressive symptoms associated with PTSD. Variables predicting differential treatment response were identified using an automated variable selection approach (genetic algorithm) and afterwards included in regression models, allowing the calculation of each patient's PAI. RESULTS: Age, employment status, gender, and functional impairment were identified as relevant variables for Tf-CBT. For EMDR, baseline depressive symptoms as well as prescribed antidepressant medication were selected as predictor variables. Fifty-six percent of the patients (n = 125) had a PAI equal or higher than one standard deviation. From those patients, 62 (50%) did not receive their model-predicted treatment and could have benefited from a treatment assignment based on the PAI. CONCLUSIONS: Using a PAI-based algorithm has the potential to improve clinical decision making and to enhance individual patient outcomes, although further replication is necessary before such an approach can be implemented in prospective studies.

Randomized controlled trial to evaluate the effects of personalized prediction and adaptation tools on treatment outcome in outpatient psychotherapy: study protocol.

BACKGROUND: Psychotherapy is successful for the majority of patients, but not for every patient. Hence, further knowledge is needed on how treatments should be adapted for those who do not profit or deteriorate. In the last years prediction tools as well as feedback interventions were part of a trend to more personalized approaches in psychotherapy. Research on psychometric prediction and feedback into ongoing treatment has the potential to enhance treatment outcomes, especially for patients with an increased risk of treatment failure or drop-out. METHODS/DESIGN: The research project investigates in a randomized controlled trial the effectiveness as well as moderating and mediating factors of psychometric feedback to therapists. In the intended study a total of 423 patients, who applied for a cognitive-behavioral therapy at the psychotherapy clinic of the University Trier and suffer from a depressive and/or an anxiety disorder (SCID interviews), will be included. The patients will be randomly assigned either to one therapist as well as to one of two intervention groups (CG, IG2). An additional intervention group (IG1) will be generated from an existing archival data set via propensity score matching. Patients of the control group (CG; n = 85) will be monitored concerning psychological impairment but therapists will not be provided with any feedback about the patients assessments. In both intervention groups (IG1: n = 169; IG2: n = 169) the therapists are provided with feedback about the patients self-evaluation in a computerized feedback portal. Therapists of the IG2 will additionally be provided with clinical support tools, which will be developed in this project, on the basis of existing systems. Therapists will also be provided with a personalized treatment recommendation based on similar patients (Nearest Neighbors) at the beginning of treatment. Besides the general effectiveness of feedback and the clinical support tools for negatively developing patients, further mediating and moderating variables on this feedback effect should be examined: treatment length, frequency of feedback use, therapist effects, therapist's experience, attitude towards feedback as well as congruence of therapist's and patient's evaluation concerning the progress. Additional procedures will be implemented to assess treatment adherence as well as the reliability of diagnosis and to include it into the analyses. DISCUSSION: The current trial tests a comprehensive feedback system which combines precision mental health predictions with routine outcome monitoring and feedback tools in routine outpatient psychotherapy. It also adds to previous feedback research a stricter design by investigating another repeated measurement CG as well as a stricter control of treatment integrity. It also includes a structured clinical interview (SCID) and controls for comorbidity (within depression and anxiety). This study also investigates moderators (attitudes towards, use of the feedback system, diagnoses) and mediators (therapists' awareness of negative change and treatment length) in one study. TRIAL REGISTRATION: Current Controlled Trials NCT03107845 . Registered 30 March 2017.

Movement-based patient-therapist attunement in psychological therapy and its association with early change.

Objective: Attunement is a novel measure of nonverbal synchrony reflecting the duration of the present moment shared by two interaction partners. This study examined its association with early change in outpatient psychotherapy. Methods: Automated video analysis based on motion energy analysis (MEA) and cross-correlation of the movement time-series of patient and therapist was conducted to calculate movement synchrony for N = 161 outpatients. Movement-based attunement was defined as the range of connected time lags with significant synchrony. Latent change classes in the HSCL-11 were identified with growth mixture modeling (GMM) and predicted by pre-treatment covariates and attunement using multilevel multinomial regression. Results: GMM identified four latent classes: high impairment, no change (Class 1); high impairment, early response (Class 2); moderate impairment (Class 3); and low impairment (Class 4). Class 2 showed the strongest attunement, the largest early response, and the best outcome. Stronger attunement was associated with a higher likelihood of membership in Class 2 (b = 0.313, p = .007), Class 3 (b = 0.251, p = .033), and Class 4 (b = 0.275, p = .043) compared to Class 1. For highly impaired patients, the probability of no early change (Class 1) decreased and the probability of early response (Class 2) increased as a function of attunement. Conclusions: Among patients with high impairment, stronger patient-therapist attunement was associated with early response, which predicted a better treatment outcome. Video-based assessment of attunement might provide new information for therapists not available from self-report questionnaires and support therapists in their clinical decision-making.

Prospective evaluation of a clinical decision support system in psychological therapy.

OBJECTIVE: Thus far, most applications in precision mental health have not been evaluated prospectively. This article presents the results of a prospective randomized-controlled trial investigating the effects of a digital decision support and feedback system, which includes two components of patient-specific recommendations: (a) a clinical strategy recommendation and (b) adaptive recommendations for patients at risk for treatment failure. METHOD: Therapist-patient dyads (N = 538) in a cognitive behavioral therapy outpatient clinic were randomized to either having access to a decision support system (intervention group; n = 335) or not (treatment as usual; n = 203). First, treatment strategy recommendations (problem-solving, motivation-oriented, or a mix of both strategies) for the first 10 sessions were evaluated. Second, the effect of psychometric feedback enhanced with clinical problem-solving tools on treatment outcome was investigated. RESULTS: The prospective evaluation showed a differential effect size of about 0.3 when therapists followed the recommended treatment strategy in the first 10 sessions. Moreover, the linear mixed models revealed therapist symptom awareness and therapist attitude and confidence as significant predictors of an outcome as well as therapist-rated usefulness of feedback as a significant moderator of the feedback-outcome and the not on track-outcome associations. However, no main effects were found for feedback. CONCLUSIONS: The results demonstrate the importance of prospective studies and the high-quality implementation of digital decision support tools in clinical practice. Therapists seem to be able to learn from such systems and incorporate them into their clinical practice to enhance patient outcomes, but only when implementation is successful. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Progress feedback narrows the gap between more and less effective therapists: A therapist effects meta-analysis of clinical trials.

OBJECTIVE: Some psychotherapists are more effective than others, which means that patients' treatment outcomes partly depend on therapist effects (TEs). This study investigated whether the use of progress feedback influences TE. METHOD: Data from N = 4,549 participants and 131 therapists across six clinical trials of progress feedback were analyzed. All trials used the Outcome-Questionnaire-45 (OQ-45) outcome measure and assigned psychotherapy patients to a usual psychological care condition or feedback condition. We examined whether feedback utilization moderated TE using multilevel modeling and random-effects meta-analysis. RESULTS: TE explained a small proportion (intracluster correlation coefficient [ICC] = .011) of variability in posttreatment OQ-45 scores in the pooled multistudy sample, after controlling for intake severity. Feedback utilization was associated with a statistically significant reduction of the magnitude of the TE (ICC = .009) by approximately 18.2%. Secondary analyses of OQ-45 subscales indicated that TEs were statistically significant in relation to symptom distress, but not interpersonal relations or social role. Feedback was associated with better treatment outcomes and narrower variability between therapists. CONCLUSIONS: Feedback-informed treatment reduces the gap between more and less effective therapists, leading to more equitable and effective psychological care. (PsycInfo Database Record (c) 2022 APA, all rights reserved).