A cohort study of engagement in telehealth psychotherapy versus in-person services.

OBJECTIVE: Although telehealth psychotherapies have been studied for over 20 years, mental health services remained largely delivered in person until the COVID-19 pandemic forced clinics to reconsider the utility of telehealth psychotherapy. This study aims to compare patient engagement in in-person versus telehealth services in outpatient psychotherapy for mood and anxiety disorders. METHOD: A cohort investigation was conducted, using a propensity score matched sample, extracted from an electronic health record (EHR) to compare engagement in psychotherapy for 762 patients who used in-person services before the pandemic to a cohort of 762 patients who used telehealth psychotherapy after the onset of COVID-19. The authors compared cohorts on initial engagement in psychotherapy services following an initial intake, number of psychotherapy sessions attended, and the rate of missed sessions. RESULTS: There was a 26% increase in the total number of individual psychotherapy sessions attended when the clinics transitioned to telehealth services (p < .001). In addition, patients who received telehealth psychotherapy were five times more likely to not cancel or miss any scheduled sessions (p < .001). CONCLUSION: These results indicate that telehealth services may result in improved treatment engagement for outpatient centers focused on brief evidence-based psychotherapies for mood and anxiety disorders.

Gender, Race/Ethnicity, and Patient-Therapist Matching on Gender and Race/Ethnicity: Predictors/Moderators of the Effectiveness of Trust/Respect Feedback.

A plethora of studies has exhibited the effectiveness of using measurement-based care feedback systems within mental health services to improve treatment outcomes; however, patient gender/race and patient-therapist matching on gender and race remain relatively unexplored as predictors/moderators in feedback studies. We conducted predictor/moderator analyses focusing on the relation of gender, race/ethnicity, and patient-therapist gender and race/ethnicity matching on two outcomes: patient self-reported levels of (1) functioning and (2) trust/respect within the therapeutic relationship. We used data from a randomized controlled trial studying the effectiveness of a feedback system comparing patient-reported levels of trust and respect towards their provider (together with symptom feedback) in comparison to symptom only feedback. We found that men improved in functioning more than women when their therapists received trust/respect feedback compared to symptom only feedback (F[1, 902] = 9.79, p = .002, d = 0.21). We also found that dyads matched on race/ethnicity but not gender, and those matched on gender but not race/ethnicity, improved in functioning over time more than dyads mismatched on both gender and race/ethnicity and those matched on both gender and race/ethnicity (F[1, 897] = 8.63, p = .0034, d = 0.20). On trust/respect outcomes, we found a gender difference over time (F[1, 759] = 6.61, p = .01, d = 0.19), a gender matching difference by feedback condition interaction (F[1, 757] = 5.25, p = .02, d = 0.17), and a racial/ethnic matching difference on trust/respect scores over time (F[1, 785] = 3.89, p = .049, d = 0.14). Male patients showed an initial decrease followed by a steady increase in trust/respect over time while female patients showed an initial increase followed by a steady decrease. Gender-matched therapeutic dyads showed higher levels of trust/respect compared to mismatched dyads when therapists received symptom only feedback, but this difference was not apparent when trust/respect feedback was provided. Dyads mismatched on race/ethnicity improved steadily in trust/respect over time, but matched dyads decreased in trust/respect after an initial increase. Future research should focus on the use of feedback systems to enhance outcomes for patients with specific gender and racial/ethnic identities.

The association between trauma and interpersonal problems in a United States community mental health setting.

OBJECTIVE: Previous research has documented associations between trauma and interpersonal problems. We examined the impact of trauma on interpersonal problems among depressed patients seeking treatment in a community mental health setting. METHODS: A total of 453 patients seeking treatment and screened for a comparative effectiveness study of therapies for depression were included. We conducted analyses relating the 32-item inventory of interpersonal problems (IIP-32) to trauma measures. RESULTS: 99.1% of the sample experienced a traumatic event. There were significant associations between the total number of traumas, the number of sexually and physically assaultive traumas, and both gender and race. The number of sexually assaultive traumas was significantly related to the IIP-32 "too caring" subscale (simple r = 0.167, p < 0.001). Controlling for demographics and other IIP-32 subscales, the total number of traumas remained significantly related to the IIP-32 "too caring" domain (partial r = 0.163, p < 0.001). CONCLUSIONS: Traumatic events are prevalent among community populations and these experiences are associated with certain interpersonal problems. Trauma and interpersonal problems are key issues for the treatment of patients in the community mental health setting.

Repeated assessments of depressive symptoms in randomized psychosocial intervention trials: best practice for analyzing symptom change over time.

OBJECTIVE: Psychotherapy randomized trials rarely have tested for the best fitting model for time effects. We examined the fit of different statistical models for examining time when repeated assessments of depressive symptoms are the primary outcome. METHOD: We used data from three studies comparing psychotherapy treatments for major depressive disorder. Outcome measures were self-report ratings for Study 1 (N = 237) and Study 2 (N = 100) and clinician ratings for Study 3 (N = 120) of depressive symptoms measured at every session (Studies 1 and 2) or monthly (Study 3). We examined the fit of the following time patterns: linear, quadratic, cubic, log transformation of time, piece-wise linear, and unstructured. RESULTS: In Study 1, a log-linear model had the best fit (Δ Akaike information criterion [AICc] = 7.5). In Study 2, all models had essentially no support (Δ AICcs > 10) in comparison to the best fitting model, which was the unstructured model. In Study 3, the cubic model had the best fit, but it was not significantly better than a log-linear (Δ AICc = 3.5) or unstructured model (Δ AICc = 2.5). CONCLUSIONS: Trials should routinely compare different time models, including an unstructured model, when repeated measures of depressive symptoms are the primary outcome.

Initial Development of Pragmatic Behavioral Activation Fidelity Assessments.

PURPOSE: Our goal was to develop brief pragmatic assessments of Behavioral Activation (BA) fidelity to support its dissemination in low-resource settings. METHODS: We used qualitative and quantitative methods across three investigations to develop pragmatic assessments rated from the perspective of therapists, patients, and observers: (1) we developed an initial comprehensive pool of 119 items and adapted/refined the item pool to 32 items through stakeholder focus groups and cognitive interviews; (2) independent blind judges rated each of items in the refined item pool on an early session of BA for 64 patients to support the selection of items based on predictive validity; and (3) we conducted a preliminary evaluation of the acceptability and feasibility of the assessments of BA fidelity from the perspective of therapists and patients. RESULTS: The internal consistency reliability for the 10-item total score was .83 rated from the perspective of independent observers. The assessment was completed by patients following 90% of sessions and by clinicians following 93% of sessions. Items were rated high on overall satisfaction by both therapists (M = 4.6, SD = 0.89) and patients (M = 4.8, SD = 0.41). CONCLUSION: Our findings suggest that these brief assessments of BA fidelity are reliable, feasible, and acceptable to community stakeholders.

Insight as a mechanism of change in dynamic therapy for major depressive disorder.

This study aimed to investigate change in insight into maladaptive interpersonal patterns over the course of psychotherapy, as well as the specificity of insight as a change mechanism in dynamic treatments. A total of 100 patients received up to 16 sessions of either cognitive or dynamic therapy for major depressive disorder in a randomized clinical trial. Assessments of insight (Insight into Conflictual Relationship Patterns scale) and depression severity (Hamilton Depression Inventory) took place at the beginning of treatment, at month 2, and month 5. Patient insight significantly improved over the course of dynamic treatments. Gains in insight from the beginning to month 2 of treatment were a significant predictor of decreases of depressive symptoms from month 2 to month 5 of treatment in the dynamic, but not in the cognitive treatment group, despite a nonsignificant interaction. Results provide support for insight as a change factor in dynamic therapies. Better self-understanding of dysfunctional interaction patterns could help patients to find more adaptive ways of behaving, to form more satisfying relationships, and to improve their depression. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Use of cognitive techniques is associated with change in positive compensatory skills in the treatment of major depressive disorder in a community mental health setting.

To examine the association between adherence and competence in cognitive therapy (CT) techniques and change in positive compensatory skills and depressive symptoms within a community mental health setting.Adherence ratings were available for 97 individuals receiving CT for major depressive disorder. Assessments of adherence and competence were rated on one early session of CT. Compensatory skills were measured using the Ways of Responding Community Version at baseline and months 1, 2, and 5. Symptom severity was evaluated using the Hamilton Rating Scale for Depression at baseline and months 1, 2, 4, and 5.In mixed effects models, adherence was significantly associated with linear change in positive compensatory skills from baseline to month 5 (F [1, 76] = 8.05, p=.006, r=.31). Competence was also significantly associated with change in positive compensatory skills from baseline to month 5 (F [1, 78] = 5.1, p=.027, r=.25). High adherence was associated with improvements in HAM-D scores from baseline to month 5 (F [1, 78] = 5.1, p=.027, r=.25).Results support the hypothesis that use of CT techniques is associated with change in compensatory skills in a community mental health setting.

Instrumental variable analyses for causal inference: Application to multilevel analyses of the alliance-outcome relation.

Objective: To introduce readers to instrumental variable analyses for causal inferences using as an example a test of the hypothesis that the quality of the therapeutic alliance has a causal role in relation to the outcome of psychotherapy. Method: We used data from a recent non-inferiority trial of cognitive and dynamic therapies for major depressive disorder in a community mental health setting. The data (N = 161) were analyzed using standard approaches as well as a multilevel 2-stage instrumental variables approach that allows for causal interpretations by removing the influence of unmeasured confounds. Results: Instrumental variables were created at the patient and therapist level using baseline patient and therapist variables. These baseline variables predicted the alliance but were otherwise unrelated to treatment outcome other than through their effects on the alliance. Standard multilevel mixed effects analyses revealed statistically significant associations of the alliance with outcome at the therapist level of analysis. The therapist level effect remained statistically significant when using the instrumental variables approach. Conclusion: Our results support the hypothesis that, at least at the therapist level, the alliance plays a causal role in producing better outcomes. Instrumental variable analyses can be a useful tool to supplement standard analyses.

Insight into conflictual relationship patterns: Development and validation of an observer rating scale.

Objective: This study aimed to develop an observer-rated measure of Insight into Conflictual Relationship Patterns (ICR) applicable to audio- or videotapes of psychotherapy sessions and conduct a first psychometric evaluation. Method: We investigated the item properties, principal components, reliability, and validity of the ICR in a naturalistic sample of N = 125 outpatients in psychodynamic psychotherapy. Results: The ICR consists of 12 items that showed adequate item discrimination and item difficulty indices. All items represent one principal component. Using item response theory, discrimination parameters and item characteristic curves revealed that the ability of all items to differentiate patients was adequate to very good. The scale demonstrated good interrater reliability (ICC(3,1) = .76-.93), adequate internal consistency (Cronbach's α = .84), and high retest reliability (r = .91). Regarding validity, the ICR was significantly associated with insight according to the Achievement of Therapeutic Objectives Scale and patient-perceived session depth. Insight at session five predicted a symptomatic increase from session five to session ten. Conclusion: The ICR is an observer-rated measure to assess insight from psychotherapy session recordings that has demonstrated several aspects of reliability and validity. Future studies are needed to clarify the impact of ICR-assessed insight for symptomatic outcome.

A self-report version of the Ways of Responding: Reliability and validity in a clinical sample.

OBJECTIVE: The Ways of Responding (WOR) instrument measures compensatory skills, a central construct in some theories of the mechanism of cognitive therapy for depression. However, the instrument is time-consuming and expensive to use in community settings, because it requires trained independent judges to rate subjects' open-ended written responses to depressogenic scenarios. The present study evaluated the reliability and validity of a self-report version of the WOR (WOR-SR) in a community mental health sample with depressive symptoms (N = 467). METHOD: Subjects completed the WOR-SR, a modified version of the original WOR, and other measures of depressive symptoms, dysfunctional cognitions, functioning, quality of life, and interpersonal problems at multiple time points. RESULTS: An exploratory factor analysis confirmed the two-factor structure of the WOR-SR. The positive and negative subscales both demonstrated excellent internal consistency (Cronbach's alphas = .91) and moderate convergent validity with other measures. CONCLUSION: The WOR-SR is a reliable and valid measure of compensatory skills in patients receiving treatment for depression at community mental health centers.