Progress feedback narrows the gap between more and less effective therapists: A therapist effects meta-analysis of clinical trials.

OBJECTIVE: Some psychotherapists are more effective than others, which means that patients' treatment outcomes partly depend on therapist effects (TEs). This study investigated whether the use of progress feedback influences TE. METHOD: Data from N = 4,549 participants and 131 therapists across six clinical trials of progress feedback were analyzed. All trials used the Outcome-Questionnaire-45 (OQ-45) outcome measure and assigned psychotherapy patients to a usual psychological care condition or feedback condition. We examined whether feedback utilization moderated TE using multilevel modeling and random-effects meta-analysis. RESULTS: TE explained a small proportion (intracluster correlation coefficient [ICC] = .011) of variability in posttreatment OQ-45 scores in the pooled multistudy sample, after controlling for intake severity. Feedback utilization was associated with a statistically significant reduction of the magnitude of the TE (ICC = .009) by approximately 18.2%. Secondary analyses of OQ-45 subscales indicated that TEs were statistically significant in relation to symptom distress, but not interpersonal relations or social role. Feedback was associated with better treatment outcomes and narrower variability between therapists. CONCLUSIONS: Feedback-informed treatment reduces the gap between more and less effective therapists, leading to more equitable and effective psychological care. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Symptom change trajectories in patients with persistent somatic symptoms and their association to long-term treatment outcome.

OBJECTIVE: This study investigated symptom change trajectory for patients with persistent somatic symptoms (PSS) during psychotherapy and the association of these patterns with pre-treatment characteristics and long-term outcome. METHODS: Growth mixture modeling was used to identify trajectory curves in a sample of N = 210 outpatients diagnosed with PSS and treated either with conventional cognitive behavioral therapy (CBT) or CBT enriched with emotion regulation training (ENCERT). RESULTS: We identified three subgroups of patients with similar symptom change patterns over the course of treatment (a "no change," "strong response," and "slow change" subgroup). Higher initial anxiety symptoms were significantly associated with the no change and strong response subgroups; symptom-related disability in daily routine with no changes. Patients with a strong response had the highest proportion of reliable improvement at termination and at six-month-follow-up. CONCLUSION: Our results indicate that, instead of one common change pattern, patients with PSS respond differently to treatment. Due to the high association of symptom curves with long-term outcome, the identification and prediction of an individual's trajectory could provide important information for clinicians to identify non-responding patients that are at risk for failure. Selecting personalized treatment interventions could increase the effectiveness of psychotherapy.Trial registration: ClinicalTrials.gov identifier: NCT01908855..

Validation of the Four-Dimensional Symptom Questionnaire (4DSQ) in a mental health setting.

Mental health problems are highly prevalent in primary care. Validated tools to detect mental disorders in general practice are needed. The Four-Dimensional Symptom Questionnaire (4DSQ) was designed to help GPs differentiating between psychological distress and psychopathological conditions (depression, anxiety, somatization). The aim of the current study was to examine psychometric properties of the 4DSQ in a mental health setting. Reliability, factorial, construct, and criterion validity of the English translation of the 4DSQ were analyzed in an American sample of 159 patients attending a psychotherapy outpatient clinic. Measurement equivalence across languages was determined by analyzing differential item functioning (DIF) and differential test functioning (DTF) in the American sample and a Dutch mental health sample, matched by age and sex. A confirmatory factor analysis confirmed all 4DSQ subscales to be unidimensional. All 4DSQ subscales revealed excellent reliability (Cronbach's alpha and McDonald omega ≥.90) and high correlations with a symptom distress subscale of an instrument that is commonly used to monitor psychotherapy progress, the Outcome Questionnaire-45. Eight items were flagged with DIF. The Depression subscale was free of DIF. DTF analyses showed an impact of DIF on scale level for the lower cutoff score of the Distress scale. The 4DSQ Distress score was the best predictor of a mood disorder diagnosis and the Anxiety score outperformed other 4DSQ scales to predict an anxiety disorder. In conclusion, the 4DSQ demonstrates excellent reliability and validity in a mental health setting. Further research is needed to determine reliable cutoff values on 4DSQ subscales to predict psychiatric diagnoses.

Why are some cases not on track? An item analysis of the Assessment for Signal Cases during inpatient psychotherapy.

Within the Routine Outcome Monitoring system "OQ-Analyst," the questionnaire "Assessment for Signal Cases" (ASC) supports therapists in detecting potential reasons for not-on-track trajectories. Factor analysis and a machine learning algorithm (LASSO with 10-fold cross-validation) were applied, and potential predictors of not-on-track classifications were tested using logistic multilevel modeling methods. The factor analysis revealed a shortened (30 items) version of the ASC with good internal consistency (α = 0.72-0.89) and excellent predictive value (area under the curve = 0.98; positive predictive value = 0.95; negative predictive value = 0.94). Item-level analyses showed that interpersonal problems captured by specific ASC items (not feeling able to speak about problems with family members; feeling rejected or betrayed) are the most important predictors of not-on-track trajectories. It should be considered that our results are based on analyses of ASC items only. Our findings need to be replicated in future studies including other potential predictors of not-on-track trajectories (e.g., changes in medication, specific therapeutic techniques, or treatment adherence), which were not measured this study.

Psychotherapy relationships that work III.

This article introduces the journal issue devoted to the most recent iteration of evidence-based psychotherapy relationships and frames it within the work of the Third Interdivisional American Psychological Association Task Force on Evidence-Based Relationships and Responsiveness. The authors summarize the overarching purposes and processes of the Task Force and trace the devaluation of the therapy relationship in contemporary treatment guidelines and evidence-based practices. The article outlines the meta-analytic results of the subsequent 16 articles in the issue, each devoted to the link between a particular relationship element and treatment outcome. The expert consensus deemed 9 of the relationship elements as demonstrably effective, 7 as probably effective, and 1 as promising but with insufficient research to judge. What works-and what does not-in the therapy relationship is emphasized throughout. The limitations of the task force work are also addressed. The article closes with the Task Force's formal conclusions and 28 recommendations. The authors conclude that decades of research evidence and clinical experience converge: The psychotherapy relationship makes substantial and consistent contributions to outcome independent of the type of treatment. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring.

This systematic review and meta-analysis examines the impact of measuring, monitoring, and feeding back information on client progress to clinicians while they deliver psychotherapy. It considers the effects of the 2 most frequently studied routine outcome monitoring (ROM) practices: The Partners for Change Outcome Management System and the Outcome Questionnaire System. Like other ROM practices, they typify attempts to enhance routine care by assisting psychotherapists in recognizing problematic treatment response and increasing collaboration between therapist and client to overcome poor treatment response. A total of 24 studies were identified and considered suitable for analysis. Two-thirds of the studies found that ROM-assisted psychotherapy was superior to treatment-as-usual offered by the same practitioners. Mean standardized effect sizes indicated that the effects ranged from small to moderate. Feedback practices reduced deterioration rates and nearly doubled clinically significant/reliable change rates in clients who were predicted to have a poor outcome. Clinical examples, diversity considerations, and therapeutic advances are provided. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Correction to: Reliability of Therapist Effects in Practice-Based Psychotherapy Research: A Guide for the Planning of Future Studies.

The original version of this article unfortunately contained a mistake. In Results section, under the heading the "Application", CI difference values were incorrect in one of the sentences. The corrected sentence is given below.

Different lens or different picture? Comparing methods of defining dramatic change in psychotherapy.

OBJECTIVES: Differing methodologies that identify dramatic change in psychotherapy have been thought to be capturing similar phenomena. We compared three methods-percentage improvement-50% (PI-50), rapid response (RR), and sudden gains (SG)-to identify similarities and differences between these approaches. METHODS: Using a large database (n = 11,764) from a western university counseling center, we examined client characteristics (including initial severity and number of sessions in a course of treatment) and treatment outcomes (including overall change and meeting clinically significant criteria) using the Outcome Questionnaire-45. RESULTS: Approximately 47% of clients (n = 5516) met criteria for one or more of the dramatic change definitions examined. Only 498 clients (3.7%) met criteria for all three methods, while 1349 (11.5%) met criteria for only one; RR identified the most clients (41.9%) and SG identified the fewest (4.9%). All definitions were associated with higher rates of clinically significant change at termination. Compared to those who recovered gradually, dramatic changers showed higher initial severity and more overall change. RR showed fewer sessions and PI-50 and SG showed more sessions than those who recovered gradually. CONCLUSIONS: Given these differences, consensus needs to be reached in the literature regarding the definition of dramatic change. We call for further theory development and research to help formulate a definition that can be simply applied and that more fully and parsimoniously captures the phenomenon of dramatic change.

Early response in cognitive-behavior therapy for syndromes of medically unexplained symptoms.

BACKGROUND: Early dramatic treatment response suggests a subset of patients who respond to treatment before most of it has been offered. These early responders tend to be over represented among those who are well at termination and at follow-up. Early response patterns in psychotherapy have been investigated only for a few of mental disorders so far. The main aim of the current study was to examine early response after five therapy-preparing sessions of a cognitive behavior therapy (CBT) for syndromes of medically unexplained symptoms (MUS). METHODS: In the context of a randomized, waiting-list controlled trial 48 patients who suffered from ≥3 MUS over ≥6 months received 5 therapy-preparing sessions and 20 sessions of CBT for somatoform disorders. They completed self-report scales of somatic symptom severity (SOMS-7 T), depression (BDI-II), anxiety (BSI), illness anxiety and behavior (IAS) at pre-treatment, after 5 therapy-preparing sessions (FU-5P) and at therapy termination (FU-20 T). RESULTS: The current analyses are based on data from the treatment arm only. Repeated measure ANOVAs revealed a significant decrease of depression (d = 0.34), anxiety (d = 0.60), illness anxiety (d = 0.38) and illness behavior (d = 0.42), but no change of somatic symptom severity (d = -0.03) between pre-treatment and FU-5P. Hierarchical linear multiple regression analyses showed that symptom improvements between pre-treatment and FU-5P predict a better outcome at therapy termination for depression and illness anxiety, after controlling for pre-treatment scores. Mixed-effect ANOVAs revealed significant group*time interaction effects indicating differences in the course of symptom improvement over the therapy between patients who fulfilled a reliable change (i.e., early response) during the 5 therapy-preparing sessions and patients who did not reach an early reliable change. Demographic or clinical variables at pre-treatment were not significantly correlated with differential scores between pre-treatment and FU-5P (-.23 ≤ r ≤ .23). CONCLUSIONS: Due to several limitations (e.g., small sample size, lack of a control group) the results of this study have to be interpreted cautiously. Our findings show that reliable changes in regard to affective-cognitive and behavioral variables can take place very early in CBT of patients with distressing MUS. These early changes seem to be predictive of the outcome at therapy termination. Future studies are needed in order to replicate our results, and to identify mechanisms of these early response patterns in somatoform patients. TRIAL REGISTRATION: ISRCTN. ISRCTN17188363 . Registered retrospectively on 29 March 2007.

Maximizing Psychotherapy Outcome beyond Evidence-Based Medicine.

Despite evidence that psychotherapy has a positive impact on psychological disorders, 30% of patients fail to respond during clinical trials, and as many as 65% of patients in routine care leave treatment without a measured benefit. In addition, therapists appear to overestimate positive outcomes in their patients relative to measured outcomes and are particularly poor at identifying patients at risk for a negative outcome. These problems suggest the need for measuring and monitoring patient treatment response over the course of treatment while applying standardized methods of identifying at-risk cases. Computer-assisted methods for measuring, monitoring, identifying potential deteriorators, and providing feedback to clinicians are described along with a model that explains why feedback is likely to be beneficial to patients. The results of 12 clinical trials are summarized and suggest that deterioration rates can be substantially reduced in at-risk cases (from baseline rates of 21% down to 13%) and that recovery rates are substantially increased in this subgroup of cases (from a baseline of 20% up to 35%) when therapists are provided this information. When problem-solving methods are added to feedback, deterioration in at-risk cases is further reduced to 6% while recovery/improvement rates rise to about 50%. It is suggested that the feedback methods become a standard of practice. Such a change in patterns of care can be achieved through minimal modification to routine practice but may require discussions with patients about their clinical progress.

Translation of the Outcome Questionnaire-45 (OQ) into Japanese: A cultural adaptation.

OBJECTIVE: While there are several Japanese, qualitative, case studies examining psychotherapy outcome, there is a growing need for quantitative psychotherapy outcome research in Japan. This study adapted the Outcome Questionnaire-45 (OQ), one of the most common quantitative measures of clinical outcome, for use in Japan. METHOD: With the help of 6 translators and 116 native Japanese pilot respondents, the original OQ was translated into Japanese following Beaton et al.'s methodology and includes forward translation, synthesis, back translation, and expert committee meetings. RESULTS: The study produced four pre-final versions, two pretest version, and one pilot version of the Japanese OQ. With permission from the original questionnaire developers, a few items were modified to achieve cultural equivalence. The rigorous translation and adaptation processes, evaluated through the Translation Validity Index and Content Validity Index provided semantic, content, and conceptual equivalence between the English and Japanese versions. CONCLUSIONS: The current study partially validated the translation equivalence and cultural adaptation of the Japanese OQ. Study limitations and suggestions for further development are discussed.

Reliability of Therapist Effects in Practice-Based Psychotherapy Research: A Guide for the Planning of Future Studies.

This paper aims to provide researchers with practical information on sample sizes for accurate estimations of therapist effects (TEs). The investigations are based on an integrated sample of 48,648 patients treated by 1800 therapists. Multilevel modeling and resampling were used to realize varying sample size conditions to generate empirical estimates of TEs. Sample size tables, including varying sample size conditions, were constructed and study examples given. This study gives an insight into the potential size of the TE and provides researchers with a practical guide to aid the planning of future studies in this field.

Body Mass Index is a Poor Predictor of Bedside Appendix Ultrasound Success or Accuracy.

INTRODUCTION: The objective of this study was to determine whether there is a relationship between body mass index (BMI) and success or accuracy rate of beside ultrasound (BUS) for the diagnosis of appendicitis. METHODS: Patients four years of age and older presenting to the emergency department with suspected appendicitis were eligible. Enrollment was by convenience sampling. After informed consent, BUS was performed by trained emergency physicians who had undergone a minimum of one-hour didactic training on the use of BUS to diagnose appendicitis. We ascertained subject outcomes by a combination of medical record review and telephone follow up. Calculated BMI for adults and children were divided into four categories (underweight, normal, overweight, obese) according to Centers for Disease Control and Prevention classifications. RESULTS: A total of 125 subjects consented for the study, and 116 of them had adequate image data for final analysis. Seventy (60%) of the subjects were children. Prevalence of appendicitis was 39%. Fifty-two (45%) of the BUS studies were diagnostic (successful). Overall accuracy rate was 75%. Analysis by chi-square test or Mann-Whitney U test did not find any significant correlation between BMI category and BUS success. Similarly, there was no significant correlation between BMI category and BUS accuracy. The same conclusion was reached when children and adults were analyzed separately, or when subjects were dichotomized into underweight/normal and overweight/obese categories. CONCLUSION: BMI category alone is a poor predictor of appendix BUS success or accuracy.

The orthogonal-oblique bi-level model of the Outcome Questionnaire (OQ-45.2): Polish adaptation based on factor analysis.

UNLABELLED: AIM : The aim of this project was to conduct the cross-cultural factorial validation of the Outcome Questionnaire (OQ-45.2) using the Polish population. METHODS: Data were obtained from day-patients (n = 211), inpatients (n = 234), outpatients (n = 137) and non-patients (n = 426). Statistical analyses included: parallel analysis, exploratory factor analysis, confirmatory factor analysis, correlation analysis, criterion equivalence, clinical significance and reliable change index, and test-retest. RESULTS: Statistical analyses provided the strongest support for the bi-level model of the total score, five orthogonal (subscales specific for the Polish OQ, i.e. Social Conflicts and Addictive Behaviors; and original yet modified subscales, i.e. Symptom Distress, Interpersonal Relations, and Social Role), and two oblique factors (Somatization and Anxiety, Social Role 2). The psychometric properties of the Polish OQ were found to be adequate and similar to the original American OQ and its international adaptations. Specific for the Polish OQ cut-off scores for clinical significance were established. The role of cultural differences and the passage of time in the process of the cross-cultural validation were elaborated upon. CONCLUSIONS: The Polish version of the OQ 45-2 has been recognized as an instrument adequately measuring general functioning as well as specific areas of functioning of the individual (i.e. interpersonal relations; social role performance; social conflicts; symptom distress; somatization and anxiety; addictive behaviors). Results of this factorial analysis seem to be valuable for both clinicians using the OQ-45.2 and for creators of any psychotherapy outcome measure.

Progress feedback and the OQ-system: The past and the future.

A serious problem in routine clinical practice is clinician optimism about the benefit clients derive from the therapy that they offer compared to measured benefits. The consequence of seeing the silver lining is a failure to identify cases that, in the end, leave treatment worse-off than when they started or are simply unaffected. It has become clear that some methods of measuring, monitoring, and providing feedback to clinicians about client mental health status over the course of routine care improves treatment outcomes for clients at risk of treatment failure (Shimokawa, Lambert, & Smart, 2010) and thus is a remedy for therapist optimism by identifying cases at risk for poor outcomes. The current article presents research findings related to use of the Outcome Questionnaire-45 and Clinical Support Tools for this purpose. The necessary characteristics of feedback systems that work to benefit client's well-being are identified. In addition, suggestions for future research and use in routine care are presented.

The relationship between session frequency and psychotherapy outcome in a naturalistic setting.

OBJECTIVE: The dose-response relationship in psychotherapy has been examined extensively, but few studies have included session frequency as a component of psychotherapy "dose." Studies that have examined session frequency have indicated that it may affect both the speed and the amount of recovery. No studies were found examining the clinical significance of this construct in a naturalistic setting, which is the aim of the current study. METHOD: Using an archival database of session-by-session Outcome Questionnaire 45 (OQ-45) measures over 17 years, change trajectories of 21,488 university counseling center clients (54.9% female, 85.0% White, mean age = 22.5) were examined using multilevel modeling, including session frequency at the occasion level. Of these clients, subgroups that attended therapy approximately weekly or fortnightly were compared to each other for differences in speed of recovery (using multilevel Cox regression) and clinically significant change (using multilevel logistic regression). RESULTS: Results indicated that more frequent therapy was associated with steeper recovery curves (Cohen's f2 = 0.07; an effect size between small and medium). When comparing weekly and fortnightly groups, clinically significant gains were achieved faster for those attending weekly sessions; however, few significant differences were found between groups in total amount of change in therapy. CONCLUSIONS: Findings replicated previous session frequency literature and supported a clinically significant effect, where higher session frequency resulted in faster recovery. Session frequency appears to be an impactful component in delivering more efficient psychotherapy, and it is important to consider in individual treatment planning, institutional policy, and future research.

Dialectical behavior therapy with American Indian/Alaska Native adolescents diagnosed with substance use disorders: combining an evidence based treatment with cultural, traditional, and spiritual beliefs.

This pilot study examined pre to post-change of patients in a substance use residential treatment center that incorporated Dialectical Behavior Therapy with specific cultural, traditional and spiritual practices for American Indian/Alaska Native adolescents. Specifically, the incorporation of cultural, spiritual and traditional practices was done while still maintaining fidelity to the evidence based treatment (DBT). 229 adolescents participated in the study and were given the Youth Outcome Questionnaire-Self-Report version at pre-treatment and post-treatment and the total scores were compared. The results of the research study showed that 96% of adolescents were either "recovered" or "improved" using clinical significant change criteria. Additionally, differences between the group's pre-test scores and post-test scores were statistically significant using a matched standard T-test comparison. Finally, the effect size that was calculated using Cohen's criteria was found to be large. The results are discussed in terms of the implication for integrating western and traditional based methods of care in addressing substance use disorders and other mental health disorders with American Indian/Alaska Native adolescents.

Validation of the Hebrew and Arabic Versions of the Outcome Questionnaire (OQ-45).

BACKGROUND: Measuring the progress of mental health treatment aids in assessment and monitoring of psychotherapeutic outcomes. The OQ-45 is a widely accepted measure of such outcomes. The aim of this study was to validate the Hebrew and Arabic versions of the OQ-45. METHOD: Data were collected from three samples: non patient university students (n=189), university mental health clinic patients (n=37), and outpatient mental health clinic patients (n=135). Subjects completed the OQ-45 as well as the BSI and PHQ-9 questionnaires. RESULTS: Test-retest and internal reliability, and concurrent and discriminative validity of both OQ-45 versions were satisfactory. Sensitivity of the Hebrew and Arabic versions was 0.70 and 0.80, respectively, and the specificity was 0.69and 0.93, respectively. Sensitivity-to-change was noted only for the Symptom Distress (SD) subscale. LIMITATIONS: Sensitivity-to-change was not demonstrated for the total OQ-45, possibly due to a too-short follow-up period. CONCLUSIONS: Adequate psychometric properties of the Hebrew and Arabic OQ-45 suggest that they can serve as useful measures of mental health treatment in Israel.Further research is necessary to confirm norms, cut-off scores and sensitivity-to-change using a larger representative population and diverse types of treatment over a longer period of time.

Using the Assessment for Signal Clients as a feedback tool for reducing treatment failure.

OBJECTIVE: The Clinical Support Tools (CSTs) were developed to help therapists organize and target potential problems that might account for negative outcomes in psychotherapy. The core of CST feedback is the Assessment for Signal Clients. The purpose of this study was to describe and identify patterns of problems that typically characterize off-track cases. METHOD: The responses and scores from 107 off-track clients from a hospital-based outpatient clinic were analyzed. RESULTS: A cluster analysis of the 107 off-track clients revealed three client types: those whose problems were characterized by alliance and motivational difficulties; those characterized by social support and life event difficulties; and those whose problems had an indistinguishable pattern. Log-linear modeling showed that if patients had less therapeutic alliance problems they were also less likely to have motivational problems. Findings were also consistent with the cluster analysis, which showed that a relatively higher percentage of not-on-track participants received signal alerts for the social support items and scale. CONCLUSIONS: Individuals whose progress goes off-track while in psychotherapy appear to have their greatest difficulty with social support, followed closely by motivation for therapy and therapeutic alliance.