Strength-based methods - a narrative review and comparative multilevel meta-analysis of positive interventions in clinical settings.

OBJECTIVE: In psychotherapy, strength-based methods (SBM) represent efforts to build on patients' strengths while addressing the deficits and challenges that led them to come to therapy. SBM are incorporated to some extent in all major psychotherapy approaches, but data on their unique contribution to psychotherapy efficacy is scarce. METHODS: First, we conducted a systematic review and narrative synthesis of eight process-outcome psychotherapy studies that investigated in-session SBM and their relation to immediate outcomes. Second, we conducted a systematic review and multilevel comparative meta-analysis contrasting strength-based bona fide psychotherapy vs. other bona fide psychotherapy at post-treatment (57 effect sizes nested in 9 trials). RESULTS: Despite their methodological variability, the pattern of results in the process-outcome studies was generally positive, such that SBM were linked with more favorable immediate, session-level patient outcomes. The comparative meta-analysis found an overall weighted average effect size of g = 0.17 (95% CIs [0.03, 0.31], p < .01) indicating a small but significant effect in favor of strength-based bona fide psychotherapies. There was non-significant heterogeneity among the effect sizes (Q(56) = 69.1, p = .11; I2 = 19%, CI [16%, 22%]). CONCLUSION: Our findings suggest that SBMs may not be a trivial by-product of treatment progress and may provide a unique contribution to psychotherapy outcomes. Thus, we recommend integration of SBM to clinical training and practice across treatment models.

Assessing the alliance-outcome association adjusted for patient characteristics and treatment processes: A meta-analytic summary of direct comparisons.

The alliance is widely recognized as a robust predictor of posttreatment outcomes. However, there is a debate regarding whether the alliance is an epiphenomenon of intake characteristics and/or treatment processes occurring over the course of treatment. This meta-analysis aimed to synthesize the evidence on this issue. We identified 125 effect sizes in 60 independent samples (6,061 participants) of studies that reported alliance-outcome correlations as well as parallel intake or process characteristics. We examined the impact of these potential confounds on the alliance-outcome correlations. We meta-analyzed the studies estimates by computing omnibus effects models as well as multivariate models. We identified 3 variable types that were used to adjust the alliance-outcome correlations: (a) intake characteristics (k = 35); (b) simultaneous processes, such as adherence or competence (k = 13); and (c) both intake and simultaneous processes (k = 24). We found moderate alliance-outcome correlations with or without adjustments for intake and simultaneous processes (range from r = .23 to r = .31). Our results provide robust empirical evidence for the assertion that the alliance-outcome association is an independent process-based factor. Findings suggest that alliance is positively related to outcome above and beyond the studied patient intake characteristics and treatment processes. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Effect size calculation in meta-analyses of psychotherapy outcome research.

Meta-analysis of psychotherapy intervention research normally examines differences between treatment groups and some form of comparison group (e.g., wait list control; alternative treatment group). The effect of treatment is normally quantified as a standardized mean difference (SMD). We describe procedures for computing unbiased estimates of the population SMD from sample data (e.g., group Ms and SDs), and provide guidance about a number of complications that may arise related to effect size computation. These complications include (a) incomplete data in research reports; (b) use of baseline data in computing SMDs and estimating the population standard deviation (σ); (c) combining effect size data from studies using different research designs; and (d) appropriate techniques for analysis of data from studies providing multiple estimates of the effect of interest (i.e., dependent effect sizes). Clinical or Methodological Significance of this article: Meta-analysis is a set of techniques for producing valid summaries of existing research. The initial computational step for meta-analyses of research on intervention outcomes involves computing an effect size quantifying the change attributable to the intervention. We discuss common issues in the computation of effect sizes and provide recommended procedures to address them.

In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy.

OBJECTIVE: Three recent meta-analyses have made the claim, albeit with some caveats, that cognitive-behavioral treatments (CBT) are superior to other psychotherapies, in general or for specific disorders (e.g., social phobia). METHOD: The purpose of the present article was to examine four issues in meta-analysis that mitigate claims of CBT superiority: (a) effect size, power, and statistical significance, (b) focusing on disorder-specific symptom measures and ignoring other important indicators of psychological functioning, (c) problems inherent in classifying treatments provided in primary studies into classes of treatments, and (d) the inclusion of problematic trials, which biases the results, and the exclusion of trials that fail to find differences among treatments. RESULTS: When these issues are examined, the effects demonstrating the superiority of CBT are small, nonsignificant for the most part, limited to targeted symptoms, or are due to flawed primary studies. CONCLUSION: Meta-analytic evidence for the superiority of CBT in the three meta-analysis are nonexistent or weak.

Open access meta-analysis for psychotherapy research.

Meta-analysis has played a key role in psychotherapy research for nearly 40 years. There is now an opportunity for technology to assist with transparent and open meta-analyses. The authors describe an open-access database of effect sizes and a corresponding web application for performing meta-analyses, viewing the database, and downloading effect sizes. The initial databases provide effect sizes for family therapy for delinquency studies and for alliance-outcome correlations in individual psychotherapy. Disciplinary norms about data sharing and openness are shifting. Furthermore, meta-analyses of behavioral interventions have been criticized for lacking transparency and openness. The database and web application are aimed at facilitating data sharing and improving the transparency of meta-analyses. The authors conclude with a discussion of future directions for the database.

A meta-analysis of topiramate's effects for individuals with alcohol use disorders.

BACKGROUND: Influenced by several trials and reviews highlighting positive outcomes, topiramate is increasingly prescribed as a treatment for alcohol use disorders (AUDs). The only previously published meta-analysis of topiramate for AUDs was limited by a sample of only 3 randomized, placebo-controlled trials (RCTs). METHODS: A systematic search identified 7 RCTs (including a total of 1,125 participants) that compared topiramate to placebo for the treatment for AUDs. This meta-analysis estimated the overall effects of topiramate on abstinence, heavy drinking, craving, and γ-glutamyltranspeptidase (GGT) outcomes and included several sensitivity analyses to account for the small sample of studies. RESULTS: Overall, the small to moderate effects favored topiramate, although the effect on craving was not quite significantly different from 0. The largest effect was found on abstinence (g = 0.468, p < 0.01), followed by heavy drinking (g = 0.406, p < 0.01), GGT (g = 0.324, p = 0.02), and craving (g = 0.312, p = 0.07) outcomes. Sensitivity analyses did not change the magnitude or direction of the results, and tests did not indicate significant publication bias. The small sample size did not allow for examination of specific moderators of the effects of topiramate. CONCLUSIONS: Topiramate can be a useful tool in the treatment of AUDs. Its efficacy, based on the current sample of studies, seems to be of somewhat greater magnitude than that of the most commonly prescribed medications for AUDs (naltrexone and acamprosate). Further research will help to identify the contexts in which topiramate is most beneficial (e.g., dose, concurrent psychotherapy, patient characteristics).

The impact of neurobehavioral features on medication adherence in HIV: evidence from longitudinal models.

Effective antiretroviral therapy has led to substantial improvements in health-related outcomes among individuals with HIV. Despite advances in HIV pharmacotherapy, suboptimal medication adherence remains a significant barrier to successful treatment. Although several factors have been associated with medication adherence in the extant literature, study assessing the effects of some of the neurobehavioral features specific to HIV has been limited. Moreover, although there is a growing body of literature measuring medication adherence in HIV prospectively, few employ advanced statistical methodologies suited to handle advanced models with multiple predictors that would strengthen our understanding of medication adherence trajectories in HIV. This study sought to integrate traditionally assessed predictors of medication adherence with neurobehavioral features of HIV in a longitudinal study of medication adherence to combined antiretroviral therapy (cART). The current study used multilevel modeling to examine a wide arrangement of categories of factors - demographic, medication related, psychosocial, and neurobehavioral - on medication adherence. The sample consisted of 235 HIV+ individuals whose medication adherence was monitored over the course of six months using electronic monitoring devices. After controlling for the effects of demographic, medication, and psychosocial factors, neurobehavioral features added predictive validity to the model. In the final model, simultaneously controlling for the effects of each of the predictors within all the categories, age, self-efficacy, executive functioning, apathy, and frequency of stimulant use emerged as unique individual predictors of average medication adherence across the 6-month study. Self-efficacy and irritability predicted changes in medication adherence over time. Adherence behavior is multidetermined. Adequate assessment of these factors, combined with timely intervention, appears to be warranted in order to boost adherence rates.

The secret ingredient in mindfulness interventions? A case for practice quality over quantity.

As mindfulness-based interventions become increasingly widespread, interest has grown in better understanding which features of these treatments produce beneficial effects. The present study examined the relative contribution of mindfulness practice time and practice quality in predicting psychological functioning (negative affect, emotion regulation, quality of life, mindfulness). Data were drawn from a randomized clinical trial of mindfulness training for smokers and assessed outcomes at posttreatment (n = 43) and 5-month follow-up (n = 38). The intervention included instruction in mindfulness techniques targeted to smoking cessation and relapse prevention and was composed of 10 group meetings over 8 weeks. Data from 8 treatment groups were used. Mindfulness practice quality was measured weekly over the course of treatment, and multilevel modeling was used to estimate trajectories of change in practice quality. The measure of practice quality was shown to be valid and reliable, with change in practice quality predicting change in psychological functioning at both posttreatment (ß = .31, 95% CI = [0.04, 0.56], p = .022) and follow-up (ß = .45 [0.16, 0.73], p = .002), even when controlling for practice time. Practice time predicted outcomes at posttreatment (ß = .31 [0.05, 0.57], p = .019) but not at follow-up (ß = .16 [-0.14, 0.47], p = .293). Neither practice time nor change in practice quality predicted smoking abstinence at 1 month or 6 months postquit. Results support the importance of practice quality as a relevant aspect of mindfulness interventions.

Placebo group improvement in trials of pharmacotherapies for alcohol use disorders: a multivariate meta-analysis examining change over time.

OBJECTIVE: Placebo group improvement in pharmacotherapy trials has been increasing over time across several pharmacological treatment areas. However, it is unknown to what degree increasing improvement has occurred in pharmacotherapy trials for alcohol use disorders or what factors may account for placebo group improvement. This meta-analysis of 47 alcohol pharmacotherapy trials evaluated (1) the magnitude of placebo group improvement, (2) the extent to which placebo group improvement has been increasing over time, and (3) several potential moderators that might account for variation in placebo group improvement. METHOD: Random-effects univariate and multivariate analyses were conducted that examined the magnitude of placebo group improvement in the 47 studies and several potential moderators of improvement: (a) publication year, (b) country in which the study was conducted, (c) outcome data source/type, (d) number of placebo administrations, (e) overall severity of study participants, and (f) additional psychosocial treatment. RESULTS: Substantial placebo group improvement was found overall and improvement was larger in more recent studies. Greater improvement was found on moderately subjective outcomes, with more frequent administrations of the placebo, and in studies with greater participant severity of illness. However, even after controlling for these moderators, placebo group improvement remained significant, as did placebo group improvement over time. CONCLUSIONS: Similar to previous pharmacotherapy placebo research, substantial pretest to posttest placebo group improvement has occurred in alcohol pharmacotherapy trials, an effect that has been increasing over time. However, several plausible moderator variables were not able to explain why placebo group improvement has been increasing over time.

The declining efficacy of naltrexone pharmacotherapy for alcohol use disorders over time: a multivariate meta-analysis.

BACKGROUND: Oral naltrexone is an FDA-approved medication for treating alcohol use disorders. Although its efficacy has been supported in multiple clinical trials, an earlier review found that its effect sizes (ESs) on relapse to heavy drinking and, to a lesser extent, percent days drinking were smaller in more recent trials and in multicenter than in single-site studies. We examined whether these findings held when studies from 2004 to 2009 were taken into account, and whether single-site versus multicenter trials, the use of placebo run-in periods, and placebo group improvement accounted for variation in naltrexone effects and decreasing effects over time. METHODS: A multivariate meta-analysis of naltrexone pharmacotherapy trials for alcohol use disorders was conducted. All analyses simultaneously modeled ESs on outcomes of percent days abstinent and relapse to heavy drinking. Potential moderators of medication effects that were examined included publication year, multicenter design (vs. single site), placebo run-in period, and placebo group improvement. RESULTS: Statistically significant between-group differences on percent days abstinent (the inverse of percent days drinking) and relapse to heavy drinking favored naltrexone over placebo. Year of publication was a significant moderator for both outcomes, with more recent trials having smaller ESs. Neither multi- versus single-site study, the interaction between multi- versus single-site study and year of publication, nor placebo run-in period was a significant moderator of naltrexone effects. Although placebo group improvement was modestly associated with smaller between-group naltrexone versus placebo ESs, only 21 studies provided usable information on placebo group improvement. Within those studies, there was no relationship between naltrexone ESs and time, so placebo group improvement was not examined as a moderator of that relationship. CONCLUSIONS: Naltrexone ESs have attenuated over time. Moderators that explain why effects have been decreasing remain to be determined.

Monitoring mindfulness practice quality: an important consideration in mindfulness practice.

Mindfulness-Based Stress Reduction (MBSR) is an experientially based group intervention empirically supported to reduce psychological symptomology. Although MBSR has shown to be an effective intervention, little is known about which facets of the intervention are important in producing positive outcomes. This study tested several aspects of mindfulness practice (total practice duration, practice frequency and practice quality) with the primary focus being on validating (i.e., predictive and convergent validity) a new measure of mindfulness practice quality (PQ-M). The PQ-M fit a two-factor solution via a Maximum Likelihood Exploratory Factor Analysis (n=99). Using longitudinal multilevel modeling on a smaller subsample (n=19), preliminary support was found for changes in practice quality over the course of the MBSR intervention. Further, change in practice quality was associated with improvements in psychological symptoms. While this study was exploratory, these findings suggest that practice quality is a relevant factor to promote positive outcomes and may guide mindfulness instructors in providing highly tailored interventions.

Valuing clients' perspective and the effects on the therapeutic alliance: a randomized controlled study of an adjunctive instruction.

The patterns of growth and development of the therapeutic alliance over the course of therapy have been of continued interest to psychotherapy researchers. The purpose of this study was to investigate whether a simple institutional metacommunication intervention with clients had an effect on the development of the alliance. This adjunctive instruction involved inviting therapy clients to take a proactive role in their treatment by encouraging feedback to their therapist about various aspects of the therapy process. In this randomized controlled study (N = 94), clients were assigned to 1 of 2 conditions: (a) an institutional adjunctive instruction condition in which patients were contacted by clinic personnel at the beginning of the remediation phase (Session 5) and encouraged to take a proactive role in their treatment and (b) a control condition that contained no institutional adjunctive instruction. Between-condition differences in the alliance were tested, controlling for baseline influences and the early therapeutic alliance. Clients' postsession reports from Sessions 1 to 24 indicated that the adjunctive instruction increased the alliance over the course of therapy vis-à-vis the control condition. The adjunctive instruction appeared to have fostered clients' evaluation of their therapists' interest in their welfare. The results indicate that interventions, even brief or subtle, can produce lasting benefits in the alliance when targeted at specific psychological processes. Systematic metacommunication from the institutional level appeared to reinforce clients' therapeutic alliance with their therapists in individual treatment.

How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis.

Prior meta-analyses have found a moderate but robust relationship between alliance and outcome across a broad spectrum of treatments, presenting concerns, contexts, and measurements. However, there continues to be a lively debate about the therapeutic role of the alliance, particularly in treatments that are tested using randomized clinical trial (RCT) designs. The purpose of this present study was to examine whether research design, type of treatment, or author's allegiance variables, alone or in combination, moderate the relationship between alliance and outcome. Multilevel longitudinal analysis was used to investigate the following moderators of the alliance-outcome correlation: (a) research design (RCT or other), (b) use of disorder-specific manuals, (c) specificity of outcomes, (d) cognitive and/or behavioral therapy (CBT) or other types of treatments, (e) researcher allegiance, and (f) time of alliance assessment. RCT, disorder-specific manual use, specificity of primary and secondary outcomes, and CBT did not moderate the alliance-outcome correlation. Early alliance-outcome correlations were slightly higher in studies conducted by investigators with specific interest in alliance than were those in studies conducted by researchers without such an allegiance. Over the course of therapy, these initial differences disappeared. Apart from this trend, none of the variables previously proposed as potential moderators or mediators of the alliance-outcome relation, alone or in combination, were found to have a mediating impact.

The relative efficacy of bona fide cognitive behavioral therapy and applied relaxation for generalized anxiety disorder at follow-up: A longitudinal multilevel meta-analysis.

OBJECTIVE: This meta-analysis examined the relative efficacy of bona fide psychotherapy conditions in generalized anxiety disorder (GAD) from posttreatment to follow-up in adults. METHODS: Omnibus tests of relative efficacy across bona fide psychotherapies for primary and secondary outcomes were conducted. Longitudinal multilevel subgroup analyses investigated, (a) applied relaxation versus cognitive behavioral therapy (CBT) without applied relaxation and (b) well-established CBT versus augmented integrative CBT. RESULTS: In total, 54 repeated effect sizes nested in 23 studies were included in this meta-analysis. Omnibus test of relative efficacy indicated no significant differences among the bona fide psychotherapy contrasts in primary and some differences in secondary outcomes. When contrasting applied relaxation with CBT without applied relaxation, negligible relative efficacy differences were found at each assessment time. There were small efficacy differences in favor of augmented integrative CBT in comparison to well-established CBT. CONCLUSION: Small relative efficacy differences were found between bona fide psychotherapies in GAD. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Examining therapist effects in the alliance-outcome relationship: A multilevel meta-analysis.

OBJECTIVE: The relationship between the therapeutic alliance and outcome has been supported consistently over time. More recently, studies have examined therapist effects in the alliance-outcome relationship and came up with somewhat mixed findings. The purpose of this study was to replicate and extend previous meta-analytic work using a much larger data set, permitting not only the verification of the overall impact of the therapists' contribution but, at the same time, controlling for several potential covariates effecting this relationship. METHOD: We conducted two- and three-level mixed-effects meta-analyses (k = 152; 827 total effect sizes) to examine the significance of several potential moderators of the alliance-outcome correlation. These moderators included (a) Patient-Therapist Ratio (PTR; Patient N divided by therapist N to test therapist effects), (b) Alliance and Outcome Rater's contribution (patient, therapist, observer, and other), (c) Alliance Measures, (d) Research Design (RCT, Other) and (e) Personality Disorder. RESULTS: The PTR, an index of the therapist's contribution to the alliance, was a significant moderator of the alliance-outcome correlation in both the two- and three-level models. When several potential confounds were simultaneously tested in a three-level multipredictor metaregression, including rater of alliance and outcome, research design, alliance measure, and personality disorder, PTR remained a significant moderator of the alliance-outcome correlation. CONCLUSION: Replicating and extending previous research, this study supported the significance of therapists' impact in the alliance-outcome relationship. These results remained significant even when, using three-level metaregressions, several potential covariates were simultaneously controlled. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The predictive validity of the progress assessment, a clinician administered instrument for use in measurement-based care for substance use disorders.

We tested the predictive validity of the Progress Assessment (PA), a brief counselor administered tool for use in measurement-based care for substance use disorders. The PA includes 5 items assessing relapse risk and 5 items assessing factors protective against relapse. Data were drawn from a completed study of continuing care for cocaine dependence (McKay et al., 2013) and includes 12 months of follow-up on158 participants (76% male) who received brief telephone or face-to-face sessions. Each session began with the administration of the PA, followed by cognitive-behavioral counseling tied to the results of the PA and anticipated risky situations. Outcome was assessed via urine toxicology every 3 months. As administered in an effectiveness trial, average PA risk and protective scales within each 3-month segment of the study predicted urine toxicology results at the end of that period, with higher risk scores and lower protective scores predicting greater rates of cocaine positive urine drug screens. PA scores did not predict dropout from continuing care participation. The 10-item PA shows promise as a pragmatic clinical tool for ongoing monitoring during continuing care for substance dependence.

The reciprocal relationship between alliance and early treatment symptoms: A two-stage individual participant data meta-analysis.

OBJECTIVE: Even though the early alliance has been shown to robustly predict posttreatment outcomes, the question whether alliance leads to symptom reduction or symptom reduction leads to a better alliance remains unresolved. To better understand the relation between alliance and symptoms early in therapy, we meta-analyzed the lagged session-by-session within-patient effects of alliance and symptoms from Sessions 1 to 7. METHOD: We applied a 2-stage individual participant data meta-analytic approach. Based on the data sets of 17 primary studies from 9 countries that comprised 5,350 participants, we first calculated standardized session-by-session within-patient coefficients. Second, we meta-analyzed these coefficients by using random-effects models to calculate omnibus effects across the studies. RESULTS: In line with previous meta-analyses, we found that early alliance predicted posttreatment outcome. We identified significant reciprocal within-patient effects between alliance and symptoms within the first 7 sessions. Cross-level interactions indicated that higher alliances and lower symptoms positively impacted the relation between alliance and symptoms in the subsequent session. CONCLUSION: The findings provide empirical evidence that in the early phase of therapy, symptoms and alliance were reciprocally related to one other, often resulting in a positive upward spiral of higher alliance/lower symptoms that predicted higher alliances/lower symptoms in the subsequent sessions. Two-stage individual participant data meta-analyses have the potential to move the field forward by generating and interlinking well-replicable process-based knowledge. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The alliance in adult psychotherapy: A meta-analytic synthesis.

The alliance continues to be one of the most investigated variables related to success in psychotherapy irrespective of theoretical orientation. We define and illustrate the alliance (also conceptualized as therapeutic alliance, helping alliance, or working alliance) and then present a meta-analysis of 295 independent studies that covered more than 30,000 patients (published between 1978 and 2017) for face-to-face and Internet-based psychotherapy. The relation of the alliance and treatment outcome was investigated using a three-level meta-analysis with random-effects restricted maximum-likelihood estimators. The overall alliance-outcome association for face-to-face psychotherapy was r = .278 (95% confidence intervals [.256, .299], p < .0001; equivalent of d = .579). There was heterogeneity among the effect sizes, and 2% of the 295 effect sizes indicated negative correlations. The correlation for Internet-based psychotherapy was approximately the same (viz., r = .275, k = 23). These results confirm the robustness of the positive relation between the alliance and outcome. This relation remains consistent across assessor perspectives, alliance and outcome measures, treatment approaches, patient characteristics, and countries. The article concludes with causality considerations, research limitations, diversity considerations, and therapeutic practices. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The sleeper effect: Artifact or phenomenon-A brief comment on Bell et al. (2013).

OBJECTIVE: Bell, Marcus, and Goodlad (2013) recently conducted a meta-analysis of randomized controlled additive trials and found that adding an additional component to an existing treatment vis-à-vis the existing treatment produced larger effect sizes on targeted outcomes at 6-months follow-up than at termination, an effect they labeled as a sleeper effect. One of the limitations with Bell et al.'s detection of the sleeper effect was that they did not conduct a statistical test of the size of the effect at follow-up versus termination. METHOD: To statistically test if the differences of effect sizes between the additive conditions and the control conditions at follow-up differed from those at termination, we used a restricted maximum-likelihood random-effect model with known variances to conduct a multilevel longitudinal meta-analysis (k = 30). RESULTS: Although the small effects at termination detected by Bell et al. were replicated (ds = 0.17-0.23), none of the analyses of growth from termination to follow-up produced statistically significant effects (ds < 0.08; p > .20), and when asymmetry was considered using trim-and-fill procedure or the studies after 2000 were analyzed, magnitude of the sleeper effect was negligible (d = 0.00). CONCLUSION: There is no empirical evidence to support the sleeper effect. (PsycINFO Database Record