Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review.

We face increasing demand for greater access to effective routine mental health services, including telehealth. However, treatment outcomes in routine clinical practice are only about half the size of those reported in controlled trials. Progress feedback, defined as the ongoing monitoring of patients' treatment response with standardized measures, is an evidence-based practice that continues to be under-utilized in routine care. The aim of the current review is to provide a summary of the current evidence base for the use of progress feedback, its mechanisms of action and considerations for successful implementation. We reviewed ten available meta-analyses, which report small to medium overall effect sizes. The results suggest that adding feedback to a wide range of psychological and psychiatric interventions (ranging from primary care to hospitalization and crisis care) tends to enhance the effectiveness of these interventions. The strongest evidence is for patients with common mental health problems compared to those with very severe disorders. Effect sizes for not-on-track cases, a subgroup of cases that are not progressing well, are found to be somewhat stronger, especially when clinical support tools are added to the feedback. Systematic reviews and recent studies suggest potential mechanisms of action for progress feedback include focusing the clinician's attention, altering clinician expectations, providing new information, and enhancing patient-centered communication. Promising approaches to strengthen progress feedback interventions include advanced systems with signaling technology, clinical problem-solving tools, and a broader spectrum of outcome and progress measures. An overview of methodological and implementation challenges is provided, as well as suggestions for addressing these issues in future studies. We conclude that while feedback has modest effects, it is a small and affordable intervention that can potentially improve outcomes in psychological interventions. Further research into mechanisms of action and effective implementation strategies is needed.

A Clinical Leadership Lens on Implementing Progress Feedback in Three Countries: Development of a Multidimensional Qualitative Coding Scheme.

BACKGROUND: Progress feedback, also known as measurement-based care (MBC), is the routine collection of patient-reported measures to monitor treatment progress and inform clinical decision-making. Although a key ingredient to improving mental health care, sustained use of progress feedback is poor. Integration into everyday workflow is challenging, impacted by a complex interrelated set of factors across patient, clinician, organizational, and health system levels. This study describes the development of a qualitative coding scheme for progress feedback implementation that accounts for the dynamic nature of barriers and facilitators across multiple levels of use in mental health settings. Such a coding scheme may help promote a common language for researchers and implementers to better identify barriers that need to be addressed, as well as facilitators that could be supported in different settings and contexts. METHODS: Clinical staff, managers, and leaders from two Dutch, three Norwegian, and four mental health organizations in the USA participated in semi-structured interviews on how intra- and extra-organizational characteristics interact to influence the use of progress feedback in clinical practice, supervision, and program improvement. Interviews were conducted in the local language, then translated to English prior to qualitative coding. RESULTS: A team-based consensus coding approach was used to refine an a priori expert-informed and literature-based qualitative scheme to incorporate new understandings and constructs as they emerged. First, this hermeneutic approach resulted in a multi-level coding scheme with nine superordinate categories and 30 subcategories. Second-order axial coding established contextually sensitive categories for barriers and facilitators. CONCLUSIONS: The primary outcome is an empirically derived multi-level qualitative coding scheme that can be used in progress feedback implementation research and development. It can be applied across contexts and settings, with expectations for ongoing refinement. Suggestions for future research and application in practice settings are provided. Supplementary materials include the coding scheme and a detailed playbook.

Leveraging Implementation Science to Integrate Digital Mental Health Interventions as part of Routine Care in a Practice Research Network.

The supply / demand issue in behavioral health care is a well-established fact, and the mental health toll of the COVID-19 pandemic continues to add challenges to an already taxed system. Existing healthcare models are not set up to adequately address the increasing mental health related needs. As such, innovative models are needed to provide patients with access to appropriate, evidence-based behavioral health care within routine clinical care. This paper introduces Precision Behavioral Health (PBH) as an example of such a model. PBH is an innovative, digital first care delivery model that provides an ecosystem of evidence-based digital mental health interventions to patients as a frontline behavioral health treatment within routine care in a large multispecialty group medical center in the United States. This paper describes the implementation of PBH within a practice research network set-up as part of an integrated behavioral health department. We will present how our team leveraged the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance; "What is RE-AIM?," n.d.) implementation science framework, which emphasizes the design, dissemination, and implementation processes at the individual, staff, and organizational levels, to prioritize key implementation constructs to enhance the successful integration of PBH within routine care. We describe how each of these constructs were operationalized to aid data gathering for rapid evaluation and lessons learned. We discuss the benefits of these types of initiatives across multiple stakeholders including patients, providers, organizations, payers, and digital intervention vendors.

The Impact of the Covid-19-Related Transition to Telehealth on Visit Adherence in Mental Health Care: An Interrupted Time Series Study.

Covid-19 has led to an unprecedented shift to telemental health (TMH) in mental healthcare. This study examines the impact of this transition on visit adherence for mental health services in an integrated behavioral health department. Monthly visit data for 12,245 patients from January, 2019 to January, 2021 was extracted from the electronic medical record. Interrupted time series (ITS) analysis examined the impact of the Covid-19 transition to TMH on immediate level and trend changes in the percentage of cancelled visits and no shows in the 10 months following the transition. ITS also compared changes across the three largest services types: adult, pediatric, and substance use. Following the TMH-transition, completed visits increased by 10% amounting to an additional 3644 visits. In April, 2020, immediately following the TMH-transition, no shows increased by 1.4%, (95% CI 0.1, 2.7, p < 0.05) and cancellations fell by 13.5% (95% CI - 17.9, - 9.0, p < 0.001). Across the 10-month post-TMH period, 18.2% of visits were cancelled, compared to 28.3% across the 14-month pre-TMH period. The proportion of no-shows remained the same. The pattern was similar for pediatric and adult sub-clinics, but no significant changes in cancellations or no shows were observed in the substance use sub-clinic. TMH during the Covid-19 pandemic is associated with improved visit adherence over time and may be a promising model for improving the efficiency of mental health care delivery once it is safe to resume in person care.

Associations between psychiatric morbidity and COVID-19 vaccine hesitancy: An analysis of electronic health records and patient survey.

Psychiatric illness confers significant risk for severe COVID-19 morbidity and mortality; identifying psychiatric risk factors for vaccine hesitancy is critical to mitigating risk in this population. This study examined the prevalence of vaccine hesitancy among those with psychiatric illness and the associations between psychiatric morbidity and vaccine hesitancy. Data came from electronic health records and a patient survey obtained from 14,365 patients at a group medical practice between February and May 2021. Logistic regression was used to calculate odds for vaccine hesitancy adjusted for sociodemographic characteristics and physical comorbidity. Of 14,365 participants 1,761 (12.3%) participants reported vaccine hesitancy. Vaccine hesitancy was significantly more prevalent among participants with substance use (29.6%), attention deficit and hyperactivity (23.3%), posttraumatic stress (23.1%), bipolar (18.0%), generalized anxiety (16.5%), major depressive (16.1%), and other anxiety (15.5%) disorders, tobacco use (18.6%), and those previously infected with COVID-19 (19.8%) compared to participants without . After adjusting for sociodemographic characteristics and physical comorbidities, substance use disorders and tobacco use were significantly associated with increased odds for vaccine hesitancy and bipolar disorder was significantly inversely associated with vaccine hesitancy. Interventions to improve uptake in these populations may be warranted.

Initial quantitative development of the Norse Feedback system: a novel clinical feedback system for routine mental healthcare.

PURPOSE: As routine outcome monitoring has become prevalent in psychological practice, there is need for measurement tools covering diverse symptoms, treatment processes, patient strengths, and risks. Here we describe the development and initial tests of the psychometric properties of a multi-scale system for use in mental healthcare, Norse Feedback. METHODS: In Study 1, we present the item-generation process and structure of the Norse Feedback, a 17-scale digital-first measurement tool for psychopathology and treatment-relevant variables. In Study 2, we present analyses of this initial measure in a nonclinical sample of 794 healthy controls and a sample of 222 mental health patients. In Study 3, we present the analysis of a revised 20-scale system in two separate samples of patients. In each analysis, we investigate item and test information in particular, including analysis of differential item functioning on gender, age, site, and sample differences where applicable. RESULTS: Scales performed variably. Changes to items and scales are described. Several scales appeared to reliably discriminate individuals entering mental health treatment on severity, and others are less reliable. Marked improvements in scale internal consistency and measurement precision were observed between the first and second implemented versions. CONCLUSION: This system includes some scales with reasonable structural validity, though several areas for future development are identified. The system was developed to be iteratively re-evaluated, to strengthen the validity of its scales over time. There are currently a number of limitations on inferences from these scores, which future developments should address.

Continuous quality improvement in measure development: Lessons from building a novel clinical feedback system.

PURPOSE: While the use of clinical feedback systems has become commonplace in psychological treatment, many of the most common instruments used for this purpose have not changed in decades. This paper describes the first four cycles of a measure development method designed to embrace continuous quality improvement. METHODS: Using techniques and philosophies developed in business management and academia-lean continuous quality improvement, action research, and practice research networks-we iterated through multiple cycles of development with the goal of creating an optimal clinical feedback system. These cycles emphasize building capacity to receive and implement feedback from a variety of stakeholders, especially patients and providers of behavioral health services, while also being responsive to quantitative findings from measure development. RESULTS: Iterating measure development with stakeholder feedback over the course of 5 years has resulted in a novel measurement system with 19 subscales administered via branching logic, and a supporting practice research network to sustain development. CONCLUSION: In developing a new clinical feedback system, the less-frequently-discussed practical aspects of measure development require close attention. Specifically, being willing to embrace change, planning for iteration, and systematically seeking stakeholder feedback are identified as central methods for improving clinical feedback systems.

Termination in integrated primary care behavioral health.

Termination with patients in integrated primary care behavioral health (IPCBH) is driven by elements that are present in other psychotherapies but more strongly emphasized under the primary care model. All treatments are, by design, time limited, and require transparent communication and almost immediate preparation for termination. Because treatment occurs within a primary care relationship, however, termination conveys a different message than it does in other settings-the conclusion of an episode, but not of a treatment relationship. As with primary care for medical conditions, the expectation is that the patient may return to treatment in the future to address new problems or recurrence of the previously treated condition, possibly making the brevity of treatment episodes more acceptable. This article discusses the process of termination in IPCBH and indicates with a case example how conversations around termination evolve throughout the brief treatment process. Suggestions for addressing termination in IPCBH are adapted from the literature on termination in more traditional psychotherapies. There is currently no published research on termination in the IPCBH setting, and research is needed to clarify how termination discussions affect treatment outcomes and patient satisfaction. As IPCBH models become more common, the meaning of termination in psychotherapy may change, with decreasing emphasis on the dyadic relationship of an individual therapist and patient. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

This is what I need a clinical feedback system to do for me: A qualitative inquiry into therapists' and patients' perspectives.

Routine outcome monitoring and clinical feedback systems (ROM/CFSs) are promising methods of providing naturalistic research data and enhancing mental health care. However, implementation in routine care is challenging, and we need more knowledge about clinicians' and patients' needs from such systems. OBJECTIVE: We aimed to study perspectives of clinicians and patients to explore how ROM/CFS can be helpful and acceptable to them. METHOD: We interviewed 55 participants in focus groups and individual interviews and analyzed the data through rigorous team-based qualitative analyses. RESULTS: We report 3 overarching domains: (a) Shared needs, (b) Specific patient needs, and (c) Specific therapist needs. Shared needs, in which perspectives of different stakeholders converge, was the dominant domain in the material. Under each domain, we report 3 specific themes: (a1) Degree of trust in therapy, (a2) Allowing for openness, (a3) Monitoring joint objectives; (b1) Life functioning, (b2) Canary in the coal mine, (b3) Holistic report; and (c1) Emotional presence and style, (c2) Monitoring risk and symptoms, and (c3) Agency and ownership of process. CONCLUSIONS: In what should increase our confidence toward core aspects of ROM, we suggest that an integration of relational feedback concepts and stringent clinical dimension tracking into the ROM/CFS can be beneficial.

Enhancing feedback for clinical use: Creating and evaluating profiles of clients seeking counseling.

The current study explored the reliability and clinical utility of a method designed to identify latent classes of students seeking counseling, based on 8 symptom domains and their interactions. Participants were over 50,000 college students in counseling, assessed with the CCAPS-62 and -34 as part of routine clinical care. Latent profile analysis was used to group an exploratory and confirmatory sample of students by reported symptoms across the 8 CCAPS subscales. Profiles were evaluated for reliability and clinical utility, in particular for risk assessment and the prediction of treatment duration and success. Nine reliably stable latent profiles, or groups of profiles, emerged from analysis. Profiles differed significantly in reported symptoms, demographic makeup, psychosocial history, and diagnoses. Additionally, profiles appeared to capture meaningful differences between clients that had implications for relative risk of suicide, self-harm, and violence toward others as well as significant differences in the number of sessions in treatment and the effect size of treatment. Latent profiles of patients appear to capture meaningful, stable differences that could be implemented in an automated system of evaluation and feedback, and that might be useful to clinicians, administrators, and researchers.

The Ascendancy of Second-Generation Antipsychotics as Frontline Antimanic Agents.

INTRODUCTION: Knowledge of the factors affecting the adoption of new medications can enhance mental health care and guide quality improvement and policy development. Food and Drug Administration indications for treating bipolar disorder with several second-generation antipsychotics (SGAs) in the 2000s represent an opportunity to identify factors that impact the spread of a then-innovative treatment through a new population. METHODS: Analysis of Department of Veterans Affairs administrative data identified the population of 170,811 veterans diagnosed with bipolar disorder from 2003 to 2010. We analyzed time trends and predictors of antimanic choice (SGA vs other) among the 40,512 outpatients with bipolar disorder who initiated their first VA outpatient antimanic prescription, using multinomial logistic regression in month-by-month analyses. We conducted classwise analyses and investigated prespecified predictors among specific agents. RESULTS: In classwise analyses, SGAs supplanted lithium, valproate, and carbamazepine/oxcarbazepine as the most commonly initiated antimanics by 2007. Psychosis, but not other indices of severity, predicted SGA initiation. Demographic analyses did not identify substantial disparities in initiation of SGAs. Drug-specific analyses revealed some consideration of medical comorbidities in choosing among specific antimanic agents, although effect sizes were small. Most patients initiating an antimanic had received an antidepressant in the previous year. DISCUSSION: Second-generation antipsychotics quickly became the frontline antimanic treatment for bipolar disorder, although antidepressants most commonly predated antimanic prescriptions. Second-generation antipsychotics were used for a broad range of patients rather than being restricted to a severely ill subpopulation. The modest association of antimanic choice with relevant medical comorbidities suggests that continued attention to quality prescribing practices is warranted.

Neural and genetic markers of vulnerability to post-traumatic stress symptoms among survivors of the World Trade Center attacks.

Although recent research has begun to describe the neural and genetic processes underlying variability in responses to trauma, less is known about how these processes interact. We addressed this issue by using functional magnetic resonance imaging to examine the relationship between posttraumatic stress symptomatology (PTSS), a common genetic polymorphism of the serotonin transporter [5-HTT (5-hydroxy tryptamine)] gene and neural activity in response to viewing images associated with the 9/11 terrorist attack among a rare sample of high-exposure 9/11 survivors (n = 17). Participants varied in whether they carried a copy of the short allele in the promoter region of the 5-HTT gene. During scanning, participants viewed images of the 9/11 attack, non-9/11 negative and neutral images. Three key findings are reported. First, carriers of the short allele displayed higher levels of PTSS. Second, both PTSS and the presence of the short allele correlated negatively with activity in a network of cortical midline regions (e.g. the retrosplenal and more posterior cingulate cortices (PCCs)) implicated in episodic memories and self-reflection when viewing 9/11 vs non-9/11 negative control images. Finally, exploratory analyses indicated that PCC activity mediated the relationship between genotype and PTSS. These results highlight the role of PCC in distress following trauma.

Validating the rapid responder construct within a practice research network.

OBJECTIVE: The present study was a replication and extension of prior work (Stulz, Lutz, Leach, Lucock, & Barkham, ) that identified multiple groups of clients in treatment with high-symptom severity and markedly different recovery trajectories (rapid/early response vs. little or no response). METHOD: Using data collected through repeated administrations of the Depression subscale of the Treatment Outcome Package (n = 147), growth mixture modeling was employed to determine whether clients fell into discrete groups of response trajectories during 15 sessions of psychotherapy. Additionally, logistic regressions were conducted to assess possible predictors of group membership. RESULTS: Three separate groups of treatment responders were identified: 2 high-symptom groups-rapid responders and nonresponders-and 1 low-symptom group of nonresponders. Elevated social conflict and suicidality predicted increased likelihood of membership in the high-symptom nonresponder group. Increased feelings of interpersonal hostility and better sexual functioning predicted increased likelihood of membership in the rapid responder group. CONCLUSION: Replication of earlier results provides further evidence for the usefulness of modeling change during psychotherapy using multiple trajectories. Predictors of group membership indicate the influence of functional impairment on recovery, and support the importance of multidimensional measurement of client problems.

Clinical validity of the counseling center assessment of psychological symptoms-62 (CCAPS-62): further evaluation and clinical applications.

Self-report instruments of psychological symptoms are increasingly used in counseling centers but rely on rigorous evaluation of their clinical validity. Three studies reported here (total N = 26,886) investigated the validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62; Locke et al., 2011) as an assessment and screening instrument. In Study 1, initial evidence regarding the concurrent validity of the CCAPS-62 was replicated and extended in a naturalistic clinical sample of clients from 16 counseling centers. Using this sample, convergent validity of the subscales was examined in counseling center clients, the range of sensitivity of the subscales was investigated using item-response theory, and the presence of 2nd-order factors was preliminarily examined. In Study 2, 7 of the 8 CCAPS-62 subscales statistically significantly differentiated between students in counseling and those who were not, using data collected from a large national survey, although most differences were small and the groups' distributions overlapped considerably. Cut scores based on the differences between these clinical and nonclinical populations showed limited utility due to overall similarities between these broadly defined groups. In Study 3, therapist-rated diagnoses collected from 5 university counseling centers were used to further examine the validity of subscale scores. In addition, cut points for diagnostic screening using receiver operating characteristic curves were evaluated. Overall, these studies support the use of the CCAPS-62 as an initial measure of psychological symptoms in college counseling settings, provide additional information about its psychometric performance, develop cut scores, and illustrate the potential for collaboration between practitioners and researchers on a large scale.

Therapist effectiveness: implications for accountability and patient care.

Significant therapist variability has been demonstrated in both psychotherapy outcomes and process (e.g., the working alliance). In an attempt to provide prevalence estimates of "effective" and "harmful" therapists, the outcomes of 6960 patients seen by 696 therapists in the context of naturalistic treatment were analyzed across multiple symptom and functioning domains. Therapists were defined based on whether their average client reliably improved, worsened, or neither improved nor worsened. Results varied by domain with the widespread pervasiveness of unclassifiable/ineffective and harmful therapists ranging from 33 to 65%. Harmful therapists demonstrated large, negative treatment effect sizes (d= -0.91 to -1.49) while effective therapists demonstrated large, positive treatment effect sizes (d=1.00 to 1.52). Therapist domain-specific effectiveness correlated poorly across domains, suggesting that therapist competencies may be domain or disorder specific, rather than reflecting a core attribute or underlying therapeutic skill construct. Public policy and clinical implications of these findings are discussed, including the importance of integrating benchmarked outcome measurement into both routine care and training.

A randomized controlled trial of cognitive-behavioral therapy for generalized anxiety disorder with integrated techniques from emotion-focused and interpersonal therapies.

OBJECTIVE: Recent models suggest that generalized anxiety disorder (GAD) symptoms may be maintained by emotional processing avoidance and interpersonal problems. METHOD: This is the first randomized controlled trial to test directly whether cognitive-behavioral therapy (CBT) could be augmented with the addition of a module targeting interpersonal problems and emotional processing. Eighty-three primarily White participants (mean age = 37) with a principle diagnosis of GAD were recruited from the community. Participants were assigned randomly to CBT plus supportive listening (n = 40) or to CBT plus interpersonal and emotional processing therapy (n = 43) within a study using an additive design. Doctoral-level psychologists with full-time private practices treated participants in an outpatient clinic. Using blind assessors, participants were assessed at pretreatment, posttreatment, 6-month, 1-year, and 2-year follow-up with a composite of self-report and assessor-rated GAD symptom measures (the Penn State Worry Questionnaire; T. J. Meyer, M. L. Miller, R. L. Metzger, & T. D. Borkovec, 1990; Hamilton Anxiety Rating Scale; M. Hamilton, 1959; assessor severity rating; State-Trait Anxiety Inventory-Trait Version; C. D. Spielberger, R. L. Gorsuch, R. Lushene, P. R. Vagg, & G. A. Jacobs, 1983) as well as with indices of clinically significant change. RESULTS: Mixed models analysis of all randomized participants showed very large within-treatment effect sizes for both treatments (CI = [-.40, -.28], d = 1.86) with no significant differences at post (CI = [-.09, .07], d = .07) or 2-year follow-up (CI = [-.01, .01]), d = .12). There was also no statistical difference between compared treatments on clinically significant change based on chi-square analysis. CONCLUSIONS: Interpersonal and emotional processing techniques may not augment CBT for all GAD participants. Trial Registry name: Clinical Trials.gov, Identifier: NCT00951652.

Competency in integrative psychotherapy: perspectives on training and supervision.

Increasingly, many psychotherapists identify with an integrative approach to psychotherapy. In recent years, more attention has been directed toward the operationalization and evaluation of competence in professional psychology and health care service delivery. Aspects of integrative psychotherapy competency may differ from competency in other psychotherapy orientations, although convergence is more often the case. Despite the potential differences, there exist very few formal training programs or guidelines to systematically guide clinicians in developing a competent integrative practice. This paper attempts to distill the essential elements of competent integrative psychotherapy practice and focuses on how these might be developed in training and supervision. We address most of these complex issues from a specific integrative perspective: principle-based assimilative integration.

AN OPEN TRIAL OF INTEGRATIVE THERAPY FOR GENERALIZED ANXIETY DISORDER.

Cognitive- behavioral therapy (CBT), although effective, has the lowest average effect size for generalized anxiety disorder (GAD), when compared to effect sizes of CBT for other anxiety disorders. Additional basic and applied research suggests that although interpersonal processes and emotional avoidance may be maintaining GAD symptomatology, CBT has not sufficiently addressed interpersonal issues or emotion avoidance. This study aimed to test the feasibility and preliminary efficacy of an integrative psychotherapy, combining CBT with techniques to address interpersonal problems and emotional avoidance. Eighteen participants received 14 sessions of CBT plus interpersonal emotional processing therapy and three participants (for training and feasibility purposes) received 14 sessions of CBT plus supportive listening. Results showed that the integrative therapy significantly decreased GAD symptomatology, with maintenance of gains up to 1 year following treatment. In addition, comparisons with extant literature suggested that the effect size for this new GAD treatment was higher than the average effect size of CBT for GAD. Results also showed clinically significant change in GAD symptomatology and interpersonal problems with continued gains during the 1-year follow-up. Implications of these results are discussed.