Practice-Oriented Research: An Introduction to New Developments and Future Directions.

Aimed at understanding and improving psychological therapies as they are conducted in clinical routine, practice-oriented research (POR) is now a well-established approach to the scientific foundations of mental health care services. Resting on the accumulation of a wide range of practice-based evidence related to treatment outcome and process, as well as factors associated with the participants of psychotherapy and its context, POR is ripe for new developments - regarding what to investigate and how to investigate it. This paper is the introduction of a series devoted to recent advances and future directions of POR as their pertained to routine outcome monitoring, technologies and artificial intelligence, the integration of constructs and methods from program evaluation and implementation science, and the investigation of populations with limited financial resources across various regions of the world. The series also includes commentaries from two leaders of POR.

The Importance of Conducting Practice-oriented Research with Underserved Populations.

There has been a growing emphasis on dissemination of empirically supported treatments. Dissemination, however, should not be restricted to treatment. It can and, in the spirit of the scientific-practitioner model, should also involve research. Because it focuses on the investigation of clinical routine as it takes place in local settings and because it can involve the collaboration of several stakeholders, practice-oriented research (POR) can be viewed as an optimal research method to be disseminated. POR has the potential of addressing particularly relevant gaps of knowledge and action when implemented in regions of the world that have limited resources for or experiences with empirical research, and/or in clinical settings that are serving clinical populations who are not typically receiving optimal mental care services - specifically, individuals in rural and inner cities that have limited economic and social resources. The establishment and maintenance of POR in such regions and/or settings, however, come with specific obstacles and challenges. Integrating the experiences acquired from research conducted in various continents (Africa, Europe, Latin America, and North America), the goal of this paper is to describe some of these challenges, strategies that have been implemented to address them, as well as new possible directions to facilitate the creation and growth of POR. It also describes how these challenges and ways to deal with them can provide helpful lessons for already existing POR infrastructures.

Therapeutic techniques and session impact: A practice-research network study in private practice.

Objective: This study investigated the relationship between therapeutic techniques and session impact, by examining the replicability of findings observed in a university-based training clinic (Boswell et al., 2010) in another practice-oriented setting: private practice.Method: N = 8 therapists completed session-level assessments of their technique use for N = 38 clients. The same client sample completed session-level assessments of session outcome. Technique-outcome associations were examined with multilevel models.Results: As in Boswell et al., common factors were associated with positive session impact. For clients who received higher average common factor techniques (relative to their own therapist's caseload), session impact was the poorest in sessions with higher behavioral change techniques use (relative to the client's own average). Moreover, clients with the lowest average common factor techniques (relative to their therapist's caseload) reported better session impact in sessions that involved a higher degree of session-level behavioral change techniques (relative to their own average).Conclusion: In line with Boswell et al., therapists should be mindful of the consistency of their routine technique use between- and within-clients, and this can be aided through collection of their own practice-oriented data.

Therapeutic alliance and clinical outcomes in teletherapy and in-person psychotherapy: A noninferiority study during the COVID-19 pandemic.

OBJECTIVE: The current study aimed to inform the varied and limited research on clinical variables in the context of teletherapy. Questions remain about the comparative quality of therapeutic alliance and clinical outcome in the context of teletherapy compared to in-person treatment. METHODS: We utilized a cohort design and a noninferiority statistical approach to study a large, matched sample of clients who reported therapeutic alliance as well as psychological distress before every session as part of routine clinical practice at a university counseling center. A cohort of 479 clients undergoing teletherapy after the emergence of the COVID-19 pandemic was compared to a cohort of 479 clients receiving in-person treatment before the onset of the pandemic. Tests of noninferiority were conducted to investigate the absence of meaningful differences between the two modalities of service delivery. Client characteristics were also examined as moderators of the association between modality and alliance or outcome. RESULTS: Clients receiving teletherapy showed noninferior alliance and clinical outcome when compared to clients receiving in-person psychotherapy. A significant main effect on alliance was found with regard to race and ethnicity. A significant main effect on outcome was found with regard to international student status. Significant interactions on alliance were found between cohort and current financial stress. CONCLUSIONS: Study findings support the continued use of teletherapy by demonstrating commensurate clinical process and outcome. Yet, it will be important for providers to be aware of existing mental health disparities that continue to accompany psychotherapy - in person and via teletherapy. Results and findings are discussed in terms of research and clinical implications. Future directions for researching teletherapy as a viable treatment delivery method are also discussed.

Baseline overly accommodating interpersonal problems in relation to parsed alliance-outcome associations in cognitive behavioral therapy for generalized anxiety disorder.

Given its interpersonal underpinnings, relational factors may be salient in psychotherapy for generalized anxiety disorder (GAD). Supporting this point, research has indicated a positive total alliance-improvement correlation in cognitive behavioral therapy (CBT) for GAD. However, less research has disaggregated this correlation into within- and between-patient components, or examined theory-informed ways in which patient characteristics influence to these components. Thus, we first investigated parsed alliance-outcome associations in CBT for GAD. Second, consistent with theory that alliance may represent a direct interpersonal change correlate, we tested whether within-patient alliance improvements were especially therapeutic for patients with higher levels of an interpersonal problem prototypical of GAD-over accommodation. Also, consistent with theory that between-patient differences in overall alliance may be influenced by patients' preexisting relational characteristics, we tested whether more overly accommodating patients reported poorer average alliances that, in turn, related to worse outcomes.Sixty-nine patients received variants of CBT. Patients rated over accommodation at baseline, and alliance and outcome across treatment.As hypothesized, within-patient alliance improvements correlated with subsequent anxiety reduction, and this association was stronger for more overly accommodating patients. All between-patient associations were nonsignificant.Results help clarify the nuanced role of alliance in CBT for GAD.

Reconstructing dropout: Building from multiple definitions, therapist effects, and center effects.

Objective: The literature regarding dropout from psychotherapy has suffered from issues of diverse operationalization of the construct. Some have called for a more uniform definition to aid in generalization across research; this study aimed to assess the viability of such a definition by examining the rate of occurrence for three distinct definitions simultaneously. In addition, therapist and center level variances are explored to further understand the differences between definitions.Method: We compared the prevalence rates and overlap of three distinct operationalizations of dropout (based on last session attendance, therapist judgment, and symptom change) using data gathered from a national practice research network (N = 2977). Higher-order therapist and center-level effects were assessed for each definition.Results: There was very little overlap among definitions, with less than one percent of clients simultaneously meeting criteria for all three definitions. Additionally, therapist and center effects were found for each definition, especially notable for therapist-rated and last-session attendance definitions of dropout.Conclusion: Rather than a singular definition of dropout, these results instead suggest that multiple, specific, and unique definitions more accurately depict clinical reality, and future research might benefit from uncovering predictors of different "classes" of dropouts and examining the different practices of therapists and centers.

The impact of integrating emotion focused components into psychological therapy: A randomized controlled trial.

OBJECTIVES: This paper presents a randomized controlled trial on assimilative integration, which is aimed at integrating elements from other orientations within one approach to enrich its conceptual and practical repertoire. Elements from Emotion-Focused Therapy (EFT) were integrated into a form of cognitive behavior therapy: Psychological Therapy (PT). In one treatment condition, EFT was added to PT (+EFT) with the intent to enhance therapists' working with emotions. In the other condition, concepts and interventions based on the socialpsychological self-regulation approach were added to PT (+SR). Our assumption was that the +EFT would lead to greater and deeper change, particularly in the follow-up assessments. METHOD: Patients (n = 104) with anxiety, depression, or adjustment disorders were randomized to the two conditions and treated by 38 therapists who self-selected between the conditions. Primary outcome was symptom severity at 12-month follow-up; secondary outcomes included several measures such as interpersonal problems and quality of life. Variables were assessed at baseline, after 8 and 16 sessions, at posttreatment, and at 6- and 12-month follow-up. RESULTS: Contrary to our hypothesis, no significant between-group effects were found. CONCLUSION: The findings first suggest the difficulty of topping an already very effective approach to psychotherapy. Alternative interpretations were that the EFT training, while corresponding to regular practice in AI, was not sufficient to make a difference in outcome, or that while profiting from the enhancement of abilities for working with emotions, this was outbalanced by negative effects of difficulties related to the implementation of the new elements.

Client-Therapist Convergence on Sleep Difficulty and its Impact on Treatment Outcomes.

While agreement between clients and their clinicians on therapy goals has frequently been investigated as a process-level variable (i.e., working alliance), dyadic convergence on presenting concerns is also important for initial case formulation. Transdiagnostic presenting problems, like sleep difficulty, pose a particular challenge for client-therapist convergence. The current study describes sleep difficulty in a treatment-seeking college population and investigates the impact of client and therapist baseline sleep problem reports on therapy outcomes.Data were collected through a large practice research network, with the sample comprising 47,023 clients from 99 university counseling centers across the United States.A larger proportion of clients (49.3%) had self-reported high baseline sleep difficulty than those with a clinician-identified sleep concern (16.0%). Clients with baseline sleep difficulty were more likely to end treatment with greater self-reported sleep difficulty and psychological symptom distress, although they may experience larger gross symptom change than clients without baseline sleep difficulty. Clinician-identified sleep concerns were significantly associated with client outcomes, particularly when clients did not report baseline sleep difficulty themselves.Findings from this study suggest that it may be efficacious and efficient with limited time for treatment to address sleep concerns in a college setting.Clinicians' attendance to their clients' transdiagnostic presenting concerns, like sleep difficulty, may increase clients' own awareness of problematic patterns of behavior. When time for therapy is short, as is often the case in college counseling, it may be efficient to prioritize these concerns with the potential to impact a broad range of symptoms.

Predicting future courses of psychotherapy within a grouped LASSO framework.

Objective: There is a paucity of studies examining the experience of clients who undergo multiple courses of psychotherapy. Conducted within a large practice research network, this study demonstrated that returning therapy clients comprise a considerable portion of the clinical population in university counseling settings, and identified variables associated with return to therapy. Method: Utilizing data spanning 2013 to 2017, statistical variable selection for predicting return to therapy was conducted via grouped least absolute shrinkage and selection operator (grouped LASSO) applied to logistic regression. The grouped LASSO approach is described in detail to facilitate learning and replication. The paper also addresses methodological considerations related to this approach, such as sample size, generalizability, as well as general strengths and limitations. Results: Attendance rate, duration of initial treatment course, social anxiety, perceived social support, academic distress, and alcohol use were identified as predictive of return to therapy. Conclusions: Findings could help inform more cost-effective policies for session limits (e.g., extending session limits for clients with social anxiety), referral decisions (e.g., for clients with alcohol use problems), and appointment reminders (based on the association between poor attendance rate and return to therapy). Taking into account the many reasons that can explain why clients do or do not return to therapy, these findings also could inform clinicians' early case conceptualizations and treatment interventions.

Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences.

ABSTRACTPurpose: Routine outcome monitoring (ROM) and clinical feedback systems (CFS) are becoming prevalent in mental health services, but there are several challenges to successful implementation. ROM/CFS seem to be helpful for some patients, but not for others. To investigate this, we explored patients' experiences with ROM/CFS as an interpersonal and psychotherapeutic process, in naturalistic settings. Method: We used video-assisted interpersonal process recall interviews to investigate the experiences of 12 patients using ROM/CFS in a Norwegian mental health outpatient clinic. Data were analyzed through systematic text condensation. Results: Our analysis resulted in three pairs of experiences with ROM/CFS: (1) Explicit vs. implicit use of information, (2) Directing focus towards or away from therapeutic topics, and (3) Giving and receiving feedback. These experiences could be helpful or hindering, depending on participants' needs and preferences. All participants needed to know that the CFS was used in a meaningful way. If not, it could be detrimental to the therapeutic process. Conclusion: In order to be helpful for patients, ROM/CFS should be used in a way that is flexible, meaningful to patients, and sensitive to individual needs and preferences. Future research should further explore this how-to aspect of ROM/CFS with different CFS and populations.

Multilevel versus single-level factor analysis: Differentiating within-person and between-person variability using the CCAPS-34.

Objective: Although most self-report measures of distress are intended to assess time-varying constructs, they are usually developed using between-person data. They are therefore vulnerable to misspecification due to measurement nonequivalence at the between-person and within-person levels. In recent years, multiple studies have found that self-report distress may not be the same when considered over time versus between people: what changes over time may not be the same as what makes individuals different from one another. Method: In this study, we present a multilevel factor analysis (MFA) of a widely used multidimensional self-report measure of psychological symptoms, the Counseling Center Assessment of Psychological Symptoms-34 (CCAPS-34), in two samples (Ns: 1,223 and 757) of individuals with 10 or more observations each. We compare the results to traditional factor analysis. Results: Single-level factor analyses converged with the established seven-factor structure, regardless of sample or data subset. The MFA largely, but not entirely, recovered the existing factor structure of the CCAPS-34 at the within-person level in both samples, but not at the between-person level. The between-person factor structure was simpler than the within-person factor structure, particularly in the nonclinical sample in which only two factors were sufficient. Conclusions: The factors of this instrument that change over time appear to be narrow, while differences between people are broader. This argues against using general distress measures when assessing treatment outcomes. MFA is a promising method for measure development, even in data with relatively few observations per person. This method may clarify how self-report psychopathology manifests over time. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Use of common and unique techniques in the early treatment phase for cognitive-behavioral, interpersonal/emotional, and supportive listening interventions for generalized anxiety disorder.

Psychotherapy research often compares specific treatments to control conditions to establish efficacy of the specified treatment. Research has typically evaluated common factor elements (e.g., credibility, expectancy) in treatments only after the first or second session, largely as a manipulation check and under the assumption that such factors are static. This study observed therapist common factor and model-specific interventions in three treatment approaches from a randomized control trial for generalized anxiety disorder across the entire early phase of treatment (i.e., first five sessions). The parent randomized control trial compared two treatment conditions, using an additive design where patients were randomized to receive either interpersonal/emotional processing interventions or supportive listening after receiving a session of cognitive-behavioral therapy. The first five video-recorded sessions of N = 40 randomly sampled participants were observationally coded with a multidimensional intervention measure, with subscales reflecting diverse theoretical orientations and common factors. Multilevel modeling was used to examine intervention use and investigate differences between treatment conditions and segments. Among the results, common factor interventions were rated as significantly more typical in cognitive-behavioral therapy compared with supportive listening. The pattern of intervention use of other subscales was generally consistent with the orientation of the respective protocols. In the early phase of treatment, supportive listening conditions do not appear to function as common factor controls in the manner that many might assume. Common factors are potentially enhanced in bona fide treatments that include a more detailed, specific rationale and clear and cohesive techniques and goals. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Keeping psychologists in the driver's seat: Four perspectives on quality improvement and clinical data registries.

Performance accountability-also frequently referred to as quality improvement in the fields of medicine and public policy-is under growing scrutiny in mental and behavioral health care. As one high-profile example, psychologists and other mental health providers will be deemed "eligible clinicians" under the 2015 Medicare Access and Children's Health Insurance Program Reauthorization Act starting in 2019. This will incentivize psychologists to track their Medicare patients' clinical outcomes and report them in data registries, and those who do not will suffer a reimbursement penalty. However, many psychologists are not aware of these developments or prepared for this change. The goal of this article is to provide information to psychologists about quality improvement and clinical data registries from four distinct, though overlapping, vantage points: professional governance, quantitative research, qualitative research, and clinical practice. We review recent regulations and research in this area, with an emphasis on exploring both the potential benefits and challenges of quality improvement. We conclude by providing recommendations for the field of psychology. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Suicide among college students in psychotherapy: Individual predictors and latent classes.

This study sought to identify predictors of suicidal behavior among college students who are psychotherapy clients, as well as to determine underlying classes of clients with suicidal ideation. Data were gathered from 101,570 clients, 391 of whom engaged in suicide behavior during treatment. Regression analyses revealed that suicide behavior was positively associated with 3 pretreatment variables: depression, prior suicide behavior, and prior nonsuicidal self-injury. Four latent classes of clients with suicidal ideation were identified that were named "prior ideation," "extensive risk," "prior treatment," and "circumscribed depression." The number of clients in each class varied widely, as did the relative risk of suicide behavior. Implications for treatment, suicide assessment, and suicide prevention are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Patients' experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature.

Routine outcome monitoring (ROM) and clinical feedback (CF) systems have become important tools for psychological therapies, but there are challenges for their successful implementation. OBJECTIVE: To overcome these challenges, a greater understanding is needed about how patients experience the use of ROM/CF. METHOD: We conducted a systematic literature search of qualitative studies on patient experiences with the use of ROM/CF in mental health services. RESULTS: The findings from 16 studies were synthesized, resulting in four meta-themes: (1) Suspicion towards service providers, (2) Flexibility and support to capture complexity, (3) Empowering patients, and (4) Developing collaborative practice. CONCLUSIONS: We discuss the implications of these meta-themes for further development and implementation of ROM/CF into clinical practice, acknowledging the limitations of our review and suggesting avenues for further research. Clinical or methodological significance of this article: This article provides useful and actionable knowledge about the patient perspective on ROM/CF, an important discussion on the current state of research in this area, and useful and concrete suggestions for further avenues of research.

Effectiveness of routine psychotherapy: Method matters.

OBJECTIVE: Though many studies have shown that psychotherapy can be effective, psychotherapy available in routine practice may not be adequate. Several methods have been proposed to evaluate routine psychological treatments. The aim of this paper is to demonstrate the combined utility of complementary methods, change-based benchmarking, and end-state normative comparisons, across a range of self-reported psychological symptoms. METHOD: Benchmarks derived from randomized controlled trials (RCTs) and normative comparisons were used to evaluate the effectiveness of psychotherapy in a large (N = 9895) sample of clients in university counseling centers (UCCs). RESULTS: Overall, routine psychotherapy was associated with significant improvement across all symptoms examined. For clients whose initial severity was similar to RCT participants, the observed pre-post effect sizes were equivalent to those in RCTs. However, treatment tended to lead to normative end-state functioning only for those clients who were moderately, but not severely, distressed at the start of psychotherapy. CONCLUSIONS: This suggests that although psychotherapy is associated with an effective magnitude of symptom improvement in routine practice, additional services for highly distressed individuals may be necessary. The methods described here comprise a comprehensive analysis of the quality of routine care, and we recommend using both methods in concert. Clinical or methodological significance of this article: This study examines the effectiveness of routine psychotherapy provided in a large network of counseling centers. By comparing multiple established methods to define outcomes in this sample we provide a detailed understanding of typical outcomes. The findings show that, across several different problem areas, routine psychotherapy provided substantial benefit, particularly to clients in the most distress. However, there is room to improve, especially by increasing the number of clients who return to normal functioning by the end of treatment. Using distinct methods provides complementary answers to the question: How effective is routine psychotherapy?

Assessing and investigating clinicians' research interests: Lessons on expanding practices and data collection in a large practice research network.

Conducted in naturalistic settings, practice-oriented research (POR) is aimed at building stronger connections between the science and practice of psychotherapy. Promoting the principles of POR, this article has 2 aims: (a) presenting the results of a survey assessing the interests of members of a large practice research network in topics that could guide future research conducted as part of clinical routine, and (b) describing difficulties in implementing a study in line with such interests. Despite the significant interest in and perceived clinical significance of two relationship constructs (alliance and countertransference), there were unique obstacles faced in their empirical investigation within an already operationally functional practice research network. Challenges in this process included resource-related difficulties (such as changes in staff and the time required to set up the study and administer the measures), logistics-related issues, and effectively incorporating the assessment procedure into an existing clinical system. The article also describes strategies to address these obstacles, with differing degrees of success, including the role of a "local champion" at each site, the importance of a personal/professional relationship between the researcher and participating centers, as well as the pragmatic assistance to sites during the preparation, coordination, and implementation process (e.g., providing templates and feedback on institutional review board applications, and technological assistance on how to incorporate the measures into existing center software). The article concludes with general recommendations and future directions for POR. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Negative effects in psychotherapy: commentary and recommendations for future research and clinical practice.

BACKGROUND: Psychotherapy can alleviate mental distress and improve quality of life, but little is known about its potential negative effects and how to determine their frequency. AIMS: To present a commentary on the current understanding and future research directions of negative effects in psychotherapy. METHOD: An anonymous survey was distributed to a select group of researchers, using an analytical framework known as strengths, weaknesses, opportunities and threats. RESULTS: The researchers perceive an increased awareness of negative effects in psychotherapy in recent years, but also discuss some of the unresolved issues in relation to their definition, assessment and reporting. Qualitative methods and naturalistic designs are regarded as important to pursue, although a number of obstacles to using such methods are identified. CONCLUSION: Negative effects of psychotherapy are multifaceted, warranting careful considerations in order for them to be monitored and reported in research settings and routine care. DECLARATION OF INTEREST: None.