Practice-Oriented Research: An Introduction to New Developments and Future Directions.

Aimed at understanding and improving psychological therapies as they are conducted in clinical routine, practice-oriented research (POR) is now a well-established approach to the scientific foundations of mental health care services. Resting on the accumulation of a wide range of practice-based evidence related to treatment outcome and process, as well as factors associated with the participants of psychotherapy and its context, POR is ripe for new developments - regarding what to investigate and how to investigate it. This paper is the introduction of a series devoted to recent advances and future directions of POR as their pertained to routine outcome monitoring, technologies and artificial intelligence, the integration of constructs and methods from program evaluation and implementation science, and the investigation of populations with limited financial resources across various regions of the world. The series also includes commentaries from two leaders of POR.

Different factors identified by stakeholder group for barriers and facilitators to measurement-based care implementation in behavioral health clinics.

INTRODUCTION: Despite the benefits of measurement-based care (MBC) in the behavioral health setting, there have been difficulties in implementation and low saturation. Although barriers and facilitators to MBC implementation have been identified, research has generally only included the perspective of one stakeholder group. The current study aims to examine the similarities and differences-by stakeholder group-in the identified barriers to and facilitators of implementing MBC in the behavioral health setting. METHOD: A purposeful sampling approach was used to recruit and conduct interviews and focus groups with stakeholders (clinicians, clinic leaders, and administrative staff) from four behavioral health clinics at an academic medical center that is part of a larger healthcare system. The data coding process included a directed content analytic approach whereby the coding team used an iterative process to analyze deidentified transcripts starting with a codebook based on the Consolidated Framework for Implementation Research (CFIR) constructs. RESULTS: A total of 31 clinicians, 11 clinic leaders, and 8 administrative staff participated in the interviews and focus groups. There was convergence among all stakeholder regarding which CFIR constructs were identified as barriers and facilitators, but there were differences in the specific thematic factors identified by stakeholders as barriers and facilitators within each of these implementation constructs. The barriers and facilitators that stakeholders identified within each CFIR construct were often connected to their specific role in implementing MBC. CONCLUSION: Collecting information on barriers and facilitators to MBC implementation from the multiple stakeholders involved in the process may enhance successful implementation of MBC given the variation between groups in identified thematic factors. Administrative staff perspectives, which have not been reported in the literature, may be of particular importance in planning for successful MBC implementation.

The Importance of Conducting Practice-oriented Research with Underserved Populations.

There has been a growing emphasis on dissemination of empirically supported treatments. Dissemination, however, should not be restricted to treatment. It can and, in the spirit of the scientific-practitioner model, should also involve research. Because it focuses on the investigation of clinical routine as it takes place in local settings and because it can involve the collaboration of several stakeholders, practice-oriented research (POR) can be viewed as an optimal research method to be disseminated. POR has the potential of addressing particularly relevant gaps of knowledge and action when implemented in regions of the world that have limited resources for or experiences with empirical research, and/or in clinical settings that are serving clinical populations who are not typically receiving optimal mental care services - specifically, individuals in rural and inner cities that have limited economic and social resources. The establishment and maintenance of POR in such regions and/or settings, however, come with specific obstacles and challenges. Integrating the experiences acquired from research conducted in various continents (Africa, Europe, Latin America, and North America), the goal of this paper is to describe some of these challenges, strategies that have been implemented to address them, as well as new possible directions to facilitate the creation and growth of POR. It also describes how these challenges and ways to deal with them can provide helpful lessons for already existing POR infrastructures.

Therapeutic techniques and session impact: A practice-research network study in private practice.

Objective: This study investigated the relationship between therapeutic techniques and session impact, by examining the replicability of findings observed in a university-based training clinic (Boswell et al., 2010) in another practice-oriented setting: private practice.Method: N = 8 therapists completed session-level assessments of their technique use for N = 38 clients. The same client sample completed session-level assessments of session outcome. Technique-outcome associations were examined with multilevel models.Results: As in Boswell et al., common factors were associated with positive session impact. For clients who received higher average common factor techniques (relative to their own therapist's caseload), session impact was the poorest in sessions with higher behavioral change techniques use (relative to the client's own average). Moreover, clients with the lowest average common factor techniques (relative to their therapist's caseload) reported better session impact in sessions that involved a higher degree of session-level behavioral change techniques (relative to their own average).Conclusion: In line with Boswell et al., therapists should be mindful of the consistency of their routine technique use between- and within-clients, and this can be aided through collection of their own practice-oriented data.

Leveraging Implementation Science to Integrate Digital Mental Health Interventions as part of Routine Care in a Practice Research Network.

The supply / demand issue in behavioral health care is a well-established fact, and the mental health toll of the COVID-19 pandemic continues to add challenges to an already taxed system. Existing healthcare models are not set up to adequately address the increasing mental health related needs. As such, innovative models are needed to provide patients with access to appropriate, evidence-based behavioral health care within routine clinical care. This paper introduces Precision Behavioral Health (PBH) as an example of such a model. PBH is an innovative, digital first care delivery model that provides an ecosystem of evidence-based digital mental health interventions to patients as a frontline behavioral health treatment within routine care in a large multispecialty group medical center in the United States. This paper describes the implementation of PBH within a practice research network set-up as part of an integrated behavioral health department. We will present how our team leveraged the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance; "What is RE-AIM?," n.d.) implementation science framework, which emphasizes the design, dissemination, and implementation processes at the individual, staff, and organizational levels, to prioritize key implementation constructs to enhance the successful integration of PBH within routine care. We describe how each of these constructs were operationalized to aid data gathering for rapid evaluation and lessons learned. We discuss the benefits of these types of initiatives across multiple stakeholders including patients, providers, organizations, payers, and digital intervention vendors.

Implementation Science and Practice-Oriented Research: Convergence and Complementarity.

Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

Improved emotion regulation following a trauma-informed CBT-based intervention associates with reduced risk for recidivism in justice-involved emerging adults.

Objective: Male youth who have been involved in the juvenile legal system have disproportionate rates of trauma and violence exposure. Many justice-involved youth have untreated mental illness, with an estimated 66% of young men who are incarcerated meeting criteria for at least one mental health disorder, including posttraumatic stress disorder (PTSD), depression, and substance abuse. While Cognitive Behavioral Therapy (CBT) approaches are considered among effective evidence-based treatments for addressing and treating behavioral and emotional difficulties, male youth with a history of incarceration and youth who are at risk for (re)incarceration, violence, emotion dysregulation, and trauma face significant barriers in accessing these services. Methods: Roca, Inc. (Roca), an internationally recognized organization moving the needle on urban violence by working relentlessly with young people at the center of violence in Massachusetts and Maryland, employs a trauma-informed CBT-based skills curriculum and approach in their intervention model, to improve youths' educational, employment, parenting, and life skills opportunities, while decreasing risk for recidivism, addressing trauma and increasing skills for emotion regulation. The aim of this analysis was to assess the effectiveness of Roca's trauma-informed CBT skills curriculum on youths' emotional and behavioral outcomes. We analyzed data from over 300 participating emerging adult men from four sites in Massachusetts and one site in Baltimore, Maryland who had at least three series of data collection across multiple skills-based sessions. Results: We found improvements in outcomes in overall mean scores related to decreased distress about employment and education, as are expected with standard intervention approaches for justice-involved youth. Participants who show improvement in emotion regulation across engagement (approximately half the cohort), were found to have significant improvements in distress related to relationship and family functioning and self-care, and decreased substance use, along with other outcomes compared to those participants with less improvement in emotion regulation. Furthermore, improvement in different aspects of emotion regulation were associated with improved relationships, life distress, substance use, and improved prosocial thinking. Conclusions: Together, these data suggest that adding mental health support and skills training, such as with trauma-informed CBT models, to programs for justice-involved youth may lead to significant improvements in functioning, quality of life, and mental health outcomes.

Ensuring the fit of an evidence-based curriculum for high-risk Latina young mothers using implementation science.

Conduct a comprehensive needs assessment to evaluate the fit of a Cognitive Behavioral Theory (CBT) curriculum implemented within a community organization and inform possible adaptations to fit the mental health difficulties of high-risk Latina young mothers. The PRECEDE-PROCEED implementation framework guided the assessment and results. Focus groups were conducted with high-risk Latina young mothers and staff members to assess the priority mental health problems, environmental stressors and factors contributing and maintaining these difficulties, and existing resources that could be leveraged to address them. Latina young mothers experience a variety of mental health needs and immigration and interpersonal-related stressors. The organization's existing CBT curriculum was found to be feasible and a good fit for the target population. Proposed minor adaptations included a focus on parenting. Results support the robust effects of CBT interventions, including when delivered by paraprofessionals to a high-risk population in a low-resource community setting.

Effectiveness of a Modular Cognitive-Behavioral Skills Curriculum in High-Risk Justice-Involved Youth.

The aim of this study was to evaluate the effectiveness of a flexible modular cognitive-behavioral theory (CBT) skills curriculum delivered by paraprofessionals in a community organization targeting high-risk justice-involved youth. Programmatic data were collected from 980 high-risk young men (Mage, 21.12; SD, 2.30), and Cox proportional hazards regression was used. The results showed that compared with young men with no CBT encounters, those with one or more CBT encounters had a 66% (hazard ratio [HR], 0.34; 95% confidence interval [CI], 0.28-0.42; p < 0.001) lower risk of unenrolling from programming, 65% (HR, 1.65; 95% CI, 1.29-2.12; p < 0.001) higher risk of obtaining a job, and no difference in risk of engaging in new criminal activity while enrolled in programming (HR, 0.99; 95% CI, 0.78-1.25; p = 0.918), despite higher risk factors. Training paraprofessionals to deliver CBT skills to high-risk populations is effective and has scalability potential.

The value of implementation frameworks: Using the active implementation frameworks to guide system-wide implementation of Collaborative Problem Solving.

In the last decade, many implementation frameworks have emerged that consolidate the research on implementation science, guiding purveyors and service agencies in improving implementation of evidence-based practices (EBPs). In this paper, we describe how the purveyor of one EBP utilized the active implementation frameworks (AIFs) to define and standardize strategies for site-wide implementation. We illustrate what implementation looked like before and after using AIFs to understand implementation, as well as some ways in which using the AIFs helped the purveyor identify, and then overcome, barriers to implementation. This paper provides a model for others who seek to use AIFs to guide their implementation practices, or more broadly, an illustration of how to use any implementation framework to ensure best practices in implementation.

Barriers and Facilitators to Implementing a Short-Term Transdiagnostic Mental Health Treatment for Homeless Persons.

Despite the significant mental health needs and comorbidity in homeless individuals, there is a "science-practice gap" between the available evidence-based treatments (EBTs) and their lack of use in community health centers servicing homeless populations. To address this gap, it is imperative to evaluate and attend to the contextual factors that influence the implementation process of EBTs before their integration into routine care. The study aims to evaluate the barriers and facilitators to implementing a transdiagnostic EBT in a community health center serving homeless individuals. The results of the thematic analyses (7 focus groups, 67 participants) yielded 8 themes for barriers and 10 themes for facilitators to implementation. The findings of the current study highlight common tensions faced by community programs and clinicians when working toward integrating EBTs across different types of populations, and those unique to homeless persons. Results can inform subsequent strategies used in implementing EBTs.

Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change.

OBJECTIVE: The purpose of this study is to examine associations between therapist adherence, competence, and modifications of an evidence-based protocol (EBP) delivered in routine clinical care and client outcomes. METHOD: Data were derived from a NIMH-funded implementation-effectiveness hybrid study of Cognitive Processing Therapy (CPT) for PTSD in a diverse community health center. Providers (n = 19) treated clients (n = 58) as part of their routine clinical care. Clients completed the PCL-S and PHQ-9 at baseline, after each CPT session, and posttreatment. CPT sessions were rated for treatment fidelity and therapist modifications. RESULTS: Overall, therapist adherence was high, although it decreased across sessions suggesting potential drift. Therapist competence ratings varied widely. Therapists made on average 1.6 fidelity-consistent and 0.4 fidelity-inconsistent modifications per session. Results show that higher numbers of fidelity-consistent modifications were associated with larger reductions in posttraumatic stress and depressive symptoms. High adherence ratings were associated with greater reductions in depressive symptoms, whereas higher competence ratings were associated with greater reduction in posttraumatic stress symptoms. CONCLUSIONS: The results highlight the importance of differentially assessing therapist adherence, competence, and modifications to EBP in usual care settings. The findings also suggest that effective EBP delivery in routine care may require minor adaptations to meet client needs, consistent with previous studies. Greater attention to fidelity and adaptation can enhance training so providers can tailor while retaining core components of the intervention. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Effectiveness of routine psychotherapy: Method matters.

OBJECTIVE: Though many studies have shown that psychotherapy can be effective, psychotherapy available in routine practice may not be adequate. Several methods have been proposed to evaluate routine psychological treatments. The aim of this paper is to demonstrate the combined utility of complementary methods, change-based benchmarking, and end-state normative comparisons, across a range of self-reported psychological symptoms. METHOD: Benchmarks derived from randomized controlled trials (RCTs) and normative comparisons were used to evaluate the effectiveness of psychotherapy in a large (N = 9895) sample of clients in university counseling centers (UCCs). RESULTS: Overall, routine psychotherapy was associated with significant improvement across all symptoms examined. For clients whose initial severity was similar to RCT participants, the observed pre-post effect sizes were equivalent to those in RCTs. However, treatment tended to lead to normative end-state functioning only for those clients who were moderately, but not severely, distressed at the start of psychotherapy. CONCLUSIONS: This suggests that although psychotherapy is associated with an effective magnitude of symptom improvement in routine practice, additional services for highly distressed individuals may be necessary. The methods described here comprise a comprehensive analysis of the quality of routine care, and we recommend using both methods in concert. Clinical or methodological significance of this article: This study examines the effectiveness of routine psychotherapy provided in a large network of counseling centers. By comparing multiple established methods to define outcomes in this sample we provide a detailed understanding of typical outcomes. The findings show that, across several different problem areas, routine psychotherapy provided substantial benefit, particularly to clients in the most distress. However, there is room to improve, especially by increasing the number of clients who return to normal functioning by the end of treatment. Using distinct methods provides complementary answers to the question: How effective is routine psychotherapy?

Assessing and investigating clinicians' research interests: Lessons on expanding practices and data collection in a large practice research network.

Conducted in naturalistic settings, practice-oriented research (POR) is aimed at building stronger connections between the science and practice of psychotherapy. Promoting the principles of POR, this article has 2 aims: (a) presenting the results of a survey assessing the interests of members of a large practice research network in topics that could guide future research conducted as part of clinical routine, and (b) describing difficulties in implementing a study in line with such interests. Despite the significant interest in and perceived clinical significance of two relationship constructs (alliance and countertransference), there were unique obstacles faced in their empirical investigation within an already operationally functional practice research network. Challenges in this process included resource-related difficulties (such as changes in staff and the time required to set up the study and administer the measures), logistics-related issues, and effectively incorporating the assessment procedure into an existing clinical system. The article also describes strategies to address these obstacles, with differing degrees of success, including the role of a "local champion" at each site, the importance of a personal/professional relationship between the researcher and participating centers, as well as the pragmatic assistance to sites during the preparation, coordination, and implementation process (e.g., providing templates and feedback on institutional review board applications, and technological assistance on how to incorporate the measures into existing center software). The article concludes with general recommendations and future directions for POR. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Practical solutions for sustaining long-term academic-community partnerships.

The science-practice gap in the treatment of mental health is most pronounced in community settings, where clients with the highest needs often receive their care. Implementation science and community-based participatory research strategies aim to effectively address this gap by establishing partnerships that focus on scientifically rigorous, as well as clinically and socially relevant, research. Despite significant benefits, the community-based participatory research implementation framework has a unique set of challenges. The current article describes evidence-supported implementation strategies that were deployed to address various barriers to the implementation and long-term sustainability of an innovative cognitive-behavioral theory (CBT) life skills program identified during a feasibility trial. Through the committed work of an established partnership between a community-based nonprofit organization and researchers, barriers and the strategies for mitigating these obstacles were jointly identified. Specific challenges included fidelity (variability in staff's CBT competency and delivery), sustainability, and the cost of guideline implementation (data collection, time, and resources) of the CBT curriculum. We also provide details on the partnership's solutions to these major obstacles, including the development of an intensive 3-month training and coaching phase. The results of this rigorous training suggest improvement in staff's overall CBT competency and fidelity, increased participant engagement in the CBT curriculum, and enhanced data-collection procedures; yet, sustainability difficulties remained. General recommendations for long-term community research partnerships include early organizational buy-in; comprehensive needs assessments, including the organization's research building capacity; and sustained training and coaching models. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Client-level predictors of treatment engagement, outcome and dropout: moving beyond demographics.

BACKGROUND: Despite the availability of evidence-based treatments for posttraumatic stress disorder (PTSD), significant heterogeneity in the effectiveness of PTSD treatment persists, especially in community settings. Client demographics used to understand this variability in treatment outcome and dropout have yielded mixed results. Despite increasing evidence for the importance of attending to treatment engagement in community settings, few studies have explored client-level predictors. AIM: The purpose of this study is to explore client-level predictors of treatment outcome and dropout beyond client demographics, and to identify client-level predictors of treatment engagement in community settings. METHOD: Secondary data analysis was conducted with data collected as part of an implementation-effectiveness hybrid study of cognitive processing therapy (CPT) for PTSD in a diverse community health centre. Providers (n=19) treated (n=52) clients as part of their routine clinical care. Non-demographic client-level predictors included barriers to treatment, quality of life, session-level language and employment history assessed at baseline. Treatment engagement included number of weeks in the study, number of sessions with repeated CPT content, number of unique CPT sessions attended, frequency of session attendance and consistency of session attendance. RESULTS: Results showed language as a significant predictor of treatment engagement. There were significant differences between Spanish and English-speaking clients, with the former having a tendency to repeat more session content than the latter (ß=1.4 sessions, p=0.003), and also less likely to attend treatment frequently (r=0.62, p=0.009) and consistently (r =0.57, p=0.027) if high logistical and financial barriers were endorsed. Irrespective of language, clients who reported high quality of life at baseline were less likely to repeat CPT session content (ß=-0.3, p=0.04), and those with increased baseline barriers to treatment had deceleration in PTSD symptom improvement over time (ß=-0.62, p<0.05). In terms of treatment engagement moderators impacting treatment outcome, clients who repeated more session content were more likely to complete treatment (OR=1.84, p=0.037). CONCLUSION: Identification of client-level predictors of treatment engagement, outcome and dropout is essential to optimise treatment, particularly in community settings.

Are we in crisis? National mental health and treatment trends in college counseling centers.

The current state of college student mental health is frequently labeled a "crisis," as the demand for services and severity of symptomatology have appeared to increase in recent decades. Nationally representative findings are presented from the Center for Collegiate Mental Health, a practice research network based in the United States, composed of more than 340 university and college counseling centers, in an effort to illuminate trends in symptom severity and patterns in treatment utilization for the campus treatment seeking population. Clinical data collected over 5 academic years (2010-2015) showed small but significantly increasing trends for self-reported distress in generalized anxiety, depression, social anxiety, family distress, and academic distress, with the largest effect sizes observed for generalized anxiety, depression, and social anxiety. On the other hand, a significantly decreasing trend was observed for substance use. No significant changes were observed for eating concerns and hostility. Utilization data over 6 years indicated a gradual yet steady increase in the number of students seeking services (beyond the rate expected with increasing institutional enrollment), as well as increases in the number of appointments scheduled and attended, with great variation between centers. Within the context of changing national trends, we conclude that it is advisable to consider the specific needs of local centers to best accommodate distinct student bodies. (PsycINFO Database Record

Presenting concerns in counseling centers: The view from clinicians on the ground.

Despite growing evidence that a greater number of students are seeking counseling in college and university counseling centers throughout the United States, there is a dearth of empirical information about (a) the presenting concerns for which students seek treatment and (b) how these concerns differ according to client demographic factors. The purpose of this descriptive and exploratory study was to explore how counseling center clinicians categorize client presenting concerns, and how these concerns vary according to client demographics. Given the importance of client suicide within the field of college counseling, the frequency of suicidality as an identified presenting concern was also explored. A sample of 1,308 clinicians from 84 counseling centers rated the presenting concerns of 53,194 clients using the Clinician Index of Client Concerns (CLICC) after an initial consultation. Results of descriptive and nonparametric analyses indicated that the most prevalent concerns were anxiety, depression, stress, family, and academic performance, and that clients who belong to different demographic groups frequently present to counseling with broadly similar types of concerns. Furthermore, suicidality represented an area of concern for 8.4% of all clients, and it ranked 20 of 44 as a clinician-rated concern. Comparable rates emerged across the range of client demographic groups examined, although rates were notably higher for a handful of groups. The findings offer one of the largest and most generalizable descriptions of why college students seek counseling services, as determined by clinicians' evaluations of presenting concerns. Implications for research and clinical applications of the findings are discussed. (PsycINFO Database Record

Therapist effects on dropout from a college counseling center practice research network.

Dropout has been a pervasive and costly problem in psychotherapy, particularly for college counseling centers. The present study examined potential predictors of dropout using a large data set (N = 10,147 clients, 481 therapists) that was gathered through a college counseling center practice research network as a replication and extension of recent findings regarding therapist effects on dropout. The final model resulted in a dropout rate of 15.9% and a therapist effect of 9.51% on dropout variance. Therapist demographic variables were investigated, though none were found to be significant. Variables found to be predictive of increased likelihood of dropping out included higher levels of general presenting concerns, alcohol-related distress, and current financial stress. Ultimately, this study showed that therapists may play an important role in the likelihood of client dropout, and that additional research should be conducted to identify additional predictors, particularly at the therapist and center level. (PsycINFO Database Record