Provider Use of, Attitudes Towards, and Self-efficacy with Key Measurement-based Care Practices in Youth Mental Health Treatment: A Multi-site Examination.

Measurement-based care (MBC) is an underutilized evidence-based practice, and current implementation efforts demonstrate limited success in increasing MBC use. A better understanding of MBC implementation determinants is needed to improve these efforts, particularly from studies examining the full range of MBC practices and that span multiple samples of diverse providers using different MBC systems. This study addressed these limitations by conducting a multi-site survey examining MBC predictors and use in youth treatment. Participants were 159 clinicians and care coordinators working in youth mental health care settings across the United States. Participants were drawn from three program evaluations of MBC implementation. Providers completed measures assessing use of five MBC practices (administering measures, viewing feedback, reviewing feedback in supervision, sharing feedback with clients in session, and using feedback to plan treatment), MBC self-efficacy, and MBC attitudes. Despite expectations that MBC should be standard care for all clients, providers reported only administering measures to 40-60% of clients on average, with practices related to the use of feedback falling in the 1-39% range. Higher MBC self-efficacy and more positive views of MBC practicality predicted higher MBC use, although other attitude measures were not significant predictors. Effects of predictors were not moderated by site, suggesting consistent predictors across implementation settings. Implications of study findings for future research and for the implementation of MBC are discussed.

Testing Robustness of Child STEPs Effects with Children and Adolescents: A Randomized Controlled Effectiveness Trial.

A critical task in psychotherapy research is identifying the conditions within which treatment benefits can be replicated and outside of which those benefits are reduced. We tested the robustness of beneficial effects found in two previous trials of the modular Child STEPs treatment program for youth anxiety, depression, trauma, and conduct problems. We conducted a randomized trial, with two significant methodological changes from previous trials: (a) shifting from cluster- to person-level randomization, and (b) shifting from individual to more clinically feasible group-based consultation with STEPs therapists. Fifty community clinicians from multiple outpatient clinics were randomly assigned to receive training and consultation in STEPs (n= 25) or to provide usual care (UC; n= 25). There were 156 referred youths-ages 6-16 (M= 10.52, SD = 2.53); 48.1% male; 79.5% Caucasian, 12.8% multiracial, 4.5% Black, 1.9% Latino, 1.3% Other-who were randomized to STEPs (n= 77) or UC (n= 79). Following previous STEPs trials, outcome measures included parent- and youth-reported internalizing, externalizing, total, and idiographic top problems, with repeated measures collected weekly during treatment and longer term over 2 years. Participants in both groups showed statistically significant improvement on all measures, leading to clinically meaningful problem reductions. However, in contrast to previous trials, STEPs was not superior to UC on any measure. As with virtually all treatments, the benefits of STEPs may depend on the conditions-for example, of study design and implementation support-in which it is tested. Identifying those conditions may help guide appropriate use of STEPs, and other treatments, in the future.

Implementing Evidence Based Practices for Children's Mental Health: A Case Study in Implementing Modular Treatments in Community Mental Health.

There is strong enthusiasm for utilizing implementation science in the implementation of evidence-based programs in children's community mental health, but there remains work to be done to improve the process. Despite the proliferation of implementation frameworks, there is limited literature providing case examples of overcoming implementation barriers. This article examines whether the use of three implementations strategies, a structured training and coaching program, the use of professional development portfolios for coaching, and a progress monitoring data system, help to overcome barriers to implementation by facilitating four implementation drivers at a community mental health agency. Results suggest that implementation is a process of recognizing and adapting to both predictable and unpredictable barriers. Furthermore, the use of these implementation strategies is important in improving implementation outcomes.

Evidence-based youth psychotherapy in the mental health ecosystem.

Five decades of randomized trials research have produced dozens of evidence-based psychotherapies (EBPs) for youths. The EBPs produce respectable effects in traditional efficacy trials, but the effects shrink markedly when EBPs are tested in practice contexts with clinically referred youths and compared to usual clinical care. We considered why this might be the case. We examined relevant research literature and drew examples from our own research in practice settings. One reason for the falloff in EBP effects may be that so little youth treatment research has been done in the context of everyday practice. Researchers may have missed opportunities to learn how to make EBPs work well in the actual youth mental health ecosystem, in which so many real-world factors are at play that cannot be controlled experimentally. We sketch components and characteristics of that ecosystem, including clinically referred youths, their caregivers and families, the practitioners who provide their care, the organizations within which care is provided, the network of youth service systems (e.g., child welfare, education), and the policy context (e.g., reimbursement regulations and incentives). We suggest six strategies for future research on EBPs within the youth mental health ecosystem, including reliance on the deployment-focused model of development and testing, testing the mettle of current EBPs in everyday practice contexts, using the heuristic potential of usual care, testing restructured and integrative adaptations of EBPs, studying the use of treatment response feedback to guide clinical care, and testing models of the relation between policy change and EBP implementation.

Assessing practical implementation of modular psychotherapy for youth in community-based settings using benchmarking.

Background: Achieving high quality outcomes in a community context requires the strategic coordination of many activities in a service system, involving families, clinicians, supervisors, and administrators. In modern implementation trials, the therapy itself is guided by a treatment manual; however, structured supports for other parts of the service system may remain less well-articulated (e.g., supervision, administrative policies for planning and review, information/feedback flow, resource availability). This implementation trial investigated how a psychosocial intervention performed when those non-therapy supports were not structured by a research team, but were instead provided as part of a scalable industrial implementation, testing whether outcomes achieved would meet benchmarks from published research trials. Method: In this single-arm observational benchmarking study, a total of 59 community clinicians were trained in the Modular Approach to Therapy for Children (MATCH) treatment program. These clinicians delivered MATCH treatment to 166 youth ages 6 to 17 naturally presenting for psychotherapy services. Clinicians received substantially fewer supports from the treatment developers or research team than in the original MATCH trials and instead relied on explicit process management tools to facilitate implementation. Prior RCTs of MATCH were used to benchmark the results of the current initiative. Client improvement was assessed using the Top Problems Assessment and Brief Problem Monitor. Results: Analysis of client symptom change indicated that youth experienced improvement equal to or better than the experimental condition in published research trials. Similarly, caregiver-reported outcomes were generally comparable to those in published trials. Conclusions: Although results must be interpreted cautiously, they support the feasibility of using process management tools to facilitate the successful implementation of MATCH outside the context of a formal research or funded implementation trial. Further, these results illustrate the value of benchmarking as a method to evaluation industrial implementation efforts.Plain Language Summary: Randomized effectiveness trials are inclusive of clinicians and cases that are routinely encountered in community-based settings, while continuing to rely on the research team for both clinical and administrative guidance. As a result, the field still struggles to understand what might be needed to support sustainable implementation and how interventions will perform when brought to scale in community settings without those clinical trial supports. Alternative approaches are needed to delineate and provide the clinical and operational support needed for implementation and to efficiently evaluate how evidence-based treatments perform. Benchmarking findings in the community against findings of more rigorous clinical trials is one such approach. This paper offers two main contributions to the literature. First, it provides an example of how benchmarking is used to evaluate how the Modular Approach to Therapy for Children (MATCH) treatment program performed outside the context of a research trial. Second, this study demonstrates that MATCH produced comparable symptom improvements to those seen in the original research trials and describes the implementation strategies associated with this success. In particular, although clinicians in this study had less rigorous expert clinical supervision as compared with the original trials, clinicians were provided with process management tools to support implementation. This study highlights the importance of evaluating the performance of intervention programs when brought to scale in community-based settings. This study also provides support for the use of process management tools to assist providers in effective implementation.

Assessment of parental experiential avoidance in a clinical sample of children with anxiety disorders.

This investigation seeks to establish the psychometric properties of an adapted measure of experiential avoidance (EA) in the parenting context by assessing its relation to other parenting constructs and psychosocial correlates of child anxiety in a clinical sample. Participants were 154 children (90 female, 64 male) diagnosed with anxiety disorders and their parents (148 mothers, 119 fathers). The newly developed Parental Acceptance and Action Questionnaire (PAAQ) was administered to parents along with self-report measures of adult experiential avoidance, parental psychopathology, affective expression, and parental control behaviors. A subsample of participants, n = 35, were re-administered the PAAQ to assess temporal stability. Factor analysis of the PAAQ yielded a two-factor solution with factors labeled Inaction and Unwillingness. Temporal stability of the PAAQ was found to be moderate, r = .68-.74. Internal consistency was fair across subscales of the PAAQ, alpha = .64-.65. Correlational analysis of the PAAQ and parent-report measures support the criterion validity of the PAAQ, suggesting that the PAAQ correlates with parent-report measures of parental locus of control, affective expression, and controlling parental behaviors as well as child psychopathology symptoms. Finally, the clinical applicability of the PAAQ is indicated by the PAAQ's ability to predict a significant amount of variance in parent- and clinician-rated levels of child anxiety and related psychopathology.

When the torch is passed, does the flame still burn? Testing a "train the supervisor" model for the Child STEPs treatment program.

OBJECTIVE: We assessed sustainability of an empirically supported, transdiagnostic youth psychotherapy program when therapist supervision was shifted from external experts to internal clinic staff. METHOD: One hundred sixty-eight youths, aged 6-15 years, 59.5% male, 85.1% Caucasian, were treated for anxiety, depression, traumatic stress, or conduct problems by clinicians employed in community mental health clinics. In Phase 1 (2.7 years), 1 group of clinicians, the Sustain group, received training in Child STEPs (a modular transdiagnostic treatment + weekly feedback on youth response) and treated clinic-referred youths, guided by weekly supervision from external STEPs experts. In Phase 2 (2.9 years), Sustain clinicians treated additional youths but with supervision by clinic staff who had been trained to supervise STEPs. Also in Phase 2, a new group, External Supervision clinicians, received training and supervision from external STEPs experts and treated referred youths. Phase 2 youths were randomized to Sustain or External Supervision clinicians. Groups were compared on 3 therapist fidelity measures and 14 clinical outcome measures. RESULTS: Sustain clinicians maintained their previous levels of fidelity and youth outcomes after switching from external to internal supervision; and in Phase 2, the Sustain and External Supervision groups also did not differ on fidelity or youth outcomes. Whereas all 34 group comparisons were nonsignificant, trends with the largest effect sizes showed better clinical outcomes for internal than external supervision. CONCLUSIONS: Implementation of empirically supported transdiagnostic treatment may be sustained when supervision is transferred from external experts to trained clinic staff, potentially enhancing cost-effectiveness and staying power in clinical practice. (PsycINFO Database Record

Identification of high-risk behaviors among victimized adolescents and implications for empirically supported psychosocial treatment.

An adolescent's possible response to being the victim of interpersonal violence is not limited to posttraumatic stress disorder and depression but may also involve a host of developmental effects, including the occurrence of high-risk behaviors that may have a significant and negative impact on the adolescent's psychological and physical health. Identifying such high-risk behaviors, understanding their possible link to a previous victimization incident, and implementing interventions that have been demonstrated to reduce such behaviors may help decrease potential reciprocal interactions between these areas. Clinicians in psychiatric practice may be in a unique position to make these connections, since parents of adolescents may perceive a greater need for mental health services for youth engaging in problematic externalizing behaviors than for those displaying internalizing symptoms. In this article, the authors first describe high-risk behaviors, including substance use, delinquent behavior, risky sexual behaviors, and self-injurious behaviors, that have been linked with experiencing interpersonal violence. They then review empirically based treatments that have been indicated to treat these deleterious behaviors in order to help clinicians select appropriate psychosocial interventions for this population. Recommendations for future research on the treatment of high-risk behaviors in adolescents are also presented.

Assessing the utility of atypical antipsychotic medication in adults with mild mental retardation and comorbid psychiatric disorders.

OBJECTIVE: Research on psychiatric outcomes among individuals dually diagnosed with mild mental retardation and co-occurring mental illness who are treated with antipsychotic medication is markedly limited due to difficulties encountered in (1) making valid and reliable psychiatric diagnoses and (2) accurately rating and following psychiatric symptom change over time in this specialty population. METHOD: To address these issues, DSM-IV psychiatric diagnoses were made by an experienced dual-diagnosis clinician, and the Aberrant Behavior Checklist (ABC) and the Global Assessment of Functioning were used to assess behavioral and psychiatric features in a psychiatric partial hospital setting. Data were collected by chart review from 72 patients admitted consecutively from January 1998 to December 1999. Assessments were compared at admission and discharge in this retrospective study for 3 treatment groups that were defined by antipsychotic medication status at discharge: no antipsychotic (N = 15), atypical antipsychotic only (N = 41), and mixed atypical/typical antipsychotics or typical anti-psychotic only (N = 16). RESULTS: Improvement on the ABC social withdrawal subscale was greater for atypical anti-psychotic medication-treated, dually diagnosed patients than for those who received other treatment regimens. In addition, a dose-response relationship was observed for this subscale and atypical antipsychotic medication dose. CONCLUSION: For certain psychotic patients with mild mental retardation, the atypical antipsychotics may be an appropriate and effective treatment modality.

A comparison of the Aberrant Behavior Checklist and the GAF among adults with mental retardation and mental illness.

Psychiatric assessment among individuals with a diagnosis of both mental retardation and mental illness presents a clinical challenge. This retrospective study compared two rating scales--the Aberrant Behavior Checklist (ABC) and the Global Assessment of Functioning (GAF)--to determine the scales' utility in a partial hospital setting. Although ABC and GAF ratings were weakly correlated, the ABC revealed symptom patterns consistent with recognizable features of psychiatric syndromes and differential improvement in symptoms within and between diagnostic subgroups. The ABC provided a more useful measure of treatment response than the GAF in this patient population.