An Analysis of Six Month Follow-Up Data from a Peer Parent Support Study.

The current study examines trajectories of treatment outcomes 6 months after completion of a peer parent program, NAMI Basics. Fifty-two caregivers who were part of a larger trial completed questionnaires prior to, immediately after, and 6 months after completing NAMI Basics. Growth curve models were used to examine trajectories of caregiver ratings of parent activation and engagement, parent help-seeking intentions, child symptoms, outpatient service use, and parent stress at 6 months after completion of the program. Prior improvements to the outcomes of parent activation and engagement (ß = 2.31, p < .001, d = 1.35), parent help-seeking intentions (ß = 1.94, p = .017, d = 0.69), and child intrapersonal distress (ß = - 3.93, p = 0.046, d = 0.58) were maintained at 6 months, while help-seeking intentions was not (ß = 1.31, p = .222, d = 0.47). Though no changes were observed immediately post-class, caregivers reported significant increases in outpatient services use (ß = - 1.51, p = .030, d = 0.68) and reductions in parenting stress (ß = - 4.99, p = 0.009, d = 0.75) and overall child symptoms (ß = - 19.67, p = 0.001, d = 0.90) at 6 month follow-up. These results suggest that many of the positive impacts of the NAMI Basics program are sustained 6 months after the intervention. Additionally, these results suggest that some positive outcomes of the program may not emerge until several months after taking the class. Implications and future directions are discussed.

Setting and Provider Predictors of Implementation Success for an Eating Disorder Prevention Program Delivered by College Peer Educators.

INTRODUCTION: College students face increased risk for a variety of mental health problems but experience barriers to treatment access. Prevention programs, including those implemented by peer educators, may decrease treatment needs and increase service access. We examined the implementation of an evidence-based eating disorder prevention program, Body Project, delivered by college peer educators at 63 colleges/universities, comparing three levels of implementation support: (1) Train-the-Trainer (TTT) training; (2) TTT plus a technical assistance workshop (TTT + TA); and (3) TTT + TA with one year of quality assurance calls (TTT + TA + QA). The present study tested the degree to which indicators proposed by the Consolidated Framework for Implementation Research (CFIR) were associated with core implementation outcomes. METHOD: We tested whether indices of CFIR domains (i.e., perceived intervention characteristics, outer and inner setting factors, provider characteristics, and implementation process) were correlated with three implementation outcomes (program reach, fidelity, effectiveness) during a 1-year implementation period. RESULTS: Greater program reach was associated with implementation process, specifically the completion of more implementation activities (ß = 0.46). Greater program fidelity was associated with higher positive (ß = 0.44) and lower negative (ß = - 0.43) perceptions of the Body Project characteristics, and greater reported general support for evidence-based practices (ß = 0.41). Greater effectiveness was associated with lower negative perceptions of Body Project characteristics (d = 0.49). CONCLUSIONS: Several implementation determinants proposed by the CFIR model predicted outcomes, especially intervention fidelity. Across the outcomes of interest, implementation determinants related to peer educator and supervisor perceived characteristics of the specific intervention and general attitudes towards evidence-based practices emerged as robust predictors to inform future work investigating ongoing implementation and sustainability of programs in university settings.

A Second and Third Look at FIRST: Testing Adaptations of A Principle-Guided Youth Psychotherapy.

Objective: We examined the acceptability, integrity, and symptom trajectories associated with FIRST, a principle-guided treatment for youth internalizing and externalizing problems designed to support efficient uptake and implementation.Method: We conducted two open trials of an adapted FIRST, focusing on uptake and implementation by novice trainees in a university-affiliated clinic, limiting treatment duration to six sessions, and benchmarking findings against a 2017 FIRST trial with community therapists. In Study 1, trainees received a two-day training and weekly two-hour supervision (N = 22 youths, ages 7-17, 50% female, 54.54% Caucasian, 4.55% Latinx). In Study 2, trainees received a one-day training and weekly one-hour supervision, delivering the six-session FIRST in a predetermined sequence (N = 26 youths, ages 11-17, 42.31% female, 65.38% Caucasian, 7.69% Latinx). In Study 3, the original study therapists - now practitioners - evaluated FIRST's effectiveness and implementation difficulty, and reported their own post-study FIRST use.Results: Acceptability (treatment completion, session attendance, caregiver participation) and integrity (adherence, competence) were comparable across Study 1, Study 2 and the 2017 trial. Improvement effect sizes across ten outcome measures were in the large range in all three trials: M ES = 1.10 in the 2017 trial, 0.83 in Study 1, and 0.81 in Study 2. Study 3 showed high effectiveness ratings, low difficulty ratings, and continued use of FIRST by a majority of clinicians.Conclusions: Across two open trials and a follow-up survey, FIRST showed evidence of acceptability and integrity, with youth symptom reduction comparable to that in prior research.

Pediatric Consultation-Liaison: Patient Characteristics and Considerations for Training in Evidence-Based Practices.

Consultation-liaison services are an integral part of many pediatric hospital settings, yet characteristics of this patient population have not been extensively documented. The current study is a retrospective one-year chart review of the consultation-liaison service at a large pediatric hospital in the Southwestern United States. The purpose of this study is twofold: (1) to characterize this hospital's CL population and (2) to use these characteristics to identify preliminary evidence-based practices that should be considered for CL provider training. Identifying evidence-based practice elements that align with the characteristics of consultation-liaison patient populations may inform trainings for consultation-liaison staff. This would help to ensure that youth seen in hospital consultation-liaison services are getting the best available services, which is critical given the shortened time frame available to work with this patient population.

Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency.

Measurement feedback systems (MFSs) that routinely collect and report client progress to mental health therapists have demonstrated beneficial impact on outcomes in numerous studies, with evidence that there is a dose-response relationship related to the implementation of the MFS. The current study examined the impact of MFS implementation (Implementation Index) on youth symptom outcomes separately by caregiver and youth self-report. Additionally, we tested the extent to which Implementation Index rates varied by individual therapists and clients, and whether therapist and client characteristics predicted MFS implementation. Methods: Administrative data (client charts, youth- and caregiver-reported Youth Outcome Questionnaires) for 229 youth (52.83% Latinx, 42.79% girls, M age = 10.33) treated during a 1-year period at a community mental health organization in Central Texas were analyzed using multi-level modeling. Caregiver-reported symptoms decreased faster for those with a higher MFS Implementation Index. Between-group differences among therapists accounted for a significant proportion of variance in the Implementation Index for caregiver report, whereas client differences accounted for most of the variance in the Implementation Index for youth self-report. Therapist trainee status predicted a significant increase in the Implementation Index for caregiver-report data. Youth symptom improvement as reported by caregivers varied with the extent of MFS implementation fidelity, and MFS implementation fidelity was higher for clients treated by trainees relative to staff therapists for caregiver report of symptoms.

Assessing the Irritable and Defiant Dimensions of Youth Oppositional Behavior Using CBCL and YSR Items.

Research suggests that irritability and defiance are distinct dimensions of youth oppositionality that are differentially associated with internalizing and conduct problems, respectively. Because much of this evidence has emerged with limited psychometric evaluation, we conducted the first multi-informant examination of selected Child Behavior Checklist (CBCL) and Youth Self Report (YSR) items for measuring irritability and defiance in a large clinical sample. Clinically referred youths (N = 1,030; ages 6-15; 43% female, 42% ethnic minority) were assessed prior to treatment using multi-informant rating scales and diagnostic interviews. Analyses examined factor structure, invariance, internal consistency, multi-informant patterns, and convergent, discriminant, and criterion validity with internalizing and externalizing problems/disorders. A correlated 2-factor model of irritability (stubborn/sullen/irritable, mood, temper) and defiance (argues, disobeys-home, disobeys-school) fit well for both informants. Adequate measurement invariance and scale consistency was consistently found for parent-report but not youth-report. With both informants, all hypothesized convergent and discriminant validity associations were supported: irritability and defiance with internalizing and conduct scales, respectively. However, hypothesized criterion validity associations were largely found only by parent-report: irritability with anxiety and depressive disorders, defiance with conduct disorder, and both with oppositional defiant disorder. Results consistently supported the reliability and validity of the CBCL irritability and defiance scales, with somewhat less consistent support for the YSR scales. Thus, CBCL items may provide psychometrically sound assessment of irritability and defiance, whereas further research is needed to advance youth-report and multi-informant strategies. Results also provide further support for a two subdimension model of oppositional defiant disorder symptoms that includes irritability and defiance.

Testing Robustness of Child STEPs Effects with Children and Adolescents: A Randomized Controlled Effectiveness Trial.

A critical task in psychotherapy research is identifying the conditions within which treatment benefits can be replicated and outside of which those benefits are reduced. We tested the robustness of beneficial effects found in two previous trials of the modular Child STEPs treatment program for youth anxiety, depression, trauma, and conduct problems. We conducted a randomized trial, with two significant methodological changes from previous trials: (a) shifting from cluster- to person-level randomization, and (b) shifting from individual to more clinically feasible group-based consultation with STEPs therapists. Fifty community clinicians from multiple outpatient clinics were randomly assigned to receive training and consultation in STEPs (n= 25) or to provide usual care (UC; n= 25). There were 156 referred youths-ages 6-16 (M= 10.52, SD = 2.53); 48.1% male; 79.5% Caucasian, 12.8% multiracial, 4.5% Black, 1.9% Latino, 1.3% Other-who were randomized to STEPs (n= 77) or UC (n= 79). Following previous STEPs trials, outcome measures included parent- and youth-reported internalizing, externalizing, total, and idiographic top problems, with repeated measures collected weekly during treatment and longer term over 2 years. Participants in both groups showed statistically significant improvement on all measures, leading to clinically meaningful problem reductions. However, in contrast to previous trials, STEPs was not superior to UC on any measure. As with virtually all treatments, the benefits of STEPs may depend on the conditions-for example, of study design and implementation support-in which it is tested. Identifying those conditions may help guide appropriate use of STEPs, and other treatments, in the future.

After the Study Ends: A Qualitative Study of Factors Influencing Intervention Sustainability.

Sustaining evidence-based practices after initial training and support has ended is necessary to ensure lasting improvements in youth mental health services. This study examined factors impacting community clinicians' decisions to sustain a transdiagnostic youth intervention following participation in a study. The aim of the study was to identify potentially mutable factors impacting sustainability to inform future implementation efforts. Thirteen clinicians (85% women, 92% Caucasian, M age = 35.6) completed interviews after participating in an open trial of an evidence-based intervention for depression, anxiety, and conduct disorders. Interviews were analyzed using thematic analysis methods. All (100%) clinicians reported current use of the intervention. Four themes emerged related to sustainability. Clinicians (100%) reported that making modifications, alignment with prior training, and relative advantage influenced their current intervention use. Clinicians (100%) reported that knowledge transfer from treatment developers was vital to sustainability. They (92%) noted a number of logistical, inner-organizational, and client-level barriers to sustainability. Lastly, clinicians (92%) identified factors related to scaling up the intervention. A variety of personal, organizational, logistical, and client variables influence the sustainment of new interventions, and could be leveraged in future implementation efforts.

Stakeholder Perceptions of the Barriers to Receiving and Delivering Exposure-Based Cognitive Behavioral Therapy for Anxiety Disorders in Adult Community Mental Health Settings.

CBT is considered the first-line treatment for anxiety disorders, particularly when it involves gradual confrontation with feared stimuli (i.e., exposure); however, delivery of CBT for anxiety disorders in real-world community clinics is lacking. This study utilized surveys we developed with key stakeholder feedback (patient, provider, and administrator) to assess patient and provider/administrator perceptions of the barriers to delivering (or receiving) CBT for anxiety disorders. Providers/administrators from two counties in California (N = 106) indicated lack of training/competency as primary barriers. Patients in one large county (N = 42) reported their own symptoms most often impacted treatment receipt. Both groups endorsed acceptability of exposure but indicated that its use in treatment provided/received had been limited. Implications and recommendations are discussed.

A Preliminary Exploration of the Barriers to Delivering (and Receiving) Exposure-Based Cognitive Behavioral Therapy for Anxiety Disorders in Adult Community Mental Health Settings.

Despite the effectiveness of exposure-based cognitive behavioral therapy (CBT) for anxiety disorders, few individuals in need receive this treatment, particularly in community mental health settings serving low-income adults. The present study took a preliminary step to understand these barriers by conducting a series of key informant interviews and focus groups among patients, providers, clinical administrators, and policy makers. Several themes emerged as barriers to the delivery of exposure-based CBT in these settings, including therapist training and compentency issues, logistical issues, and funding stream issues. Clinical implications and future research that can build from these data are discussed.

Clinical Supervision of Mental Health Professionals Serving Youth: Format and Microskills.

Clinical supervision is an element of quality assurance in routine mental health care settings serving children; however, there is limited scientific evaluation of its components. This study examines the format and microskills of routine supervision. Supervisors (n = 13) and supervisees (n = 20) reported on 100 supervision sessions, and trained coders completed observational coding on a subset of recorded sessions (n = 57). Results indicate that microskills shown to enhance supervisee competency in effectiveness trials and experiments were largely absent from routine supervision, highlighting potential missed opportunities to impart knowledge to therapists. Findings suggest areas for quality improvement within routine care settings.

Initial Test of a Principle-Guided Approach to Transdiagnostic Psychotherapy With Children and Adolescents.

To address implementation challenges faced by some evidence-based youth psychotherapies, we developed an efficient transdiagnostic approach-a potential "first course" in evidence-based treatment (EBP)-guided by five empirically supported principles of therapeutic change. An open trial of the resulting FIRST protocol was conducted in community clinics. Following a 2-day training, staff practitioners treated 24 clinically referred youths ages 7-15, 50% male, 87% White and 13% Latino, all with the Schedule for Affective Disorders and Schizophrenia for School-Age Children Diagnostic and Statistical Manual of Mental Disorders (4th ed.) anxiety, depressive, or conduct-related disorders, and averaging 2.21 disorders. We evaluated the protocol's (a) feasibility for use in everyday clinical practice (examining therapy process, client engagement, and therapist adherence and competence in using the protocol), (b) acceptability (examining therapeutic alliance and treatment satisfaction by youths, caregivers, and therapists), and (c) potential for clinical benefit (examining treatment outcomes across multiple measures and time points). FIRST scored well on measures of feasibility, acceptability to clients and clinicians, and clinical outcomes, matching or exceeding the corresponding scores in most benchmarking comparisons. Observational coding of sessions showed high levels of protocol adherence (86.6%) and good therapist competence in the evidence-based skills. Weekly assessments throughout treatment showed effect sizes for clinical improvement ranging from .41 to 2.66 on weekly total problems and problems deemed "most important" by caregivers and youths. The FIRST protocol showed evidence of feasibility, acceptability, and clinical benefit when used by practitioners with referred youths treated in community clinics. The findings suggest sufficient potential to justify a full randomized controlled trial of FIRST.

Building an Evidence Base for Effective Supervision Practices: An Analogue Experiment of Supervision to Increase EBT Fidelity.

Treatments that are efficacious in research trials perform less well under routine conditions; differences in supervision may be one contributing factor. This study compared the effect of supervision using active learning techniques (e.g. role play, corrective feedback) versus "supervision as usual" on therapist cognitive restructuring fidelity, overall CBT competence, and CBT expertise. Forty therapist trainees attended a training workshop and were randomized to supervision condition. Outcomes were assessed using behavioral rehearsals pre- and immediately post-training, and after three supervision meetings. EBT knowledge, attitudes, and fidelity improved for all participants post-training, but only the SUP+ group demonstrated improvement following supervision.

Review: Comprehensive treatments for youth comorbidity - evidence-guided approaches to a complicated problem.

BACKGROUND: Evidence-based treatments (EBTs) with a single-disorder focus have improved the potential for youth mental health care, yet may be an imperfect fit to clinical care settings where diagnostic comorbidity and co-occurring problems are commonplace. Most EBTs were developed to treat one diagnosis or problem (or a small homogenous cluster), but most clinically referred youths present with multiple disorders and problems. FINDINGS: Three emerging approaches may help address the comorbidity that is so common in treated youths. Conceptually unified treatments target presumed causal and maintaining factors that are shared among more than one disorder or problem area; preliminary open trials and case studies show promising results. Modular protocols combine the 'practice elements' that commonly appear in separate single-disorder EBTs and repackage them into coordinated delivery systems; one modular protocol, MATCH, has produced positive findings in a randomized effectiveness trial. Monitoring and Feedback Systems (MFSs) provide real-time data on client progress to inform clinical decision-making, encompassing comorbid and co-occurring problems; one study shows beneficial effects in everyday practice with diverse youth problems. CONCLUSIONS: All three approaches - conceptually unified, modular, and MFS - can be strengthened by increased research attention to treatment integrity, clinician user-appeal, design simplicity, and the infrastructure necessary for successful implementation.

From Practice to Evidence in Child Welfare: Model Specification and Fidelity Measurement of Team Decisionmaking.

Fidelity measurement methods have traditionally been used to develop and evaluate the effects of psychosocial treatments and, more recently, their implementation in practice. The fidelity measurement process can also be used to operationally define and specify components of emerging but untested practices outside the realm of conventional treatment. Achieving optimal fidelity measurement effectiveness (scientific validity and reliability) and efficiency (feasibility and relevance in routine care contexts) is challenging. The purpose of this paper is to identify strategies to address these challenges in child welfare system practices. To illustrate the challenges, and operational steps to address them, we present a case example using the "Team Decisionmaking" (TDM; Annie E. Casey Foundation) intervention. This intervention has potential utility for decreasing initial entry into and time spent in foster care and increasing rates of reunification and relative care. While promising, the model requires rigorous research to refine knowledge regarding the relationship between intervention components and outcomes-research that requires fidelity measurement. The intent of this paper is to illustrate how potentially generalizable steps for developing effective and efficient fidelity measurement methods can be used to more clearly define and test the effects of child welfare system practices.

Predictors of the sustainability for an evidence-based eating disorder prevention program delivered by college peer educators.

BACKGROUND: Despite ongoing efforts to introduce evidence-based interventions (EBIs) into mental health care settings, little research has focused on the sustainability of EBIs in these settings. College campuses are a natural place to intervene with young adults who are at high risk for mental health disorders, including eating disorders. The current study tested the effect of three levels of implementation support on the sustainability of an evidence-based group eating disorder prevention program, the Body Project, delivered by peer educators. We also tested whether intervention, contextual, or implementation process factors predicted sustainability. METHODS: We recruited 63 colleges with peer educator programs and randomly assigned them to (a) receive a 2-day Train-the-Trainer (TTT) training in which peer educators were trained to implement the Body Project and supervisors were taught how to train future peer educators (TTT), (b) TTT training plus a technical assistance (TA) workshop (TTT + TA), or (c) TTT plus the TA workshop and quality assurance (QA) consultations over 1-year (TTT + TA + QA). We tested whether implementation support strategies, perceived characteristics of the intervention and attitudes towards evidence-based interventions at baseline and the proportion of completed implementation activities during the implementation year predicted three school-level dichotomous sustainability outcomes (offering Body Project groups, training peer educators, training supervisors) over the subsequent two-year sustainability period using logistic regression models. RESULTS: Implementation support strategies did not significantly predict any sustainability outcomes, although a trend suggested that colleges randomized to the TTT + TA + QA strategy were more likely to train new supervisors (OR = 5.46, 95% CI [0.89-33.38]). Colleges that completed a greater proportion of implementation activities were more likely to offer Body Project groups (OR = 1.53, 95% CI [1.19-1.98]) and train new peer educators during the sustainability phase (OR = 1.39, 95% CI [1.10-1.74]). Perceived positive characteristics of the Body Project predicted training new peer educators (OR = 18.42, 95% CI [1.48-299.66]), which may be critical for sustainability in routine settings with high provider turnover. CONCLUSIONS: Helping schools complete more implementation activities and increasing the perceived positive characteristics of a prevention program may result in greater sustainment of prevention program implementation. TRIAL REGISTRATION: This study was preregistered on 12/07/17 with ClinicalTrials.gov, ID NCT03409809, https://clinicaltrials.gov/ct2/show/NCT03409809 .

Tracking evidence based practice with youth: validity of the MATCH and standard manual consultation records.

This study sought to evaluate the agreement between therapist report and coder observation of therapy practices. The study sampled session data from a community-based, randomized trial of treatment for youth ages 7 to 13. We used therapist report of session content and coverage gathered using formal Consultation Records and developed complimentary records for coders to use when watching or listening to therapy tape. We established initial reliability between coders and then conducted a random, stratified, and comprehensive sample of sessions across youth (N = 121), therapists (N = 57), conditions (MATCH and Standard Manuals), and study sites (Honolulu and Boston) to code and compare with therapist record reports. Intraclass correlation coefficients (ICCs) representing coder versus therapist agreement on manual content delivered ranged from .42 to 1.0 across conditions and problem areas. Analyses revealed marked variability in agreement regarding whether behavioral rehearsals took place (ICCs from -.01 to 1.0) but strong agreement on client comprehension of therapy content and homework assignments. Overall, the findings indicate that therapists can be accurate reporters of the therapeutic practices they deliver, although they may need more support in reporting subtle but valuable aspects of implementation such as types of behavioral rehearsals. Developing means to support accurate reporting is important to developing future clinical feedback methodology applicable to the implementation of evidence-based treatments in the real world.

More practice, less preach? the role of supervision processes and therapist characteristics in EBP implementation.

Identifying predictors of evidence-based practice (EBP) use, such as supervision processes and therapist characteristics, may support dissemination. Therapists (N = 57) received training and supervision in EBPs to treat community-based youth (N = 136). Supervision involving modeling and role-play predicted higher overall practice use than supervision involving discussion, and modeling predicted practice use in the next therapy session. No therapist characteristics predicted practice use, but therapist sex and age moderated the supervision and practice use relation. Supervision involving discussion predicted practice use for male therapists only, and modeling and role-play in supervision predicted practice use for older, not younger, therapists.

An experimental test of increasing implementation support for college peer educators delivering an evidence-based prevention program.

OBJECTIVE: College students are at particularly high risk for mental health problems, such as eating disorders, which are associated with functional impairment, distress, and morbidity, but barriers limit implementation of evidence-based interventions at colleges. We evaluated the effectiveness and implementation quality of a peer educator (PE) delivered eating disorder prevention program (the Body Project [BP]), which has a broad evidence-based using a train-the-trainer (TTT) approach and experimentally evaluated three levels of implementation support. METHOD: We recruited 63 colleges with peer educator programs and randomly assigned them to (a) receive a 2-day TTT training in which peer educators were trained to implement the Body Project and supervisors were taught how to train future peer educators (TTT), (b) TTT training plus a technical assistance (TA) workshop (TTT + TA), or (c) TTT plus the TA workshop and quality assurance (QA) consultations over 1-year (TTT + TA + QA). Colleges recruited undergraduates (N = 1,387, 98% female, 55% White) to complete Body Project groups. RESULTS: There were no significant differences across condition for attendance, adherence, competence, and reach, though nonsignificant trends suggested some benefit of TTT + TA + QA relative to TTT for adherence and competence (ds = .40 and .30). Adding TA and QA to TTT was associated with significantly larger reductions in risk factors and eating disorder symptoms. CONCLUSIONS: Results suggest that the Body Project can be effectively implemented at colleges using peer educators and a TTT approach and that adding TA and QA resulted in significantly larger improvements in outcomes for group participants, and marginally higher adherence and competence. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Mental Health Trajectories of Latinx Female Caregivers and Young Children During COVID-19: A Longitudinal Analysis.

Studies of the impact of COVID-19 on mental health symptoms suggest that there may be a unique impact of COVID-19 on minoritized individuals, young children (children five and younger), and their caregivers. Longitudinal studies with representative samples including minoritized populations are needed to accurately reflect the experience of families during COVID-19. The current study used a longitudinal design to assess trajectories of mental health among Latinx female caregivers and their young children over time, beginning prior to the onset of the COVID-19 pandemic and over the course of 12 months. In fall of 2019, Latinx female caregivers (N = 213; 93.0% biological mother) of young children (M age = 5.38, SD = 0.34) reported on their own and their child's (52.6% female) mental health symptoms, as well as parenting stress, at three time points through Fall of 2020. Growth curve models showed that self-report of caregiver global mental health worsened over time, though caregiver depression and parenting stress did not change significantly, nor did caregiver-report of their children's mental health. Results suggest that while female caregiver well-being was adversely affected by COVID-19, caregivers showed resilience in the face of this pandemic, which in turn may have buffered the impact of the pandemic on Latinx child mental health. Methodological and contextual implications of these results are considered.