Data-Informed Communication: How Measurement-Based Care Can Optimize Child Psychotherapy.

Measurement-based care (MBC) research and practice, including clinical workflows and systems to support MBC, are grounded in adult-serving mental health systems. MBC research evidence is building in child and adolescent services, but MBC practice is inherently more complex due to identified client age, the family system and the need to involve multiple reporters. This paper seeks to address a gap in the literature by providing practical guidance for youth-serving clinicians implementing MBC with children and their families. We focus on MBC as a data-informed, client-centered communication process, and present three key strategies to enhance usual care child and adolescent psychotherapy via developmentally-appropriate MBC. These strategies include (1) go beyond standardized measures; (2) lean into discrepancies; and (3) get curious together. Case-based examples drawn from various child-serving settings illustrate these key strategies of MBC in child psychotherapy.

Provider Use of, Attitudes Towards, and Self-efficacy with Key Measurement-based Care Practices in Youth Mental Health Treatment: A Multi-site Examination.

Measurement-based care (MBC) is an underutilized evidence-based practice, and current implementation efforts demonstrate limited success in increasing MBC use. A better understanding of MBC implementation determinants is needed to improve these efforts, particularly from studies examining the full range of MBC practices and that span multiple samples of diverse providers using different MBC systems. This study addressed these limitations by conducting a multi-site survey examining MBC predictors and use in youth treatment. Participants were 159 clinicians and care coordinators working in youth mental health care settings across the United States. Participants were drawn from three program evaluations of MBC implementation. Providers completed measures assessing use of five MBC practices (administering measures, viewing feedback, reviewing feedback in supervision, sharing feedback with clients in session, and using feedback to plan treatment), MBC self-efficacy, and MBC attitudes. Despite expectations that MBC should be standard care for all clients, providers reported only administering measures to 40-60% of clients on average, with practices related to the use of feedback falling in the 1-39% range. Higher MBC self-efficacy and more positive views of MBC practicality predicted higher MBC use, although other attitude measures were not significant predictors. Effects of predictors were not moderated by site, suggesting consistent predictors across implementation settings. Implications of study findings for future research and for the implementation of MBC are discussed.

Consultation as an Implementation Strategy to Increase Fidelity of Measurement-Based Care Delivery in Community Mental Health Settings: An Observational Study.

Regularly administering outcome measures to clients to inform clinical decision making, referred to as measurement-based care (MBC), has the potential to improve mental health treatment due to its applicability across disorders and treatment settings. Given the utility of MBC, understanding predictors of high-fidelity MBC implementation is important. Training and consultation are widely used implementation strategies to increase the fidelity of evidence-based practice delivery but have rarely been studied with MBC. The current study will examine the relationship between time clinicians spent discussing a case in consultation ("dosage") and MBC fidelity. Thirty clinicians and 56 youth were in the MBC condition of a randomized controlled trial and completed baseline questionnaires. Consultation dosage was extracted from call notes. MBC fidelity was measured using the implementation index, which combines rates of administering and viewing questionnaires, using objective data from the online MBC system. Multi-level modeling was used. Greater consultation dosage significantly predicted a higher implementation index (ß = 0.27, SE = 0.06, p < .001). For every 30 min spent discussing a case in consultation, the case's MBC fidelity increased by 8.1%. Greater consultation dosage significantly predicted higher rates of administration (ß = 0.07, SE = 0.03, p = 0.033) and feedback report viewing (ß = 0.24, SE = 0.06, p < .001). More consultation at the case level predicts greater MBC fidelity using objective measures. The greatest impact was increasing the clinician feedback report viewing rate. The results of this study can help inform future efforts to increase the fidelity with which MBC is delivered and to make consultation as efficient and effective as possible.

Clinical Consultation During a Trauma-Focused Cognitive Behavioral Therapy Community-Based Learning Collaborative: Examination of Consultation Content, Consultative Strategies, and Provider Engagement.

Consultation following evidence-based practice (EBP) training enhances the uptake of EBPs. Yet, little is known about what occurs during consultation, and it is often difficult for providers to engage in consultation. This study examined provider engagement in consultation and the content and strategies used during consultation following training in Trauma-focused Cognitive Behavioral Therapy (TF-CBT) as part of a community-based learning collaborative (CBLC). Minute-to-minute live coding of consultation calls revealed most content was clinically-oriented and the most common strategies used by consultants were didactic in nature. Providers with more years of professional experience and those with greater TF-CBT knowledge attended significantly more consultation calls. Providers with a greater average weekly caseload and providers who were supervisors presented significantly more cases on calls. Providers with greater TF-CBT knowledge spoke significantly more minutes on calls. Consistent with previous work, findings highlight difficulties with provider engagement in consultation and that providers with more baseline expertise are most likely to be engaged. Findings suggest tailoring EBP training efforts to better engage providers at greatest risk for low engagement.

External and Internal Validity Considerations in Youth Effectiveness Trials: Lessons Learned from the COMET Study.

OBJECTIVE: Effectiveness trials aim to increase the generalizability and public health impact of interventions. However, challenges associated with this design present threats to external and internal validity. This paper illustrates these challenges using data from a two-site randomized effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET) and presents recommendations for future research. METHOD: COMET was a randomized effectiveness trial conducted in 19 community mental health clinics in two states comparing three interventions: treatment as usual (TAU), TAU with measurement-based care (TAU+), and the Unified Protocol forTransdiagnostic Treatment of Emotional Disorders in Adolescents with MBC (UPA). Participants included 176 clinicians (mean age = 35.5; 85.8% cisgender female; 53.0% racially and/or ethnically minorized) and 196 adolescents (mean age = 14.7; 65.3% cisgender female; 69.4% racially and/or ethnically minorized). Analyses outlined participant flow from recruitment to study completion, described participant characteristics, and examined site differences. RESULTS: Analysis of participant flow suggested that recruitment and retention of clinicians and adolescents was challenging, raising questions about whether participants were representative of participating clinics. Both the clinician and adolescent samples were racially and ethnically diverse and adolescents were low income and clinically complex. Significant site differences were observed in clinician and adolescent characteristics. CONCLUSIONS: While this study was successful in recruiting a diverse and historically under-represented sample, difficulties in recruitment and retention raise questions about external validity and site differences present challenges to internal validity of study findings. Suggestions for future effectiveness studies, drawing from implementation science approaches, are discussed.

Characterizing measurement-based care implementation using therapist report.

The effectiveness of measurement-based care (MBC), an evidence-based practice that uses regularly collected assessment data to guide clinical decision-making, is impacted by whether and how therapists use information from MBC tools in treatment. Improved characterization of how therapists use MBC in treatment sessions with youth is needed to guide implementation and understand variability in MBC effectiveness. To meet this need, this study examined therapists' sharing and discussion of MBC in treatment sessions. Thirty therapists were randomly assigned to the MBC condition as part of a comparative effectiveness trail of treatments for adolescent anxiety and depression. A qualitative content analysis was conducted on therapists' written explanations of changes made to the session based on the MBC data. Therapists reported sharing data with youth and caregivers in an average of 34.6% and 27.4% of sessions, respectively. Therapists reported incorporating MBC data in an average of 21.1% of sessions. When data were used, therapists predominately focused changes on short-term (e.g., current symptoms, treatment skill) rather than long-term (e.g., symptom progress, treatment goals) decision-making. Therapists inconsistently used MBC data, highlighting the need for improved training in and monitoring of how therapists use MBC in session to guide collaborative treatment decision-making with youth and caregivers.

Training Community Therapists in Core Elements of CBT and Family Therapy for Adolescent Externalizing Problems.

OBJECTIVE: This pilot study tested pragmatic methods for training therapists in core techniques of two evidence-based interventions (EBIs) for adolescent externalizing problems: cognitive-behavioral therapy (CBT) or family therapy (FT). Training methods were designed to help therapists accurately self-monitor their use of EBIs and increase delivery of EBIs with current clients. The study compared coder training only versus coder training plus fidelity-focused consultation. METHOD: Therapists (N = 42) from seven behavioral health clinics reported on 65 youth clients; four clinics elected to train in CBT and three in FT. Therapists were randomized to either coder training only, consisting of a 25-week observational coder training course (didactic instruction and mock session coding exercises in core EBI techniques); or coder training plus fidelity-focused consultation, consisting of direct-to-therapist fidelity measurement feedback along with fidelity-focused expert consultation. During the 25 weeks of training, therapists submitted self-report data on EBI use along with companion session audiotapes subsequently coded by observational raters. RESULTS: Compared to coder training only, coder training plus fidelity-focused consultation produced superior effects in therapist ability to judge the extensiveness of EBI techniques in online coding sessions, as well as therapist ability to self-rate use of EBI techniques with their own cases. In both conditions, therapists who trained in CBT showed a significant, though modest, increase in real-world delivery of core CBT techniques; this did not occur for FT. CONCLUSIONS: Pragmatic training and consultation methods show promise as viable and effective options for enhancing EBI fidelity monitoring and, for CBT, increasing EBI delivery.

Treatment Engagement in Adolescents: The Associations of Sociodemographic Characteristics, Caregiver Perceived Barriers, and Clinical Impairment.

OBJECTIVE: To examine the associations between sociodemographic characteristics, perceived barriers to treatment, clinical impairment, and youth treatment engagement. METHOD: Participants included 196 families (youth: ages 12 to 18; 64.3% cis-gender female; 23.5% Black, 60.7% White, and 12.2% Mixed/Other race; 41.3% Hispanic or Latinx ethnicity) recruited as part of a comparative effectiveness trial for adolescent anxiety and depression. Self-report measures of sociodemographic characteristics and caregiver perceived barriers were completed at intake. Youth clinical impairment was assessed at baseline via clinical interview. Measures of engagement were collected throughout treatment, including initiation status, session attendance, and termination status. Relationships were examined using analyses of variances and hierarchal linear and logistic modeling. RESULTS: Perceived barriers did not differ by sociodemographic characteristics. Greater perceived stressors and obstacles predicted fewer sessions attended and a lower likelihood of successful termination. Youth of caregivers with an advanced degree and those with caregivers who were employed part time attended more sessions and were more likely to initiate and terminate treatment successfully compared to youth with caregivers of a lower education level or student or unemployed status. At higher levels of youth clinical impairment, greater perceived treatment demands and issues predicted reduced likelihood of treatment initiation. CONCLUSIONS: Perceived barriers, sociodemographic characteristics, and clinical impairment were all associated with levels of engagement in the treatment process. Baseline and continued assessment of perceived and experienced barriers to treatment may promote individualized strategies for families identified as at-risk for reduced engagement.

A thematic analysis of broker consultation in a TF-CBT community based learning collaborative.

Background: Consultation is an important implementation strategy to increase competence, knowledge, and fidelity to evidence-based practice in community settings. However, the literature has primarily focused on consultation for clinical providers, and less is known about consultation for "broker" professionals, or those who identify and refer children to mental health services. Given their critical role in connecting youth to evidence-based treatment, investigating broker knowledge and use of evidence-based screening and referral are needed. Objective: To address this gap, the current study examines the content of consultation provided to broker professionals.

Youth Trauma Histories are Associated with Under-diagnosis and Under-treatment of Co-occurring Youth Psychiatric Symptoms.

OBJECTIVE: We examined whether in the presence of trauma exposure, non-traumatic stress-related symptoms are interpreted by mental health clinicians as less salient than the trauma exposure and are de-emphasized as a treatment target, consistent with a diagnostic overshadowing bias. METHODS: Using an adapted version of a diagnostic overshadowing bias experimental paradigm, mental health clinicians (N = 266, M age = 34.4 years, 82% female) were randomly assigned to receive two of six clinical vignette variations. Vignette 1 described an adolescent with obsessive-compulsive disorder (OCD). Vignette 2 described a pre-adolescent with oppositional defiant disorder (ODD). Vignettes were identical except for whether the youth reported exposure to a potentially traumatic event (PTE; no PTE, sexual PTE, or physical PTE). Clinicians received one vignette with a PTE and one without, counterbalancing order. Clinicians rated the likelihood the youth met criteria for various diagnoses and the appropriateness of various treatments on 7-point scales. RESULTS: Across both vignettes, clinicians rated the target diagnosis (OCD in Vignette 1, ODD in Vignette 2) as less likely for vignettes with a PTE than for the same vignettes without a PTE. Clinicians also rated evidence-based treatment modalities for target diagnoses as less appropriate in the presence of a PTE than when a PTE was present. CONCLUSIONS: Consistent with possible bias, clinicians may under-recognize and under-treat non-traumatic stress-related mental health symptoms in youth with a co-occurring trauma history. Future work to validate this bias in real-world practice is indicated.

Pilot Trial of Online Measurement Training and Feedback in Family Therapy for Adolescent Behavior Problems.

OBJECTIVE: Pragmatic procedures for sustaining high-fidelity delivery of evidence-based interventions are needed to support implementation in usual care. This study tested an online therapist training system, featuring observational coder training and self-report fidelity feedback, to promote self-report acumen and routine use of family therapy (FT) techniques for adolescent behavior problems. METHOD: Therapists (N = 84) from nine substance use and mental health treatment sites reported on 185 adolescent clients. Therapists submitted baseline data on FT technique use with clients, completed a workshop introducing the 32-week training system, and were randomly assigned by site to Core Training versus Core Training + Consultation. Core Training included a therapist coder training course (didactic instruction and mock session coding exercises in 13 FT techniques) and fidelity feedback procedures depicting therapist-report data on FT use. Consultation convened therapists and supervisors for one-hour monthly sessions with an external FT expert. During the 32 weeks of training, therapists submitted self-report data on FT use along with companion session audiotapes subsequently coded by observational raters. RESULTS: Therapist self-report reliability and accuracy both increased substantially during training. Observers reported no increase over time in FT use; therapists self-reported a decrease in FT use, likely an artifact of their improved self-report accuracy. Consultation did not enhance therapist self-report acumen or increase FT use. CONCLUSIONS: Online training methods that improve therapist-report reliability and accuracy for FT use may confer important advantages for treatment planning and fidelity monitoring. More intensive and/or different training interventions appear needed to increase routine FT delivery.

What is the Status of Multi-Informant Treatment Fidelity Research?

OBJECTIVE: The precise measurement of treatment fidelity (quantity and quality in the delivery of treatment strategies in an intervention) is essential for intervention development, evaluation, and implementation. Various informants are used in fidelity assessment (e.g., observers, practitioners [clinicians, teachers], clients), but these informants often do not agree on ratings. This scoping review aims to ascertain the state of science around multi-informant assessment of treatment fidelity. METHOD: A literature search of articles published through December 2021 identified 673 articles. Screening reduced the number of articles to 44, and the final study set included 35 articles. RESULTS: There was substantial variability across studies regarding study design, how fidelity was operationalized, and how reliability was defined and assessed. Most studies evaluated the agreement between independent observers and practitioner-report, though several other informant pairs were assessed. Overall, findings suggest that concordance across fidelity informants was low to moderate, with a few key exceptions. CONCLUSIONS: It is difficult to draw clear conclusions about the degree to which single versus multiple informant assessment is needed to produce an accurate and complete picture of treatment fidelity. The field needs to take steps to determine how to leverage multi-informant assessment to accurately assess treatment fidelity.

Unaccompanied migrant children in the United States: Implementation and effectiveness of trauma-focused cognitive behavioral therapy.

OBJECTIVE: The number of unaccompanied children (UC) arriving in the United States (U.S.) from other countries has increased significantly over the past decade. UC report high trauma exposure and greater posttraumatic stress symptoms compared with youth who immigrate with caregivers. Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) has demonstrated preliminary effectiveness with UC. However, few studies have treated U.S.-based samples of UC, who emigrate primarily from Central America. METHOD: One hundred thirty-eight UC were referred for treatment and 129 completed a pretreatment assessment including the Child and Adolescent Trauma Screen (CATS) and the Strengths and Difficulties Questionnaire (SDQ). Most UC were from Central America (n = 109; 79.0%) and resided in government facilities (n = 76; 55.1%). One hundred twenty-two youth began TF-CBT, had an average of 9.71 sessions (SD = 9.3, range: 1-48), and 41.8% (n = 51) completed treatment. One hundred four youth completed a brief, six-item progress monitoring measure of trauma symptoms, for which 84 had at least two observations during treatment. RESULTS: UC endorsed 3.80 traumatic events on average (SD = 2.38). High rates of violence, physical and sexual abuse, and serious injury were reported. There were significant improvements on most self-report rating scales (p < .05); within-subjects Cohen's d's ranged from .07 to 1.03 for pre- to posttreatment assessments and was d = .44 for the progress monitoring measure. Therapists reported on TF-CBT modifications for UC, including discussing mental health beliefs, navigating roles and relationships, tailoring treatment examples, exploring coping strategies, and addressing immigration factors. CONCLUSION: Preliminary findings support the utility of TF-CBT with UC. Implications for implementation and cultural modifications are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Initial Effects of a Brief Transdiagnostic Intervention on Parent Emotion Management During COVID-19.

Parents are a vulnerable group to increased distress resulting from the COVID-19 pandemic. In this study, 80 parents with at least mildly elevated internalizing symptoms were randomized to receive a four session, transdiagnostic intervention via telehealth during the height of the COVID-19 pandemic based on the Unified Protocols for Transdiagnostic Treatment of Emotional Disorders (UP-Caregiver), immediately or 6-weeks after receipt of psychoeducational materials. Results showed no between-condition differences in slopes of primary outcome measures; however, significant group differences in intercepts indicated that those receiving UP-Caregiver immediately had greater improvements in distress tolerance and intolerance of uncertainty than those in the delayed condition. Analyses also suggested within-condition improvements in emotional functioning and high satisfaction with UP-Caregiver. Results suggest that psychoeducation and symptom monitoring may be helpful to some distressed parents. Future investigations should utilize a larger sample to identify which parents might benefit the most from interventions like UP-Caregiver during crises.

WHO Participates in Effectiveness Research? A Comparison of Effectiveness Trial Clinicians to National Survey Samples.

Findings from research participants in effectiveness treatment trials (i.e., randomized control trials conducted in community rather than research settings) are considered more generalizable than those from participants in efficacy trials. This is especially true for clinician participants, whose characteristics like attitudes towards evidence-based practices (EBPs) may impact treatment implementation and the generalizability of research findings from effectiveness studies. This study compared background characteristics, attitudes toward EBPs, and attitudes towards measurement-based care (MBC) among clinicians participating in a National Institute of Mental-Health (NIMH) funded effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET), to clinician data from nationally representative U.S. survey samples. Results indicated COMET clinicians were significantly younger, less clinically experienced, and were more likely to have a training background in psychology versus other disciplines compared to national survey samples. After controlling for demographics and professional characteristics, COMET clinicians held more positive attitudes towards EBPs and MBC compared to national survey samples. Implications for implementation efforts are discussed.

Measuring clinician stuck points about trauma-focused cognitive behavior therapy: The TF-CBT Stuck Points Questionnaire.

Although evidence-based treatments (EBTs) for youth trauma have been developed, trauma-informed EBTs are rarely used in community settings. Clinician concerns about evidence-based trauma treatment may be a barrier to adoption and delivery. However, few instruments to assess clinician beliefs about specific EBTs, such as trauma-focused cognitive behavior therapy (TF-CBT) are available. This study evaluated an instrument of clinician concerns about TF-CBT, the TF-CBT Therapist Stuck Points questionnaire, in a sample of community mental health clinicians training in a year-long TF-CBT community-based learning collaborative. The 26 items in the instruments, which aim to assess clinician views on child trauma treatment and TF-CBT, indicate preliminary psychometric support (i.e., item-total correlations, internal consistency, negative correlations with measures of attitudes towards evidence-based practice). Scores on the TF-CBT Therapist Stuck Points questionnaire revealed that, on average, clinicians expressed concerns about having children talk about their trauma in session, the effectiveness of certain TF-CBT components, and whether to involve caregivers in treatment. Clinician doubts could be targeted during a TF-CBT implementation effort and clinical supervision to facilitate treatment delivery. Implications for assessing TF-CBT specific beliefs during implementation are discussed.

To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth.

Mental health organizations that serve youth are under pressure to adopt measurement-based care (MBC), defined as the continuous collection of client-report data used to support clinical decision-making as part of standard care. However, few frameworks exist to help leadership ascertain how to select an MBC approach for a clinical setting. This paper seeks to define how an MBC approach can display clinical utility to provide such a framework. Broadly, we define clinical utility as evidence that an MBC approach assists stakeholders in fulfilling clinical goals related to care quality (i.e., improve client-clinician alliance and clinical outcomes) at the client (i.e., youth and caregiver), clinician, supervisor, and administrator levels. More specifically, our definition of clinical utility is divided into two categories relevant to the usability and usefulness of an MBC approach for a specific setting: (a) implementability (i.e., evidence indicating ease of use in a clinical setting) and (b) usefulness in aiding clinical activities (i.e., evidence indicating the potential to improve communication and make clinical activities related to care quality easier or more effective). These categories provide valuable information about how easy an MBC approach is to use and the potential benefits that the MBC data will confer. To detail how we arrived at this definition, we review prior definitions of clinical utility, discuss how previous definitions inform our definition of clinical utility for MBC, and provide examples of how the concept of clinical utility can be applied to MBC. We finish with a discussion of future research directions.

shinyDLRs: A dashboard to facilitate derivation of diagnostic likelihood ratios.

Despite increased recognition of the importance of evidence-based assessment in clinical psychology, utilization of gold-standard practices remains low, including during diagnostic assessments. One avenue to streamline evidence-based diagnostic assessment is to increase the use of diagnostic likelihood ratios (DLRs), derived from receiver operating characteristic curve analyses. DLRs allow for the adjustment of the likelihood that an individual has a disorder based on self-report data (e.g., questionnaires, psychosocial, family history). Although DLRs provide strong and readily implementable psychometric data to guide diagnostic decision-making, analyses necessary to derive DLRs are not commonplace in psychological curriculum and available resources require familiarity with specialized statistical methodologies and software. We developed a free, researcher-oriented dashboard, shinyDLRs (https://dlrs.shinyapps.io/shinyDLRs/), to facilitate the derivation of DLRs. shinyDLRs allows researchers to carry out multiple analyses while providing descriptive interpretations of statistics derived from receiver operating characteristic curves. We present the utility of this interface as applied to several freely available measures of mood and anxiety for the purposes of guiding diagnosis of psychopathology. The sample leveraged to accomplish this goal included 576 youth, 4-19 years of age, and a parent informant, both of whom completed several questionnaires and semi-structured interviews prior to participating in treatment at a university-based research clinic. Lastly, we provide recommendations for inclusion of DLRs in future research investigating the psychometric properties and diagnostic utility of assessments. (PsycInfo Database Record (c) 2022 APA, all rights reserved).