Patterns of Child Mental Health Service Utilization Within a Multiple EBP System of Care.

The current study (1) characterizes patterns of mental health service utilization over 8 years among youth who received psychotherapy in the context of a community implementation of multiple evidence-based practices (EBPs), and (2) examined youth-, provider- and service-level predictors of service use patterns. Latent profile analyses were performed on 5,663,930 administrative claims data furnished by the county department of mental health. Multinomial logistic regression with Vermunt's method was used to examine predictors of care patterns. Based on frequency, course, cost, and type of services, three distinct patterns of care were identified: (1) Standard EBP Care (86.3%), (2) Less EBP Care (8.5%), and (3) Repeated/Chronic Care (5.2%). Youth age, ethnicity, primary language, primary diagnosis and secondary diagnosis, provider language and provider type, and caregiver involvement and service setting were significant predictors of utilization patterns. Although the majority of youth received care aligned with common child EBP protocols, a significant portion of youth (13.7%) received no evidence-based care or repeated, costly episodes of care. Findings highlight opportunities to improve and optimize services, particularly for youth who are adolescents or transition-aged, Asian-American/Pacific Islander, Spanish-speaking, or presenting with comorbidities.

Examining How CBT Interventions for Anxious Youth Are Delivered Across Settings.

Most efforts to assess treatment integrity-the degree to which a treatment is delivered as intended-have conflated content (i.e., therapeutic interventions) and delivery (i.e., strategies for conveying the content, such as modeling). However, there may be value in measuring content and delivery separately. This study examined whether the quantity (how much) and quality (how well) of delivery strategies for individual cognitive behavioral therapy (ICBT) for youth anxiety varied when the same evidence-based treatment was implemented in research and community settings. Therapists (N = 29; 69.0% White; 13.8% male) provided ICBT to 68 youths (M age = 10.60 years, SD = 2.03; 82.4% white; 52.9% male) diagnosed with a principal anxiety disorder in research or community settings. Training and supervision protocols for therapists were comparable across settings. Two independent teams of trained coders rated 744 sessions using observational instruments designed to assess the quantity and quality of delivery of interventions found in ICBT approaches. Overall, both the quantity and quality of delivery of interventions found in ICBT approaches were significantly lower in the community settings. The extent to which didactic teaching, collaborative teaching, and rehearsal were used systematically varied over the course of treatment. In general, differences in the quantity and quality of delivery observed between settings held when differences in youth characteristics between settings were included in the model. Our findings suggest the potential relevance of measuring how therapists deliver treatment separate from the content.

Generalizability and Decision Studies of a Treatment Adherence Instrument.

Observational measurement of treatment adherence has long been considered the gold standard. However, little is known about either the generalizability of the scores from extant observational instruments or the sampling needed. We conducted generalizability (G) and decision (D) studies on two samples of recordings from two randomized controlled trials testing cognitive-behavioral therapy for youth anxiety in two different contexts: research versus community. Two doctoral students independently coded 543 session recordings from 52 patients treated by 13 therapists. The initial G-study demonstrated that context accounted for a disproportionately large share of variance, so we conducted G- and D-studies for the two contexts separately. Results suggested that reliable cognitive-behavioral therapy adherence studies require at least 10 sessions per patient, assuming 12 patients per therapists and two coders-a challenging threshold even in well-funded research. Implications, including the importance of evaluating alternatives to observational measurement, are discussed.

Proposing a Mechanistic Model of Clinician Training and Consultation.

To make evidence-based treatments deliverable, effective, and scalable in community settings, it is critical to develop a workforce that can deliver evidence-based treatments as designed with skill. However, the science and practice of clinician training and consultation lags behind other areas of implementation science. In this paper, we present the Longitudinal Education for Advancing Practice (LEAP) model designed to help span this gap. The LEAP model is a mechanistic model of clinician training and consultation that details how training inputs, training and consultation strategies, and mechanisms of learning influence training outcomes. We first describe the LEAP model and then discuss how key implications of the model can be used to develop effective training and consultation strategies.

Initial development of a treatment adherence measure for cognitive-behavioral therapy for child anxiety.

The measurement of treatment adherence (a component of treatment integrity defined as the extent to which a treatment is delivered as intended) is a critical element in treatment evaluation research. This article presents initial psychometric data for scores on the Cognitive-Behavioral Therapy Adherence Scale for Youth Anxiety (CBAY-A), an observational measure designed to be sensitive to common practice elements found in individual cognitive-behavioral therapy (ICBT) for youth anxiety. Therapy sessions (N = 954) from 1 efficacy and 1 effectiveness study of ICBT for youth anxiety were independently rated by 2 coders. Interrater reliability (as gauged by intraclass correlation coefficients) for the item scores averaged 0.77 (SD = 0.15; range .48 to .80). The CBAY-A item and scale (skills, model, total) scores demonstrated evidence of convergent and discriminant validity with an observational measure of therapeutic interventions and an observational measure of the alliance. The CBAY-A item and scale scores also discriminated between therapists delivering ICBT in research and practice settings and therapists delivering nonmanualized usual clinical care. We discuss the importance of replicating these psychometric findings in different samples and highlight possible application of an adherence measure in testing integrity-outcome relations.

Acting Locally and Globally: Dissemination and Implementation Around the World and Next Door.

Murray et al. (this issue) present a fascinating account of their international dissemination and implementation (D&I) research focused on training therapists in Thailand and Iraq to provide a modular treatment approach called Common Elements Treatment Approach to youth. In this commentary, we use Murray et al. as a springboard to discuss a few general conclusions about the current direction of D&I research. Specifically, we reflect on current D&I models, highlighting their ecological focus and their emphasis on stakeholder involvement. Next, we discuss the central importance of implementation supports such as treatment programs, training approaches, assessment and outcome monitoring tools, and organizational interventions. We conclude with a consideration of how D&I work that aims to adapt implementation supports for local needs represent a key path to our goal of sustainability.

Child welfare training in child psychiatry residency: a program director survey.

OBJECTIVE: This study surveys child psychiatry residency program directors in order to 1) characterize child welfare training experiences for child psychiatry residents; 2) evaluate factors associated with the likelihood of program directors' endorsing the adequacy of their child welfare training; and 3) assess program directors' familiarity with some existing child welfare training and information resources. METHOD: Program directors of American College of Graduate Medical Education (ACGME)-accredited child psychiatry residency programs were surveyed anonymously. Participants characterized their program's child welfare training curriculum and indicated their awareness of selected child welfare information and training resources. RESULTS: In all, 68% of program directors responded; 90% of respondents indicated that their residents encounter child welfare-involved youth very frequently or frequently. Just over half of the respondents reported inadequate training materials, and half were aware of at least one of the three queried child welfare information resources. However, nearly 40% of respondents who were familiar with the queried child welfare resources still reported having inadequate training materials. Respondents with adequate training materials were more likely to classify their program as devoting enough time to child welfare training. Respondents at sites that spent less than 5 hours on non-didactic child welfare training during residency were more likely to indicate that not enough time was spent on training. CONCLUSION: The findings of this study suggest that increasing child psychiatry program director awareness of existing child welfare information resources and providing 6-or-more hours of non-didactic child welfare training, two feasible and relatively low resource actions, may improve child welfare training in child psychiatry residencies.