Managers' Micro-Communities Matter: The Impact of Clinical Supervision Team on Therapist Perception of the Organization.

Positive organizational climate - employee perceptions of their work environment and the impact of this environment on well-being and functioning - is associated with desirable organizational and client-level outcomes in mental health organizations. Clinical supervisors are well-positioned to impact organizational climate, as they serve as intermediaries between higher-level administrators who drive the policies and procedures and the therapists impacted by such decisions. This cross-sectional study examined the role of clinical supervisors as drivers of therapist perceptions of organizational climate within supervisory teams. Specifically, the present study investigated: (1) shared perceptions of organizational climate among therapists on the same supervisory team; (2) predictors of therapist climate perceptions. Eighty-six therapists were supervised by 22 supervisors. Indices of interrater agreement and interrater reliability of therapists on the same supervisory team were examined to determine shared or distinct perceptions of organizational climate. Multi-level models were used to examine whether supervisor attitudes towards evidence-based practices and therapist perceptions of supervisor communication predicted perceived organizational climate. Results showed perceptions of organizational cohesion and autonomy were shared among therapists on the same supervisory team and distinct from therapists on different supervisory teams. Therapist perceptions of their supervisor's communication was positively associated with perceptions of organizational cohesion and autonomy. These findings align with emerging evidence that middle managers shape their employees' experience of their work environment through communication strategies. These findings also point to the potential for intervening at lower organizational levels to improve overall organizational climate.

Getting More Out of Clinical Documentation: Can Clinical Dashboards Yield Clinically Useful Information?

This study investigated coded data retrieved from clinical dashboards, which are decision-support tools that include a graphical display of clinical progress and clinical activities. Data were extracted from clinical dashboards representing 256 youth (M age = 11.9) from 128 practitioners who were trained in the Managing and Adapting Practice (MAP) system (Chorpita & Daleiden in BF Chorpita EL Daleiden 2014 Structuring the collaboration of science and service in pursuit of a shared vision. 43(2):323 338. 2014, Chorpita & Daleiden in BF Chorpita EL Daleiden 2018 Coordinated strategic action: Aspiring to wisdom in mental health service systems. 25(4):e12264. 2018) in 55 agencies across 5 regional mental health systems. Practitioners labeled up to 35 fields (i.e., descriptions of clinical activities), with the options of drawing from a controlled vocabulary or writing in a client-specific activity. Practitioners then noted when certain activities occurred during the episode of care. Fields from the extracted data were coded and reliability was assessed for Field Type, Practice Element Type, Target Area, and Audience (e.g., Caregiver Psychoeducation: Anxiety would be coded as Field Type = Practice Element; Practice Element Type = Psychoeducation; Target Area = Anxiety; Audience = Caregiver). Coders demonstrated moderate to almost perfect interrater reliability. On average, practitioners recorded two activities per session, and clients had 10 unique activities across all their sessions. Results from multilevel models showed that clinical activity characteristics and sessions accounted for the most variance in the occurrence, recurrence, and co-occurrence of clinical activities, with relatively less variance accounted for by practitioners, clients, and regional systems. Findings are consistent with patterns of practice reported in other studies and suggest that clinical dashboards may be a useful source of clinical information. More generally, the use of a controlled vocabulary for clinical activities appears to increase the retrievability and actionability of healthcare information and thus sets the stage for advancing the utility of clinical documentation.

Toward Efficient, Sustainable, and Scalable Methods of Treatment Characterization: An Investigation of Coding Clinical Practice from Chart Notes.

PURPOSE: Chart notes provide a low-cost data source that could help characterize what occurs in treatment with sufficient precision to improve management of care. This study assessed the interrater reliability of treatment content coded from chart notes and evaluated its concordance with content coded from transcribed treatment sessions. METHOD: Fifty randomly selected and digitally recorded treatment events were transcribed and coded for practice content. Independent coders then applied the same code system to chart notes for these same treatment events. ANALYSIS: We measured reliability and concordance of practice occurrence and extensiveness at two levels of specificity: practices (full procedures) and steps (subcomponents of those procedures). RESULTS: For chart notes, practices had moderate interrater reliability (M k = 0.50, M ICC = 0.56) and steps had moderate (M ICC = 0.74) to substantial interrater reliability (M k = 0.78). On average, 2.54 practices and 5.64 steps were coded per chart note and 4.53 practices and 13.10 steps per transcript. Across sources, ratings for 64% of practices and 41% of steps correlated significantly, with those with significant correlations generally demonstrating moderate concordance (practice M r = 0.48; step M r = 0.47). Forty one percent of practices and 34% of steps from transcripts were also identified in the corresponding chart notes. CONCLUSION: Chart notes provide an accessible data source for evaluating treatment content, with different levels of specificity posing tradeoffs for validity and reliability, which in turn may have implications for chart note interfaces, training, and new metrics to support accurate, reliable, and efficient measurement of clinical practice.

Future Directions in Youth and Family Treatment Engagement: Finishing the Bridge Between Science and Service.

The field has spent more than 50 years investing in the quality of youth mental healthcare, with intervention science yielding roughly 1,300 efficacious treatments. In the latter half of this period, concurrent efforts in implementation science have developed effective methods for supporting front-line service organizations and therapists to begin to bridge the science to service gap. However, many youths and families still do not benefit fully from these strategic investments due to low treatment engagement: nearly half of youths in need of services pursue them, and among those who do, roughly another half terminate prematurely. The negative impact of low engagement is substantial, and is disproportionally and inequitably so for many. We contend that to build a robust and "finished" bridge connecting science and service, the field must go beyond its two historical foci of designing interventions and preparing therapists to deliver them, to include an intentional focus on the youths and families who participate in these interventions and who work with those therapists. In this paper, we highlight the significance of treatment engagement in youth mental healthcare and discuss the current state of the literature related to four priorities: conceptualization, theory, measurement, and interventions. Next, we offer an example from our own program of research as one illustration for advancing these priorities. Finally, we propose recommendations to act on these priorities.

Race, racial matching, and cultural understanding as predictors of treatment engagement in youth mental health services.

OBJECTIVE: This study examined the role of youth race, youth-therapist racial matching, and youth-reported therapist cultural understanding on early treatment engagement in mental health services. METHOD: The sample included 1158 youths and 126 therapists. Approximately four weeks after the first therapy session, youths responded to a survey assessing five engagement dimensions. Cultural understanding was assessed by asking youths to rate within that questionnaire the extent their therapist "understands their culture and values." Three multivariate multiple regression models were conducted to assess the associations of race, racial matching, and cultural understanding with treatment engagement. RESULTS: Youth race and racial matching were not significant predictors of treatment engagement, whereas youth-reported therapist cultural understanding was a significant predictor of engagement. Cultural understanding had the highest average effect size across all treatment engagement dimensions (ηp2 = .36) compared with youth race (ηp2 = .00) and racial matching (ηp2 = .00). Race was examined as a moderator of the effects of racial matching and cultural understanding on treatment engagement and did not yield significant effect sizes. CONCLUSIONS: Findings suggest that increasing therapists' cultural understanding of their youth clients may be a promising strategy for engaging youths early in mental health services.

Predicting Therapists' Intentions to Use Innovations: Comparing the Role of Individual, Organizational, and Innovation Characteristics.

Theories emphasize the role of individual and organizational characteristics in implementation outcomes, yet research indicates that these characteristics account for only a small amount of variance in those outcomes. Innovation characteristics might be important proximal determinants of implementation outcomes but are infrequently examined in mental health services research. This study examined the relative variance explained by individual, organizational, and innovation characteristics on behavioral intentions, a central implementation outcome in implementation theories. Data were collected from 95 therapists and 28 supervisors who participated in a cluster randomized trial that tested the effectiveness of two clinical decision-making innovations. Multilevel models compared individual, organizational, and innovation characteristics as predictors of therapists' intentions to use the innovations. Subsequent mediational path analyses tested whether innovation characteristics mediated the effect of innovation type on intentions. Individual and organizational characteristics explained 29% of the variability in therapists' intentions. Approximately 75% of the variability in therapists' intentions was accounted for by innovation characteristics. Individual and organizational characteristics were not statistically significant predictors of intentions after controlling for innovation characteristics. The indirect effect of innovation type on intentions through therapists' beliefs was statistically significant (B = 0.410, 95% Bootstrapped CI = [0.071, 0.780]), but the direct effect of innovation type was not (B = 0.174, p = .365). Innovation characteristics are related to therapist intentions and might explain why some innovations are received more favorably than others. Future studies should explore the complex interrelationships between these beliefs alongside other individual or organizational characteristics.

A Multidimensional Examination of the Measurement of Treatment Engagement: Implications for Children's Mental Health Services and Research.

OBJECTIVE: The gap between rates of children's mental health problems and their participation in services highlights the need to address concerns related to engagement in mental health services more effectively. To identify, understand, and resolve engagement concerns appropriately requires effective measurement. In this study, we employed a multidimensional conceptual framework of engagement to examine the measurement of engagement in intervention studies focused on improving children's and/or families' engagement in services. METHOD: We coded 52 randomized controlled trials (RCTs) of interventions designed to enhance treatment engagement published between 1974 and 2019 to examine what engagement constructs have been measured, how these constructs have been measured, who has provided information about engagement, and when and why engagement measures have been administered. RESULTS: Attendance was measured in 94.2% of studies, and 59.6% of studies measured only attendance. Furthermore, most studies (61.5%) measured only one engagement dimension. One hundred twelve unique indicators of treatment engagement were used (61.6% measuring attendance). Infrequent measurement of youth (19.2% of studies) or caregiver (26.9%) perspectives was apparent. About half (54.7%) of measures were completed on one occasion, with 53.7% of measures completed after treatment was concluded. CONCLUSIONS: Results highlight how the field's measurement of engagement has focused narrowly on attendance and on interventions that improve attendance. We consider promising new directions for capturing the multidimensional, dynamic, and subjective aspects of engagement, and for leveraging measurement in research and practice settings to feasibly and effectively identify, monitor, and address engagement challenges.

A Systematic Review of Cultural Competence Trainings for Mental Health Providers.

We conducted a systematic review to characterize features and evaluate outcomes of cultural competence trainings delivered to mental health providers. We reviewed 37 training curricula described in 40 articles published between 1984-2019 and extracted information about curricular content (e.g., cultural identities), as well as training features (e.g., duration), methods (e.g., instructional strategies), and outcomes (i.e., attitudes, knowledge, skills). Training participants included graduate students and practicing professionals from a range of disciplines. Few studies (7.1%) employed a randomized-controlled trial design, instead favoring single-group (61.9%) or quasi-experimental (31.0%) designs. Many curricula focused on race/ethnicity (64.9%), followed by sexual orientation (45.9%) and general multicultural identity (43.2%). Few curricula included other cultural categorizations such as religion (16.2%), immigration status (13.5%), or socioeconomic status (13.5%). Most curricula included topics of sociocultural information (89.2%) and identity (78.4%), but fewer included topics such as discrimination and prejudice (54.1%). Lectures (89.2%) and discussions (86.5%) were common instructional strategies, whereas opportunities for application of material were less common (e.g., clinical experience: 16.2%; modeling: 13.5%). Cultural attitudes were the most frequently assessed training outcome (89.2%), followed by knowledge (81.1%) and skills (67.6%). To advance the science and practice of cultural competence trainings, we recommend that future studies include control groups, pre- and post-training assessment, and multiple methods for measuring multiple training outcomes. We also recommend consideration of cultural categories that are less frequently represented, how curricula might develop culturally competent providers beyond any single cultural category, and how best to leverage active learning strategies to maximize the impact of trainings.

Pilot Study of the MAP Curriculum for Psychotherapy Competencies in Child and Adolescent Psychiatry.

OBJECTIVE: This pilot study aimed to evaluate the relevance, feasibility, acceptability, and instructional efficacy of the Managing and Adapting Practice (MAP) curriculum for enhancing the teaching of psychotherapy to child and adolescent psychiatry (CAP) fellows. MAP is a system of resources and decision models that supports practitioners in selecting and implementing psychotherapeutic interventions for children and adolescents. The MAP curriculum includes modules to guide education about psychotherapeutic procedures (e.g., behavioral activation) common in evidence-based treatments for an array of childhood problems and to support development of competencies in assessment, treatment planning, and reflective practice. METHODS: Curriculum coding was used to examine the relevance of MAP's core components to the skills articulated in the Accreditation Council for Graduate Medical Education (ACGME) CAP milestones. Feasibility, acceptability, and learning outcomes were examined after delivery of the MAP curriculum to 12 CAP fellows at two sites, with instructional features tailored according to faculty preferences and training program structure. RESULTS: Coding suggested that the MAP curriculum was relevant to 95% of the 21 ACGME CAP training subcompetencies. Feasibility was indicated by the successful delivery of 100% of the planned MAP curriculum across the two sites. Acceptability was supported by positive feedback from the CAP fellows, and psychotherapy knowledge increased significantly. Finally, case review scores (mean±SD=2.21±0.15) showed positive posttraining application of MAP to two patients and exceeded scores achieved by other samples of mental health professionals. CONCLUSIONS: This pilot study demonstrated the potential for the MAP curriculum to support CAP education. MAP's versatility as a curriculum supports broader adoption, with continuing rigorous empirical evaluation.

How Do Treatment Protocols Affect the Use of Engagement Practices in Youth Mental Health Services?

PURPOSE: Treatment engagement poses challenges for youth mental health providers. With the expansion of evidence-based treatments (EBTs), providers face complex decisions regarding how to engage youth and families using available information sources. This study investigated how EBT protocols are associated with the selection and delivery of engagement practices. METHOD: Twenty engagement practices were coded in a sample of digital recordings of early treatment sessions (N = 193) from the Child STEPs in California study, a randomized trial testing modular treatment and community-implemented treatment for youth mental health problems. Data were collected on which protocols mental health providers reportedly used to guide their sessions and the protocols in which they had received training. We examined which information sources (i.e., the guiding protocol, other protocols in training history, unspecified source) were associated with observed engagement practices. RESULTS: In sessions guided by a protocol, most observed engagement practices were accounted for by the guiding protocol (p < .001), rather than protocols in training history or unspecified sources (p < .001). In sessions not guided by a protocol, most observed practices were accounted for by training history (p < .001). Practice frequency and extensiveness was generally greater when a protocol guided the session. CONCLUSIONS: Inclusion in protocols is associated with the selection and delivery of engagement practices, but this strategy might be insufficient for supporting the use of the full range of engagement practices supported by evidence. Supports are needed that leverage the engagement evidence base to ensure that selected practices empirically fit the engagement needs of youth and families.

Knowing What To Do and When To Do It: Mental Health Professionals and the Evidence Base for Treatment Engagement.

Most mental health professionals encounter challenges to helping youth and families enroll and participate in mental health services. The empirical literature suggests that most engagement strategies are well-suited for certain types of engagement challenges. In this mixed-methods study, we examined whether mental health professionals reported using any solutions from the evidence base and, if so, the extent to which these procedures fit the engagement challenges they encountered. We surveyed all 244 mental health professionals working in a large urban school district about their experiences engaging youth and families in services. We coded professionals' written responses to open-ended questions about the challenges they encountered engaging youth and families in services, along with solutions they used to address these challenges. Most reported engagement challenges (83.3%) had a corresponding solution in the evidence base. Most reported solutions (86.5%) were practices found in the evidence base, yet most practices from the evidence base were infrequently nominated by professionals. Moreover, only 38.5% of professionals reported at least one solution that fit at least one of their challenges. In general, professionals reported using a narrow subset of engagement strategies from the literature, which often did not fit the engagement problems encountered. These results highlight opportunities for developing and disseminating a framework that explicitly coordinates evidence-based solutions matched to specific engagement challenges to support provider selection and application of engagement procedures and ultimately enhance youth and family engagement in services.

Decision-Making in Mental Health Care: Measuring Provider and Supervisor Use of Evidence.

Use of evidence to inform clinical decisions has been shown to improve the quality and effectiveness of services. This study piloted an observational coding system for understanding providers and supervisors' use of evidence in their clinical decision-making. The Action Cycle and Use of Evidence Behavioral Observation Coding System (ACE-BOCS) is based on Graham et al. (Contin Educ Health Prof 26:13-24, 2006) conceptual framework for knowledge management, which articulates a sequence relevant to integrating evidence into decisions and actions, including identifying and selecting a problem and choosing, planning, and rehearsing a solution or action. Using the ACE-BOCS, two coders rated the extensiveness with which evidence was used to inform decisions made in clinical supervision sessions. In these clinical supervision sessions, supervisor-provider dyads discussed cases (N = 30; age range 8-19 years; 80% Latino/a or Hispanic ethnicity) that were identified as potentially being at risk for low treatment engagement in school mental health services. Results indicated that the ACE-BOCS can reliably and validly measure use of evidence and distinguish between strategic and indiscriminate use of evidence. The ACE-BOCS has value and utility for studying use of evidence, as it incorporates multiple actions related to service delivery and has the potential to be adapted for other aspects of mental healthcare decision-making beyond clinical supervision, as well as decision making within fields outside of mental health.

Common Elements of Childhood Universal Mental Health Programming.

Despite the availability of multiple mental health prevention and promotion programs for children, challenges related to their dissemination limit their reach and impact. This review identifies the most common practice elements of effective childhood universal mental health programming for children ages 3-11, based on a structured interpretation and coding of program manuals and descriptions in peer-reviewed articles. Across a range of program goals and targeted outcomes, psychoeducation and problem solving emerged as the most common practice elements, followed by social skills training, insight building, and communication skills. These skills were largely taught via role-plays and modeling. Synthesizing what we know from the universal mental health programming literature has potential to facilitate dissemination of information to inform the development, adaptation or adoption of programs for children.

The Core Components of Evidence-Based Social Emotional Learning Programs.

Implementing social emotional learning (SEL) programs in school settings is a promising approach to promote critical social and emotional competencies for all students. However, there are several challenges to implementing manualized SEL programs in schools, including program cost, competing demands, and content that is predetermined and cannot be tailored to individual classroom needs. Identifying core components of evidence-based SEL programs may make it possible to develop more feasible approaches to implementing SEL in schools. The purpose of this study was to systematically identify the core components in evidence-based elementary school SEL programs, using the five interrelated sets of competencies identified by the Collaborative for Academic, Social, and Emotional Learning (CASEL) as an organizing framework. We present the components that were identified, and the rates at which each component was included in the sample of evidence-based SEL programs. The core components that occurred most frequently across programs were Social Skills (100% of programs), Identifying Others' Feelings (100% of programs), Identifying One's Own Feelings (92.3% of programs), and Behavioral Coping Skills/Relaxation (91.7% of programs). These findings illustrate the feasibility of systematically identifying core components from evidence-based SEL programs and suggest potential utility of developing and evaluating modularized SEL programs.

Strengthening and Expanding Child Services in Low Resource Communities: The Role of Task-Shifting and Just-in-Time Training.

In the United States, the demand for child mental health services is increasing, while the supply is limited by workforce shortages. These shortages are unlikely to be corrected without significant structural changes in how mental health services are provided. One strategy for bridging this gap is task-shifting, defined as a process by which services that are typically delivered by professionals are moved to individuals with less extensive qualifications or training. Although task-shifting can increase the size of the workforce, there are challenges related to training new workers. In this paper, we propose Just-In-Time Training (JITT) as one strategy for improving task-shifting efforts. We define JITT as on-demand training experiences that only include what is necessary, when it is necessary, to promote competent service delivery. We offer a proof of concept from our own work shifting counseling and academic support tasks from school mental health professionals to pre-baccalaureate mentors, citing lessons learned during our iterative process of JITT development. We conclude with a series of key considerations for scaling up the pairing of task-shifting and JITT, including expanding the science of JITT and anticipating how task-shifting and JITT would work within the context of dynamic mental health service systems.

Managing and Adapting Practice: Provider Perceptions of an Evidence-Informed Framework for Delivering Mental Health Services.

This study examined providers' reflections on delivering managing and adapting practice (MAP), an evidence-informed framework that guides decision-making from scientific and client data. Consensual qualitative research methods were used to analyze the reflections of 201 youth mental health providers. Results indicated that providers approached MAP according to their own preferences and particular cases. While most appeared to approach MAP from a practice management standpoint, when faced with challenging cases, providers used coordination and outcomes management resources. Regardless of approach, most providers came to appreciate the full framework through reflective practice. Their diverse approaches offer lessons for evidence-based practice implementation and sustainment.

Forty Years of Engagement Research in Children's Mental Health Services: Multidimensional Measurement and Practice Elements.

Poor engagement in child and adolescent mental health services is a significant public health concern. The purpose of this study was to synthesize the engagement literature using a multidimensional measurement framework to identify practice elements that are associated with improved engagement. We examined 50 randomized controlled trials of interventions targeting treatment engagement in youth mental health services published between 1974 and 2016. We utilized a multidimensional measurement framework that includes five engagement domains (i.e., Relationship, Expectancy, Attendance, Clarity, Homework [REACH]). We also used a distillation method (Chorpita & Daleiden, 2009; Chorpita, Daleiden, & Weisz, 2005) to identify specific practices common to interventions that were effective at increasing engagement within each REACH domain. Engagement was most frequently operationalized in intervention studies as Attendance. Individual practices distilled from effective interventions were successful when used with participants with diverse characteristics in a wide variety of contexts. Importantly, we found unique practice patterns associated with outcomes from each REACH domain. Findings suggest that practices such as assessment, psychoeducation, accessibility promotion, barriers to treatment, and goal setting might be used with all youth and families to promote engagement and that other practices could be introduced on an as-needed basis to target specific engagement domains (e.g., modeling to promote Clarity about therapy; therapist monitoring to promote Homework/participation). A substantial evidence base demonstrates that engagement can be improved through specific interventions, and findings highlight opportunities to advance the field's understanding of engagement through multidimensional measurement in future studies.

Replicating Evidence-Based Practices with Flexibility for Perinatal Home Visiting by Paraprofessionals.

Introduction Strategies are needed to improve the efficacy of paraprofessional home visitors for pregnant women in the United States. This study evaluates the maternal and child outcomes when evidence-based practices (EBP) are replicated with flexibility, rather than fidelity to a manualized intervention. Methods Pregnant mothers (N = 203) in five clinics were recruited in the waiting rooms and randomized to standard clinic care as the control condition (n = 104) or standard care plus home visiting (n = 99). Home visitors (n = 9) were selected, trained in foundational skills common to EBP and four problem domains (weight control, breastfeeding, daily habits, and depression). Independent interviewers assessed targeted outcomes at birth (82%) and 6 months later (83%). RESULTS: Home visitors, called Mentor Mothers [MM], made an average of 14.9 home visits or telephone contacts (SD = 9; total contacts = 1491) addressing maternal daily habits, breastfeeding, and depression. Intervention and control mothers were similar in weight, Body Mass Index (BMI), depression and social support at baseline and 6 months later. The percentage of low birth weight babies was similar; intervention infants' growth (weight/height Z score) tended to be significantly better compared to the control condition. DISCUSSION: There are many explanations for the failure to find significant benefits: insufficient statistical power; the benefits of repeated assessments by warm, supportive peers to improve outcomes; or the failure of EBP and the need to maintain replication with fidelity. All study mothers had better outcomes than documented among comparable published samples of low-income, Latina and Korean-American mothers in Los Angeles, CA. ClinicalTrials.gov registration NCT01687634.

How Do School-Based Prevention Programs Impact Teachers? Findings from a Randomized Trial of an Integrated Classroom Management and Social-Emotional Program.

A number of classroom-based interventions have been developed to improve social and behavioral outcomes for students, yet few studies have examined how these programs impact the teachers who are implementing them. Impacts on teachers may affect students and therefore also serve as an important proximal outcome to examine. The current study draws upon data from a school-based randomized controlled trial testing the impact of two prevention programs. In one intervention condition, teachers were trained in the classroom behavior management program, PAX Good Behavior Game (PAX GBG). In a second intervention condition, teachers were trained to use an integrated program, referred to as PATHS to PAX, of the PAX GBG and a social and emotional learning curriculum called Promoting Alternative Thinking Strategies (PATHS©). This study aimed to determine whether both interventions positively impacted teachers, with a particular interest in the teachers' own beliefs and perceptions regarding self-efficacy, burnout, and social-emotional competence. The sample included 350 K-5 teachers across 27 schools (18 schools randomized to intervention, 9 to control). Multilevel latent growth curve analyses indicated that the PATHS to PAX condition generally demonstrated the most benefits to teachers, relative to both the control and PAX GBG conditions. These findings suggest that school-based preventive interventions can have a positive impact on teachers' beliefs and perceptions, particularly when the program includes a social-emotional component. Several possible mechanisms might account for the added benefit to teachers. Additional research is needed to better understand how these programs impact teachers, as well as students.