School Mental Health Professionals' Knowledge of Stereotypes and Implicit Bias Toward Black and Latinx Youths.

Clinician bias is a contributor to health care inequities, but research on racial-ethnic bias among mental health professionals, especially toward minoritized youths, is limited. This column describes two studies involving mental health clinicians in schools, where most youths access mental health services. Study 1 used a mixed-methods approach to identify stereotypes about Black and Latinx youths salient to clinicians (e.g., academic failure; anger and aggression). In study 2, the authors developed four Implicit Association Tests to assess clinicians' implicit prejudice and stereotyping of Black and Latinx youths and found pro-White and anti-Black/Latinx bias at levels similar to those of other health care providers and the general population.

A Brief Online Implicit Bias Intervention for School Mental Health Clinicians.

Clinician bias has been identified as a potential contributor to persistent healthcare disparities across many medical specialties and service settings. Few studies have examined strategies to reduce clinician bias, especially in mental healthcare, despite decades of research evidencing service and outcome disparities in adult and pediatric populations. This manuscript describes an intervention development study and a pilot feasibility trial of the Virtual Implicit Bias Reduction and Neutralization Training (VIBRANT) for mental health clinicians in schools-where most youth in the U.S. access mental healthcare. Clinicians (N = 12) in the feasibility study-a non-randomized open trial-rated VIBRANT as highly usable, appropriate, acceptable, and feasible for their school-based practice. Preliminarily, clinicians appeared to demonstrate improvements in implicit bias knowledge, use of bias-management strategies, and implicit biases (as measured by the Implicit Association Test [IAT]) post-training. Moreover, putative mediators (e.g., clinicians' VIBRANT strategies use, IAT D scores) and outcome variables (e.g., clinician-rated quality of rapport) generally demonstrated correlations in the expected directions. These pilot results suggest that brief and highly scalable online interventions such as VIBRANT are feasible and promising for addressing implicit bias among healthcare providers (e.g., mental health clinicians) and can have potential downstream impacts on minoritized youth's care experience.

A systematic review of empirical studies examining mechanisms of implementation in health.

BACKGROUND: Understanding the mechanisms of implementation strategies (i.e., the processes by which strategies produce desired effects) is important for research to understand why a strategy did or did not achieve its intended effect, and it is important for practice to ensure strategies are designed and selected to directly target determinants or barriers. This study is a systematic review to characterize how mechanisms are conceptualized and measured, how they are studied and evaluated, and how much evidence exists for specific mechanisms. METHODS: We systematically searched PubMed and CINAHL Plus for implementation studies published between January 1990 and August 2018 that included the terms "mechanism," "mediator," or "moderator." Two authors independently reviewed title and abstracts and then full texts for fit with our inclusion criteria of empirical studies of implementation in health care contexts. Authors extracted data regarding general study information, methods, results, and study design and mechanisms-specific information. Authors used the Mixed Methods Appraisal Tool to assess study quality. RESULTS: Search strategies produced 2277 articles, of which 183 were included for full text review. From these we included for data extraction 39 articles plus an additional seven articles were hand-entered from only other review of implementation mechanisms (total = 46 included articles). Most included studies employed quantitative methods (73.9%), while 10.9% were qualitative and 15.2% were mixed methods. Nine unique versions of models testing mechanisms emerged. Fifty-three percent of the studies met half or fewer of the quality indicators. The majority of studies (84.8%) only met three or fewer of the seven criteria stipulated for establishing mechanisms. CONCLUSIONS: Researchers have undertaken a multitude of approaches to pursue mechanistic implementation research, but our review revealed substantive conceptual, methodological, and measurement issues that must be addressed in order to advance this critical research agenda. To move the field forward, there is need for greater precision to achieve conceptual clarity, attempts to generate testable hypotheses about how and why variables are related, and use of concrete behavioral indicators of proximal outcomes in the case of quantitative research and more directed inquiry in the case of qualitative research.

Designing the Future of Children's Mental Health Services.

Advancements in evidence-based psychosocial interventions, digital technologies, and implementation strategies (i.e., health services research products) for youth mental health services have yet to yield significant improvement in public health outcomes. Achieving such impact will require that these research products are easy to use, useful, and contextually appropriate. This paper describes how human-centered design (HCD), an approach that aligns product development with the needs of the people and settings that use those products, can be leveraged to improve youth mental health services. We articulate how HCD can advance accessibility, effectiveness, and equity, with specific consideration of unique aspects of youth mental health services.

The role of the outer setting in implementation: associations between state demographic, fiscal, and policy factors and use of evidence-based treatments in mental healthcare.

BACKGROUND: Despite consistent recognition of their influence, empirical study of how outer setting factors (e.g., policies, financing, stakeholder relationships) influence public systems' investment in and adoption of evidence-based treatment (EBT) is limited. This study examined associations among unmodifiable (e.g., demographic, economic, political, structural factors) and modifiable (e.g., allocation of resources, social processes, policies, and regulations) outer setting factors and adoption of behavioral health EBT by US states. METHODS: Multilevel models examined relationships between state characteristics, an array of funding and policy variables, and state adoption of behavioral health EBTs for adults and children across years 2002-2012, using data from the National Association for State Mental Health Program Directors Research Institute and other sources. RESULTS: Several unmodifiable state factors, including per capita income, controlling political party, and Medicaid expansion, predicted level of state fiscal investments in EBT. By contrast, modifiable factors, such as interagency collaboration and investment in research centers, were more predictive of state policies supportive of EBT. Interestingly, level of adult EBT adoption was associated with state fiscal supports for EBT, while child EBT adoption was predicted more by supportive policies. State per capita debt and direct state operation of services (versus contracting for services) predicted both child and adult EBT adoption. CONCLUSIONS: State-level EBT adoption and associated implementation support is associated with an interpretable array of policy, financing, and oversight factors. Such information expands our knowledge base of the role of the outer setting in implementation and may provide insight into how best to focus efforts to promote EBT for behavioral health disorders.

Mind the Gap: Considering Disparities in Implementing Measurement-Based Care.

Synergistic advancements in evidence-based practice, implementation science, health care policy, and health information technology (HIT) have led to increasing efforts to broadly implement measurement-based care (MBC)-the systematic use of repeated outcome measures to monitor treatment progress and support clinical decision making1-in psychiatric services. Much of this work has been done with adult populations, and more efforts are needed for MBC to gain traction in child and adolescent psychiatry. In this Letter to the Editor, we describe a quality improvement (QI) project that leveraged HIT to implement MBC in the child and adolescent psychiatry department of a regional pediatric tertiary-care center and report long-term (5-year) implementation outcomes (ie, adoption and penetration). Although a myriad of implementation strategies was used, here we focus on the most complex strategy-integrating a digital measurement-feedback system (MFS) into standard workflow. Then, we discuss pitfalls and lessons learned with special attention to potential unintended effects of QI efforts on existing health disparities.

Reliability, Validity, and Factor Structure of the Current Assessment Practice Evaluation-Revised (CAPER) in a National Sample.

Measurement-based care (MBC) is an increasingly popular, evidence-based practice, but there are no tools with established psychometrics to evaluate clinician use of MBC practices in mental health service delivery. The current study evaluated the reliability, validity, and factor structure of scores generated from a brief, standardized tool to measure MBC practices, the Current Assessment Practice Evaluation-Revised (CAPER). Survey data from a national sample of 479 mental health clinicians were used to conduct exploratory and confirmatory factor analyses, as well as reliability and validity analyses (e.g., relationships between CAPER subscales and clinician MBC attitudes). Analyses revealed competing two- and three-factor models. Regardless of the model used, scores from CAPER subscales demonstrated good reliability and convergent and divergent validity with MBC attitudes in the expected directions. The CAPER appears to be a psychometrically sound tool for assessing clinician MBC practices. Future directions for development and application of the tool are discussed.

Enhanced "Train and Hope" for Scalable, Cost-Effective Professional Development in Youth Suicide Prevention.

BACKGROUND: The knowledge base surrounding how to most effectively prepare and sustain practitioner knowledge and skills for suicide risk assessment and management is limited. AIMS: This study examined the impact of a 6-hr continuing education training, and the effect of a posttraining reminder system, on mental health practitioners' knowledge, attitudes, and behavior surrounding suicide assessment and intervention. METHOD: Data were obtained prior to the training, immediately after the training, and at the 3-month follow-up. Medical record data were abstracted for a subsample of practitioners. Participants were randomly assigned to an e-mail reminder condition or no reminder condition that provided information related to the training. RESULTS: All practitioners demonstrated increase s in suicide assessment knowledge and attitudes for engaging in suicide risk assessments from pre- to posttest, and gains were maintained at the 3-month follow-up. There was no effect of the e-mail reminder on practitioner knowledge, attitudes, or behaviors compared with the condition without the e-mail reminder. The use of e-mail reminders was not associated with any additional changes. LIMITATIONS: Limitations include predominantly self-report and small sample. CONCLUSION: Strategies to effectively change practitioner knowledge, attitudes, and behaviors toward suicidal clients may include continuing education. Efficient and effective designs of reminder systems for augmenting and supporting suicide assessment management training are needed.

Implementing the teen marijuana check-up in schools-a study protocol.

BACKGROUND: Substance misuse is now encountered in settings beyond addiction specialty care, with schools a point-of-contact for student access to behavioral health services. Marijuana is a leading impetus for adolescent treatment admissions despite declining risk perception, for which the Teen Marijuana Check-Up (TMCU)-a tailored adaptation of motivational enhancement therapy-offers an efficacious service option. To bridge the knowledge gap concerning effective and affordable technical assistance strategies for implementing empirically supported services, the described trial will test such a strategy to facilitate school-based TMCU implementation. METHODS: A type II effectiveness/implementation hybrid trial will test a novel strategy for a TMCU purveyor to provide technical assistance on an 'as-needed' basis when triggered by a fidelity drift alarm bell, compared to resource-intensive 'gold-standard' technical assistance procedures of prior efficacy trials. Trial procedures adhere to the EPIS framework as follows: (1) initial mixed-method exploration of the involved school contexts and identification of TMCU interventionist candidates in elicitation interviews; (2) interventionist preparation via a formally evaluated training process involving a two-day workshop and sequence of three training cases; (3) post-training implementation for 24 months for which trained interventionists are randomized to 'as-needed' or 'gold-standard' technical assistance and self-referring students randomized (in 2:1 ratio) to TMCU or waitlist/control; and (4) examination of TMCU sustainment via interventionist completion of biannual outcome assessments, cost analyses, and exit interviews. Hypothesized effects include non-differential influence of the competing technical assistance methods on both TMCU fidelity and intervention effectiveness, with lesser school costs for the 'as-needed' than 'gold-standard' technical assistance and greater reduction in the frequency of marijuana use expected among TMCU-exposed students relative to those assigned to waitlist/control. DISCUSSION: This trial-occurring in Washington state as legislative, fiscal, and sociocultural forces converge to heighten exposure of American adolescents to marijuana-related harms-is set to advance understanding of best implementation practices for this and other efficacious, school-based interventions through examination of a data-driven technical assistance method. If shown to be clinically useful and affordable, the concept of a fidelity drift alarm could be readily translated to other empirically supported services and in other health settings. TRIAL REGISTRATION: ClinicalTrials.gov NCT03111667 registered 7 April 2017.

Intentional research design in implementation science: implications for the use of nomothetic and idiographic assessment.

The advancement of implementation science is dependent on identifying assessment strategies that can address implementation and clinical outcome variables in ways that are valid, relevant to stakeholders, and scalable. This paper presents a measurement agenda for implementation science that integrates the previously disparate assessment traditions of idiographic and nomothetic approaches. Although idiographic and nomothetic approaches are both used in implementation science, a review of the literature on this topic suggests that their selection can be indiscriminate, driven by convenience, and not explicitly tied to research study design. As a result, they are not typically combined deliberately or effectively. Thoughtful integration may simultaneously enhance both the rigor and relevance of assessments across multiple levels within health service systems. Background on nomothetic and idiographic assessment is provided as well as their potential to support research in implementation science. Drawing from an existing framework, seven structures (of various sequencing and weighting options) and five functions (Convergence, Complementarity, Expansion, Development, Sampling) for integrating conceptually distinct research methods are articulated as they apply to the deliberate, design-driven integration of nomothetic and idiographic assessment approaches. Specific examples and practical guidance are provided to inform research consistent with this framework. Selection and integration of idiographic and nomothetic assessments for implementation science research designs can be improved. The current paper argues for the deliberate application of a clear framework to improve the rigor and relevance of contemporary assessment strategies.

The Consistencies and Vagaries of the Washington State Inventory of Evidence-Based Practice: The Definition of "Evidence-Based" in a Policy Context.

As states increasingly establish the importance of evidence-based practice through policy and funding mandates, the definition of evidence-based practice can have a significant impact on investment decisions. Not meeting established criteria can mean a loss of funding for established programs and the implementation disruption of programs without a strong research base. Whether the definition of "evidence-based" is influenced by these high stakes contexts is an interesting question that can inform the larger field about the value and utility of evidence-based practice lists/inventories for disseminating knowledge. In this paper we review the development of the Washington State Inventory of Evidence-Based, Research-Based and Promising Practices as a case study for the process of defining evidence-based practice in a policy context. As part of this study we also present a comparison of other well-known evidence-based practice inventories and examine consistencies and differences in the process of identifying and developing program ratings.

Community Engagement Strategies for Implementation of a Policy Supporting Evidence-Based Practices: A Case Study of Washington State.

After nearly two decades of cultivating an evidence based practice milieu in Washington State, the 2012 legislature passed House Bill 2536 (HB 2536) to promote the increased uptake and use of evidence based practices in the child welfare, juvenile justice and child behavioral health systems. The current paper examines stakeholder participation and engagement in HB 2536 during the first year of its implementation. The current paper describes the community response, influence, and engagement during the drafting of the bill language. It then describes initial policy implementation and community engagement efforts within a framework of implementation strategies (Powell et al. in Medical Care Research and Review 69:123-57, 2012). Analysis includes common concerns, statements of support, and suggestions from diverse stakeholder groups. Discussion reviews the lessons learned and future directions, including opportunities for additional collaborations with community stakeholders in the subsequent years of HB 2536 implementation.

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children's Mental Health Initiative.

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess "analogue fidelity" in a children's mental health quality improvement initiative. Results indicated low-but representative-clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

Community-Sourced Intervention Programs: Review of Submissions in Response to a Statewide Call for "Promising Practices".

This study was initiated to add to the nascent literature on locally-grown intervention programs in the youth mental health, child welfare, and juvenile justice service sectors, many of which demonstrate practice-based or community-defined evidence, but may not have been subjected to empirical evaluation. Characteristics of applications submitted in response to three public calls for additions to an inventory of research-supported intervention programs were reviewed on evidence for effectiveness, the use of key quality assurance (QA) elements (e.g., clearly specified training or integrity monitoring procedures), and cultural specificity. Findings indicate that four QA processes were identified in approximately half of all submissions: a specific initial training process, the existence of intervention integrity measures, routine outcome monitoring, and ongoing support post-training. An initial training process and integrity measurement were more commonly described among programs determined to have greater research evidence for their effectiveness. Overall, cultural elements were described relatively infrequently and most often reflected surface-level program delivery characteristics (e.g., offering services in languages other than English). Discussion is focused on the alignment of submitted programs with the larger literatures focused on implementation science and cultural competence.

Advancing Evidence-Based Assessment in School Mental Health: Key Priorities for an Applied Research Agenda.

Evidence-based assessment (EBA) is a critically important aspect of delivering high-quality, school-based mental health care for youth. However, research in this area is limited and additional applied research on how best to support the implementation of EBA in school mental health (SMH) is needed. Accordingly, this manuscript seeks to facilitate the advancement of research on EBA in SMH by reviewing relevant literature on EBA implementation in schools and providing recommendations for key research priorities. Given the limited number of published studies available, findings from child and adolescent mental health and implementation science research are also included to inform a robust and comprehensive research agenda on this topic. Based on this literature review, five priorities for research on EBA in SMH are outlined: (1) effective identification of assessment targets, (2) appropriate selection of assessment measures, (3) investigation of organizational readiness for EBA, (4) study of implementation support for EBA, and (5) promotion of EBA data integration and use. Each priority area includes recommended directions for future research. A comprehensive and robust research agenda is warranted to build the science and practice of implementing EBA in SMH. Specific directions for this agenda are offered.

Student Perceptions of the Acceptability and Utility of Standardized and Idiographic Assessment in School Mental Health.

Evidence-based assessment (EBA) comprises the use of research and theory to select methods and processes that have demonstrated reliability, validity, and clinical usefulness for prescribed populations. EBA can lead to positive clinical change, and recent work has suggested that it is perceived to be useful by school mental health providers. However, virtually nothing is known about student perceptions of assessment use. Semi-structured interviews were conducted with 31 ethnically diverse middle and high school students (71% female) receiving mental health services in school-based health centers. Findings indicated that the majority of students found assessments to be useful, and perceived three primary functions of assessments: structuring the therapy session, increasing students' self-awareness, and improving communication with the provider. Barriers to acceptability were also found for a minority of respondents. Some students found the nature of standardized assessments to be confining, and others expressed that they wanted more feedback from their counselors about their responses. Idiographic assessments demonstrated especially high acceptability in this sample, with students reporting that tracking idiographic outcomes increased self-awareness, spurred problem-solving, and helped them to reach behavioral goals. Implications for school mental health service improvements are discussed.

Modeling the Impact of School-Based Universal Depression Screening on Additional Service Capacity Needs: A System Dynamics Approach.

Although it is widely known that the occurrence of depression increases over the course of adolescence, symptoms of mood disorders frequently go undetected. While schools are viable settings for conducting universal screening to systematically identify students in need of services for common health conditions, particularly those that adversely affect school performance, few school districts routinely screen their students for depression. Among the most commonly referenced barriers are concerns that the number of students identified may exceed schools' service delivery capacities, but few studies have evaluated this concern systematically. System dynamics (SD) modeling may prove a useful approach for answering questions of this sort. The goal of the current paper is therefore to demonstrate how SD modeling can be applied to inform implementation decisions in communities. In our demonstration, we used SD modeling to estimate the additional service demand generated by universal depression screening in a typical high school. We then simulated the effects of implementing "compensatory approaches" designed to address anticipated increases in service need through (1) the allocation of additional staff time and (2) improvements in the effectiveness of mental health interventions. Results support the ability of screening to facilitate more rapid entry into services and suggest that improving the effectiveness of mental health services for students with depression via the implementation of an evidence-based treatment protocol may have a limited impact on overall recovery rates and service availability. In our example, the SD approach proved useful in informing systems' decision-making about the adoption of a new school mental health service.

Determinants and Functions of Standardized Assessment Use Among School Mental Health Clinicians: A Mixed Methods Evaluation.

The current study evaluated why and how school mental health clinicians use standardized assessment tools in their work with youth and families. Quantitative and qualitative (focus group) data were collected prior to and following a training and consultation sequence as part of a trial program to assess school clinician's (n = 15) experiences administering standardized tools to youth on their caseloads (n = 191). Findings indicated that, although assessment use was initially somewhat low, clinicians used measures to conduct initial assessments with the bulk of their caseloads (average = 62.2%) during the implementation period. Clinicians also reported on factors influencing their use of assessments at the client, provider, and system levels; perceived functions of assessment; student responses to assessment use; and use of additional sources of clinically-relevant information (primarily educational data) for the purposes of assessment and progress monitoring. Implications for the contextual appropriateness of standardized assessment and training in assessment tools are discussed.

Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination.

Health information technology (HIT) and care coordination for individuals with complex needs are high priorities for quality improvement in health care. However, there is little empirical guidance about how best to design electronic health record systems and related technologies to facilitate implementation of care coordination models in behavioral health, or how best to apply user input to the design and testing process. In this paper, we describe an iterative development process that incorporated user/stakeholder perspectives at multiple points and resulted in an electronic behavioral health information system (EBHIS) specific to the wraparound care coordination model for youth with serious emotional and behavioral disorders. First, we review foundational HIT research on how EBHIS can enhance efficiency and outcomes of wraparound that was used to inform development. After describing the rationale for and functions of a prototype EBHIS for wraparound, we describe methods and results for a series of six small studies that informed system development across four phases of effort-predevelopment, development, initial user testing, and commercialization-and discuss how these results informed system design and refinement. Finally, we present next steps, challenges to dissemination, and guidance for others aiming to develop specialized behavioral health HIT. The research team's experiences reinforce the opportunity presented by EBHIS to improve care coordination for populations with complex needs, while also pointing to a litany of barriers and challenges to be overcome to implement such technologies.