Assessment of Adoption and Early Implementation Barriers and Facilitators of the Safe Environment for Every Kid (SEEK) Model.

OBJECTIVE: Although the use of interventions for screening for social determinants of health of families in pediatric primary care clinics has increased in the past decade, research on the barriers and facilitators of implementing such interventions has been limited. We explored barriers, facilitators, and the mechanisms clarifying their roles in the adoption and implementation of the Safe Environment for Every Kid (SEEK) model, an approach for strengthening families, promoting children's health and development, and preventing child maltreatment. METHODS: A total of 28 semistructured interviews were completed with 9 practice champions, 11 primary care professionals, 5 behavioral health professionals, and 3 nursing/administrative staff representing 12 pediatric primary care practices participating in a larger randomized control trial of implementing SEEK. RESULTS: We identified several barriers and facilitators in the stages of SEEK's adoption and early implementation. Barriers associated with outer and inner setting determinants and poor innovation-organization fit declined in importance over time, while facilitators associated with SEEK characteristics increased in importance based on participants' responses. Barriers and facilitators were linked by mechanisms of comparison and contrast of burdens and benefits, and problem-solving to address limited capacity with available resources. CONCLUSIONS: Any screening for and addressing social determinants of health demands greater attention to adoption and implementation mechanisms and the processes by which primary care professionals assess and utilize facilitators to address barriers. This occurs in a context defined by perceived burdens and benefits of innovation adoption and implementation, the capacity of the practice, and changes in perception with experiencing the innovation.

The influence of evidence-based program registry websites for dissemination of evidence-based interventions in behavioral healthcare.

PURPOSE: Evidence-based program registries (EBPRs) are web-based databases of evaluation studies that summarize the available evidence for the effectiveness of behavioral healthcare programs, including programs addressing substance misuse, mental health, child welfare, or offender rehabilitation. The study determined the extent to which visitors to selected EBPRs accomplished the objectives of their visits and how often those visits resulted in the adoption of new or improved evidence-based interventions (EBIs). METHOD: A follow-up telephone survey was conducted with 216 visitors to a convenience sample of six EBPRs an average of six months after the visitors' incident visit to the EBPR. RESULTS: The most frequent objective was to identify evidence-based programs/services, curricula or assessments, followed by finding resources to implement or improve the preceding and writing a grant proposal including to comply with funding requirements; 71% of such objectives were achieved across the full set of objectives. Implementation of an EBI was completely achieved for 31% of relevant objectives and some progress on EBI implementation occurred for 19% of relevant objectives. CONCLUSIONS: This is the first study to document the usage of EBPRs as a modality to increase the utilization of EBIs in the actual practice of behavioral healthcare. The results support the continued use of web-based EBPRs for disseminating information on evidence-based interventions for behavioral healthcare.

A Scoping Review of the Influence of Evidence-Based Program Resources (EBPR) Websites for Behavioral Health.

Evidence-based program resources (EBPR) websites evaluate behavioral health programs, practices or policies (i.e., interventions) according to a predetermined set of research criteria and standards, usually resulting in a summary rating of the strength of an intervention's evidence base. This study is a mixed-methods analysis of the peer-reviewed academic literature relating to the influence of EBPRs on clinical practice and policy in the behavioral health field. Using an existing framework for a scoping review, we searched for research articles in PubMed, Web of Science, SCOPUS, and ProQuest that were published between January 2002 and March 2022, referenced an EBPR or multiple EBPRs, and presented data showing the influence of one or more EBPRs on behavioral health. A total of 210 articles met the inclusion criteria and were classified into five distinct categories of influence, the most important of which was showing the direct impact of one or more EBPRs on behavioral health (8.1% of articles), defined as documenting observable changes in interventions or organizations that are at least partly due to information obtained from EBPR(s). These included impacts at the state legislative and policy-making level, at the community intervention level, provider agency level, and individual practitioner level. The majority of influences identified in the study were indirect demonstrations of how EBPRs are used in various ways. However, more studies are needed to learn about the direct impact of information from EBPRs on the behavioral health field, including impact on clinician practice and treatment outcomes for consumers.

Visitors' Assessment and Utilization of Evidence-Based Program Resources (EBPR) Websites.

Background: Evidence-based program resources (EBPR) websites for behavioral health are a potentially useful tool to assist decision-makers and practitioners in deciding which behavioral health interventions to implement. EBPR websites apply rigorous research standards to assess the effectiveness of behavioral healthcare programs, models, and clinical practices. Method: Visitors to a convenience sample of six EBPR websites (N=369, excluding students) were recruited for telephone interviews primarily by means of a pop-up invitation on the sites. Results: The visitors view the EBPR sites as important sources of information to support the identification and adoption of evidence-based programs/practices (EBPs) in behavioral healthcare, which aligns with the primary mission of EBPRs. For repeat visitors, there was some indication that the information obtained helped effect certain changes in their agencies' programs and policies. However, increased or improved guidance on EBP implementation was also requested. Conclusion: EBPR websites should be better publicized to the behavioral healthcare field.

State Department and Provider Agency Utilization of Evidence-Based Program Registries in Behavioral Healthcare and Child Welfare.

Evidence-based program registries (EBPRs) are web-based compilations of behavioral healthcare programs/interventions that rely on research-based criteria to rate program efficacy or effectiveness for support of programmatic decision-making. The objective was to determine the extent to which behavioral health decision-makers access EBPRs and to understand whether and exactly how they use the information obtained from EPBRs. Single State Authorities (SSAs) and service provider agencies in the areas of behavioral health and child welfare were recruited nationally. Senior staff (n = 375) responsible for the selection and implementation of programs and/or policies were interviewed by telephone concerning their visits (if any) to 28 relevant EBPRs, the types of information they were seeking, whether they found it, and how they may have used that information to effect changes in their organizations. At least one EBPR was visited by 80% of the respondents, with a median of three different registers being visited. Most visitors (55%) found all the information they were seeking; those who did not desired more guidance or tools for individual program implementation or were unable to locate the program or practice that they were seeking. Most visitors (65%) related using the information obtained to make changes in their organizations, in particular to select, start or change a program, or to support the adoption or improvement of evidence-based clinical practices. EBPRs were shown to be important resources for dissemination of research-based program effectiveness data, leading to increased use of evidence-based practices in the field, but the study also identified needs for greater awareness of EBPRs generally and for more attention to implementation of specific recommended programs and practices.

Adaptation to family-based treatment for Medicaid-insured youth with anorexia nervosa in publicly-funded settings: Protocol for a mixed methods implementation scale-out pilot study.

BACKGROUND: Family-based treatment (FBT) for anorexia nervosa is an evidence-based treatment, but its effectiveness is untested among socioeconomically disadvantaged and racially diverse youth. Adapting FBT may facilitate "scale-out" for Medicaid-insured youth served in publicly-funded settings and potentially improve outcomes for more diverse populations. METHODS: This mixed methods effectiveness-implementation Hybrid Type 3 pilot study protocol included a planning period in collaboration with the San Francisco Department of Public Health, culminating in a two-day in-person FBT training for 25 therapists in the county, followed by the opportunity to engage in one year of weekly supervision. The training incorporated FBT adaptations intended to improve fit for low-income families within community-based settings. Treatment appropriateness and acceptability will be measured immediately post-training. Following the training, cases referred for FBT will only be assigned to the trained clinicians who voluntarily opted into long-term group supervision. Clinicians treating at least one FBT case during the supervision period will report on implementation, adaptations, and patient weight gain. Finally, semi-structured interviews with clinician participants will be conducted, focused on implementation challenges and facilitators, local treatment adaptations, and overall satisfaction with FBT. DISCUSSION: Learning about clinician adaptations will advance knowledge about treatment of eating disorders in publicly-funded community clinics, which serve a racially/ethnically and socioeconomically diverse group of youth. This project is designed to accelerate FBT implementation in publicly-funded mental health systems, and inform service improvements for underserved youth with eating disorders.

State behavioral health agency website references to evidence-based program registers.

PURPOSE: Evidence-based program registers (EBPRs) are important tools for facilitating the use of evidence-based practices or programs (EBPs) by state statutory agencies responsible for behavioral healthcare, broadly defined as substance misuse, mental health, HIV/AIDS prevention, child welfare, and offender rehabilitation. There are currently no data on the purposes for which such state agencies reference EBPRs on their official websites. METHOD: A webscraping method was used to identify and classify relevant "hits", defined as a state behavioral health webpage with single or multiple references to a study EBPR. A total of 778 hits (unique combinations of webpage and register) were coded. Up to three codes were applied to each hit for the "reasons for the EBPR reference" (EBPR use) dimension, one code was applied to each hit for the "purpose of the EBPR reference" and "intended audience of the webpage containing the hit" dimensions, and up to two codes were applied to each hit for the "funding mentions" dimension. RESULTS: Three EBPRs out of 28 accounted for 73.6% of the hits. The most frequent reason for referencing EBPRs were as a resource for selecting EBPs or validating existing programs and practices. The references tended to appear in reports from the state, in training materials, or guidelines. The references tended to address broad groups of behavioral healthcare professionals. EBPRs were frequently referenced in the context of federal block grants or other federal funding. CONCLUSIONS: Increasing state agencies' awareness and use of the entire range of existing EBPRs may improve implementation of EBPs nationally.

Protocol for comparing two training approaches for primary care professionals implementing the Safe Environment for Every Kid (SEEK) model.

BACKGROUND: Child maltreatment (CM) is a major public health problem, affecting many lives, in the short and long term, and costing individuals, families, and society dearly. There is a need for broad implementation of evidence-based preventive interventions, such as the Safe Environment for Every Kid (SEEK) model, developed for pediatric primary care. Primary care offers an excellent opportunity to help address prevalent psychosocial problems (e.g., parental depression) that are risk factors for CM. By addressing such problems, SEEK can strengthen families and support parents; promote children's health, development, and safety; help prevent CM; and benefit the health of the US population. This study will examine intervention strategies for optimizing SEEK's adoption, implementation, and sustainment, and its effectiveness in preventing CM.Despite strong evidence from two federally funded randomized controlled trials, SEEK has not been widely adopted. The goal of this study is to examine technology-driven implementation strategies to scale-up SEEK-in pediatric and family medicine primary care settings. The aims are to (1) evaluate the effectiveness of training strategies on SEEK's implementation in primary care practices, (2) evaluate barriers and facilitators to successful implementation and sustainment of SEEK, and (3) examine the model's effectiveness in preventing CM and the economic costs of implementing SEEK. METHODS: This randomized type III hybrid mixed methods design will examine how advances in medical training can bolster SEEK's adoption and implementation in pediatric and family medicine practices in different regions of the USA. These are independent online training and in-depth structured training via a quality improvement project, approved by the American Boards of Pediatrics and of Family Medicine. We will also evaluate SEEKonline, software that assists primary care practitioners implement the model, and a "Traditional" paper and pencil strategy for their impact on implementation. The study uses the EPIS framework and the Universal Stages of Implementation Completion, quantitative measures, qualitative interviews, and data abstracted from electronic health records. DISCUSSION: The knowledge gained should improve pediatric primary care to better address prevalent social determinants of health, benefiting many children and families. The outcomes should enhance the field of implementation science and guide future interventions in primary care. TRIAL REGISTRATION: NCT03642327, Clinical Trials, registered August 21, 2018.

Parenting Interventions in Pediatric Primary Care: A Systematic Review.

CONTEXT: More than 4 decades of research indicate that parenting interventions are effective at preventing and treating mental, emotional, and behavioral disorders in children and adolescents. Pediatric primary care is a viable setting for delivery of these interventions. OBJECTIVE: Previous meta-analyses have shown that behavioral interventions in primary care can improve clinical outcomes, but few reviews have been focused specifically on the implementation of parenting interventions in primary care. We aimed to fill this gap. DATA SOURCES: We reviewed 6532 unique peer-reviewed articles published in PubMed, the Cumulative Index to Nursing and Allied Health Literature, and PsycInfo. STUDY SELECTION: Articles were included if at least part of the intervention was delivered in or through primary care; parenting was targeted; and child-specific mental, emotional, and behavioral health outcomes were reported. DATA EXTRACTION: Articles were reviewed in Covidence by 2 trained coders, with a third coder arbitrating discrepancies. RESULTS: In our review of 40 studies, most studies were coded as a primary. Few researchers collected implementation outcomes, particularly those at the service delivery system level. LIMITATIONS: Including only published articles could have resulted in underrepresentation of implementation-related data. CONCLUSIONS: Parenting interventions delivered and implemented with fidelity in pediatric primary care could result in positive and equitable impacts on mental, emotional, and behavioral health outcomes for both parents and their children. Future research on the implementation strategies that can support adoption and sustained delivery of parenting interventions in primary care is needed if the field is to achieve population-level impact.

From Research Training to Scientific Advancement-Contributions from the Implementation Research Institute: An Introduction to the Special Issue.

The special series is designed to provide examples of funded implementation research conducted by alumni of the first four cohorts of the Implementation Research Institute (IRI). The introduction links the six substantive papers to the conceptual and methodological challenges laid out in a 2009 publication in this journal which led to the IRI training program in the emerging science of implementation with a special focus on behavior health settings. The 7th paper in the series illustrates an innovative evaluative approach to design and measurement of IRI fellow publications and grants informed by the training program such as bibliometrics. The introduction also notes some elements identified in the 2009 foundational paper not represented in these papers such as costs as well as important developments and foci in the decade since 2009 such as de-implementation, sustainability, dynamic adaptation processes, and hybrid designs that need to be an integral part of training programs in implementation research.

Evaluation of the Implementation Research Institute: Trainees' Publications and Grant Productivity.

With growth in the field of dissemination and implementation (D&I) research, there has been growth in capacity building, with many training opportunities. As such, it is important to continue to evaluate D&I research training programs. This paper reports the results of an evaluation of the Implementation Research Institute (IRI), a R25 funded by the National Institute of Mental Health with additional funding by the Department of Veterans Affairs (VA). The fourth cohort also had a supplement from the National Institute on Drug Abuse. Using bibliometrics data, we report on a quasi-experimental retrospective cohort study assessing whether the rates of scholarly productivity in D&I science of IRI fellows (those who applied and were accepted to the training) were greater than those who applied but were not accepted to IRI. Our findings show that Selected Applicants' odds of publishing in implementation science were higher for earlier alumni, starting at 12% 1 year out and increasing to 94% for those who were 4 years out from starting training. Chances for Non-Selected Applicants remained relatively stable, starting at 47% at 1 year and going to 33% at 4 years since their application, a pattern that was stable even after controlling for demographic characteristics. These results support the hypothesis that IRI is increasing the D&I research productivity of those selected to the program, and that our fellows are advancing the field of D&I compared to those investigators not selected to our institute. Our finding also indicates the importance of a 2-year training.

Developing and evaluating a lay health worker delivered implementation intervention to decrease engagement disparities in behavioural parent training: a mixed methods study protocol.

INTRODUCTION: Behavioural parent training (BPT) programmes are effective in preventing and treating early-onset conduct problems and child maltreatment. Unfortunately, pervasive mental health service disparities continue to limit access to and engagement in these interventions. Furthermore, challenges with parental engagement can impede the successful implementation of evidence-based practices (EBPs) in community settings that serve low-income, ethnic minority families. Lay health workers (LHWs)-individuals without formal mental health training-represent an important workforce to increase engagement, as they are members of the communities they serve. However, the mobilisation of LHWs has not been well studied as an implementation strategy to extend the reach or effectiveness of EBPs in the USA. LHW-delivered implementation interventions that specifically support the engagement of Latinx parents in evidence-based BPT programmes have the potential to improve clinical and implementation outcomes. METHODS AND ANALYSIS: A community-partnered approach will use the Quality Implementation Framework (QIF) to tailor and implement an LHW-delivered implementation intervention that aims to promote Latinx parent engagement in BPT programmes. Steps from the QIF will guide study activities to (1) conduct a mixed methods needs assessment to fit the implementation intervention to the local context, (2) adapt LHW-delivered implementation strategies to promote parent access to and engagement in Parent-Child Interaction Therapy and (3) conduct a hybrid effectiveness-implementation pilot trial to examine the feasibility, acceptability and preliminary effectiveness of the LHW implementation intervention at increasing engagement. ETHICS AND DISSEMINATION: Study procedures have been approved by the Institutional Review Board at the University of California, Santa Barbara. Results will be shared with the community-advisory group, at community-based meetings for other stakeholders involved in the pilot project, and submitted for publication in peer-reviewed journals.

Factors Associated with Community-Partnered School Behavioral Health Clinicians' Adoption and Implementation of Evidence-Based Practices.

Community-partnered school behavioral health (CP-SBH) is a model whereby schools partner with local community agencies to deliver services. This mixed-methods study examined 80 CP-SBH clinicians' adoption and implementation of evidence-based practice (EBP) approaches following mandated training. Forty-four clinicians were randomly assigned to one of two training conditions for a modular common elements approach to EBPs; 36 clinicians were preselected for training in a non-modular EBP. EBP knowledge improved for all training conditions at 8-month follow-up and practice element familiarity improved for modular approach training conditions, but the modular condition including ongoing consultation did not yield better results. Qualitative interviews (N = 17) highlighted multi-level influences of the CP-SBH service system and individual clinician characteristics on adoption and implementation.

Homelessness and Aging Out of Foster Care: A National Comparison of Child Welfare-Involved Adolescents.

The present study represents the first large-scale, prospective comparison to test whether aging out of foster care contributes to homelessness risk in emerging adulthood. A nationally representative sample of adolescents investigated by the child welfare system in 2008 to 2009 from the second cohort of the National Survey of Child and Adolescent Well-being Study (NSCAW II) reported experiences of housing problems at 18- and 36-month follow-ups. Latent class analyses identified subtypes of housing problems, including literal homelessness, housing instability, and stable housing. Regressions predicted subgroup membership based on aging out experiences, receipt of foster care services, and youth and county characteristics. Youth who reunified after out-of-home placement in adolescence exhibited the lowest probability of literal homelessness, while youth who aged out experienced similar rates of literal homelessness as youth investigated by child welfare but never placed out of home. No differences existed between groups on prevalence of unstable housing. Exposure to independent living services and extended foster care did not relate with homelessness prevention. Findings emphasize the developmental importance of families in promoting housing stability in the transition to adulthood, while questioning child welfare current focus on preparing foster youth to live.

An Overview of Research and Evaluation Designs for Dissemination and Implementation.

The wide variety of dissemination and implementation designs now being used to evaluate and improve health systems and outcomes warrants review of the scope, features, and limitations of these designs. This article is one product of a design workgroup that was formed in 2013 by the National Institutes of Health to address dissemination and implementation research, and whose members represented diverse methodologic backgrounds, content focus areas, and health sectors. These experts integrated their collective knowledge on dissemination and implementation designs with searches of published evaluations strategies. This article emphasizes randomized and nonrandomized designs for the traditional translational research continuum or pipeline, which builds on existing efficacy and effectiveness trials to examine how one or more evidence-based clinical/prevention interventions are adopted, scaled up, and sustained in community or service delivery systems. We also mention other designs, including hybrid designs that combine effectiveness and implementation research, quality improvement designs for local knowledge, and designs that use simulation modeling.

Forging a link between mentoring and collaboration: a new training model for implementation science.

BACKGROUND: Training investigators for the rapidly developing field of implementation science requires both mentoring and scientific collaboration. Using social network descriptive analyses, visualization, and modeling, this paper presents results of an evaluation of the mentoring and collaborations fostered over time through the National Institute of Mental Health (NIMH) supported by Implementation Research Institute (IRI). METHODS: Data were comprised of IRI participant self-reported collaborations and mentoring relationships, measured in three annual surveys from 2012 to 2014. Network descriptive statistics, visualizations, and network statistical modeling were conducted to examine patterns of mentoring and collaboration among IRI participants and to model the relationship between mentoring and subsequent collaboration. RESULTS: Findings suggest that IRI is successful in forming mentoring relationships among its participants, and that these mentoring relationships are related to future scientific collaborations. Exponential random graph network models demonstrated that mentoring received in 2012 was positively and significantly related to the likelihood of having a scientific collaboration 2 years later in 2014 (p = 0.001). More specifically, mentoring was significantly related to future collaborations focusing on new research (p = 0.009), grant submissions (p = 0.003), and publications (p = 0.017). Predictions based on the network model suggest that for every additional mentoring relationships established in 2012, the likelihood of a scientific collaboration 2 years later is increased by almost 7 %. CONCLUSIONS: These results support the importance of mentoring in implementation science specifically and team science more generally. Mentoring relationships were established quickly and early by the IRI core faculty. IRI fellows reported increasing scientific collaboration of all types over time, including starting new research, submitting new grants, presenting research results, and publishing peer-reviewed papers. Statistical network models demonstrated that mentoring was strongly and significantly related to subsequent scientific collaboration, which supported a core design principle of the IRI. Future work should establish the link between mentoring and scientific productivity. These results may be of interest to team science, as they suggest the importance of mentoring for future team collaborations, as well as illustrate the utility of network analysis for studying team characteristics and activities.

Measuring sustainment of prevention programs and initiatives: a study protocol.

BACKGROUND: Sustaining prevention efforts directed at substance use and mental health problems is one of the greatest, yet least understood, challenges in the field of implementation science. A large knowledge gap exists regarding the meaning of the term "sustainment" and what factors predict or even measure sustainability of effective prevention programs and support systems. METHODS/DESIGN: The U.S. Substance Abuse and Mental Health Services Administration (SAMHSA) supports a diverse portfolio of prevention and treatment grant programs that aim to improve population and individual level behavioral health. This study focuses on four SAMHSA prevention grant programs, two of which target substance abuse prevention at the state or single community level, one targets suicide prevention, and one targets prevention of aggressive/disruptive behavior in elementary schools. An examination of all four grant programs simultaneously provides an opportunity to determine what is meant by the term sustainment and identify and support both the unique requirements for improving sustainability for each program as well as for developing a generalizable framework comprised of core components of sustainment across diverse prevention approaches. Based on an analysis of qualitative and quantitative data of 10 grantees supported by these four programs, we will develop a flexible measurement system, with both general and specific components, that can bring precision to monitoring sustainment of infrastructure, activities, and outcomes for each prevention approach. We will then transform this system for use in evaluating and improving the likelihood of achieving prevention effort sustainment. To achieve these goals, we will (1) identify core components of sustainment of prevention programs and their support infrastructures; (2) design a measurement system for monitoring and providing feedback regarding sustainment within the four SAMHSA's prevention-related grant programs; and (3) pilot test the predictability of this multilevel measurement system across these programs and the feasibility and acceptability of a measurement system to evaluate and improve the likelihood of sustainment. DISCUSSION: This project is intended to improve sustainment of the supporting prevention infrastructure, activities, and outcomes that are funded by federal, state, community, and foundation sources.

Associations Between Magnitude of Child Maltreatment and Medicaid Expenditures for Psychotropic Medications.

OBJECTIVE: This study examined relationships between various measures of the severity of child maltreatment and expenditures on psychotropic drugs among children in the welfare system. METHODS: Child participants (N=4,453) in the first National Survey of Child and Adolescent Well-Being (NSCAW) were linked to their Medicaid claims from 36 states. Three specifications for severity of maltreatment were developed. A two-part regression of logistic and generalized linear models of expenditures on psychotropic medications was estimated for each specification. RESULTS: Physically abused children had higher odds (odds ratio [OR]=1.34) and neglected children had lower odds (OR=.76) of incurring psychotropic drug expenditures. Children who experienced the most severe level of harm had higher odds (OR=1.33) of medication use, compared with children without appreciable harm. No maltreatment specifications were associated with increased expenditures on psychotropic drugs. CONCLUSIONS: The magnitude of maltreatment affected odds of use of psychotropic drugs but had no effect on Medicaid expenditures for these drugs.

For Better or Worse? Change in Service Use by Children Investigated by Child Welfare Over a Decade.

BACKGROUND: Children, particularly minority children, referred to child welfare because of suspected maltreatment are vulnerable and need many services. We sought to assess whether service use has improved over the past decade and whether racial-ethnic disparities in service use have decreased. METHODS: We used 2 national data sets (the National Survey of Child and Adolescent Well-Being [NSCAW] I and II) collected a decade apart to assess changes over time in health, education, mental health (MH), and dental services and overall service use. RESULTS: In NSCAW II more children were young, had lower Child Behavior Checklist (CBCL) scores, and were Hispanic. We found significant increases in dental services, a decrease in special education services, and a decrease in MH services on the bivariate level (all P < .01). A large proportion of the change in MH services occurred in school settings, but the pattern continued when examining only those services delivered outside of school. The greatest decrease occurred for children with CBCL scores <64. However, in multivariate analyses, older children, white non-Hispanic children, and children placed out of the home were significantly more likely to receive MH services. Rates of MH services controlling for CBCL scores showed no improvement over the decade, nor was there a decrease in racial and ethnic disparities. CONCLUSIONS: These data showed no change in MH services over time for children referred for child welfare evaluation, but improvement in dental services was noted. Racial and ethnic disparities persist. Decrease in MH services occurred predominantly among children whose MH symptoms were below the clinical range.