The influence of evidence-based program registry websites for dissemination of evidence-based interventions in behavioral healthcare.

PURPOSE: Evidence-based program registries (EBPRs) are web-based databases of evaluation studies that summarize the available evidence for the effectiveness of behavioral healthcare programs, including programs addressing substance misuse, mental health, child welfare, or offender rehabilitation. The study determined the extent to which visitors to selected EBPRs accomplished the objectives of their visits and how often those visits resulted in the adoption of new or improved evidence-based interventions (EBIs). METHOD: A follow-up telephone survey was conducted with 216 visitors to a convenience sample of six EBPRs an average of six months after the visitors' incident visit to the EBPR. RESULTS: The most frequent objective was to identify evidence-based programs/services, curricula or assessments, followed by finding resources to implement or improve the preceding and writing a grant proposal including to comply with funding requirements; 71% of such objectives were achieved across the full set of objectives. Implementation of an EBI was completely achieved for 31% of relevant objectives and some progress on EBI implementation occurred for 19% of relevant objectives. CONCLUSIONS: This is the first study to document the usage of EBPRs as a modality to increase the utilization of EBIs in the actual practice of behavioral healthcare. The results support the continued use of web-based EBPRs for disseminating information on evidence-based interventions for behavioral healthcare.

Visitors' Assessment and Utilization of Evidence-Based Program Resources (EBPR) Websites.

Background: Evidence-based program resources (EBPR) websites for behavioral health are a potentially useful tool to assist decision-makers and practitioners in deciding which behavioral health interventions to implement. EBPR websites apply rigorous research standards to assess the effectiveness of behavioral healthcare programs, models, and clinical practices. Method: Visitors to a convenience sample of six EBPR websites (N=369, excluding students) were recruited for telephone interviews primarily by means of a pop-up invitation on the sites. Results: The visitors view the EBPR sites as important sources of information to support the identification and adoption of evidence-based programs/practices (EBPs) in behavioral healthcare, which aligns with the primary mission of EBPRs. For repeat visitors, there was some indication that the information obtained helped effect certain changes in their agencies' programs and policies. However, increased or improved guidance on EBP implementation was also requested. Conclusion: EBPR websites should be better publicized to the behavioral healthcare field.

State Department and Provider Agency Utilization of Evidence-Based Program Registries in Behavioral Healthcare and Child Welfare.

Evidence-based program registries (EBPRs) are web-based compilations of behavioral healthcare programs/interventions that rely on research-based criteria to rate program efficacy or effectiveness for support of programmatic decision-making. The objective was to determine the extent to which behavioral health decision-makers access EBPRs and to understand whether and exactly how they use the information obtained from EPBRs. Single State Authorities (SSAs) and service provider agencies in the areas of behavioral health and child welfare were recruited nationally. Senior staff (n = 375) responsible for the selection and implementation of programs and/or policies were interviewed by telephone concerning their visits (if any) to 28 relevant EBPRs, the types of information they were seeking, whether they found it, and how they may have used that information to effect changes in their organizations. At least one EBPR was visited by 80% of the respondents, with a median of three different registers being visited. Most visitors (55%) found all the information they were seeking; those who did not desired more guidance or tools for individual program implementation or were unable to locate the program or practice that they were seeking. Most visitors (65%) related using the information obtained to make changes in their organizations, in particular to select, start or change a program, or to support the adoption or improvement of evidence-based clinical practices. EBPRs were shown to be important resources for dissemination of research-based program effectiveness data, leading to increased use of evidence-based practices in the field, but the study also identified needs for greater awareness of EBPRs generally and for more attention to implementation of specific recommended programs and practices.

State behavioral health agency website references to evidence-based program registers.

PURPOSE: Evidence-based program registers (EBPRs) are important tools for facilitating the use of evidence-based practices or programs (EBPs) by state statutory agencies responsible for behavioral healthcare, broadly defined as substance misuse, mental health, HIV/AIDS prevention, child welfare, and offender rehabilitation. There are currently no data on the purposes for which such state agencies reference EBPRs on their official websites. METHOD: A webscraping method was used to identify and classify relevant "hits", defined as a state behavioral health webpage with single or multiple references to a study EBPR. A total of 778 hits (unique combinations of webpage and register) were coded. Up to three codes were applied to each hit for the "reasons for the EBPR reference" (EBPR use) dimension, one code was applied to each hit for the "purpose of the EBPR reference" and "intended audience of the webpage containing the hit" dimensions, and up to two codes were applied to each hit for the "funding mentions" dimension. RESULTS: Three EBPRs out of 28 accounted for 73.6% of the hits. The most frequent reason for referencing EBPRs were as a resource for selecting EBPs or validating existing programs and practices. The references tended to appear in reports from the state, in training materials, or guidelines. The references tended to address broad groups of behavioral healthcare professionals. EBPRs were frequently referenced in the context of federal block grants or other federal funding. CONCLUSIONS: Increasing state agencies' awareness and use of the entire range of existing EBPRs may improve implementation of EBPs nationally.

Kids and Teens in Court (KTIC): A Model for Preparing Child Witnesses for Court.

Each year, numerous children testify in the United States in either criminal, civil, or juvenile court cases. Typically, children who testify are alleged victims of sexual or physical abuse or neglect, witnesses to violent crime, or subjects in custodial hearings in civil court. As more maltreatment cases are prosecuted and child custody is contested, an increasing number of children are being called as witnesses in court. Many of these children have already been traumatized by the experiences that led to their need to testify, and participation in the court process can have additional negative effects. This article describes the development and recent formative evaluation of a court preparation program that provides psychoeducation and utilizes components of evidence-based trauma treatment approaches, such as relaxation and in vivo exposure, to support child witnesses and reduce the risk of retraumatization. Children and adolescents participating in the program attend group sessions conducted by mental health clinicians and complete a court-related anxiety measure before and after each session. Results from 175 participants are reported. Findings indicated significant decreases in court-related anxiety with large program effects. Challenges encountered by the program and future directions are discussed.

Measuring collaboration across children's behavioral health and child welfare systems.

A commonly emphasized component of trauma-informed care is the practice of building cross-system collaboration (CSC). While existing research on CSC states numerous benefits and barriers associated with increasing collaboration between systems, there is limited empirical understanding on how to define and measure collaboration between county systems of care. The current study presents the psychometric evaluation of scores from the Perceptions of Overarching Cross-System Collaboration-Child Welfare and Behavioral Health Systems (POCSC-CW/BH), a 6-item self-report instrument completed by system administrative leadership and direct service providers, administered within child welfare and children's behavioral health systems in 6 California counties. Psychometric analysis demonstrated good support of internal consistency, as well as the factorial, convergent, and discriminant validity of scores produced by the tool. There was also evidence for content validity. System-level analyses showed within-county child welfare, and children's behavioral health system staff reported similar perceptions of CSC in 5 of 6 counties, whereas POCSC-CW/BH scores across counties showed variability. Exploratory results revealed CSC scores varied by staff role in each system. In general, the POCSC-CW/BH is a promising instrument that adds to a limited array of practical empirically supported measurement tools for measuring CSC between child welfare and children's behavior health systems. The study limitations and implications for CSC measurement and trauma-informed practice are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Health-risk behaviors in teens investigated by U.S. Child Welfare Agencies.

PURPOSE: The aim of this study was to examine prevalence and correlates of health-risk behaviors in 12- to 17.5-year-olds investigated by child welfare and compare risk-taking over time and with a national school-based sample. METHODS: Data from the National Survey of Child and Adolescent Well-Being (NSCAW II) were analyzed to examine substance use, sexual activity, conduct behaviors, and suicidality. In a weighted sample of 815 adolescents aged 12-17.5 years, prevalence and correlates for each health-risk behavior were calculated using bivariate analyses. Comparisons to data from NSCAW I and the Youth Risk Behavior Survey were made for each health-risk behavior. RESULTS: Overall, 65.6% of teens reported at least one health-risk behavior with significantly more teens in the 15- to 17.5-year age group reporting such behaviors (81.2% vs. 54.4%; p ≤ .001). Almost 75% of teens with a prior out-of-home placement and 77% of teens with child behavior checklist scores ≥64 reported at least one health-risk behavior. The prevalence of smoking was lower than in NSCAW I (10.5% vs. 23.2%; p ≤ .05) as was that of sexual activity (18.0% vs. 28.8%; p ≤ .05). Prevalence of health-risk behaviors was lower among older teens in the NSCAW II sample (n = 358) compared with those of the 2011 Youth Risk Behavior Surveillance System high school-based sample with the exception of suicidality, which was approximately 1.5 times higher (11.3% [95% confidence interval, 6.5-19.0] vs. 7.8% [95% confidence interval, 7.1-8.5]). CONCLUSIONS: Health-risk behaviors in this population of vulnerable teens are highly prevalent. Early efforts for screening and interventions should be part of routine child welfare services monitoring.

Adolescent maltreatment in the child welfare system and developmental patterns of sexual risk behaviors.

In this longitudinal study, we tested whether adolescent maltreatment and out-of-home placement as a response to maltreatment altered developmental patterns of sexual risk behaviors in a nationally representative sample of youth involved in the child welfare system. Participants included adolescents aged 13 to 17 (M = 15.5, SD = 1.49) at baseline (n = 714), followed over 18 months. Computer-assisted interviews were used to collect self-reported sexual practices and experiences of physical and psychological abuse at both time points. Latent transition analyses were used to identify three patterns of sexual risk behaviors: abstainers, safe sex with multiple partners, and unsafe sex with multiple partners. Most adolescents transitioned to safer sexual behavior patterns over time. Adolescents exhibiting the riskiest sexual practices at baseline were most likely to report subsequent abuse and less likely to be placed into out-of-home care. Findings provide a more nuanced understanding of sexual risk among child welfare-involved adolescents and inform practices to promote positive transitions within the system.

Health status and type of out-of-home placement: informal kinship care in an investigated sample.

OBJECTIVE: To assess the sociodemographic, health, and mental health of children in different types of out-of-home placements after investigation by child welfare agencies; to determine whether there are systematic differences in the children and their caregivers by type of out-of-home placements; and to provide the first description of these characteristics in a nationally representative sample for children in informal kinship care after child welfare involvement. METHODS: Using data from the National Survey of Child and Adolescent Well-being (NSCAW II), we compared children (0-17.5 years) in formal nonkinship foster care, formal kinship foster care, and informal kinship care shortly after a child welfare investigation. All analyses were weighted to reflect the sampling design. RESULTS: Children in informal kinship care are at comparable risk of having chronic health conditions and poorer health but are less likely to receive school-based services. All children in kinship care (formal and informal) are less likely to be reported to have mental health problems and are more likely to live with older caregivers whose educational level is low and whose health is reportedly poorer. CONCLUSIONS: Although children in kinship care have health problems similar to children in nonkinship foster care, they are likely to live in families with fewer economic and educational resources. This mismatch between need and access has implications for the long-term well-being of the children who are living in informal kinship arrangements without system-level support of formal foster care.

Exploration and Adoption of Evidence-based Practice by US Child Welfare Agencies.

OBJECTIVE: To examine the extent to which child welfare agencies adopt new practices and to determine the barriers to and facilitators of adoption of new practices. METHODS: Data came from telephone interviews with the directors of the 92 public child welfare agencies that constituted the probability sample for the first National Survey of Child and Adolescent Well-being (NSCAWI). In a semi-structured 40 minute interview administered by a trained Research Associate, agency directors were asked about agency demographics, knowledge of evidence-based practices, use of technical assistance and actual use of evidence-based practices.. Of the 92 agencies, 83 or 90% agreed to be interviewed. RESULTS: Agencies reported that the majority of staff had a BA degree (53.45%) and that they either paid for (52.6%) or provided (80.7%) continuing education. Although agencies routinely collect standardized child outcomes (90%) they much less frequently collect measures of child functioning (30.9%). Almost all agencies (94%) had started a new program or practice but only 24.8% were evidence-based and strategies used to explore new programs or practices usually involved local or state contracts. Factors that were associated with program success included internal support for the innovation (27.3%), and an existing evidence base (23.5%). CONCLUSIONS: Directors of child welfare agencies frequently institute new programs or practices but they are not often evidence-based. Because virtually all agencies provide some continuing education adding discussions of evidence-based programs/practices may spur adaption. Reliance on local and state colleagues to explore new programs and practices suggests that developing well informed social networks may be a way to increase the spread of evidence0based practices.

Cost calculator methods for estimating casework time in child welfare services: A promising approach for use in implementation of evidence-based practices and other service innovations.

Estimating costs in child welfare services is critical as new service models are incorporated into routine practice. This paper describes a unit costing estimation system developed in England (cost calculator) together with a pilot test of its utility in the United States where unit costs are routinely available for health services but not for child welfare services. The cost calculator approach uses a unified conceptual model that focuses on eight core child welfare processes. Comparison of these core processes in England and in four counties in the United States suggests that the underlying child welfare processes generated from England were perceived as very similar by child welfare staff in California county systems with some exceptions in the review and legal processes. Overall, the adaptation of the cost calculator for use in the United States child welfare systems appears promising. The paper also compares the cost calculator approach to the workload approach widely used in the United States and concludes that there are distinct differences between the two approaches with some possible advantages to the use of the cost calculator approach, especially in the use of this method for estimating child welfare costs in relation to the incorporation of evidence-based interventions into routine practice.

Persistence of mental health problems in very young children investigated by US child welfare agencies.

OBJECTIVE: To document the persistence and predictors of mental health problems in children aged 12 to 18 months investigated for alleged maltreatment. METHODS: Data came from the second National Survey of Child and Adolescent Well-being (NSCAW II), a longitudinal study of youth 0 to 17.5 years referred to US child welfare agencies. These analyses involved children 12 to 18 months. Baseline sociodemographic, social services, developmental data, and health data were collected on children and caregivers. Potential social-emotional problems at baseline were assessed with the Brief Infant-Toddler Social and Emotional (BITSEA) scales. Outcomes were scores over the clinical cutoff on the Child Behavior Checklist (CBCL) 1.5-5 assessed at 18 months after study entry. RESULTS: The multivariable analyses showed that an elevated BITSEA score at baseline (odds ratio 9.18, 95% confidence interval 1.49, 56.64; P = .018) and living with a depressed caregiver (odds ratio 13.54, 95% confidence interval 2.50, 73.46; P = .003) were associated with CBCL scores in the clinical range at the 18-month follow-up. For children who scored both positive on the BITSEA and lived with a depressed caregiver, 62.5% scored positive on the CBCL compared to 10.7% of the children with one risk factor and 3.8% of the children with neither risk factor. Only 23.9% of children and/or their caregivers received any service. CONCLUSIONS: Data show considerable persistence of mental health problems in very young children that 2 factors could identify. Lack of services to these children is a tremendous missed opportunity for identification and treatment that could potentially prevent more serious mental health problems.

Mental health problems in teens investigated by U.S. child welfare agencies.

PURPOSE: To examine prevalence and correlates of five mental health (MH) problems among 12-17.5 year olds investigated by child welfare. METHODS: Data from the National Survey on Child and Adolescent Well-being (NSCAW II) were analyzed to examine depression, anxiety, substance use/abuse, suicidality, and attention deficit hyperactivity disorder (ADHD) as reported by teens and their caregivers. In a sample of 815 adolescents, prevalence for each MH problem and correlates (e.g., age, placement location) were identified using bivariate and multivariable logistic analyses. RESULTS: After investigation for maltreatment, 42.7% of teens reported at least one MH problem, regardless of placement. Nine percent reported depression, 13.9% reported suicidality, 23% had substance use/abuse, 13.5% reported anxiety, and 18.6% had ADHD. Of 332 teens with any MH problem, 52.1% reported only one problem, 28.3% had two problems, and 19.6% had ≥ three problems. Teens with prior out-of-home placement had odds 2.29 times higher of reporting a MH problem and odds 2.12 times higher of reporting substance use/abuse. Males were significantly less likely to report depression. Older teens were more likely to report substance use/abuse. Black teens were significantly less likely to report suicidality and ADHD and almost half as likely to report anxiety. Teens with a chronic health condition and teens whose caregiver reported depression had more than twice the odds of reporting anxiety. CONCLUSIONS: This study highlights high rates of MH problems in teens of all ages and placement locations and suggests that all teens involved with child welfare should be screened for MH problems, regardless of initial placement status.

Chronic conditions among children investigated by child welfare: a national sample.

OBJECTIVE: To assess the presence of chronic health conditions (CHCs) among a nationally representative sample of children investigated by child welfare agencies. METHODS: The study included 5872 children, aged 0 to 17.5 years, whose families were investigated for maltreatment between February 2008 and April 2009. Using data from the second National Survey of Child and Adolescent Well-Being, we examined the proportion of children who had CHC. We developed 2 categorical and 2 noncategorical measures of CHC from the available data and analyzed them by using bivariate and multivariable analyses. RESULTS: Depending on the measure used, 30.6% to 49.0% of all children investigated were reported by their caregivers to have a CHC. Furthermore, the children identified by using diverse methods were not entirely overlapping. In the multivariable analyses, children with poorer health were more likely to be male, older, and receiving special educational services but not more likely to be in out-of-home placements. CONCLUSIONS: The finding that a much higher proportion of these children have CHC than in the general population underscores the substantial health problems of children investigated by child welfare agencies and the need to monitor their health carefully, regardless of their placement postinvestigation.

Mental health services use by children investigated by child welfare agencies.

OBJECTIVE: To examine the rates and predictors of mental health services use for a nationally representative cohort of youths who had been investigated for alleged maltreatment. METHODS: Data came from caregiver and caseworker baseline and 18-month interviews in the second National Survey of Child and Adolescent Well-being. These interviews took place from March 2008 to September 2008 and September 2010 to March 2011. Data on family and child characteristics and service use were gathered and examined by using weighted univariate and multivariate analyses. RESULTS: Children had numerous challenges: 61.8% had a previous report of maltreatment, 46.3% had poor socialization skills, and 23.9% had a mental health problem measured by the Child Behavior Checklist (CBCL). At baseline, 33.3% received some mental health service and this varied by age, with younger children receiving fewer services. This percentage decreased to 30.9% at the 18-month follow-up, although the youngest children had increases in services use. For younger children, race/ethnicity, out-of-home placement, chronic physical health problems, low adaptive behaviors, and CBCL scores in the clinical range were related to use. For children ≥ 11, out-of-home placement, high CBCL scores, and family risk factors predicted services use at 18 months. CONCLUSIONS: Mental health services utilization increases as young children come into contact with schools and medical providers or have more intensive involvement with child welfare. Minority children receive fewer services adjusting for need. Over the 18-month follow-up, there was a decrease in service use that may be a result of the tremendous financial challenges taking place in the United States.

Mental health problems in young children investigated by U.S. child welfare agencies.

OBJECTIVE: To examine the prevalence/predictors of mental health (MH) problems and services use in 12- to 36-month-old children who had been investigated for maltreatment. METHOD: Data came from the second National Survey of Child and Adolescent Well-Being (NSCAW II), a longitudinal study of youth ages 0 to 17.5 years referred to U.S. child welfare agencies. These analyses involved 1117 children 12 to 36 months of age. Sociodemographic, social services, developmental and health data were collected on the children and caregivers. Outcomes were scores over the clinical cutoffs on the Brief Infant Toddler Social and Emotional Assessment (BITSEA) Scales for 12- to 18-month-olds and the Child Behavior Checklist (CBCL) for 19- to 36-month-olds. RESULTS: In all, 34.6% of 12 to 18 month-olds scored high on the Problem Scale of the BITSEA, and 20.9% on the Competence Scale, whereas 10.0% of 19- to 36-month-olds scored over the CBCL clinical cut-off. Children of black ethnicity were less likely to have elevated scores on the BITSEA Problem Scale, whereas children who lived with a never-married caregiver were five times more likely to have elevated scores. Competence problems were associated with prior child welfare history. Elevated CBCL scores were associated with living with a depressed caregiver. Few children with identified MH problems, 2.2%, received an MH service. When we added parenting skills training that might be related to the treatment of child problems, 19.2% received a service. CONCLUSIONS: Identifiable MH problems are common, but few children receive services for those problems. The lack of services received by these young, multi-challenged children is a services systems and social policy failure.

Design elements in implementation research: a structured review of child welfare and child mental health studies.

Implementation science is an emerging field of research with considerable penetration in physical medicine and less in the fields of mental health and social services. There remains a lack of consensus on methodological approaches to the study of implementation processes and tests of implementation strategies. This paper addresses the need for methods development through a structured review that describes design elements in nine studies testing implementation strategies for evidence-based interventions addressing mental health problems of children in child welfare and child mental health settings. Randomized trial designs were dominant with considerable use of mixed method designs in the nine studies published since 2005. The findings are discussed in reference to the limitations of randomized designs in implementation science and the potential for use of alternative designs.

Family advocacy, support and education in children's mental health: results of a national survey.

In conjunction with the national survey of mental health service organizations (Schoenwald et al. this issue), a separate but complementary national survey was conducted of family advocacy, support and education organizations (FASEOs). Directors of FASEOs within the same localities as the mental health agencies responded to a survey and provided information in four areas: (1) structure and funding; (2) factors influencing advocacy decisions about children's mental health; (3) types of services provided by FASEOs and factors perceived as related to improved outcomes; and (4) the types of working relationships between FASEOs and local mental health clinics. Findings from a total of 226 (82% response rate) portray a network of family advocacy, support and education organizations that are strategically poised to effect substantive change and characterized by significant fiscal instability. Results from this survey and implications for delivery of family-based services are provided.

A survey of the infrastructure for children's mental health services: implications for the implementation of empirically supported treatments (ESTs).

A structured interview survey of directors of a large national sample (n = 200) of mental health service organizations treating children examined the governance, financing, staffing, services, and implementation practices of these organizations; and, director ratings of factors important to implementation of new treatments and services. Descriptive analyses showed private organizations financing services with public (particularly Medicaid) funds are prevalent and that employment of professional staff, clinical supervision and training, productivity requirements, and outcomes monitoring are common. Results of random effects regression models (RRMs) evaluating associations between governance, financing, and organizational characteristics and the use of new treatments and services showed for-profit organizations more likely to implement such treatments, and organizations with more licensed clinical staff and weekly clinical supervision in place less likely to do so. Results of RRMs evaluating relations between director ratings of the importance to new treatment and service implementation of three factors-fit with existing implementation practices, infrastructure support, and organizational mission and support-suggest greater importance to public than private organizations of these factors. Implications for EST implementation and future research are described.