The implementation potential of a method to monitor empirically-supported children's mental health treatment through claims data.

BACKGROUND: The delivery of evidence-supported treatments (EST) in children's mental health could be a valuable measure for monitoring mental healthcare quality; however, efforts to monitor the use of EST in real world systems are hindered by the lack of pragmatic methods. This mixed methods study examined the implementation and agency response rate of a pragmatic, claims-based measure of EST designed to be applied as a universal quality measure for child psychotherapy encounters in a state Medicaid system. METHODS: Implementation potential of the EST measure was assessed with healthcare leader rankings of the reporting method's acceptability, appropriateness and feasibility (n = 53), and post-implementation ratings of EST rate accuracy. Ability of the healthcare system to monitor EST through claims was measured by examining the agency responsivity in using the claims-based measure across 98 Medicaid-contracted community mental health (CMH) agencies in Washington State. RESULTS: The analysis found the reporting method had high implementation potential. The method was able to measure the use of an EST for 83% of children covered by Medicaid with 58% CMH agencies reporting > 0 ESTs in one quarter. Qualitative analyses revealed that the most significant barrier to reporting ESTs was the operability of electronic health record systems and agencies' mixed views regarding the accuracy and benefits of reporting. CONCLUSIONS: Measurement of child mental health ESTs through Medicaid claims reporting has acceptable implementation potential and promising real world responsiveness from CMH agencies in one state. Variation in reporting by agency site and low to moderate perceived value by agency leaders suggests the need for additional implementation supports for wider uptake.

Evaluating a Train-the-Trainer Approach for Increasing EBP Training Capacity in Community Mental Health.

Research suggests the train-the-trainer (TtT) model may be an effective approach to training community mental health providers in evidence-based practice (EBP). This study compared pre- and post-training consultation outcomes as well as standardized measures of trainer attributes and behaviors between university-based master trainers and experienced community-based supervisors, trained under the TtT approach. Findings suggest local and master trainers are equivalent in terms of clinical teaching effectiveness and trainee-perceived charisma. Master trainers may have higher trainee-perceived credibility, but training and consultation outcomes are equivalent across the types of trainers, with the exception of behavioral problems where clinicians trained by local trainers and master trainers saw significantly greater growth than those who received training and consultation by master trainers.

Advancing the state-level tracking of evidence-based practices: a case study.

BACKGROUND: Despite a sustained focus by policymakers and researchers on improving the standard of clinical care in public mental health services, the use of evidence-based practice remains low. Among other challenges, this reflects the difficulty of translating clinical research into useable policy that can be feasibly funded and monitored by state or large healthcare systems. CASE PRESENTATION: In this paper we present a case study of Washington State's strategy for monitoring the use of clinical elements at the session level for all Medicaid-funded children's mental health services. The implementation of this strategy reflects policy actions to promote effective practice while also actively influencing multiple other levels of the implementation ecology. The approach is informed by the Policy Ecology Framework, the Consolidated Framework for Implementation Research, the evidence-based policymaking literature, and common ontology and clinical elements models. CONCLUSIONS: We found the strategy developed in Washington State to be a feasible method of collecting session level information about the use of effective clinical mental health practices. In addition, the approach appears to be having influence on multiple layers of the implementation ecology that could be explored through further study.

Developing a Quality Assurance System for Multiple Evidence Based Practices in a Statewide Service Improvement Initiative.

Efforts to implement evidence based practices (EBP) are increasingly common in child-serving systems. However, public systems undertaking comprehensive improvement efforts that aim to increase availability of multiple practices at the same time may struggle to build comprehensive and user-friendly strategies to develop the workforce and encourage adoption, faithful implementation, and sustainability of selected EBPs. Given that research shows model adherence predicts positive outcomes, one critical EBP implementation support is systematic quality, fidelity, and compliance monitoring. This paper describes the development and initial implementation of a quality assurance framework for a statewide EBP initiative within child welfare. This initiative aimed to improve provider practice and monitor provider competence and compliance across four different EBPs, and to inform funding and policy decisions. The paper presents preliminary data as an illustration of lessons learned during the quality monitoring process and concludes with a discussion of the promise and challenges of developing and applying a multi-EBP quality assurance framework for use in public systems.

Challenging children in kin versus nonkin foster care: perceived costs and benefits to caregivers.

This study uses social exchange theory as a framework for examining 102 kin and 157 nonkin foster parents' perceptions of their foster children, their relationships with them, and their own functioning. The authors argue that these perceptions reflect perceived costs and benefits of parenting these children, which may influence their investment in them. All children in the study were referred to Parent-Child Interaction Therapy (PCIT) for treatment of the children's behavior problems, participating with their foster parents. Analyses showed that nonkin caregivers rated their foster children's behavior problems as significantly more severe than kin caregivers but rated themselves as significantly less stressed. Analyses predicting early treatment termination showed that kin caregivers were more likely than nonkin caregivers to complete the course of treatment in PCIT, particularly if they reported elevated levels of parental distress. The authors discuss the implications of these findings for foster children's placement stability and long-term success.