The Consistencies and Vagaries of the Washington State Inventory of Evidence-Based Practice: The Definition of "Evidence-Based" in a Policy Context.

As states increasingly establish the importance of evidence-based practice through policy and funding mandates, the definition of evidence-based practice can have a significant impact on investment decisions. Not meeting established criteria can mean a loss of funding for established programs and the implementation disruption of programs without a strong research base. Whether the definition of "evidence-based" is influenced by these high stakes contexts is an interesting question that can inform the larger field about the value and utility of evidence-based practice lists/inventories for disseminating knowledge. In this paper we review the development of the Washington State Inventory of Evidence-Based, Research-Based and Promising Practices as a case study for the process of defining evidence-based practice in a policy context. As part of this study we also present a comparison of other well-known evidence-based practice inventories and examine consistencies and differences in the process of identifying and developing program ratings.

American Indian perspectives on evidence-based practice implementation: results from a statewide Tribal Mental Health Gathering.

Implementation of Evidence-Based Practices (EBP) within American Indian and Alaskan Natives communities is currently an area of debate and contention. There is considerable concern about expanding EBP policy mandates to AI/AN communities as these mandates, either through funding restrictions or other de facto policies, recall past histories of clinical colonization and exploitation by the state and federal government. As a response, work is being done to evaluate indigenous programs and examine strategies for culturally-sensitive implementation. While the literature reflects the perspectives of AI/AN populations on EBP generally, no one has yet reported the perspectives of AI/AN communities on how to feasibly achieve widespread EBP implementation. We report the findings of a statewide Tribal Gathering focused on behavioral health interventions for youth. The Gathering participants included AI/AN individuals as well as staff working with AI/AN populations in tribal communities. Participants identified strengths and weaknesses of the five legislatively fundable programs for youth delinquency in Washington State and discussed strategies likely to be effective in promoting increased uptake within tribes. Analysis of these discussions resulted in many useful insights in program-specific and community-driven strategies for implementation. In addition, two major themes emerged regarding widespread uptake: the importance of a multi-phase engagement strategy and adopting a consortium/learning community model for implementation. The findings from this Gathering offer important lessons that can inform current work regarding strategies to achieve a balance of program fidelity and cultural-alignment. Attending to engagement practices at the governance, community and individual level are likely to be key components of tribal-focused implementation. Further, efforts to embed implementation within a consortium or learning community hold considerable promise as a strategy for sustainability.

The Partnership Access Line: evaluating a child psychiatry consult program in Washington State.

OBJECTIVE: To evaluate a telephone-based child mental health consult service for primary care providers (PCPs). DESIGN: Record review, provider surveys, and Medicaid database analysis. SETTING: Washington State Partnership Access Line (PAL) program. PARTICIPANTS: A total of 2285 PAL consultations by 592 PCPs between April 1, 2008, and April 30, 2011. INTERVENTIONS: Primary care provider-initiated consultations with PAL service. MAIN OUTCOME MEASURES: The PAL call characteristics, PCP feedback surveys, and Medicaid claims between April 2007 and December 2009 for fee-for-service Medicaid children before and after a PAL call. RESULTS: Sixty-nine percent of calls were about children with serious emotional disturbances, and 66% of calls were about children taking psychiatric medications. Primary care providers nearly always received new psychosocial treatment advice (87% of calls) and were more likely to receive advice to start rather than stop a medication (46% vs 24% of calls). Primary care provider feedback surveys reported uniformly positive satisfaction with the program. Among Medicaid children, there was significant increases in attention-deficit/hyperactivity disorder and antidepressant medication use after the PAL call but no significant change in reimbursements for mental health medications (P < .05). Children with a history of foster care experienced a 132% increase in outpatient mental health visits after the PAL call (P < .05). CONCLUSIONS: Primary care providers used PAL for psychosocial and medication treatment assistance for particularly high-needs children and were satisfied with the service. Furthermore, PAL was associated with increased use of outpatient mental health care for some children.

Child welfare caseworkers as service brokers for youth in foster care: findings from project focus.

Youth in the foster care system have substantially higher rates of mental health needs compared to the general population, yet they rarely receive targeted, evidence-based practices (EBPs). Increasingly emerging in the literature on mental health services is the importance of "brokers" or "gateway providers" of services. For youth in foster care, child welfare caseworkers often play this role. This study examines caseworker-level outcomes of Project Focus, a caseworker training and consultation model designed to improve emotional and behavioral outcomes for youth in foster care through increased linkages with EBPs. Project Focus was tested through a small, randomized trial involving four child welfare offices. Caseworkers in the Project Focus intervention group demonstrated an increased awareness of EBPs and a trend toward increased ability to identify appropriate EBP referrals for particular mental health problems but did not have significantly different rates of actual referral to EBPs. Dose of consultation was associated with general awareness of EBPs. Implications for practice and outcomes for youth are discussed.

Identifying a negative mood subtype in incarcerated adolescents: relationship to substance use.

OBJECTIVE: The following study tested the empirical validity and clinical meaningfulness of a negative mood subtype of incarcerated adolescent males (N=270). Differences in alcohol and marijuana use and consequences were examined. METHOD: Participants were subtyped according to reports of depressive and anxious symptoms using the Children's Depression Inventory and the Revised Children's Manifest Anxiety Scale. RESULTS: Cluster analysis confirmed the presence of negative mood (34%) and normal mood (66%) subtypes. Incarcerated adolescents in the negative mood subtype reported higher levels of alcohol use, higher levels of use-related consequences for both alcohol and marijuana, greater use of both substances to regulate mood states, and more use of avoidant coping. CONCLUSION: Results underscore the need for identification and treatment of mental health and substance use difficulties in the juvenile justice system.

Transition planning and recidivism among mentally ill juvenile offenders.

OBJECTIVES: To determine the extent to which transition planning and community service would predict lower levels of recidivism among mentally ill juvenile offenders. DESIGN: Review of legal, medical and social service records including examination of 3-month period following community release. PARTICIPANTS: Juvenile offenders incarcerated for 6 months or more (N = 44) transitioning to community. MEASURES: Child and Adolescent Functional Assessment Scale (CAFAS), sum of different documented pre- and post-release discharge planning contacts, documented community service contacts. OUTCOMES: Re-offense during the first year post-release. RESULTS: Documented community service contacts in the 3 months following discharge were rare for mental health (20.5%), substance abuse (38.6%), financial assistance (29.5%), and school placement (34.1%). The average number of different pre-release and post-release discharge planning contacts was also low, M(SD)=1.86(1.68) and M(SD)= 2.34(1.71) respectively. Post-release discharge planning and the receipt of financial assistance and mental health services were all associated with lower levels of reoffending. CONCLUSIONS: Community transition planning, including the coordination and provision of community services, is an essential component of community reintegration for juvenile offenders and is associated with lower rates of recidivism during the first year post-discharge.

Clinical utility and policy implications of a statewide mental health screening process for juvenile offenders.

OBJECTIVES: This study examined the utility of screening adjudicated juvenile offenders for mental health symptoms at intake to the State of Washington Juvenile Rehabilitation Administration. The authors assessed the ability of a screening measure, the Massachusetts Youth Screening Inventory, second edition (MAYSI-2), to identify youths with mental health problems and co-occurring substance use problems. This study also examined the relationship of these symptoms to treatment utilization both before and after intake to the juvenile justice system. Ethnic and gender differences in the screening results were studied. METHODS: The MAYSI-2 was administered to 1,840 youths consecutively admitted to state custody. Cluster analysis was used to group the youths by mental health symptom status, and the relationship between symptoms and treatment utilization was tested in the groups identified in the cluster analysis. RESULTS: Youths who reported a high level of mental health symptoms, with or without co-occurring substance use problems, were more likely to have received previous mental health treatment than youths with a low level of mental health symptoms. Youths with a high level of mental health symptoms were more likely to receive extraordinary sentences and were thus less likely to be eligible for community transition programs than youths with a low level of mental health symptoms. Significant gender and ethnic differences in mental health symptom reporting on the screening inventory were found. Female offenders were significantly more likely than male offenders to report a high level of symptoms, and Hispanic youths were significantly less likely than youths in other ethnic groups to report a high level of symptoms. CONCLUSIONS: The MAYSI-2 has utility in identifying youths in the juvenile justice system who have mental health problems, and MAYSI-2 results are related to use of treatment services both before and after intake to the juvenile justice system. Ethnic and gender differences in MAYSI-2 reporting must be considered in interpreting mental health screening data.