Using policy codesign to achieve multi-sector alignment in adolescent behavioral health: a study protocol.

BACKGROUND: Policymaking is quickly gaining focus in the field of implementation science as a potential opportunity for aligning cross-sector systems and introducing incentives to promote population health, including substance use disorders (SUD) and their prevention in adolescents. Policymakers are seen as holding the necessary levers for realigning service infrastructure to more rapidly and effectively address adolescent behavioral health across the continuum of need (prevention through crisis care, mental health, and SUD) and in multiple locations (schools, primary care, community settings). The difficulty of aligning policy intent, policy design, and successful policy implementation is a well-known challenge in the broader public policy and public administration literature that also affects local behavioral health policymaking. This study will examine a blended approach of coproduction and codesign (i.e., Policy Codesign), iteratively developed over multiple years to address problems in policy formation that often lead to poor implementation outcomes. The current study evaluates this scalable approach using reproducible measures to grow the knowledge base in this field of study. METHODS: This is a single-arm, longitudinal, staggered implementation study to examine the acceptability and short-term impacts of Policy Codesign in resolving critical challenges in behavioral health policy formation. The aims are to (1) examine the acceptability, feasibility, and reach of Policy Codesign within two geographically distinct counties in Washington state, USA; (2) examine the impact of Policy Codesign on multisector policy development within these counties using social network analysis; and (3) assess the perceived replicability of Policy Codesign among leaders and other staff of policy-oriented state behavioral health intermediary organizations across the USA. DISCUSSION: This study will assess the feasibility of a specific approach to collaborative policy development, Policy Codesign, in two diverse regions. Results will inform a subsequent multi-state study measuring the impact and effectiveness of this approach for achieving multi-sector and evidence informed policy development in adolescent SUD prevention and treatment.

Strategies for enacting health policy codesign: a scoping review and direction for research.

BACKGROUND: Strategies for supporting evidence-informed health policy are a recognized but understudied area of policy dissemination and implementation science. Codesign describes a set of strategies potentially well suited to address the complexity presented by policy formation and implementation. We examine the health policy literature describing the use of codesign in initiatives intended to combine diverse sources of knowledge and evidence in policymaking. METHODS: The search included PubMed, MEDLINE, PsychInfo, CINAHL, Web of Science, and Google Scholar in November 2022 and included papers published between 1996 and 2022. Terms included codesign, health, policy, and system terminology. Title and abstracts were reviewed in duplicate and included if efforts informed policy or system-level decision-making. Extracted data followed scoping review guidelines for location, evaluation method, health focus, codesign definition, description, level of health system user input, sectors involved, and reported benefits and challenges. RESULTS: From 550 titles, 23 citations describing 32 policy codesign studies were included from multiple continents (Australia/New Zealand, 32%; UK/Europe, 32%; South America, 14%; Africa, 9%; USA/Canada 23%). Document type was primarily case study (77%). The area of health focus was widely distributed. Policy type was more commonly little p policy (47%), followed by big p policy (25%), and service innovations that included policy-enabled funding (25%). Models and frameworks originated from formal design (e.g., human-centered or participatory design (44%), political science (38%), or health service research (16%). Reported outcomes included community mobilization (50%), policy feasibility (41%), improved multisector alignment (31%), and introduction of novel ideas and critical thinking (47%). Studies engaging policy users in full decision-making roles self-reported higher levels of community mobilization and community needs than other types of engagement. DISCUSSION: Policy codesign is theoretically promising and is gaining interest among diverse health sectors for addressing the complexity of policy formation and implementation. The maturity of the science is just emerging. We observed trends in the association of codesign strategies and outcomes that suggests a research agenda in this area could provide practical insights for tailoring policy codesign to respond to local contextual factors including values, needs, and resources.

A landscape assessment of the activities and capacities of evidence-to-policy intermediaries (EPI) in behavioral health.

BACKGROUND: A significant gap exists between the production of research evidence and its use in behavioral health policymaking. Organizations providing consulting and support activities for improving policy represent a promising source for strengthening the infrastructure to address this gap. Understanding the characteristics and activities of these evidence-to-policy intermediary (EPI) organizations can inform the development of capacity-building activities, leading to strengthened evidence-to-policy infrastructure and more widespread evidence-based policymaking. METHODS: Online surveys were sent to 51 organizations from English-speaking countries involved in evidence-to-policy activities in behavioral health. The survey was grounded in a rapid evidence review of the academic literature regarding strategies used to influence research use in policymaking. The review identified 17 strategies, which were classified into four activity categories. We administered the surveys via Qualtrics and calculated the descriptive statistics, scales, and internal consistency statistics using R. RESULTS: A total of 31 individuals completed the surveys from 27 organizations (53% response rate) in four English-speaking countries. EPIs were evenly split between university (49%) and non-university (51%) settings. Nearly all EPIs conducted direct program support (mean = 4.19/5 [sd = 1.25]) and knowledge-building (4.03 [1.17]) activities. However, engagement with traditionally marginalized and non-traditional partners (2.84 [1.39]) and development of evidence reviews using formal critical appraisal methods (2.81 [1.70]) were uncommon. EPIs tend to be specialized, focusing on a group of highly related strategies rather than incorporating multiple evidence-to-policy strategies in their portfolios. Inter-item consistency was moderate to high, with scale α's ranging from 0.67 to 0.85. Ratings of respondents' willingness to pay for training in one of three evidence dissemination strategies revealed high interest in program and policy design. CONCLUSIONS: Our results suggest that evidence-to-policy strategies are frequently used by existing EPIs; however, organizations tend to specialize rather than engage in a breadth of strategies. Furthermore, few organizations reported consistently engaging with non-traditional or community partners. Focusing on building capacity for a network of new and existing EPIs could be a promising strategy for growing the infrastructure needed for evidence-informed behavioral health policymaking.

Racial disparities in youth pretrial detention: a retrospective cohort study grounded in critical race theory.

BACKGROUND AND METHOD: Pretrial detention makes up 75% of juvenile detention admissions and contributes to the disproportionate contact of minoritized youth in the juvenile carceral system. Given that prior evidence largely examines differences between Black and white youth, this study expands research on disproportionate contact in the pretrial detention setting to Hispanic/Latinx, Indigenous, and Asian youth. With a sample of over 44,000 juvenile cases in a northwest state, we used a generalized linear mixed model to estimate the effect of individual level characteristics while accounting for the random effect of differences at the county level. Additionally, we utilized Critical Race Theory (CRT) in formulating our theoretical model and predictions and apply CRT in our analysis and discussion of our results. In doing so we hope to build upon its application in public health discourse for naming and deconstructing processes that lead to unjust social and health stratification. RESULTS: After factoring in gender, age, crime severity, previous offenses, and variation between counties, our analyses show that Black, Hispanic/Latinx, and American Indian/Alaskan Native youth are more likely to experience pretrial detention than white youth. The likelihood of pretrial detention for Asian youth and for youth identified as "Other" or "Unknown" was not significantly different from white youth. CONCLUSIONS: As the iatrogenic effects of detention are disproportionately imposed upon youth of color-particularly Black, Indigenous, and Hispanic/Latinx youth-the disparities present in our study reveal further evidence of institutional racism. In this way, we can see how this carceral process operates as a mechanism of racialized social stratification as put forth by CRT. Considering implications for policy or further research, persistent disparity highlights an enduring need for building or strengthening diversion programs and alternatives to the carceral system, with emphasis on those that are culturally responsive.

Expert versus Youth Raters on Measuring Social and Therapeutic Climate in Secure Juvenile Placement.

Growing concern about the use of incarceration is driving significant reform in juvenile legal system decision-making and is likely to have a substantial impact on the role residential options play in the future continuum of care. It appears inevitable that surviving institutions or alternative residential models will be increasingly scrutinized for their impact on youth development. While rehabilitative models focused on youth development are a promising and growing part of residential institutions, few tools are available to measure quality. For institutions to sustain a focus on quality assessment, programs should use an organized and specified treatment model`` against which staff behavior can be assessed. This study examined the concurrent validity and item functioning of corresponding youth and expert ratings of social and therapeutic climate across multiple sites in a state-wide juvenile residential setting (n = 225 paired observations). Results suggest that the reliability of expert ratings of therapeutic climate exceeds the reliability of youth ratings, whereas reliability for other indicators of social climate are roughly equal between rater types. In addition, youth and expert ratings had weak concurrent validity. Implications for the use of youth versus expertly trained raters for measuring social and therapeutic environment are discussed.

Reciprocal associations between housing instability and youth criminal legal involvement: a scoping review.

BACKGROUND: Youth experiencing homelessness have disproportionate contact with the criminal legal system. This system contact represents a critical inflection point for enhancing risk or opportunities for stabilization; however, the policy and scholarly traditions examining the criminal legal system have not traditionally incorporated housing or other social determinants as a central focus of intervention. METHODS: We conducted a scoping review using PRISMA-ScR guidelines to examine how the research literature is currently addressing housing within the context of youth involvement in the legal system. Databases searched included PubMed, Web of Science, and Academic Search Complete. Google Scholar was used to identify papers not indexed in the academic databases of interest. Database searches were conducted between September and December 2019 and articles were restricted to those published in English between the year 2000 and 2019. Key study components extracted included demographic information regarding each sample, type of article, study methodology, direction of effects of interest, outcome measures and primary findings, as well as theoretical frameworks engaged by the authors. RESULTS: The search results returned 2154 titles for review. After screening all 2154 titles, 75 met eligibility for inclusion. Abstract reviews were conducted for all 75 papers. 36 abstracts met eligibility criteria and underwent full-text review. Ultimately, 29 articles satisfied eligibility criteria and were included in this scoping review. CONCLUSIONS: Publications are primarily focused on the social epidemiology of risk factors and behaviors determining youth justice contact, but relatively less so on studies of interventions targeting youth delinquency, crime reduction, or recidivism that included housing support. The lack of continuity in theorizing from epidemiology to applied science in this area represents a gap in the literature that is likely reducing the effectiveness of interventions to interrupt patterns of legal system contact for youth. Integrating a public health framework that emphasizes the upstream social determinants leading to contact with the youth justice system would represent a paradigm shift for the field that would have beneficial effects on long term health outcomes for youth.

Cocreating evidence-informed health equity policy with community.

OBJECTIVE: To explore the feasibility of a rapid, community-engaged strategy to prioritize health equity policy options as informed by research evidence, community-voiced needs, and public health priorities. DATA SOURCES: Data came from residents in a midsized, demographically, and geographically diverse county over a period of 8 months in 2020 and an evidence review of the health equity policy literature during the same time period. STUDY DESIGN: A descriptive case study is used to explore the feasibility and potential value of a community codesigned approach to establish community priorities for health equity policy. DATA COLLECTION/EXTRACTION METHODS: Evidence synthesis of health equity policy was conducted parallel to 15 community listening sessions across the county to elicit information on health needs. We used scoping review methods to obtain literature from academic databases and scholarly public health and policy organizations. This information was cross walked with themes from the listening sessions to identify 10 priority policy areas, which were taken back to the community for 15 participatory discussion and ranking sessions. PRINCIPAL FINDINGS: The process appeared to authentically engage the input of 200 community members representative of minoritized groups while identifying 99 evidence-informed policy levers to promote health equity. Discussion and ranking activities were successful in facilitating community discussion and policy decision making. Remote platforms may have limited the engagement of some residents while promoting the participation of others. Conducting information integration within the research team prior to community policy ranking sessions limited the community ownership over how policies were interpreted and communicated. CONCLUSIONS: A combination of information integration and community ranking activities can be used to achieve community-engaged policy prioritization of options in a fairly rapid period of time. While this process provides an example of authentic community ownership of policy prioritization, the compressed timeline limited the community's engagement in the information integration phase.

The implementation potential of a method to monitor empirically-supported children's mental health treatment through claims data.

BACKGROUND: The delivery of evidence-supported treatments (EST) in children's mental health could be a valuable measure for monitoring mental healthcare quality; however, efforts to monitor the use of EST in real world systems are hindered by the lack of pragmatic methods. This mixed methods study examined the implementation and agency response rate of a pragmatic, claims-based measure of EST designed to be applied as a universal quality measure for child psychotherapy encounters in a state Medicaid system. METHODS: Implementation potential of the EST measure was assessed with healthcare leader rankings of the reporting method's acceptability, appropriateness and feasibility (n = 53), and post-implementation ratings of EST rate accuracy. Ability of the healthcare system to monitor EST through claims was measured by examining the agency responsivity in using the claims-based measure across 98 Medicaid-contracted community mental health (CMH) agencies in Washington State. RESULTS: The analysis found the reporting method had high implementation potential. The method was able to measure the use of an EST for 83% of children covered by Medicaid with 58% CMH agencies reporting > 0 ESTs in one quarter. Qualitative analyses revealed that the most significant barrier to reporting ESTs was the operability of electronic health record systems and agencies' mixed views regarding the accuracy and benefits of reporting. CONCLUSIONS: Measurement of child mental health ESTs through Medicaid claims reporting has acceptable implementation potential and promising real world responsiveness from CMH agencies in one state. Variation in reporting by agency site and low to moderate perceived value by agency leaders suggests the need for additional implementation supports for wider uptake.

Advancing the state-level tracking of evidence-based practices: a case study.

BACKGROUND: Despite a sustained focus by policymakers and researchers on improving the standard of clinical care in public mental health services, the use of evidence-based practice remains low. Among other challenges, this reflects the difficulty of translating clinical research into useable policy that can be feasibly funded and monitored by state or large healthcare systems. CASE PRESENTATION: In this paper we present a case study of Washington State's strategy for monitoring the use of clinical elements at the session level for all Medicaid-funded children's mental health services. The implementation of this strategy reflects policy actions to promote effective practice while also actively influencing multiple other levels of the implementation ecology. The approach is informed by the Policy Ecology Framework, the Consolidated Framework for Implementation Research, the evidence-based policymaking literature, and common ontology and clinical elements models. CONCLUSIONS: We found the strategy developed in Washington State to be a feasible method of collecting session level information about the use of effective clinical mental health practices. In addition, the approach appears to be having influence on multiple layers of the implementation ecology that could be explored through further study.

The Consistencies and Vagaries of the Washington State Inventory of Evidence-Based Practice: The Definition of "Evidence-Based" in a Policy Context.

As states increasingly establish the importance of evidence-based practice through policy and funding mandates, the definition of evidence-based practice can have a significant impact on investment decisions. Not meeting established criteria can mean a loss of funding for established programs and the implementation disruption of programs without a strong research base. Whether the definition of "evidence-based" is influenced by these high stakes contexts is an interesting question that can inform the larger field about the value and utility of evidence-based practice lists/inventories for disseminating knowledge. In this paper we review the development of the Washington State Inventory of Evidence-Based, Research-Based and Promising Practices as a case study for the process of defining evidence-based practice in a policy context. As part of this study we also present a comparison of other well-known evidence-based practice inventories and examine consistencies and differences in the process of identifying and developing program ratings.

Community-Sourced Intervention Programs: Review of Submissions in Response to a Statewide Call for "Promising Practices".

This study was initiated to add to the nascent literature on locally-grown intervention programs in the youth mental health, child welfare, and juvenile justice service sectors, many of which demonstrate practice-based or community-defined evidence, but may not have been subjected to empirical evaluation. Characteristics of applications submitted in response to three public calls for additions to an inventory of research-supported intervention programs were reviewed on evidence for effectiveness, the use of key quality assurance (QA) elements (e.g., clearly specified training or integrity monitoring procedures), and cultural specificity. Findings indicate that four QA processes were identified in approximately half of all submissions: a specific initial training process, the existence of intervention integrity measures, routine outcome monitoring, and ongoing support post-training. An initial training process and integrity measurement were more commonly described among programs determined to have greater research evidence for their effectiveness. Overall, cultural elements were described relatively infrequently and most often reflected surface-level program delivery characteristics (e.g., offering services in languages other than English). Discussion is focused on the alignment of submitted programs with the larger literatures focused on implementation science and cultural competence.

Evidence-Based Program Service Deserts: A Geographic Information Systems (GIS) Approach to Identifying Service Gaps for State-Level Implementation Planning.

The long term effects of untreated mental health need for individuals, families and society has prompted a number of federal policy statements encouraging the use of evidence-based programs (EBP) in children's healthcare. However, among other challenges of evidence-based practice implementation, states often do not know where to make investments based on population need. In this paper we present the use of a Geographic Information System approach to undertake a mental health needs assessment for Washington State. Our study found that this technology can be beneficially applied to conducting needs assessment for EBP implementation, and we provide recommendations for future applications.

A Research Framework for Understanding the Practical Impact of Family Involvement in the Juvenile Justice System: The Juvenile Justice Family Involvement Model.

Family involvement is recognized as a critical element of service planning for children's mental health, welfare and education. For the juvenile justice system, however, parents' roles in this system are complex due to youths' legal rights, public safety, a process which can legally position parents as plaintiffs, and a historical legacy of blaming parents for youth indiscretions. Three recent national surveys of juvenile justice-involved parents reveal that the current paradigm elicits feelings of stress, shame and distrust among parents and is likely leading to worse outcomes for youth, families and communities. While research on the impact of family involvement in the justice system is starting to emerge, the field currently has no organizing framework to guide a research agenda, interpret outcomes or translate findings for practitioners. We propose a research framework for family involvement that is informed by a comprehensive review and content analysis of current, published arguments for family involvement in juvenile justice along with a synthesis of family involvement efforts in other child-serving systems. In this model, family involvement is presented as an ascending, ordinal concept beginning with (1) exclusion, and moving toward climates characterized by (2) information-giving, (3) information-eliciting and (4) full, decision-making partnerships. Specific examples of how courts and facilities might align with these levels are described. Further, the model makes predictions for how involvement will impact outcomes at multiple levels with applications for other child-serving systems.

Achieving successful evidence-based practice implementation in juvenile justice: The importance of diagnostic and evaluative capacity.

Evidence-based programs (EBPs) are an increasingly visible aspect of the treatment landscape in juvenile justice. Research demonstrates that such programs yield positive returns on investment and are replacing more expensive, less effective options. However, programs are unlikely to produce expected benefits when they are not well-matched to community needs, not sustained and do not reach sufficient reach and scale. We argue that achieving these benchmarks for successful implementation will require states and county governments to invest in data-driven decision infrastructure in order to respond in a rigorous and flexible way to shifting political and funding climates. We conceptualize this infrastructure as diagnostic capacity and evaluative capacity: Diagnostic capacity is defined as the process of selecting appropriate programing and evaluative capacity is defined as the ability to monitor and evaluate progress. Policy analyses of Washington State, Pennsylvania and Louisiana's program implementation successes are used to illustrate the benefits of diagnostic and evaluate capacity as a critical element of EBP implementation.

American Indian perspectives on evidence-based practice implementation: results from a statewide Tribal Mental Health Gathering.

Implementation of Evidence-Based Practices (EBP) within American Indian and Alaskan Natives communities is currently an area of debate and contention. There is considerable concern about expanding EBP policy mandates to AI/AN communities as these mandates, either through funding restrictions or other de facto policies, recall past histories of clinical colonization and exploitation by the state and federal government. As a response, work is being done to evaluate indigenous programs and examine strategies for culturally-sensitive implementation. While the literature reflects the perspectives of AI/AN populations on EBP generally, no one has yet reported the perspectives of AI/AN communities on how to feasibly achieve widespread EBP implementation. We report the findings of a statewide Tribal Gathering focused on behavioral health interventions for youth. The Gathering participants included AI/AN individuals as well as staff working with AI/AN populations in tribal communities. Participants identified strengths and weaknesses of the five legislatively fundable programs for youth delinquency in Washington State and discussed strategies likely to be effective in promoting increased uptake within tribes. Analysis of these discussions resulted in many useful insights in program-specific and community-driven strategies for implementation. In addition, two major themes emerged regarding widespread uptake: the importance of a multi-phase engagement strategy and adopting a consortium/learning community model for implementation. The findings from this Gathering offer important lessons that can inform current work regarding strategies to achieve a balance of program fidelity and cultural-alignment. Attending to engagement practices at the governance, community and individual level are likely to be key components of tribal-focused implementation. Further, efforts to embed implementation within a consortium or learning community hold considerable promise as a strategy for sustainability.

Adolescent use of school-based health centers and high school dropout.

OBJECTIVE: To determine the association between use of school-based health centers (SBHCs) and school dropout. DESIGN: Quasi-experimental longitudinal analysis of a retrospective student cohort, with SBHC use as the independent variable. We statistically controlled for dropout risk and used propensity score regression adjustment to control for several factors associated with SBHC use. SETTING: Integrated database from an urban public school district (academic outcomes) and department of public health (SBHC use). PARTICIPANTS: District-enrolled students in their first semester of ninth grade in 2005 (N = 3334), followed up through their anticipated on-time graduation semester of 12th grade in 2009. Students were divided into 4 groups: never used (47%); low use (23%); moderate use (20%); and high users (10%). OUTCOME MEASURE: Time to nongraduation (described as dropout). RESULTS: Low to moderate SBHC use (0.125-2.5 visits per semester) was associated with a 33% reduction in dropout compared with non-SBHC users. The high-use group (>2.5 visits per semester) did not have dropout rates that differed from nonusers. For SBHC users who did drop out, dropout occurred approximately 1 semester later than nonusers. Exploratory analyses revealed that the association between SBHC use and prevention of dropout was greatest for higher-risk students. CONCLUSIONS: This study found an association between low to moderate SBHC use and reductions in dropout for high school students in an urban school district, especially for students at higher risk for dropout. This study supports the theory that benefits of SBHCs extend beyond managing physical and mental health needs to include academic outcomes.

Impact of School-Based Health Center use on academic outcomes.

PURPOSE: The purpose of this study was twofold: (1) to examine the effects of School-Based Health Center (SBHC) use on academic outcomes for high school students, using a well-controlled, longitudinal model, and (2) to examine whether SBHC medical and mental health service use differentially impacts academic outcomes. METHODS: Analyses used a latent variable growth curve modeling approach to examine longitudinal outcomes over five school semesters for ninth grade SBHC users and nonusers from Fall 2005 to Fall 2007 (n = 2,306). Propensity score analysis was used to control for self-selection factors in the SBHC user and nonuser groups. RESULTS: Results indicated a significant increase in attendance for SBHC medical users compared to nonusers. Grade point average increases over time were observed for mental health users compared to nonusers. Discipline incidents were not found to be associated with SBHC use. CONCLUSIONS: SBHC use was associated with academic improvements over time for a high-risk group of users. The moderating effect of type of use (medical and mental health) reinforces the importance of looking at subgroups when determining the impact of SBHC use on outcomes.

Four-facet PCL-R structure and cognitive functioning among high violent criminal offenders.

High violent inmates (N = 126) were administered the Psychopathy Checklist-Revised (PCL-R; Hare, Clark, Grann, & Thornton, 2000; Hare et al., 1990) and neuropsychological measures. No significant correlations were present between the overall PCL-R score and 14 cognitive measures. A violence score, computed as the total number of violent acts across all situations and types, was significantly correlated with the PCL-R total score and Facet 2 but not with the other three facets. Our data suggest that Facet 2 elevations may prove relevant to violence risk assessment; this link, however, needs further exploration with larger samples.

Parenting as a moderator of minority, adolescent victimization and violent behavior in high-risk neighborhoods.

Adolescent male youth in high-crime neighborhoods are at the greatest risk for personal victimization and violent behavior. The temporal relationship between victimization and violent behavior for minority youth in high-crime neighborhoods was examined to determine whether victimization is a risk factor for or by-product of violent behavior. Whether parenting and other control factors moderated the relationship between victimization and violent behavior was also examined. Interviews with 349 urban Hispanic and African American youth revealed that victimization was strongly associated with violent behavior and violent behavior was found to precede direct victimization. Race was found to moderate the relationship between parental attachment and violent behavior. African American youth with the highest levels of parental attachment also had the highest levels of violent behavior, while higher parental attachment for Latino youth was associated with lower violent behavior.