Who gets screened and who tests positive? Drug screening among justice-involved youth in a midwestern urban county.

BACKGROUND: Given high rates of substance use among justice-involved youth, justice systems have attempted to monitor use through drug screening (DS) procedures. However, there is discretion in deciding who is screened for substance use, as not every youth who encounters the system is screened. The aim of the current study was to examine factors associated with selection for and results of oral DS among justice-involved youth assigned to probation to better inform potential DS policy. Electronic court records from 4,668 youth with first-incident records assigned to probation in a midwestern urban county's juvenile justice system between 2011 and 2016 were included in the analytical sample. Race/ethnicity, gender, age, number of charges and charge type for the current incident were included as independent variables. RESULTS: Multivariable hierarchical logistic regression analyses indicated that males were more likely to be assigned to DS (aOR = 0.40, 95%CI [0.34, 0.46]), and more likely to test positive for use (aOR = 0.43, 95% CI [0.34, 0.54]) than females. As age increased, youth were less likely to be assigned to DS (aOR = 0.91, 95% CI [0.87, 0.94]), with non-significant differences in DS results. Greater number of charges were associated with a higher likelihood of being assigned to DS (aOR = 1.55, 95% CI [1.43, 1.68]). Youth with violent offenses were more likely to be assigned to DS than those with other offense types (property offenses, drug offenses, statutory offenses, disorderly conduct, and all other offenses), but less likely to test positive for use. CONCLUSIONS: Many factors were associated with differences in DS, but these factors were not always associated with differential DS results. Demographic or charge-based decisions may not be appropriate for DS assignment.

A classification system for youth outpatient behavioral health services billed to medicaid.

Rates of youth behavioral health concerns have been steadily rising. Administrative data can be used to study behavioral health service utilization among youth, but current methods that rely on identifying an associated behavioral health diagnosis or provider specialty are limited. We reviewed all procedure codes billed to Medicaid for youth in one U.S. county over a 10-year period. We identified 158 outpatient behavioral health procedure codes and classified them according to service type. This classification system can be used by health services researchers to better characterize youth behavioral health service utilization.

Initial Validation of a Computerized Adaptive Test for Substance Use Disorder Identification in Adolescents.

PURPOSE: Computerized adaptive tests (CATs) are highly efficient assessment tools that couple low patient and clinician time burden with high diagnostic accuracy. A CAT for substance use disorders (CAT-SUD-E) has been validated in adult populations but has yet to be tested in adolescents. The purpose of this study was to perform initial evaluation of the K-CAT-SUD-E (i.e., Kiddy-CAT-SUD-E) in an adolescent sample compared to a gold-standard diagnostic interview. METHODS: Adolescents (N = 156; aged 11-17) with diverse substance use histories completed the K-CAT-SUD-E electronically and the substance related disorders portion of a clinician-conducted diagnostic interview (K-SADS) via tele-videoconferencing platform. The K-CAT-SUD-E assessed both current and lifetime overall SUD and substance-specific diagnoses for nine substance classes. RESULTS: Using the K-CAT-SUD-E continuous severity score and diagnoses to predict the presence of any K-SADS SUD diagnosis, the classification accuracy ranged from excellent for current SUD (AUC = 0.89, 95% CI = 0.81, 0.95) to outstanding (AUC = 0.93, 95% CI = 0.82, 0.97) for lifetime SUD. Regarding current substance-specific diagnoses, the classification accuracy was excellent for alcohol (AUC = 0.82), cannabis (AUC = 0.83) and nicotine/tobacco (AUC = 0.90). For lifetime substance-specific diagnoses, the classification accuracy ranged from excellent (e.g., opioids, AUC = 0.84) to outstanding (e.g., stimulants, AUC = 0.96). K-CAT-SUD-E median completion time was 4 min 22 s compared to 45 min for the K-SADS. CONCLUSIONS: This study provides initial support for the K-CAT-SUD-E as a feasible accurate diagnostic tool for assessing SUDs in adolescents. Future studies should further validate the K-CAT-SUD-E in a larger sample of adolescents and examine its acceptability, feasibility, and scalability in youth-serving settings.

HIV Care Continuum Among People Living With HIV and History of Arrest and Mental Health Diagnosis.

OBJECTIVE: Justice involvement and psychiatric comorbidities contribute to excess HIV morbidity, yet their interaction is poorly understood. We examined associations of this overlap with HIV outcomes among people living with HIV (PLWH). METHODS: We conducted a retrospective cohort study of PLWH aged 13 years and older residing in Marion County (Indianapolis), IN, during 2018 (n = 5730) using linked HIV surveillance, arrest, and clinical data. We used univariable and multivariable regression to evaluate main and interaction effects of 2010-2017 arrest and mental health diagnosis on 2018 linkage to care (LTC), retention in care (RIC), and undetectable viral load (UVL). RESULTS: LTC decreased among those with, versus without, an arrest (P = 0.02), although mental health diagnoses had no significant effect on LTC. When controlling for demographics and substance use disorder, analyses indicated a protective effect of arrest history on odds of RIC (adjusted odds ratio [aOR] = 1.54) and UVL (aOR = 1.26). Mental health diagnosis also increased odds of RIC (aOR = 2.02) and UVL (aOR = 1.95). Post hoc tests demonstrated that these results were mediated by outpatient care utilization, although an arrest or mental health diagnosis did increase odds of RIC among PLWH and a history of low outpatient utilization. CONCLUSIONS: Outpatient care utilization improves HIV outcomes, even among those with justice involvement and psychiatric comorbidities. Holistic approaches to care can increase utilization. Implementation of "no wrong door" approaches, such as integration of mental health care in the primary care setting, simplifies health care navigation and improves access. Among those arrested, access to a Behavioral Court program can improve, rather than disrupt, HIV care.

Engagement With Mental Health Services Among Survivors of Firearm Injury.

Importance: Despite the prevalence of posttraumatic stress symptoms after firearm injury, little is known about how firearm injury survivors connect with mental health services. Objective: To determine facilitators and barriers to mental health care engagement among firearm injury survivors. Design, Setting, and Participants: A qualitative study of 1-on-1, semistructured interviews conducted within a community setting in Indianapolis, Indiana, between June 2021 and January 2022. Participants were recruited via community partners and snowball sampling. Participants who survived an intentional firearm injury, were shot within Indianapolis, were aged 13 years or older, and were English speaking were eligible. Participants were asked to discuss their lives after firearm injury, the emotional consequences of their injury, and their utilization patterns of mental health services. Data were analyzed from August 2022 to June 2023. Main Outcomes and Measures: Survivors' lived experience after firearm injury, sources of emotional support, mental health utilization, and their desired engagement with mental health care after firearm injury. Results: A total of 18 participants (17 were Black [94%], 16 were male [89%], and 14 were aged between 13 and 24 years [77%]) who survived a firearm injury were interviewed. Survivors described family members, friends, and informal networks as their main source of emotional support. Barriers to mental health care utilization were perceived as a lack of benefit to services, distrust in practitioners, and fear of stigma. Credible messengers served as facilitators to mental health care. Survivors also described the emotional impact their shooting had on their families, particularly mothers, partners, and children. Conclusions and Relevance: In this study of survivors of firearm injury, findings illustrated the consequences of stigma and fear when seeking mental health care, inadequate trusted resources, and the need for awareness of and access to mental health resources for family members and communities most impacted by firearm injury. Future studies should evaluate whether community capacity building, digital health delivery, and trauma-informed public health campaigns could overcome these barriers to mitigate the emotional trauma of firearm injuries to reduce health disparities and prevent future firearm violence.

Family history of substance use disorder and parental impulsivity are differentially associated with neural responses during risky decision-making.

Background: Risky decision-making is associated with the development of substance use behaviors during adolescence. Although prior work has investigated risky decision-making in adolescents at familial high risk for developing substance use disorders (SUDs), little research has controlled for the presence of co-morbid externalizing disorders (EDs). Additionally, few studies have investigated the role of parental impulsivity in offspring neurobiology associated with risky decision-making. Methods: One-hundred twenty-five children (28 healthy controls, 47 psychiatric controls with EDs without a familial history of SUD, and 50 high-risk children with co-morbid EDs with a familial history of SUD) participated in the Balloon Analog Risk Task while undergoing functional magnetic resonance imaging. Impulsivity for parents and children was measured using the UPPS-P Impulsive Behavior Scale. Results: We found that individuals in the psychiatric control group showed greater activation, as chances of balloon explosion increased, while making choices, relative to the healthy control and high-risk groups in the rostral anterior cingulate cortex (rACC) and lateral orbitofrontal cortex (lOFC). We also found a positive association between greater activation and parental impulsivity in these regions. However, within rACC, this relationship was moderated by group, such that there was a positive relationship between activation and parental impulsivity in the HC group, but an inverse relationship in the HR group. Conclusions: These findings suggest that there are key differences in the neurobiology underlying risky decision-making in individuals with EDs with and without a familial history of SUD. The current findings build on existing models of neurobiological factors influencing addiction risk by integrating parental factors. This work paves the way for more precise risk models in which to test preventive interventions.

Caregiver and Juvenile Justice Personnel Perspectives on challenges and importance of caregiver engagement and the potential utility of a peer navigator program in the Juvenile Justice System.

BACKGROUND: For youth involved in the juvenile justice (JJ) system, caregiver involvement and engagement in the system is crucial for youth development and outcomes of JJ cases; however, there are challenges to establishing positive/productive partnerships between caregivers and JJ representatives. The current project examines perspectives of caregivers and JJ personnel regarding facilitators and barriers to establishing JJ-caregiver partnerships, as well as their perceptions of the use of a caregiver navigator program to support caregivers of system-involved youth. Results are used to inform development of a caregiver navigator program to support caregivers and help them navigate the JJ system. RESULTS: Semi-structured interviews were conducted with caregivers of youth involved in JJ (n = 15, 53% White, 93% female), JJ personnel (n = 7, 100% White, 50% female), and JJ family advisory board members (n = 5, 100% Black, 100% female). Caregivers reported varying experiences across intake/arrest, court, and probation processes. Positive experiences were characterized by effective communication and feeling supported by JJ. Negative experiences related to feeling blamed and punished for their child's system involvement and feeling unsupported. JJ interviews corroborated caregiver sentiments and also illustrated facilitators and barriers to JJ-caregiver partnerships. Both JJ personnel and caregivers endorsed potential benefits of a peer-based caregiver navigator program to provide social, informational, and emotional support. CONCLUSION: Continued work is needed to improve JJ-caregiver partnerships and use of a peer-based navigator program has the potential to address barriers to caregiver engagement in the JJ system.

Antecedents of fatal overdose in an adult cohort identified through administrative record linkage in Indiana, 2015-2022.

BACKGROUND: The United States continues to experience unprecedented rates of overdose mortality and need to identify effective policies or practices that can be implemented. This study aims to measure the prevalence, frequency, timing, and rate of touchpoints that occurred prior to a fatal overdose where communities might intervene. METHODS: In collaboration with Indiana state government, we conducted record-linkage of statewide administrative datasets to vital records (January 1, 2015, through August 26, 2022) to identify touchpoints (jail booking, prison release, prescription medication dispensation, emergency department visits, and emergency medical services). We examined touchpoints within 12-months prior to a fatal overdose among an adult cohort and explored variation over time and by demographic characteristics. RESULTS: Over the 92-month study period there were 13,882 overdose deaths (89.3% accidental poisonings, X40-X44) in our adult cohort that were record-linked to multiple administrative datasets and revealed nearly two-thirds (64.7%; n=8980) experienced an emergency department visit, the most prevalent touchpoint followed by prescription medication dispensation, emergency medical services responses, jail booking, and prison release. However, with approximately 1 out of every 100 returning citizens dying from drug overdose within 12-months of release, prison release had the highest touchpoint rate followed by emergency medical services responses, jail booking, emergency department visits, and prescription medication dispensation. CONCLUSION: Record-linking administrative data from routine practice to vital records from overdose mortality is a viable means of identifying where resources should be situated to reduce fatal overdose, with potential to evaluate the effectiveness of overdose prevention efforts.

Evidence-based Treatment for Substance Use Disorders in Community Mental Health Centers: the ACCESS Program.

A significant gap remains in the availability and accessibility of evidence-based treatments (EBTs) in community substance use disorder (SUD) treatment. This study describes a 2-year statewide training initiative that sought to address this gap by training community-based therapists in motivational enhancement/cognitive behavioral therapy (MET/CBT). Therapists (N = 93) participated in a 2-day MET/CBT workshop followed by bi-weekly clinical consultation, fidelity monitoring, guided readings, and online resources. Therapists completed pre-training and follow-up assessments measuring knowledge, attitudes, confidence, and implementation barriers. Most therapists attended 10 or more consultation calls. Submission of session recordings for feedback was the least utilized training element. Therapists reported increased confidence in their ability to implement MET/CBT for SUD and demonstrated improvement in MI and CBT knowledge. Therapists reported several implementation barriers, including lack of time and opportunity to treat patients with MET/CBT. Recommendations for future training initiatives and addressing the barriers identified in this study are discussed.

Perception of Procedural Justice Amongst Previously Incarcerated Youth: Procedural Justice in Incarcerated Youth.

Violence among incarcerated youths is a serious public health issue and an area of marked health disparities. Procedural Justice is an ethical framework to guide policy approaches in the criminal justice system. The purpose of our study was to evaluate youth perception of neutrality, respect, trust, and voice while incarcerated. Young people ages 14 to 21 previously incarcerated in a juvenile detention facility were interviewed regarding their perceptions of procedural justice. Participants were recruited from community-based organizations. Interviews were semi-structured, lasting for 1 hr. Interviews were coded for themes related to procedural justice. Twenty-eight participants were interviewed regarding their experience with procedural justice while incarcerated. Key themes included: Neutrality: Participants felt that they were treated impartially regarding everyone receiving the same punishment for offenses; however, levels of punishments for offenses were inconsistent. Respect: Participants often felt disrespected by staff. Trust: The participants did not feel safe to trust. Voice: Participants felt they had no voice while incarcerated. Previously incarcerated youth perceptions indicated a need for more training in the juvenile detention system to enable staff members to have a better understanding of procedural justice and to appropriately utilize it.

Associations between outpatient treatment and the use of intensive psychiatric healthcare services.

The current manuscript examines concurrent and longitudinal associations between the utilization of outpatient and intensive psychiatric services among Medicaid-enrolled youth. Using an administrative dataset of Medicaid claims from 2007 to 2017, youth were included if they were between the ages of 10-18 (M = 13.4, SD = 2.6) and had a psychiatric Medicaid claim (N = 33,590). Psychiatric services were coded as outpatient, emergency department (ED), inpatient, or residential based on Medicaid codes. Logistic regression analyses indicated that the receipt of even one outpatient visit significantly reduced the odds of having an ED, inpatient, and residential visit within 60-, 90-, and 120-day windows. Survival analyses indicated most youth did not have any ED, inpatient, or residential visit following their first outpatient visit. For remaining youth, having an outpatient visit significantly increased the risk of having an ED, inpatient, and residential visit following their initial appointment, which may suggest these youth are being triaged to a more appropriate level of care. Classification accuracy analyses indicated a cutoff of 2 outpatient visits yielded maximum accuracy in determining youth with ED, inpatient, and residential visits. Findings highlight use of outpatient-level services in reducing risk of more intensive service utilization.

Examining Patterns of Psychotherapy Service Utilization Among Medicaid-Enrolled Adolescents.

OBJECTIVE: Adolescents with behavioral health disorders (i.e., mental health disorders and substance use) often experience frequent recurrence of symptoms, suggesting a need for an ongoing behavioral health intervention, rather than a single course of treatment. However, little is known about mental health care service use among adolescents over longer periods. The authors examined longitudinal patterns of outpatient behavioral health service utilization in a large sample of adolescents. METHODS: Medicaid claims for 8,197 adolescents (ages 10.0-13.9 years, mean±SD=11.5±1.2; 61% male) from one Indiana county between 2006 and 2017 were examined, with a focus on outpatient psychotherapy visits. Latent class analysis (LCA) was used to detect clusters of longitudinal patterns of outpatient psychotherapy visits across 5 years, beginning with an adolescent's first behavioral health visit. RESULTS: A five-class LCA model emerged with unique classes of service use based on duration and level of engagement (frequency) of monthly outpatient psychotherapy visits. Most adolescents fell in the nonuse class (38.7% of the sample). Additional classes were defined as late-onset low engagement (17.1%), early-onset high engagement (15.5%), early-onset moderate engagement (16.7%), and continuously high engagement (11.9%). Statistically significant differences were found across the classes in average duration and frequency of involvement (p<0.001), as well as in demographic characteristics (race, age, gender, and ethnicity) and behavioral health diagnoses (p<0.001). CONCLUSIONS: These findings confirm that adolescents with behavioral health diagnoses do not follow a uniform pattern of psychotherapy utilization. The distinct patterns of service use point toward the need to identify appropriate long-term service recommendations for adolescents.

Ethical Approaches to Vaccine Allocation and Administration in Carceral Settings, With a Focus on Youth.

COVID-19 has disproportionately impacted Americans in carceral settings and secure facilities. A disproportionate number of persons who are confined to carceral settings and secure facilities are members of racial, ethnic, and socioeconomic groups who experience a significant burden of COVID-19 morbidity and mortality. The pandemic-related disparities experienced by minoritized and detained adult populations have received national attention, but the burden of COVID-19 risk among justice-involved youth has been largely absent from these national conversations. With more than 40,000 youth in carceral settings, their COVID-19 risks and prevention needs warrant specific consideration, especially as vaccine distribution programs expand. Youth have been assigned a lower priority status in most state vaccine allocation plans, but youth in carceral settings are at increased risk compared with their peers, raising important questions about how to ethically allocate and administer vaccines to them. In this article we examine ethical issues that arise in the health care of minors in carceral settings and identify an ethical model that could be used to reconsider the allocation of COVID-19 vaccines.

Comparing Practices Used in Overdose Fatality Review Teams to Recommended Implementation Guidelines.

OBJECTIVES: Overdose fatality review teams are a public health and public safety collaboration that reviews fatality cases using a multidisciplinary team to provide recommendations for overdose prevention. No research exists on the case review practices currently being used in these programs. DESIGN: We administered a cross-sectional survey measuring case review practices and perceptions to a convenience sample of overdose fatality review teams. SETTING: We administered the online survey to participants at a national virtual forum on overdose fatality review. PARTICIPANTS: In this study, we examined 30 county-level overdose fatality review teams from 6 states who completed the survey. MAIN OUTCOME MEASURES: We developed measures of case review practices from an overdose fatality review implementation guide. We provided descriptive statistics on the survey items used to measure these practices and examined how practice uptake varied by overdose fatality review team characteristics. RESULTS: Most overdose fatality review teams had adequate representation and membership, but none adhered to all of the practices measured from the implementation guide. The largest gap was in perceived effectiveness and implementation of case review recommendations. In addition, teams that had been reviewing cases for longer reported more adherence to recommended practices. CONCLUSIONS: Overdose fatality case review is a collaboration between local public health and public safety agencies that holds great promise. However, these teams will require additional training and technical assistance with local community support to ensure that recommendations are actionable.

Rates of Tobacco Use Disorder, Pharmacologic Treatment, and Associated Mental Health Disorders in a Medicaid Claim Review Among Youth in Indiana, USA.

Purpose: This study delineates a number of Medicaid youth with tobacco use disorder (TUD), prescribing habits for treatment, and associated externalizing disorders. Methods: Youth Medicaid claims from 2007-2017 processed in a large Midwestern city were analyzed for a diagnosis of TUD, related pharmacotherapy, and externalizing mental health and substance use disorders. Results: Claims connected 6541 patients with 42 890 visits. Mean age was 16.4 with 40% female. 1232 of the 6541 charts contained a TUD diagnosis equating to 1848 visits. A comorbid diagnosis of ADHD, cannabis use, and conduct disorder were more common in males (3.9% vs 1.3% in females; 3.4% vs .8%; and 2.8% vs .8%; P < .05). 808 scripts were provided to 152 of the 1232 youths, with 4.7% of those scripts a nicotine replacement product. Conclusions: Pharmacotherapy is underutilized in this Medicaid claims data set. Certain externalizing factors were associated with males with TUD more than females.

Treatment completion among justice-involved youth engaged in behavioral health treatment studies in the United States: A systematic review and meta-analysis.

Justice-involved youth (JIY) have high rates of behavioral health disorders, but few can access, much less complete, treatment in the community. Behavioral health treatment completion among JIY is poorly understood, even within treatment studies. Measurement, reporting, and rates of treatment completion vary across studies. This systematic review and meta-analysis synthesizes the literature on rates of treatment completion among JIY enrolled in research studies and identifies potential moderators. After systematically searching 6 electronic databases, data from 13 studies of 20 individual treatment groups were abstracted and coded. A meta-analysis examined individual prevalence estimates of treatment completion in research studies as well as moderator analyses. Prevalence effect sizes revealed high rates of treatment completion (pr = 82.6). However, analysis suggests a high likelihood that publication bias affected the results. Treatment groups that utilized family- or group-based treatment (pr = 87.8) were associated with higher rates of treatment completion compared to treatment groups utilizing individual treatment (pr = 61.1). Findings suggest that it is possible to achieve high rates of treatment completion for JIY, particularly within the context of family- and group-based interventions. However, these findings are limited by concerns about reporting of treatment completion and publication bias.

Impacts of COVID-19 at the intersection of substance use disorder treatment and criminal justice systems: findings from three states.

BACKGROUND: Individuals with substance use disorders (SUD), particularly opioid use disorder (OUD), who are criminal justice-involved are a particularly vulnerable population that has been adversely affected by COVID-19 due to impacts of the pandemic on both the criminal justice and treatment systems. The manuscript presents qualitative data and findings exploring issues related to SUD/OUD treatment among individuals involved in the justice system and the impacts of COVID-19 on these service systems. Qualitative data were collected separately by teams from three different research hubs/sites in Illinois, Indiana, and Kentucky; at each hub, data were collected from justice system personnel (n = 17) and community-level SUD/OUD providers (n = 21). Codes from two hubs were reviewed and merged to develop the cross-hub coding list. The combined codes were used deductively to analyze the third hub's data, and higher-level themes were then developed across all the hubs' data. RESULTS: Themes reflected the justice and treatment systems' responses to COVID-19, the intersection of systems and COVID-19's impact on providing OUD treatment for such individuals, and the use of telehealth and telejustice. CONCLUSIONS: Results highlight that despite rapid adaptations made by systems during the pandemic, additional work is needed to better support individuals with OUD who are involved in the justice system. Such work can inform longer-term public health crisis planning to improve community OUD treatment access and linkage for those who are criminal justice-involved.

Healthcare utilization and mental health outcomes among nonfatal shooting assault victims.

Victims of nonfatal shooting (NFS) assaults suffer from emotional and physical trauma; however, little is understood about clinical care utilization patterns among victims. This study examines the healthcare utilization and mental health outcomes before and after an index NFS victimization. A longitudinal dataset of police and clinical data were linked at the individual level to define a cohort of NFS victims with one or more clinical encounter in the 24-months preceding an index NFS injury (N = 2,681) in Indianapolis, Indiana between 2005 and 2018. Mental health was defined using ICD diagnosis codes from any emergency department, inpatient, or outpatient encounter and clinical care utilization was the number of unique encounters within the 24-months preceding and following an index NFS injury. Multivariable logistic regression was conducted to examine factors associated with a mental health diagnosis in the post injury period. Analyses were conducted in October 2021-March 2022. Overall clinical care utilization (Mean: pre = 277.7 (SD 235.3) vs. post = 333.9 (SD 255.1), p < 0.001) and mental health prevalence (14.4% pre vs. 18.8% post, p < 0.001) increased in the 24-months following an index NFS compared to the prior 24-months. Preinjury mental health utilization increased the odds of receiving a mental health diagnosis in the 24-months following an index NFS injury - particularly for Black victims (Odds Ratio 1.69, 95% CI 1.01, 2.85). The findings indicate missed opportunities within the healthcare system to connect NFS victims with needed mental health services, as well as the importance of premorbid connection to mental health care.

Becoming an Agile Change Conductor.

Background: It takes decades and millions of dollars for a new scientific discovery to become part of clinical practice. In 2015, the Center for Health Innovation & Implementation Science (CHIIS) launched a Professional Certificate Program in Innovation and Implementation Sciences aimed at transforming healthcare professionals into Agile Change Conductors capable of designing, implementing, and diffusing evidence-based healthcare solutions. Method: In 2022, the authors surveyed alumni from the 2016-2021 cohorts of the Certificate Program as part of an educational quality improvement inquiry and to evaluate the effectiveness of the program. Results: Of the 60 alumni contacted, 52 completed the survey (87% response rate) with 60% of graduates being female while 30% were an under-represented minority. On a scale from 1 to 5, the graduates agreed that the certificate benefited their careers (4.308 with a standard deviation (SD) of 0.612); expanded their professional network (4.615, SD of 0.530); and had a large impact on the effectiveness of their leadership (4.288, SD of 0.667), their change management (4.365, SD of 0.742), and their communication (4.392, SD of 0.666). Graduates claimed to use Agile Processes (Innovation, Implementation, or Diffusion), storytelling, and nudging weekly. On a scale from 0 to 10 where 10 indicates reaching a mastery, the average score for different Agile competencies ranged from 5.37 (SD of 2.80) for drafting business proposals to 7.77 (SD of 1.96) for self-awareness. For the 2020 and 2021 cohorts with existing pre and post training competency data, 22 of the 26 competencies saw a statistically significant increase. Conclusion: The Graduate Certificate has been able to create a network of Agile Change Conductors competent to design, implement, and diffuse evidence-based care within the healthcare delivery system. Further improvements in building dissemination mastery and program expansion initiatives are advised.