Implementation Strategy Fidelity and Organizational Outcomes in a Randomized Trial: Implications for Reentry from Corrections to Community Treatment.

Background: This study examined fidelity of implementation strategies used in an organizational process improvement intervention (OPII) designed to improve evidence-based practices related to assessments for drug-involved clients exiting incarceration. Leadership was studied as a moderating factor between fidelity and outcomes. Methods: A mixed-method cluster randomized design was used to randomize 21 sites to early- or delayed-start within 9 research centers. Parent study protocol was reviewed to develop fidelity constructs (i.e., responsiveness, dose, quality, adherence). Outcomes were site-level success in achieving goals and objectives completed during the OPII (e.g., percent goals achieved). Correlations, analyses of covariance, regressions and moderation analyses were performed. Qualitative interviews assessed facilitators/barriers to implementation. Results: Fidelity constructs related to outcomes. No differences were found in fidelity by early or delayed condition. At low levels of leadership, high staff responsiveness (i.e., engagement in the OPII) related to poorer outcome. Conclusions: It is important to consider contextual factors (e.g., leadership) that may influence implementation strategy fidelity when deploying evidence-based practices. Findings are relevant to researchers, clinicians, administrators and policy makers, and suggest that goal completion during implementation of evidence-based practices requires monitoring of leadership competence, fidelity to implementation strategies (i.e., staff responsiveness to strategies) and attendance to goal importance.

Using structured implementation interventions to improve referral to substance use treatment among justice-involved youth: Findings from a multisite cluster randomized trial.

INTRODUCTION: Youth involved in the justice system have high rates of alcohol and other drug use, but limited treatment engagement. JJ-TRIALS tested implementation activities with community supervision (CS) and behavioral health (BH) agencies to improve screening, identification of substance use service need, referral, and treatment initiation and engagement, guided by the BH Services Cascade and EPIS frameworks. This paper summarizes intervention impacts on referrals to treatment among youth on CS. METHODS: This multisite cluster-randomized trial involved 18 matched pairs of sites in 36 counties in seven states randomly assigned to core or enhanced conditions after implementing the core intervention at all sites for six months. Enhanced sites received external facilitation for local change team activities to reduce unmet treatment needs; Core sites were encouraged to form interagency workgroups. The dependent variable was percentage referred to treatment among youth in need (N = 14,012). Two-level Bayesian regression assessed factors predicting referral across all sites and time periods. Generalized linear mixed models using logit transformation tested two hypotheses: (H1) referrals will increase from baseline to the experimental period, (H2) referral increases will be larger in enhanced sites than in core sites. RESULTS: Although the intervention significantly increased referral, condition did not significantly predict referral across all time periods. Youth who tested drug positive, had an alcohol/other drug-related or felony charge, were placed in secure detention or assigned more intensive supervision, or who were White were more likely to be referred. H1 (p < .05) and H2 (p < .0001) were both significant in the hypothesized direction. Interaction analyses comparing site pair differences showed that findings were not consistent across sites. CONCLUSIONS: The percentage of youth referred to treatment increased compared with baseline overall, and enhanced sites showed larger increases in referrals over time. However, variations in effects suggest that site-level differences were important. Researchers should carry out mixed methods studies to further understand reasons for the inconsistent findings within randomized site pairs, and how to further improve treatment referrals across CS and BH systems. Findings also highlight that even when CS agencies work collaboratively with BH providers to improve referrals, most justice-involved youth who need SU services are not referred.

Critical Factors Influencing Interorganizational Relationships Between Juvenile Probation and Behavioral Health Agencies.

Although interorganizational relationships (IORs) are essential to the effective delivery of human services, very little research has examined relationships between juvenile justice agencies and behavioral health providers, and few studies have identified the most critical organizational and individual-level characteristics influencing IORs. Across 36 sites, juvenile probation officials (n = 458) and community behavioral health providers (n = 91) were surveyed about characteristics of their agencies, themselves, and IORs with each other. Generalized Linear Mixed Models were used to analyze the data. The strongest predictors included Perceived Organizational Support and individual Adaptability. Implications for research, theory and practice are discussed.

A model for rigorously applying the Exploration, Preparation, Implementation, Sustainment (EPIS) framework in the design and measurement of a large scale collaborative multi-site study.

BACKGROUND: This paper describes the means by which a United States National Institute on Drug Abuse (NIDA)-funded cooperative, Juvenile Justice-Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS), utilized an established implementation science framework in conducting a multi-site, multi-research center implementation intervention initiative. The initiative aimed to bolster the ability of juvenile justice agencies to address unmet client needs related to substance use while enhancing inter-organizational relationships between juvenile justice and local behavioral health partners. METHODS: The EPIS (Exploration, Preparation, Implementation, Sustainment) framework was selected and utilized as the guiding model from inception through project completion; including the mapping of implementation strategies to EPIS stages, articulation of research questions, and selection, content, and timing of measurement protocols. Among other key developments, the project led to a reconceptualization of its governing implementation science framework into cyclical form as the EPIS Wheel. The EPIS Wheel is more consistent with rapid-cycle testing principles and permits researchers to track both progressive and recursive movement through EPIS. Moreover, because this randomized controlled trial was predicated on a bundled strategy method, JJ-TRIALS was designed to rigorously test progress through the EPIS stages as promoted by facilitation of data-driven decision making principles. The project extended EPIS by (1) elucidating the role and nature of recursive activity in promoting change (yielding the circular EPIS Wheel), (2) by expanding the applicability of the EPIS framework beyond a single evidence-based practice (EBP) to address varying process improvement efforts (representing varying EBPs), and (3) by disentangling outcome measures of progression through EPIS stages from the a priori established study timeline. DISCUSSION: The utilization of EPIS in JJ-TRIALS provides a model for practical and applied use of implementation frameworks in real-world settings that span outer service system and inner organizational contexts in improving care for vulnerable populations. TRIAL REGISTRATION: NCT02672150 . Retrospectively registered on 22 January 2016.

Influence of Organizational Characteristics on Success in Implementing Process Improvement Goals in Correctional Treatment Settings.

Although research indicates that organizational characteristics substantially influence the adoption and use of evidence-based practices (EBPs), there has been little empirical research on organizational factors most likely to influence successful implementation of EBPs, particularly in criminal justice settings. This study examined organizational characteristics related to the success of change teams in achieving improvements in assessment and case-planning procedures for persons leaving correctional settings and receiving community services. In this evaluation of the Organizational Process Improvement Intervention (OPII), part of the National Institute on Drug Abuse's (NIDA's) Criminal Justice Drug Abuse Treatment Studies (CJDATS) cooperative, 21 sites were randomized to an early-start or a delayed-start condition. For this analysis, data from both conditions were combined. Agencies with fewer program needs, good communication, adequate staffing levels, good supervision, positive attitude toward rehabilitation, and higher institutional capacity for change were better able to implement planned changes in assessment and case-planning procedures. Such agencies may be better candidates for implementation improvement strategies, whereas other agencies could benefit from pre-intervention efforts aimed at strengthening these characteristics before attempting to improve assessment procedures.

CORRELATES OF INTERORGANIZATIONAL SERVICE COORDINATION IN COMMUNITY CORRECTIONS.

Because weak interagency coordination between community correctional agencies (e.g., probation and parole) and community-based treatment providers has been identified as a major barrier to the use of evidence-based practices (EBPs) for treating druginvolved offenders, this study sought to examine how key organizational (e.g., leadership, support, staffing) and individual (e.g., burnout, satisfaction) factors influence interagency relationships between these agencies. At each of 20 sites, probation/parole officials (n = 366) and community treatment providers (n = 204) were surveyed about characteristics of their agencies, themselves, and interorganizational relationships with each other. Key organizational and individual correlates of interagency relationships were examined using hierarchical linear models (HLM) analyses, supplemented by interview data. The strongest correlates included Adaptability, Efficacy, and Burnout. Implications for policy and practice are discussed.

Examining Treatment Climate Across Prison-Based Substance Abuse Treatment Groups.

BACKGROUND: With notable exceptions, few studies have looked critically at the role and effects of factors other than individual or programmatic differences that contribute to the climate within substance abuse treatment programs. De Leon's work on the therapeutic community, however, indicates that factors beyond the individual and program can contribute to the overall functioning of similarly situated communities. OBJECTIVES: In this study, we introduce and examine the concept of the "treatment group," the level of aggregation between the individual who participates in treatment and the organization that provides it. The treatment group refers to the social context and dynamics that operate among treatment participants, and we sought to study differences in treatment climate across 12 prison-based treatment groups within a single prison. METHODS: Using data from 604 participants who were assigned at random to one of the 12 groups, we analyzed differences on seven treatment climate indicators from one month and six months into the program across the treatment groups. RESULTS: No differences were found among the treatment groups at after one month; however, after 6 months, significant differences emerged across the groups on three treatment climate variables: program structure, counselor rapport, and counselor competence. CONCLUSIONS/IMPORTANCE: This study is among the first of its kind to conceptualize and examine treatment climate across otherwise similar groups and find that differences emerge on several indicators of climate. As such, we argue that the treatment group may be important to consider in both the delivery and evaluation of substance abuse treatment.

Effects of an Organizational Linkage Intervention on Inter-Organizational Service Coordination Between Probation/Parole Agencies and Community Treatment Providers.

Weak coordination between community correctional agencies and community-based treatment providers is a major barrier to diffusion of medication-assisted treatment (MAT)--the inclusion of medications (e.g., methadone and buprenorphine) in combination with traditional counseling and behavioral therapies to treat substance use disorders. In a multisite cluster randomized trial, experimental sites (j = 10) received a 3-h MAT training plus a 12-month linkage intervention; control sites (j = 10) received the 3-h training alone. Hierarchical linear models showed that the intervention resulted in significant improvements in perceptions of interagency coordination among treatment providers, but not probation/parole agents. Implications for policy and practice are discussed.

Effects of a strategy to improve offender assessment practices: Staff perceptions of implementation outcomes.

BACKGROUND: This implementation study examined the impact of an organizational process improvement intervention (OPII) on a continuum of evidence based practices related to assessment and community reentry of drug-involved offenders: Measurement/Instrumentation, Case Plan Integration, Conveyance/Utility, and Service Activation/Delivery. METHODS: To assess implementation outcomes (staff perceptions of evidence-based assessment practices), a survey was administered to correctional and treatment staff (n=1509) at 21 sites randomly assigned to an Early- or Delayed-Start condition. Hierarchical linear models with repeated measures were used to examine changes in evidence-based assessment practices over time, and organizational characteristics were examined as covariates to control for differences across the 21 research sites. RESULTS: Results demonstrated significant intervention and sustainability effects for three of the four assessment domains examined, although stronger effects were obtained for intra- than inter-agency outcomes. No significant effects were found for Conveyance/Utility. CONCLUSIONS: Implementation interventions such as the OPII represent an important tool to enhance the use of evidence-based assessment practices in large and diverse correctional systems. Intra-agency assessment activities that were more directly under the control of correctional agencies were implemented most effectively. Activities in domains that required cross-systems collaboration were not as successfully implemented, although longer follow-up periods might afford detection of stronger effects.

Effect of an organizational linkage intervention on staff perceptions of medication-assisted treatment and referral intentions in community corrections.

INTRODUCTION: Medication-assisted treatment (MAT) is effective for alcohol and opioid use disorders but it is stigmatized and underutilized in criminal justice settings. METHODS: This study cluster-randomized 20 community corrections sites to determine whether an experimental implementation strategy of training and an organizational linkage intervention improved staff perceptions of MAT and referral intentions more than training alone. The 3-hour training was designed to address deficits in knowledge, perceptions and referral information, and the organizational linkage intervention brought together community corrections and addiction treatment agencies in an interagency strategic planning and implementation process over 12 months. RESULTS: Although training alone was associated with increases in familiarity with pharmacotherapy and knowledge of where to refer clients, the experimental intervention produced significantly greater improvements in functional attitudes (e.g. that MAT is helpful to clients) and referral intentions. Corrections staff demonstrated greater improvements in functional perceptions and intent to refer opioid dependent clients for MAT than did treatment staff. CONCLUSION: Knowledge, perceptions and information training plus interorganizational strategic planning intervention is an effective means to change attitudes and intent to refer clients for medication assisted treatment in community corrections settings, especially among corrections staff.

A cluster randomized trial of an organizational process improvement intervention for improving the assessment and case planning of offenders: a Study Protocol.

BACKGROUND: The Organizational Process Improvement Intervention (OPII), conducted by the NIDA-funded Criminal Justice Drug Abuse Treatment Studies consortium of nine research centers, examined an organizational intervention to improve the processes used in correctional settings to assess substance abusing offenders, develop case plans, transfer this information to community-based treatment agencies, and monitor the services provided by these community based treatment agencies. METHODS/DESIGN: A multi-site cluster randomized design was used to evaluate an inter-agency organizational process improvement intervention among dyads of correctional agencies and community based treatment agencies. Linked correctional and community based agencies were clustered among nine (9) research centers and randomly assigned to an early or delayed intervention condition. Participants included administrators, managers, and line staff from the participating agencies; some participants served on interagency change teams while other participants performed agency tasks related to offender services. A manualized organizational intervention that includes the use of external organizational coaches was applied to create and support interagency change teams that proceeded through a four-step process over a planned intervention period of 12 months. The primary outcome of the process improvement intervention was to improve processes associated with the assessment, case planning, service referral and service provision processes within the linked organizations. DISCUSSION: Providing substance abuse offenders with coordinated treatment and access to community-based services is critical to reducing offender recidivism. Results from this study protocol will provide new and critical information on strategies and processes that improve the assessment and case planning for such offenders as they transition between correctional and community based systems and settings. Further, this study extends current knowledge of and methods for, the study of evidence-based practice adoption and implementation.

PREDICTING RECIDIVISM FOR RELEASED STATE PRISON OFFENDERS: Examining the Influence of Individual and Neighborhood Characteristics and Spatial Contagion on the Likelihood of Reincarceration.

We examined the influence of individual and neighborhood characteristics and spatial contagion in predicting reincarceration on a sample of 5,354 released Pennsylvania state prisoners. Independent variables included demographic characteristics, offense type, drug involvement, various neighborhood variables (e.g., concentrated disadvantage, residential mobility), and spatial contagion (i.e., proximity to others who become reincarcerated). Using geographic information systems (GIS) and logistic regression modeling, our results showed that the likelihood of reincarceration was increased with male gender, drug involvement, offense type, and living in areas with high rates of recidivism. Older offenders and those convicted of violent or drug offenses were less likely to be reincarcerated. For violent offenders, drug involvement, age, and spatial contagion were particular risk factors for reincarceration. None of the neighborhood environment variables were associated with increased risk of reincarceration. Reentry programs need to particularly address substance abuse issues of ex-offenders as well as take into consideration their residential locations.

Medication-assisted treatment in criminal justice agencies affiliated with the criminal justice-drug abuse treatment studies (CJ-DATS): availability, barriers, and intentions.

Medication-assisted treatment (MAT) is underutilized in the treatment of drug-dependent, criminal justice populations. This study surveyed criminal justice agencies affiliated with the Criminal Justice Drug Abuse Treatment Studies (CJ-DATS) to assess use of MAT and factors influencing use of MAT. A convenience sample (N = 50) of criminal justice agency respondents (e.g., jails, prisons, parole/probation, and drug courts) completed a survey on MAT practices and attitudes. Pregnant women and individuals experiencing withdrawal were most likely to receive MAT for opiate dependence in jail or prison, whereas those reentering the community from jail or prison were the least likely to receive MAT. Factors influencing use of MAT included criminal justice preferences for drug-free treatment, limited knowledge of the benefits of MAT, security concerns, regulations prohibiting use of MAT for certain agencies, and lack of qualified medical staff. Differences across agency type in the factors influencing use and perceptions of MAT were also examined. MAT use is largely limited to detoxification and maintenance of pregnant women in criminal justice settings. Use of MAT during the community reentry period is minimal. Addressing inadequate knowledge and negative attitudes about MAT may increase its adoption, but better linkages to community pharmacotherapy during the reentry period might overcome other issues, including security, liability, staffing, and regulatory concerns. The CJ-DATS collaborative MAT implementation study to address inadequate knowledge, attitudes, and linkage will be described.

Is Emerging Adulthood Influencing Moffitt's Developmental Taxonomy? Adding the "Prolonged" Adolescent Offender.

The study of offender trajectories has been a prolific area of criminological research. However, few studies have incorporated the influence of emerging adulthood, a recently identified stage of the life course, on offending trajectories. The present study addressed this shortcoming by introducing the "prolonged adolescent" offender, a low-level offender between the ages of 18 and 25 that has failed to successfully transition into adult social roles. A theoretical background based in prior research in life-course criminology and emerging adulthood is presented. Using data from the National Longitudinal Study of Adolescent Health analyses examined the relationship between indicators of traditional turning points and social bonds and low-level criminal offending and drug use. Several indicators including education, economic instability, and parental attachment were all predictive of offending and drug use.

Inmate responses to prison-based drug treatment: a repeated measures analysis.

Using a sample of 347 prison inmates and general linear modeling (GLM) repeated measures analyses, this paper examined during-treatment responses (e.g., changes in psychological and social functioning) to prison-based TC drug treatment. These effects have rarely been examined in previous studies, and never with a fully multivariate model accounting for within-subjects effects (changes over time), between-subjects effects (e.g., levels of risk and motivation), and within/between-subjects interactions (timexriskxmotivation). The results provide evidence of positive inmate change in response to prison TC treatment, but the patterns of results varied depending upon: (a) specific indicators of psychological and social functioning, motivation, and treatment process; (b) the time periods examined (1, 6, and 12 months during treatment); and (c) baseline levels of risk and motivation. Significant interactions between time and type of inmate suggest important new directions for research, theory, and practice in offender-based substance abuse treatment.

Predictors of therapeutic engagement in prison-based drug treatment.

Few studies to date have examined predictors of therapeutic engagement (TE) or other indicators of responsiveness to prison drug treatment. Subjects were 347 inmates participating in a 12-month modified therapeutic community (TC) drug treatment program at a specialized treatment prison for convicted, drug-involved offenders. Data were obtained through correctional databases and the administration of the TCU Drug Screen II, the Resident Evaluation of Self and Treatment (REST), and the Counselor Rating of Client (CRC) form. Three main hypotheses were supported: (1) baseline motivation predicted therapeutic engagement net of other inmate characteristics; (2) critical dimensions of the treatment experience (e.g., peer support, counselor rapport) also predicted therapeutic engagement; and (3) dynamic predictors and programmatic characteristics became more important over time. Implications for research, theory and policy are discussed.