An Overview of Research and Evaluation Designs for Dissemination and Implementation.

The wide variety of dissemination and implementation designs now being used to evaluate and improve health systems and outcomes warrants review of the scope, features, and limitations of these designs. This article is one product of a design workgroup that was formed in 2013 by the National Institutes of Health to address dissemination and implementation research, and whose members represented diverse methodologic backgrounds, content focus areas, and health sectors. These experts integrated their collective knowledge on dissemination and implementation designs with searches of published evaluations strategies. This article emphasizes randomized and nonrandomized designs for the traditional translational research continuum or pipeline, which builds on existing efficacy and effectiveness trials to examine how one or more evidence-based clinical/prevention interventions are adopted, scaled up, and sustained in community or service delivery systems. We also mention other designs, including hybrid designs that combine effectiveness and implementation research, quality improvement designs for local knowledge, and designs that use simulation modeling.

Effects of an Organizational Linkage Intervention on Inter-Organizational Service Coordination Between Probation/Parole Agencies and Community Treatment Providers.

Weak coordination between community correctional agencies and community-based treatment providers is a major barrier to diffusion of medication-assisted treatment (MAT)--the inclusion of medications (e.g., methadone and buprenorphine) in combination with traditional counseling and behavioral therapies to treat substance use disorders. In a multisite cluster randomized trial, experimental sites (j = 10) received a 3-h MAT training plus a 12-month linkage intervention; control sites (j = 10) received the 3-h training alone. Hierarchical linear models showed that the intervention resulted in significant improvements in perceptions of interagency coordination among treatment providers, but not probation/parole agents. Implications for policy and practice are discussed.

Collaboration and growth in a large research cooperative: A network analytic approach.

Research networks encourage team science and facilitate collaboration within and across research teams. While many analyses have examined the output of these collaborative networks (e.g., authorship networks, publications, grant applications), less attention has been paid to the formative phases of these initiatives. This article presents analyses of a whole-network survey of investigators participating in a new research initiative, and examines the development of collaborative ties over the network's first year. In particular, we examine the influence of research center affiliation, seniority, and prior network experience on the number and structure of collaborative ties, including participants' bridging and broker roles. Such analyses can inform the overall management of the project in purposefully promoting new collaboration opportunities, and may ultimately predict the number of collaborative products generated by the network members.

Engaging the justice system to address the opioid crisis: The Justice Community Opioid Innovation Network (JCOIN).

Many individuals with opioid use disorder come into contact with the justice system each year, making the nexus between the criminal justice system and the health care system a critical juncture for responding to the opioid crisis and simultaneously promoting public health and public safety. Collaborations across these sectors are essential to providing effective screening, treatment, and discharge planning; connecting individuals to services following release; promoting long-term recovery while reducing recidivism; and ultimately bringing the opioid crisis under control. In 2019, with the support of the NIH Helping to End Addiction Long-term (HEAL) Initiative, the National Institute on Drug Abuse launched the Justice Community Opioid Innovation Network (JCOIN). JCOIN is a >$150M multisite cooperative designed to facilitate transdisciplinary collaborations that can create actionable, translatable insights for the justice system and community-based organizations to address the opioid epidemic in justice-involved populations. JCOIN brings together 11 Research Hubs, a coordination and translation center (CTC), and a methodology and advanced analytics resource center (MAARC), with the goal of generating evidence that is greater than the sum of the parts. Collectively, the network will field at least 12 large-scale multisite clinical trials, which are described in this special issue. This article provides a brief overview of the scientific underpinnings for these trials; describes the broad themes connecting them; and discusses the intersections of the JCOIN initiative with the COVID-19 pandemic.

Counselor attitudes toward the use of motivational incentives in addiction treatment.

Counselor attitudes toward evidence-based practices, such as motivational incentives/contingency management (MI/CM), are important in bridging the gap between research and practice. Mailed surveys from 1,959 substance abuse treatment counselors showed ambivalence toward MI/CM and strong disagreement with using monetary rewards for achievement of treatment goals. Attitudes were associated with counselors' educational attainment, a 12-step treatment ideology, affiliation with NIDA's Clinical Trials Network, and working in opioid treatment programs. Exposure to MI/CM via training was more strongly associated with attitudes when counselors worked in programs that had adopted MI/CM. While there is substantial resistance to MI/CM, dissemination and training about the essential elements of MI/CM may enhance counselors' receptivity toward this intervention.

Turnover intention and emotional exhaustion "at the top": adapting the job demands-resources model to leaders of addiction treatment organizations.

Compared with the large literature on subordinate employees, there are few studies of emotional exhaustion and turnover intention for organizational leaders. There is little research that has extended the job demands-resources (JD-R) model of emotional exhaustion to leaders. In this study, the authors adapted the JD-R framework to analyze data collected from a sample of 410 leaders of addiction treatment organizations. The authors considered whether two job demands (performance demands and centralization) and two job resources (innovation in decision making and long-range strategic planning) were associated with emotional exhaustion and turnover intention. The authors also examined whether emotional exhaustion fully or partially mediated the associations between the job-related measures and turnover intention. The results supported the partially mediated model. Both job demands were positively associated with emotional exhaustion, and the association for long-range strategic planning was negative. Emotional exhaustion was positively associated with turnover intention. Centralization and innovation in decision making were also directly associated with turnover intention. Future research should continue to examine this theoretical framework among leaders of other types of organizations using more refined measures of demands and resources.

Modified therapeutic communities and adherence to traditional elements.

Traditional therapeutic communities (TCs) are characterized by confrontational group therapy, treatment phases, a tenure-based resident hierarchy, and long-term residential care. Many TCs have modified the structure and intensity of the traditional model, tailored services for specific client populations, and hired more professionally trained staff. This study examines the extent to which modified TCs are able to retain the underlying core technology of the TC. Using data from a nationally representative sample of 380 self-identified TCs, six traditional TC elements are identified. Results from a structural equation model indicate that offering services for specific populations and professionalization of staff has limited impact on the six TC elements. Modifications to structure and intensity of TC programming evidenced the strongest effect. Specifically, outpatient-only TCs showed significantly lower adherence to five of the six elements. Short-term residential programs showed a similar negative trend. Findings suggest selected modifications are possible without significantly impacting the TC model's core technology.

Knowledge, Attitudes, and Beliefs About Opioid Use Disorder Treatment in Primary Care.

This survey study assesses the US public's perception and awareness regarding medication for opioid use disorder and its availability in primary care settings.

A model for rigorously applying the Exploration, Preparation, Implementation, Sustainment (EPIS) framework in the design and measurement of a large scale collaborative multi-site study.

BACKGROUND: This paper describes the means by which a United States National Institute on Drug Abuse (NIDA)-funded cooperative, Juvenile Justice-Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS), utilized an established implementation science framework in conducting a multi-site, multi-research center implementation intervention initiative. The initiative aimed to bolster the ability of juvenile justice agencies to address unmet client needs related to substance use while enhancing inter-organizational relationships between juvenile justice and local behavioral health partners. METHODS: The EPIS (Exploration, Preparation, Implementation, Sustainment) framework was selected and utilized as the guiding model from inception through project completion; including the mapping of implementation strategies to EPIS stages, articulation of research questions, and selection, content, and timing of measurement protocols. Among other key developments, the project led to a reconceptualization of its governing implementation science framework into cyclical form as the EPIS Wheel. The EPIS Wheel is more consistent with rapid-cycle testing principles and permits researchers to track both progressive and recursive movement through EPIS. Moreover, because this randomized controlled trial was predicated on a bundled strategy method, JJ-TRIALS was designed to rigorously test progress through the EPIS stages as promoted by facilitation of data-driven decision making principles. The project extended EPIS by (1) elucidating the role and nature of recursive activity in promoting change (yielding the circular EPIS Wheel), (2) by expanding the applicability of the EPIS framework beyond a single evidence-based practice (EBP) to address varying process improvement efforts (representing varying EBPs), and (3) by disentangling outcome measures of progression through EPIS stages from the a priori established study timeline. DISCUSSION: The utilization of EPIS in JJ-TRIALS provides a model for practical and applied use of implementation frameworks in real-world settings that span outer service system and inner organizational contexts in improving care for vulnerable populations. TRIAL REGISTRATION: NCT02672150 . Retrospectively registered on 22 January 2016.

The adoption of medications in substance abuse treatment: associations with organizational characteristics and technology clusters.

Despite growing interest in closing the "research to practice gap", there are few data on the availability of medications in American substance abuse treatment settings. Recent research suggests that organizational characteristics may be associated with medication availability. It is unclear if the availability of medications can be conceptualized in terms of "technology clusters", where the availability of a medication is positively associated with the likelihood that other medications are also offered. Using data from 403 privately funded and 363 publicly funded specialty substance abuse treatment centers in the US, this research models the availability of agonist medications, naltrexone, disulfiram, and SSRIs. Bivariate logistic regression models indicated considerable variation in adoption across publicly funded non-profit, government-owned, privately funded non-profit, and for-profit treatment centers. Some of these differences were attenuated by organizational characteristics, such as accreditation, the presence of staff physicians, and the availability of detoxification services. There was some evidence that naltrexone, disulfiram, and SSRIs represent a group of less intensely regulated medications that is distinct from more intensely regulated medications. These types of medications were associated with somewhat different correlates. Future research should continue to investigate the similarities and differences in the predictors of medication availability across national contexts.

Job stress and poor sleep quality: data from an American sample of full-time workers.

Given the associations between poor quality sleep and health, it is important to consider whether job stressors are related to sleep-related outcomes. Studies from Europe and Japan suggest that these stressors negatively impact sleep, but there are few studies of job stressors and sleep quality that draw upon large representative samples of workers in the USA. Using data collected via telephone interviews from a nationally representative random sample of 1715 American full-time employees, this research considers three dependent variables of past-month poor sleep quality: number of days the respondent had difficulty initiating sleep, number of days of difficulty maintaining sleep, and number of days of non-restorative sleep. Negative binomial regression was used to estimate a count data model of the associations between the frequency of these three types of poor sleep quality and the job stressors of work overload, role conflict, autonomy, and repetitive tasks, while controlling for socio-demographic characteristics. The average American worker reported 5.3 days of difficulty falling asleep, 6.6 days of trouble staying asleep, and 5.0 days of trouble waking up for work in the past month. Across the three types of poor sleep quality, work overload was positively associated with the frequency of poor sleep quality. Role conflict was positively associated with difficulty initiating sleep and non-restorative sleep. Repetitive tasks were associated with more days of difficulty initiating sleep and maintaining sleep. Job autonomy was negatively associated with non-restorative sleep. Given that sleep quality is associated with other health outcomes, future research should continue to explore the associations between job-related stressors, sleep quality, and workers' health status.

Research participation and turnover intention: An exploratory analysis of substance abuse counselors.

Clinical research is increasingly being conducted in community-based addiction treatment settings. Although the primary focus of such research is on the development of effective clinical interventions, less attention has been paid to the potential impact of these projects on counseling staff who are involved in their implementation. Such involvement may be perceived as stressful or rewarding, and these perceptions may be associated with counselors' turnover intention. Using data from 207 counselors involved in research projects conducted within the National Institute on Drug Abuse's Clinical Trials Network, this study examines the associations between counselors' reactions to research experiences and turnover intention. When counselors perceived that research projects resulted in organizational benefits, turnover intention was significantly lower. However, there was a positive association between perceptions of research-related stressors and turnover intention. These findings suggest that the impact of clinical trials on treatment organizations and staff members warrants continued study.

Innovation adoption in substance abuse treatment: exposure, trialability, and the Clinical Trials Network.

Researchers and policymakers are increasingly focusing on factors that facilitate or impede the diffusion of evidence-based treatment techniques into routine clinical practice. One potentially fruitful avenue of research is the influence of involvement in research networks as a predictor of organizational innovation. The Clinical Trials Network (CTN) is examining a number of behavioral and pharmacological treatment techniques in controlled multisite studies. Using data from participating CTN treatment programs and large samples of programs outside the CTN, these analyses examine the influence of exposure to clinical trials on the subsequent adoption of buprenorphine and voucher-based motivational incentives. The analyses show that, controlling for a variety of organizational characteristics, direct exposure to buprenorphine clinical trials in the CTN significantly increased the odds of subsequent adoption. By contrast, the adoption of motivational incentives was entirely explained by organizational characteristics. The findings suggest that adoption of treatment innovations is a function of exposure, organizational resources, nature of innovations, and stage of the diffusion process.

Racial and ethnic disparities in SSRI availability in substance abuse treatment.

OBJECTIVE: The high rate of co-occurrence of psychiatric and substance use disorders suggests that specialty substance abuse treatment facilities may be an important site for the delivery of psychotropic medications. However, the literature suggests there may be associations between the percentage of racial and ethnic minority clients and the availability of selective serotonin reuptake inhibitors (SSRIs) in these facilities. METHODS: Survey data from the National Treatment Center Study, comprising nationally representative samples of 326 publicly funded and 339 privately funded substance abuse treatment centers, were used to measure the availability of SSRI medications from 2002 to 2004. Independent variables included the percentages of African-American and Hispanic clients, center type, organizational affiliation, region, size, accreditation status, presence of an integrated care program, and physician availability. RESULTS: SSRIs were available in 48% of the centers. Logistic regression analysis indicated that greater minority representation in centers' caseloads was negatively associated with the availability of SSRIs. The association between the percentage of African-American clients and SSRI availability was fully mediated by the addition of factors related to treatment inputs, such as the presence of a physician on staff or contract and the presence of an integrated care program. With organizational and treatment characteristics factored out, there was a negative association between the percentage of Hispanic clients and the availability of SSRIs. CONCLUSIONS: Although SSRIs were available in nearly half of these substance abuse treatment settings, racial and ethnic disparities exist in the availability of these medications.

The use of antidepressant medications in substance abuse treatment: the public-private distinction, organizational compatibility, and the environment.

Many studies of innovation adoption in health care organizations focus either on organizational characteristics or the institutional environment, but not both. Furthermore, these perspectives are rarely employed simultaneously in both public and private health care organizations. This research considers the public-private distinction, organizational compatibility, and interorganizational referral relationships in the use of selective serotonin reuptake inhibitors (SSRIs) by substance abuse treatment organizations. Using data from nationally representative samples of 363 publicly funded and 403 privately funded substance abuse treatment centers, a four-category typology of public and private organizations initially predicted variation in SSRI use. However some differences were no longer significant once organizational and environmental characteristics were added to the statistical model. These data support hypotheses about the associations between organizational characteristics and SSRI use as well as hypotheses regarding the external environment. Future research should continue to integrate both internal and external factors in theoretical explanations of innovation adoption.

Controlled-release oxycodone admissions in public and private substance abuse treatment: associations with organizational characteristics.

Although non-medical use of controlled-release (CR) oxycodone is increasing, little is known about the substance abuse treatment facilities serving individuals dependent on this medication. This study examines the associations between the characteristics of treatment organizations and two dependent variables: any CR-oxycodone admissions and the number of CR-oxycodone admissions in the past six months. Face-to-face interviews were conducted with administrators of 363 publicly funded and 401 privately funded treatment centers in the US. Publicly funded non-profit organizations were less likely to have treated this population than government- owned, privately funded non-profit, and for-profit treatment centers. Some evidence indicated the availability of pharmacotherapies and detoxification services were associated with the dependent variables. Twelve-step programs were more likely to have treated oxycodone-dependent clients. Rural facilities treated significantly more clients than those in metropolitan areas. The high prevalence of CR-oxycodone admissions suggests the need for widespread training of treatment providers regarding treatment for CR-oxycodone dependence.

Service delivery in substance abuse treatment: reexamining "comprehensive" care.

Substance abuse treatment clients present with an array of service needs in various life domains. Ideal models of addiction treatment incorporate provision or linkages to services to meet clients' multiple needs; in turn, these wraparound and supportive services are associated with improvements in client retention and treatment outcomes. Using data from large samples of specialty addiction treatment providers in the public and private sectors, this article examines the extent and organizational correlates of the comprehensiveness of service delivery. Multivariate models indicate that private sector treatment facilities offer more "core" medical and treatment services, whereas public sector programs offer more wraparound and supportive services. However, both sectors fall short of the ideal model of service comprehensiveness in terms of absolute number of services offered. These findings raise concerns regarding the quality and availability of needed services for treatment of addiction.

Patterns of organization and management in private and public substance abuse treatment programs.

As an organizational field, substance abuse treatment clearly includes a remarkable range of organizations. Yet only in the past two decades has there been research interest in the organizational context in which treatment is delivered. The goal of this article is to promote the concept of organizational field by summarizing findings from an ongoing research program and by examining the organizational structure, service delivery, and patterns of innovation adoption in two large samples of substance abuse treatment programs in the United States. Among highlighted findings, there are notable differences between the public and private sectors in structural and staffing characteristics, as well as in the characteristics of clients receiving substance abuse treatment. With regard to the use of evidence-based practices, our findings suggest that pharmacotherapies are more likely to be adopted in private centers, whereas notably effective voucher approaches are more common in public centers. Future research directions are discussed.

Counselor emotional exhaustion and turnover intention in therapeutic communities.

Counselor turnover is a significant problem facing substance abuse treatment agencies. Understanding the role of organizational culture in predicting burnout and turnover intention may yield important information on how to address turnover in treatment organizations. Using data collected from 817 counselors employed in a national sample of 253 therapeutic communities (TCs), structural equation modeling was used to estimate the associations between emotional exhaustion, turnover intention, and three measures of organizational culture: centralized decision making, distributive justice, and procedural justice. The model controlled for counselor demographics, credentials, and earnings. Counselors' emotional exhaustion scores were higher in TCs with greater centralized decision making (p < .01) but lower in TCs where greater distributive justice (p < .05) and procedural justice (p < .001) were reported. Likewise, turnover intention was positively associated with centralized decision making (p < .05) and inversely associated with the workplace justice measures (p < .001). These data suggest that management practices in TCs and perhaps in other types of substance abuse treatment facilities likely play a substantial role in counselors' well-being and in their decisions to leave their jobs. Because these practices are not structural features of organizations, they may be targeted for intervention and change.

Early adoption of buprenorphine in substance abuse treatment centers: data from the private and public sectors.

The recent approval of buprenorphine for the treatment of opiate dependence offers an opportunity to analyze innovation adoption in community-based treatment. Using data collected from national samples of 299 privately funded and 277 publicly funded treatment centers, this research examines buprenorphine adoption using baseline data collected between 2002 and 2004 as well as follow-up data collected 12 months later. Private centers were significantly more likely than public centers to report current use of buprenorphine. The baseline data indicated that early adoption was positively associated with center accreditation, physician services, availability of detoxification services, current use of naltrexone, and the percentage of opiate-dependent clients. Multivariate analyses of follow-up data suggest that adoption was greater in accredited centers, for-profit facilities, organizations offering detoxification services, and naltrexone-using centers. Future research should continue to monitor the extent to which buprenorphine is adopted in these settings.