Exploring the Impact of External Facilitation Using Evidence-Based Implementation Strategies for Increasing Motivational Interviewing Capacity Among Outpatient Substance Use Disorder (SUD) Treatment Providers.

The large majority of individuals who access substance use disorders (SUD) treatment do not receive evidence-based care. Little attention has been paid to the notion that the scale-up of evidence-based practices (EBPs) has been limited in large part due to a weakness in the "distribution system" for bringing new innovations to the attention of practitioners and into practice settings. This study explores the impact of the Training and Practice Implementation Institute (TPII; funded by the New York City Department of Health and Mental Hygiene), an intensive technical assistance initiative that offers external facilitation to outpatient SUD treatment providers via the incorporation of multiple evidence-based implementation strategies to enhance the practice of motivational interviewing (MI). Findings from this study show that staff completed a large majority (86%) of required training/technical assistance (TTA) activities across the 9-month implementation period, demonstrating a high level of engagement among staff and the feasibility of externally facilitated intensive TTA delivered to community-based organizations for the purpose of enhancing implementation of MI for SUDs. Results also show statistically significant improvements in the delivery of MI's technical components among staff, though did not reveal corresponding improvements in the delivery of MI's relational components. An understanding of the potential return on investment associated with externally facilitated TA, offers organizations an opportunity to inform the allocation of limited resources to areas where they will have the greatest impact and ultimately improve the quality and efficacy of services.

Virtual Training Is More Cost-Effective Than In-Person Training for Preparing Staff to Implement Contingency Management.

Behavior therapy implementation relies in part on training to foster counselor skills in preparation for delivery with fidelity. Amidst Covid-19, the professional education arena witnessed a rapid shift from in-person to virtual training, yet these modalities' relative utility and expense is unknown. In the context of a cluster-randomized hybrid type 3 trial of contingency management (CM) implementation in opioid treatment programs (OTPs), a multi-cohort design presented rare opportunity to compare cost-effectiveness of virtual vs. in-person training. An initial counselor cohort (n = 26) from eight OTPs attended in-person training, and a subsequent cohort (n = 31) from ten OTPs attended virtual training. Common training elements were the facilitator, learning objectives, and educational strategies/activities. All clinicians submitted a post-training role-play, independently scored with a validated fidelity instrument for which performances were compared against benchmarks representing initial readiness and advanced proficiency. To examine the utility and expense of in-person and virtual trainings, cohort-specific rates for benchmark attainment were computed, and per-clinician expenses were estimated. Adjusted between-cohort differences were estimated via ordinary least squares, and an incremental cost effectiveness ratio (ICER) was calculated. Readiness and proficiency benchmarks were attained at rates 12-14% higher among clinicians attending virtual training, for which aggregated costs indicated a $399 per-clinician savings relative to in-person training. Accordingly, the ICER identified virtual training as the dominant strategy, reflecting greater cost-effectiveness across willingness-to-pay values. Study findings document greater utility, lesser expense, and cost-effectiveness of virtual training, which may inform post-pandemic dissemination of CM and other therapies.

Behavioral healthcare organizations' experiences related to use of telehealth as a result of the COVID-19 pandemic: an exploratory study.

BACKGROUND: Due to the COVID-19 pandemic, healthcare providers were forced to shift many services quickly from in-person to virtual, including substance use disorder (SUD) and mental health (MH) treatment services. This led to a sharp increase in telehealth services, with health systems seeing patients virtually at hundreds of times the rate as before the onset of the COVID-19 pandemic. By analyzing qualitative data about SUD and MH care organizations' experiences using telehealth, this study aims to elucidate emergent themes related to telehealth use by the front-line behavioral health workforce. METHODS: This study uses qualitative data from large-scale web surveys distributed to SUD and MH organizations between May and August 2020. At the end of these surveys, the following question was posed in free-response form: "Is there anything else you would like to say about use of telehealth during or after the COVID-19 pandemic?" Respondents were asked to answer on behalf of their organizations. The 391 responses to this question were analyzed for emergent themes using a conventional approach to content analysis. RESULTS: Three major themes emerged: COVID-specific experiences with telehealth, general experiences with telehealth, and recommendations to continue telehealth delivery. Convenience, access to new populations, and lack of commute were frequently cited advantages of telehealth, while perceived ineffectiveness of and limited access to technology were frequently cited disadvantages. Also commonly mentioned was the relaxation of reimbursement regulations. Respondents supported continuation of relaxed regulations, increased institutional support, and using a combination of telehealth and in-person care in their practices. CONCLUSIONS: This study advanced our knowledge of how the behavioral health workforce experiences telehealth delivery. Further longitudinal research comparing treatment outcomes of those receiving in-person and virtual services will be necessary to undergird organizations' financial support, and perhaps also legislative support, for virtual SUD and MH services.

Persons from racial and ethnic minority groups receiving medication for opioid use disorder experienced increased difficulty accessing harm reduction services during COVID-19.

INTRODUCTION: The COVID-19 pandemic collided with the opioid epidemic and longstanding health inequities to exacerbate the disproportionate harms experienced by persons with opioid use disorder (OUD) who self-identify as from racial and ethnic minority groups. Disrupted access to harm reduction services (e.g., naloxone, sterile syringes, recovery support) is one pathway whereby COVID-19 might exacerbate health disparities. We tested the hypothesis that persons receiving medication for opioid use disorder (MOUD) who self-identify as from racial/ethnic minority groups would experience more disruptions in access to harm reduction services than persons identifying as non-Hispanic White, even when controlling for severity of opioid use and sociodemographics (e.g., education, income, biological sex, age). METHODS: Analyses used data from a cluster randomized trial that had enrolled 188 patients, all of whom had provided baseline data on sociodemographics and severity of opioid use, across eight opioid treatment programs. Data collectors re-contacted participants between May and June 2020 and 133 (71% response rate) agreed to complete a survey about access to harm reduction services. RESULTS: Twenty-six respondents (20%) identified as from racial/ethnic minority groups (predominantly Black, Hispanic, and/or biracial). Between 7% and 27% of respondents reported disrupted access to harm reduction services. Logistic regressions indicated that persons identifying as from racial/ethnic minority groups were 8-10 times more likely than persons identifying as non-Hispanic White to report reduced access to naloxone and sterile syringes (p < .01), even when accounting for potential confounding variables. CONCLUSIONS: This report concludes with a discussion of potential outreach strategies and policies to advance more equitable access to essential harm reduction services.

Project MIMIC (Maximizing Implementation of Motivational Incentives in Clinics): A cluster-randomized type 3 hybrid effectiveness-implementation trial.

BACKGROUND: Opioid-related overdoses and harms have been declared a public health emergency in the United States, highlighting an urgent need to implement evidence-based treatments. Contingency management (CM) is one of the most effective behavioral interventions when delivered in combination with medication for opioid use disorder, but its implementation in opioid treatment programs is woefully limited. Project MIMIC (Maximizing Implementation of Motivational Incentives in Clinics) was funded by the National Institute on Drug Abuse to identify effective strategies for helping opioid treatment programs improve CM implementation as an adjunct to medication. Specific aims will test the impact of two different strategies on implementation outcomes (primary aim) and patient outcomes (secondary aims), as well as test putative mediators of implementation effectiveness (exploratory aim). METHODS: A 3-cohort, cluster-randomized, type 3 hybrid design is used with the opioid treatment programs as the unit of randomization. Thirty programs are randomized to one of two conditions. The control condition is the Addiction Technology Transfer Center (ATTC) Network implementation strategy, which consists of three core approaches: didactic training, performance feedback, and on-going consultation. The experimental condition is an enhanced ATTC strategy, with the same core ATTC elements plus two additional theory-driven elements. The two additional elements are Pay-for-Performance, which aims to increase implementing staff's extrinsic motivations, and Implementation & Sustainment Facilitation, which targets staff's intrinsic motivations. Data will be collected using a novel, CM Tracker tool to document CM session delivery, session audio recordings, provider surveys, and patient surveys. Implementation outcomes include CM Exposure (number of CM sessions delivered per patient), CM Skill (ratings of CM fidelity), and CM Sustainment (number of patients receiving CM after removal of support). Patient outcomes include self-reported opioid abstinence and opioid-related problems (both assessed at 3- and 6-months post-baseline). DISCUSSION: There is urgent public health need to improve the implementation of CM as an adjunct to medication for opioid use disorder. Consistent with its hybrid type 3 design, Project MIMIC is advancing implementation science by comparing impacts of these two multifaceted strategies on both implementation and patient outcomes, and by examining the extent to which the impacts of those strategies can be explained by putative mediators. TRIAL REGISTRATION: This clinical trial has been registered with clinicaltrials.gov (NCT03931174). Registered April 30, 2019. https://clinicaltrials.gov/ct2/show/NCT03931174?term=project+mimic&draw=2&rank=1.

Impacts of the COVID-19 pandemic on healthcare access among patients receiving medication for opioid use disorder.

BACKGROUND: The COVID-19 pandemic significantly altered treatment delivery for opioid treatment programs (OTPs) dispensing medications for opioid use disorder (MOUD). We aimed to identify patterns of substance use among MOUD patients and examine whether COVID-19-related impacts on access to healthcare varied across subgroups. METHODS: This analysis was embedded within a type 3 hybrid trial that enrolled patients across eight OTPs at the start of the pandemic. Enrolled patients reported on past-30 day use of multiple substances during their baseline assessment. Participants re-contacted in May-July 2020 completed a survey about COVID-19-related impacts on various life domains. Using latent class analysis we identified patient subgroups, and then examined group differences on a set of negative and positive COVID-19 impacts related to healthcare access. RESULTS: Of the 188 trial participants, 135 (72 %) completed the survey. Latent class analysis identified three MOUD patient subgroups: minimal use (class probability: 0.25); opioid use (class probability: 0.34); and polysubstance use (class probability: 0.41). Compared to the minimal use group, the polysubstance use group reported increased substance use and difficulty accessing sterile needles, naloxone, and preferred substance. The opioid use group reported increased substance use and difficulty accessing their preferred substance. There were no significant group differences related to accessing routine or specialized healthcare or medication; or paying attention to their health. CONCLUSIONS: During COVID-19, many MOUD patients reported challenges accessing care, particularly harm reduction services for patients with polysubstance use. Additional efforts, like providing wraparound support, may be necessary to serve the needs of MOUD patients.

Is necessity also the mother of implementation? COVID-19 and the implementation of evidence-based treatments for opioid use disorders.

Opioid-related overdoses and the coronavirus disease 2019 (COVID-19) represent two of the deadliest crises in United States' history and together constitute a syndemic. The intersecting risks of this syndemic underscore the urgent need to implement effective opioid use disorder (OUD) treatments that are sustainable amid COVID-19 mitigation strategies. In response to new federal guidance released during the pandemic, opioid treatment programs (OTPs) have quickly innovated to implement new systems of medication delivery. OTPs rapid implementation of new medication delivery models defies conventional wisdom about the pace of research transfer. As part of an ongoing cluster-randomized type 3 hybrid trial evaluating strategies to implement contingency management (CM), select staff of eight OTPs had been trained to deliver CM and were in the midst of receiving ongoing implementation support. As COVID-19 emerged, all eight OTPs mirrored trends in the addiction field and effectively adapted to federal/state demands to implement new methods of medication delivery. However, over the past few months, necessity has arguably been the mother of implementation. We have observed greater variance among these OTPs' success with the additional implementation of adjunctive CM. The speed and variability of innovation raises novel questions about drivers of implementation. We argue that the mother of the next innovation should be a public call for a progressive, thoughtful set of public health policies and other external setting levers to address the needs of those with OUD and the OTPs that serve them.

Use of Telehealth in Substance Use Disorder Services During and After COVID-19: Online Survey Study.

BACKGROUND: Social distancing guidelines for COVID-19 have caused a rapid transition to telephone and video technologies for delivering treatment for substance use disorders (SUDs). OBJECTIVE: This study examined the adoption of these technologies across the SUD service continuum, acceptance of these technologies among service providers, and intent of providers to use these technologies after the pandemic. Additional analysis using the validated technology acceptance model (TAM) was performed to test the potential applications of these technologies after the pandemic. The study objectives were as follows: (1) to assess the use of telehealth (telephone and video technologies) for different SUD services during COVID-19 in May-June 2020, (2) to assess the intended applications of telehealth for SUD services beyond COVID-19, (3) to evaluate the perceived ease of use and value of telehealth for delivering SUD services, and (4) to assess organizational readiness for the sustained use of telehealth services. METHODS: An online survey on the use of telephonic and video services was distributed between May and August 2020 to measure the current use of these services, perceived organizational readiness to use these services, and the intent to use these services after COVID-19. In total, 8 of 10 regional Addiction Technology Transfer Centers representing 43 states distributed the survey. Individual organizations were the unit of analysis. RESULTS: In total, 457 organizations responded to the survey. Overall, the technology was widely used; >70% (n>335) of organizations reported using telephone or video platforms for most services. The odds of the intent of organizations to use these technologies to deliver services post COVID-19 were significantly greater for all but two services (ie, telephonic residential counseling and buprenorphine therapy; mean odds ratio 3.79, range 1.87-6.98). Clinical users preferred video technologies to telephone technologies for virtually all services. Readiness to use telephone and video technologies was high across numerous factors, though telephonic services were considered more accessible. Consistent with the TAM, perceived usefulness and ease of use influenced the intent to use both telephone and video technologies. CONCLUSIONS: The overall perceived ease of use and usefulness of telephonic and video services suggest promising post-COVID-19 applications of these services. Survey participants consistently preferred video services to telephonic services; however, the availability of telephonic services to those lacking easy access to video technology is an important characteristic of these services. Future studies should review the acceptance of telehealth services and their comparative impact on SUD care outcomes.

Contextual compatibility of three empirically supported behavior therapies for cART adherence among patients with substance use disorders.

Though substance use disorders complicate adherence to combination antiretroviral therapy (cART), cognitive-behavioral therapy (CBT), contingency management (CM), and motivational interviewing (MI) each demonstrate efficacy to improve cART adherence among substance-using patients. To inform dissemination of these therapies, this mixed-method study was undertaken involving a full-day site visit to each of four HIV care settings. At each setting, an initial administrator interview elicited setting data. Paired focus groups with setting staff and patients then served as forums for open discussion and live polling of the therapies' respective contextual compatibility. Focus group recordings were subjected to a phenomenological narrative analysis by multidisciplinary investigators, and staff/patient compatibility ratings were analyzed via generalized linear models. Findings include: (1) emergent themes among staff of adaptability, patient-centeredness, and mission-congruence as desired therapy attributes, (2) emergent themes among patients of intrinsic motivation, respect for patient autonomy in illness management, and fairness among service recipients as desired therapy attributes; and (3) comparatively stronger staff perception of compatibility for MI than CBT or CM, and a similar albeit less robust or reliable pattern among patients. Collective findings support MI as a behavior therapy of choice for broad dissemination to HIV care settings to improve cART adherence of patients with substance use disorders.

Influence of Substance Use Disorders on 2-Year HIV Care Retention in the United States.

Substance use disorders (SUDs) are thought to predict care discontinuity, though magnitude and substance-specific variance of effects are unclear. This report of analytic work undertaken with a multi-regional American cohort of 9153 care enrollees addresses these gaps. Care retention was computed from 24-month post-linkage clinic visit documentation, with SUD cases identified from patient-report screening instruments. Two generalized estimating equations tested binary and hierarchial SUD predictors of retention, and potential effect modification by patient age-group, sex, and care site. Findings demonstrate: (1) detrimental SUD effect, equivalent to a nine percentage-point decrease in retention, with independent effects of age-group and care site; (2) substance-specific effect of marijuana UD associated with lower retention; and (3) age-modification of each effect on care discontinuity, with SUDs serving as a risk factor among 18-29 year-olds and protective factor among 60+ year-olds. Collective findings document patient attributes as influences that place particular subgroups at-risk to discontinue care.

Implementing the teen marijuana check-up in schools-a study protocol.

BACKGROUND: Substance misuse is now encountered in settings beyond addiction specialty care, with schools a point-of-contact for student access to behavioral health services. Marijuana is a leading impetus for adolescent treatment admissions despite declining risk perception, for which the Teen Marijuana Check-Up (TMCU)-a tailored adaptation of motivational enhancement therapy-offers an efficacious service option. To bridge the knowledge gap concerning effective and affordable technical assistance strategies for implementing empirically supported services, the described trial will test such a strategy to facilitate school-based TMCU implementation. METHODS: A type II effectiveness/implementation hybrid trial will test a novel strategy for a TMCU purveyor to provide technical assistance on an 'as-needed' basis when triggered by a fidelity drift alarm bell, compared to resource-intensive 'gold-standard' technical assistance procedures of prior efficacy trials. Trial procedures adhere to the EPIS framework as follows: (1) initial mixed-method exploration of the involved school contexts and identification of TMCU interventionist candidates in elicitation interviews; (2) interventionist preparation via a formally evaluated training process involving a two-day workshop and sequence of three training cases; (3) post-training implementation for 24 months for which trained interventionists are randomized to 'as-needed' or 'gold-standard' technical assistance and self-referring students randomized (in 2:1 ratio) to TMCU or waitlist/control; and (4) examination of TMCU sustainment via interventionist completion of biannual outcome assessments, cost analyses, and exit interviews. Hypothesized effects include non-differential influence of the competing technical assistance methods on both TMCU fidelity and intervention effectiveness, with lesser school costs for the 'as-needed' than 'gold-standard' technical assistance and greater reduction in the frequency of marijuana use expected among TMCU-exposed students relative to those assigned to waitlist/control. DISCUSSION: This trial-occurring in Washington state as legislative, fiscal, and sociocultural forces converge to heighten exposure of American adolescents to marijuana-related harms-is set to advance understanding of best implementation practices for this and other efficacious, school-based interventions through examination of a data-driven technical assistance method. If shown to be clinically useful and affordable, the concept of a fidelity drift alarm could be readily translated to other empirically supported services and in other health settings. TRIAL REGISTRATION: ClinicalTrials.gov NCT03111667 registered 7 April 2017.

Predictive Validity of Addiction Treatment Clinicians' Post-Training Contingency Management Skills for Subsequent Clinical Outcomes.

In the context of a contingency management (CM) implementation/effectiveness hybrid trial, the post-training implementation domains of direct-care clinicians (N=19) were examined in relation to a targeted clinical outcome of subsequently CM-exposed clients. Clinicians' CM skillfulness, a behavioral measure of their capability to skillfully deliver the intended CM intervention, was found to be a robust and specific predictor of their subsequent client outcomes. Analyses also revealed CM skillfulness to: (1) fully mediate an association between a general therapeutic effectiveness and client outcome, (2) partially mediate an association of in-training exposure to CM and client outcome, and (3) be composed of six component clinical practice behaviors that each contributed meaningfully to this behavior fidelity index. Study findings offer preliminary evidence of the predictive validity of post-training CM skillfulness for subsequent client outcomes, and inform suggestions for the design and delivery of skills-focused CM training curricula for the addiction treatment workforce.

Prevalence and Predictors of Substance Use Disorders Among HIV Care Enrollees in the United States.

Prior efforts to estimate U.S. prevalence of substance use disorders (SUDs) in HIV care have been undermined by caveats common to single-site trials. The current work reports on a cohort of 10,652 HIV-positive adults linked to care at seven sites, with available patient data including geography, demography, and risk factor indices, and with substance-specific SUDs identified via self-report instruments with validated diagnostic thresholds. Generalized estimating equations also tested patient indices as SUD predictors. Findings were: (1) a 48 % SUD prevalence rate (between-site range of 21-71 %), with 20 % of the sample evidencing polysubstance use disorder; (2) substance-specific SUD rates of 31 % for marijuana, 19 % alcohol, 13 % methamphetamine, 11 % cocaine, and 4 % opiate; and (3) emergence of younger age and male gender as robust SUD predictors. Findings suggest high rates at which SUDs occur among patients at these urban HIV care sites, detail substance-specific SUD rates, and identify at-risk patient subgroups.

Identifying HIV care enrollees at-risk for cannabis use disorder.

Increased scientific attention given to cannabis in the United States has particular relevance for its domestic HIV care population, given that evidence exists for both cannabis as a therapeutic agent and cannabis use disorder (CUD) as a barrier to antiretroviral medication adherence. It is critical to identify relative risk for CUD among demographic subgroups of HIV patients, as this will inform detection and intervention efforts. A Center For AIDS Research Network of Integrated Clinical Systems cohort (N = 10,652) of HIV-positive adults linked to care at seven United State sites was examined for this purpose. Based on a patient-report instrument with validated diagnostic threshold for CUD, the prevalence of recent cannabis use and corresponding conditional probabilities for CUD were calculated for the aggregate sample and demographic subgroups. Generalized estimating equations then tested models directly examining patient demographic indices as predictors of CUD, while controlling for history and geography. Conditional probability of CUD among cannabis-using patients was 49%, with the highest conditional probabilities among demographic subgroups of young adults and those with non-specified sexual orientation (67-69%) and the lowest conditional probability among females and those 50+ years of age (42% apiece). Similarly, youthful age and male gender emerged as robust multivariate model predictors of CUD. In the context of increasingly lenient policies for use of cannabis as a therapeutic agent for chronic conditions like HIV/AIDS, current study findings offer needed direction in terms of specifying targeted patient groups in HIV care on whom resources for enhanced surveillance and intervention efforts will be most impactful.

Finding harmony so the music plays on: pragmatic trial design considerations to promote organizational sustainment of an empirically-supported behavior therapy.

BACKGROUND: Pragmatic trials of empirically-supported behavior therapies may inform clinical and policy decisions concerning therapy sustainment. This retrospective trial design paper describes and discusses pragmatic features of a hybrid type III implementation/effectiveness trial of a contingency management (CM) intervention at an opioid treatment program. Prior reporting (Hartzler et al., J Subst Abuse Treat 46:429-438, 2014; Hartzler, Subst Abuse Treat Prev Policy 10:30, 2015) notes success in recruiting program staff for voluntary participation, durable impacts of CM training on staff-level outcomes, provisional setting implementation of the intervention, documentation of clinical effectiveness, and post-trial sustainment of CM. METHODS/DESIGN: Six pragmatic design features, and both scientific and practical bases for their inclusion in the trial, are presented: (1) a collaborative intervention design process, (2) voluntary recruitment of program staff for therapy training and implementation, (3) serial training outcome assessments, with quasi-experimental staff randomization to either single or multiple baseline assessment conditions, (4) designation of a 90-day period immediately after training in which the setting implemented the intervention on a provisional basis, (5) inclusive patient eligibility for receipt of the CM intervention, and (6) designation of two staff as local implementation leaders to oversee clinical/administrative issues in provisional implementation. DISCUSSION: Each pragmatic trial design feature is argued to have contributed to sustainment of CM. Contributions implicate the building of setting proprietorship for the CM intervention, culling of internal staff expertise in its delivery, iterative use of assessment methods that limited setting burden, documentation of setting-specific clinical effectiveness, expanded penetration of CM among staff during provisional implementation, and promotion of setting self-reliance in the oversight of sustainable implementation procedures. It is hoped this discussion offers ideas for how to impact local clinical and policy decisions via effective behavior therapy dissemination.

Interest and preferences for contingency management design among addiction treatment clientele.

BACKGROUND: Despite strong support for its efficacy, debates persist about how dissemination of contingency management is most effectively undertaken. Currently-promoted contingency management methods are empirically-validated, yet their congruence with interests and preferences of addiction treatment clientele is unknown. Such client input is a foundational support for evidence-based clinical practice. OBJECTIVE: This study documented interest in incentives and preferences for fixed-ratio vs. variable-ratio and immediate vs. distal distribution of earned incentives among clients enrolled at three community programs affiliated with the National Institute on Drug Abuse Clinical Trials Network. METHODS: This multi-site study included anonymous survey completion by an aggregate sample of 358 treatment enrollees. Analyses first ruled out site differences in survey responses, and then tested age and gender as influences on client interest in financial incentives, and preferences for fixed-ratio vs. variable-ratio reinforcement and immediate vs. distal incentive distribution. RESULTS: Interest in different types of $50 incentives (i.e. retail vouchers, transportation vouchers, cash) was highly inter-correlated, with a mean sample rating of 3.49 (0.83) on a five-point scale. While consistent across client gender, age was an inverse predictor of client interest in incentives. A majority of clients stated preference for fixed-ratio incentive magnitude and distal incentive distribution (67% and 63%, respectively), with these preferences voiced by a larger proportion of females. CONCLUSION: Sample preferences contradict currently-promoted contingency management design features. Future efforts to disseminate contingency management may be more successful if flexibly undertaken in a manner that incorporates the interests and preferences of local client populations.

Building a bonfire that remains stoked: sustainment of a contingency management intervention developed through collaborative design.

BACKGROUND: Community dissemination of empirically-supported behavior therapies is fostered by collaborative design, a joint process pooling expertise of purveyors and treatment personnel to contextualize a therapy for sustainable use. The adaptability of contingency management renders it an exemplary therapy to model this collaborative design process. METHODS: At conclusion of an implementation/effectiveness hybrid trial conducted at an opiate treatment program, a group elicitation interview was conducted with the setting's five managerial staff to cull qualitative impressions of a collaboratively-designed contingency management intervention after 90 days of provisional implementation in the setting. Two independent raters reviewed the audio-recording and conducted a phenomenological narrative analysis, extracting themes and selecting excerpts to correspond with innovation attributes (i.e., relative advantage, compatibility, complexity, trialability, observability) of a well-known implementation science framework. RESULTS: This qualitative analysis suggested the intervention was regarded as: (1) cost-effective and clinically useful relative to prior practices, (2) a strong fit with existing service structure and staffing resources, (3) procedurally uncomplicated, with staff consistently implementing it as intended, (4) providing site-specific data to sufficiently inform decisions about its sustainment, and (5) offering palpable benefits to staff-patient interactions. CONCLUSIONS: The current work complements prior reports of positive implementation outcomes and intervention effectiveness for the parent trial, mapping qualitative managerial accounts of this contingency management intervention to a set of attributes thought to influence the speed and effectiveness with which an innovative practice is disseminated. Findings support the incorporation of collaborative design processes in future efforts to transport contingency management to the addiction treatment community.

Adapting the helpful responses questionnaire to assess communication skills involved in delivering contingency management: preliminary psychometrics.

A paper/pencil instrument, adapted from Miller and colleagues' (1991) Helpful Responses Questionnaire (HRQ), was developed to assess clinician skill with core communicative aspects involved in delivering contingency management (CM). The instrument presents a single vignette consisting of six points of client dialogue to which respondents write 'what they would say next.' In the context of an implementation/effectiveness hybrid trial, 19 staff clinicians at an opiate treatment program completed serial training outcome assessments before, following, and three months after CM training. Assessments included this adaptation of the HRQ, a multiple-choice CM knowledge test, and a recorded standardized patient encounter scored for CM skillfulness. Study results reveal promising psychometric properties for the instrument, including strong scoring reliability, internal consistency, concurrent and predictive validity, test-retest reliability and sensitivity to training effects. These preliminary findings suggest the instrument is a viable, practical method to assess clinician skill in communicative aspects of CM delivery.

Training addiction professionals in empirically supported treatments: perspectives from the treatment community.

BACKGROUND: Large-scale dissemination efforts seek to expand opportunities for the addiction treatment community to receive training in empirically supported treatments (ESTs). Prospective consumers of such training are valuable sources of input about content of interest, preferences for how training events are structured, and obstacles that deter receipt of training. METHODS: In this mixed-method study, data were collected in 64 semistructured individual interviews with personnel during site visits to 16 community opioid treatment programs (OTPs). At each OTP, interviews were completed with the executive director, a clinical supervisor, and 2 direct-service clinicians. Topical interests were analyzed qualitatively in a cultural domain analysis. Likert ratings of training event preferences were analyzed via generalized linear mixed models (GLMMs), and unstructured interviewee comments were analyzed via narrative analysis. Obstacles to training receipt were analyzed qualitatively with both content coding and narrative analysis. RESULTS: Based on topics of reported interest, cultural domain analysis suggests as ESTs of note: Multidimensional Family Therapy, Motivational Enhancement Therapy, Relapse Prevention Therapy, "Seeking Safety," and broad addiction-focused pharmacotherapy. Regarding training event preferences, GLMMs and narrative analysis revealed clear preferences for time-distributed trainings and use of participatory activities (e.g., trainer demonstrations, role plays, small group exercises). Content coding identified cost as the primary obstacle to receipt of EST trainings, followed by lack of time, logistical challenges, and disinterest, and narrative analysis elaborated on contextual issues underlying these obstacles. CONCLUSIONS: As primary consumers of EST technologies, the treatment community has valuable input to offer. Dissemination efforts may be enhanced by greater consideration of their preferences for training content and event structure, as well as practical obstacles that challenge their receipt of training.

Evaluating therapist adherence in motivational interviewing by comparing performance with standardized and real patients.

OBJECTIVE: The goal of measuring therapist adherence is to determine whether a therapist can perform a given treatment. Yet, the evaluation of therapist behaviors in most clinical trials is limited. Typically, randomized trials have few therapists and minimize therapist variability through training and supervision. Furthermore, therapist adherence is confounded with uncontrolled differences in patients across therapists. Consequently, the extent to which adherence measures capture differences in actual therapist adherence versus other sources of variance is unclear. METHOD: We estimated intra-class correlations (ICCs) for therapist adherence in sessions with real and standardized patients (RPs and SPs), using ratings from a motivational interviewing (MI) dissemination trial (Baer et al., 2009) in which 189 therapists recorded 826 sessions with both patient types. We also examined the correlations of therapist adherence between SP and RP sessions, and the reliability of therapist level adherence scores with generalizability coefficients (GCs). RESULTS: ICCs for therapist adherence were generally large (average ICC for SPs = .44; average ICC for RPs = .40), meaning that a given therapist's adherence scores were quite similar across sessions. Both ICCs and GCs were larger for SP sessions compared to RPs on global measures of MI adherence, such as Empathy and MI Spirit. Correlations between therapist adherence with real and standardized patients were moderate to large on 3 of 5 adherence measures. CONCLUSION: Differences in therapist-level adherence ratings were substantial, and standardized patients have promise as tools to evaluate therapist behavior.