What influences evidence-based treatment sustainment after implementation support ends? A mixed method study of the adolescent-community reinforcement approach.

BACKGROUND: Little is known about clinician perspectives regarding the factors that support or hinder the long-term delivery (i.e., sustainment) of evidence-based treatments in community-based treatment settings. METHODS: Clinical staff from 82 community-based treatment organizations that received federal grant funding to support the delivery of the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based treatment for adolescent substance use, were asked to participate in interviews focused on understanding their perspectives about the sustainment of A-CRA. Qualitative themes were identified using inductive and deductive approaches. Then the themes were dichotomized (present/absent) so that quantitative comparisons could be made between staff from organizations that sustained and did not sustain delivery of A-CRA. Administrative data about each organization in relation to federal funding support and their primary focus was also examined to explore whether these characteristics were associated with A-CRA sustainment. RESULTS: Staff (n = 134) representing 78 organizations participated in the interviews. Staff from organizations that had received multiple federal grants to support the delivery of A-CRA and whose primary focus was substance use rather than other conditions (mental health or primary care) were more likely to report sustaining A-CRA. Staff from sustaining organizations were more likely to report positive grant experiences and success with maintaining both organizational and external support in comparison to staff from non-sustaining organizations. Staff from non-sustaining organizations were more likely to report barriers to sustaining A-CRA, including more challenges with intervention delivery, and lack of internal support and external funding. CONCLUSIONS: Our findings lend empirical support for implementation theories in that multiple factors appear to be associated with long-term delivery of an evidence-based treatment. Although A-CRA was generally perceived positively by staff from both organizations that sustained A-CRA and organizations that did not sustain A-CRA, inner setting factors (e.g., structural policies, leadership support and staff retention) along with outer setting factors (e.g., external funding support) were reported as key to A-CRA sustainment.

Measuring sustainment of an evidence based treatment for adolescent substance use.

BACKGROUND: Measuring the extent a behavioral treatment is sustained in usual care practice settings after initial support for implementation ends is challenging. Oftentimes dichotomous self-report measures are used to measure health program sustainment, but these measures may not adequately capture the quality or extent of behavioral treatment delivery. Using data collected from community based organizations that received support to implement the Adolescent Community Reinforcement Approach (A-CRA), a measure of the extent of sustainment was derived. METHODS: Based on implementation theories and implementation support protocols, a total of 10 core treatment elements were identified to measure the extent of sustainment using information collected from key clinical staff. Item response theory (IRT) and principal component analyses (PCA) were used to further refine the 10 elements into composite measures of sustainment. The association between the 10 elements and the relationships between the comprehensive measures to a dichotomous sustainment measure were also examined. RESULTS: Results from PCA identified two components from the initial 10 elements for measuring the extent of A-CRA treatment sustainment. The two components described different aspects of organizational support for A-CRA treatment implementation, one representing the quality or extent of treatment staffing and delivery and the other representing the quality of or extent of clinical supervision. CONCLUSIONS: Using IRT and PCA, we were able to derive components that could be used to measure the extent of EBT sustainment and also better capture the quality of treatment delivery than the use of simple dichotomous measure. The methodological contribution of our study is that we have demonstrated a general analytic approach that may be applicable for other psychosocial treatments.

Factors associated with an evidence-based measure of implementation for the Adolescent Community Reinforcement Approach.

BACKGROUND: An evidence-based measure of implementation (EBMI) is an implementation outcome measure shown to have predictive validity with one or more future-measured constructs of importance. The current study sought to identify correlates and predictors of an EBMI called procedure exposure. Garner et al. (2016) found procedure exposure to be an EBMI for the Adolescent Community Reinforcement Approach (A-CRA). METHODS: The dataset included 76 community-based substance use treatment organizations located across the United States. Organizational-level regression analyses, which were framed within the context of Chaudoir et al. (2013) framework for predicting implementation outcomes, were used to examine predictors of A-CRA procedure exposure RESULTS: The Washington Circle's treatment initiation performance measure (B=5.05 [SE=1.60], p=0.002), as well as session exposure (B=0.18 [SE=0.06], p=0.003), were significant predictors of A-CRA procedure exposure in the backward stepwise regression analysis (Adjusted R-square=0.55). The Washington Circle's treatment engagement performance measure (B=7.93 [SE=0.77], p<0.001), as well as time-to-proficiency (B=-0.04 [SE=0.02], p=0.02), each had significant bivariate relationships with A-CRA procedure exposure but were not retained in the final model. CONCLUSIONS: Organizations implementing A-CRA are encouraged to make the following high priorities: (a) scheduling and completing a subsequent treatment session within 14days of their index session (treatment initiation) and (b) providing a targeted number of treatment sessions to each client (session exposure). To the extent organizations do this, they may be more likely to achieve higher levels of A-CRA procedure exposure.

Predicting evidence-based treatment sustainment: results from a longitudinal study of the Adolescent-Community Reinforcement Approach.

BACKGROUND: Implementation support models are increasingly being used to enhance the delivery of evidence-based treatments (EBTs) in routine care settings. Little is known about the extent to which these models lead to continued EBT use after implementation support ends. Moreover, few empirical studies longitudinally examine the hypothesized factors associated with long-term psychosocial EBT use (i.e., sustainment). In an effort to address this gap, the current study examined sustainment of an EBT called the Adolescent-Community Reinforcement Approach (A-CRA) following the end of implementation support. METHODS: Between 2006 and 2010, the Substance Abuse and Mental Health Services Administration awarded 3 years of A-CRA implementation support to 82 community-based organizations around the USA. The extent to which A-CRA was sustained following grant end and the hypothesized factors associated with EBT sustainment were collected using both retrospective and prospective data. We examined the extent to which 10 core treatment elements of A-CRA were sustained and the associations between the extent of A-CRA sustainment and hypothesized factors using a pattern-mixture longitudinal modeling approach. RESULTS: Staff from 76 organizations participated in data collection for a 92.86% response rate. On average, about half of the 10 core treatment elements were sustained following the loss of implementation support. Factors that appeared most important to A-CRA sustainment included characteristics that were related to the outer setting (communication, funding, and partnerships), inner setting (political support, organizational capacity, and supervisor turnover rate), implementation support period (number of clinicians and supervisors certified and employed at support end and number of youth served), and staff perceptions of the intervention (implementation difficulty, relative advantage, and perceived success). CONCLUSIONS: Even with multiple years of implementation support, community-based organizations face challenges in sustaining EBT delivery over time. Consistent with implementation theories, multiple factors appear related with EBT sustainment, including the degree of implementation during the initial support period, as well as adequate funding, infrastructure support, and staff support following the end of funding.

The effect of therapists' adherence and competence in delivering the adolescent community reinforcement approach on client outcomes.

[Correction Notice: An Erratum for this article was reported in Vol 31(1) of Psychology of Addictive Behaviors (see record 2016-59284-001). In the article, the disclosed interest for Mark D. Godley in the author note is misrepresented. The accurate representation is that the organization employing Mark D. Godley, Chestnut Health Systems, receives fees for A-CRA training. In addition, the disclosed interest statement for Jane Ellen Smith and Robert J. Meyers should read Jane Ellen Smith and Robert J. Meyers each have private consulting businesses that conduct workshops on CRA or A-CRA; they also receive royalties on the CRA book. All versions of this article have been corrected.] Central to the debate over the implementation of empirically supported treatments is whether therapist skill has a measurable, positive relationship with client outcome. The fidelity and skill with which therapists deliver treatments have been studied under the constructs of adherence and competence. Evidence for a relationship between adherence and competence and client outcomes has been mixed, possibly due to small sample sizes, potentially inadequate measures for rating therapists' skill, and limited statistical methods. The current study used a data set in which 91 therapists provided services to 384 clients from the Assertive Adolescent and Family Treatment project. Therapists trained to deliver the Adolescent Community Reinforcement Approach (A-CRA) submitted audiorecorded sessions to independent raters during their training process. Measures of adherence and competence derived from session ratings were examined in a multilevel model for associations with client substance use outcomes at 3-, 6-, and 12-month follow-ups. Therapist competence was significantly predictive of decreases in clients' days of substance use. Therapist adherence was not predictive of client substance use outcomes in the full sample; however, when only those clients who completed the 12-month follow-up were included, between-therapists adherence was found to be predictive of a decrease in client substance use. This study adds to the evidence that competence in the delivery of treatment is associated with better client treatment outcomes. Adherence may be associated with better treatment outcomes as it was in follow-up completers. Future research should investigate the nature of the relationship between protocol-specific adherence and competence and client outcomes. (PsycINFO Database Record

Toward Evidence-Based Measures of Implementation: Examining the Relationship Between Implementation Outcomes and Client Outcomes.

BACKGROUND: Developing consistent, valid, and efficient implementation outcome measures is necessary to advance implementation science. However, development of such measures has been limited to date, especially for validating the extent to which such measures are associated with important improvements in client outcomes. This study seeks to address this gap by developing one or more evidence-based measures of implementation (EBMIs; i.e., implementation outcome measure that is predictive of improvements in key client outcomes) for the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based practice (EBP) for adolescent substance use. METHODS: Data for the current study were collected as part of a large-scale federally funded EBP dissemination and implementation initiative. The multilevel dataset included 65 substance use treatment organizations, 308 clinicians, and 5873 adolescent clients. Adjusted multilevel regression analyses were used to examine the extent to which client-level outcome measures assessed at 6-month follow-up (i.e., substance use, emotional problems) could be predicted by four implementation outcomes: two measures of fidelity (i.e., session exposure, procedure exposure) and two measures of penetration (i.e., absolute client penetration, absolute staff penetration). RESULTS: Adjusting for client substance use at intake, as well as several client characteristics (e.g., age, race, criminal justice involvement), client substance use at follow-up was significantly lower for treatment organizations that had higher procedure exposure (B=-1.227, standard error [SE]=0.583, 95% confidence interval=-2.370, 0.252; p<.05). None of the other three implementation outcome measures were found to predict improvements in client outcomes. CONCLUSIONS: The current study provides support for procedure exposure as an organizational-level EBMI for A-CRA. Thus, future efforts focused on implementing A-CRA could be improved by measuring and monitoring the extent to which A-CRA procedures are being delivered to clients. Additionally, given the dearth of studies that have examined the relationship between organizational-level measures of implementation and client outcomes, this article provides a prototype for future research to identify EBMIs for other behavioral treatments.

Associations between implementation characteristics and evidence-based practice sustainment: a study of the Adolescent Community Reinforcement Approach.

BACKGROUND: Few empirical studies longitudinally examine evidence-based practice (EBP) sustainment and the hypothesized factors that influence it. In an effort to address this gap, the current study examined sustainment of an EBP for adolescent substance use called the adolescent community reinforcement approach (A-CRA). METHODS: A-CRA sustainment was assessed via information collected as part of key informant interviews and surveys with clinical staff from community-based treatment organizations that had received federal funding to implement A-CRA. Administrative data from the funding period on implementation was also used. Using discrete-time survival analysis, we regressed A-CRA sustainment on several factors theorized to influence EBP sustainment. Factors examined included outer setting, inner setting, implementation quality during the funding period, and intervention-related characteristics. RESULTS: Overall, data from 83 % of the targeted sample of treatment organizations was collected. A-CRA sustainment was strongly related to the time since funding loss. Strong relationships were found between sustainment status and implementation quality during the funding period, agency focus, funding stability, and political support for the treatment along with staff perceptions of the treatment's complexity and implementation difficulty. CONCLUSIONS: Consistent with the Consolidated Framework for Implementation Research, the current study found several factors related to the outer setting (e.g., funding stability), inner setting (e.g., agency focus), implementation quality during the funding period (e.g., staff trained, clients served), and characteristics of the intervention (e.g., implementation complexity) to be associated with EBP sustainment. Future research is warranted to examine the extent to which these relationships are stable over time. Efforts to ensure that adequate implementation occurs during the initial implementation period and that adequate funding, infrastructure, and staff support following the ending of initial support are critical to a program's survival.

Examining the sustainment of the Adolescent-Community Reinforcement Approach in community addiction treatment settings: protocol for a longitudinal mixed method study.

BACKGROUND: Although evidence-based treatments are considered the gold standard for clinical practice, it is widely recognized that evidence-based treatment implementation in real world practice settings has been limited. To address this gap, the federal government provided three years of funding, training and technical assistance to 84 community-based treatment programs to deliver an evidence-based treatment called the Adolescent-Community Reinforcement Approach (A-CRA). Little is known about whether such efforts lead to long-term A-CRA sustainment after the initial funding ends. METHODS/DESIGN: We will use a longitudinal mixed method data analytic approach to characterize sustainment over time and to examine the factors associated with the extent to which A-CRA is sustained. We will use implementation data collected during the funding period (e.g., organizational functioning, staff certification rates and penetration) and supplement it with additional data collected during the proposed project period regarding implementation quality and the hypothesized predictors of sustainment (i.e., inner and outer contextual variables) collected over three waves from 2013 to 2015 representing program sustainment up to five years post-initial funding. DISCUSSION: Gaining a better understanding of the factors that influence the evidence-based treatment sustainment may lead to more effective dissemination strategies and ultimately improve the quality of care being delivered in community-based addiction treatment settings.

The Adolescent Community Reinforcement Approach (A-CRA) as a model paradigm for the management of adolescents with substance use disorders and co-occurring psychiatric disorders.

BACKGROUND: Integrated treatment for youth with substance use disorders (SUDs) and co-occurring psychiatric disorders is recommended; however, there are few studies that have evaluated integrated treatment approaches. METHODS: This paper includes a brief review of cognitive-behavioral and family therapies, since they have been demonstrated to be effective treatments for the disorders that commonly co-occur with substance use. It also describes how an integrated treatment paradigm has been implemented using one Empirically Supported Treatment, the Adolescent Community Reinforcement Approach (A-CRA). RESULTS: There is existing research that supports the use of several A-CRA procedures to treat substance use and commonly co-occurring psychiatric disorders. CONCLUSIONS: In the absence of further research, it is reasonable in the interim to train clinicians in treatments that incorporate components that have been found to be effective for both substance use and commonly co-occurring psychiatric disorders. These treatments can then be adapted as needed based on an individual youth's set of problems. Further research is needed to test treatments for various combinations of SUDs and psychiatric disorders (i.e., depression, trauma-related problems, conduct disorder/behavior problems, and attention-deficit/hyperactivity disorder [ADHD]).

A Behaviorally-Anchored Rating System to Monitor Treatment Integrity for Community Clinicians Using the Adolescent Community Reinforcement Approach.

This study evaluated a process for training raters to reliably rate clinicians delivering the Adolescent Community Reinforcement Approach (A-CRA) in a national dissemination project. The unique A-CRA coding system uses specific behavioral anchors throughout its 73 procedure components. Five randomly-selected raters each rated "passing" and "not passing" examples of the 19 A-CRA procedures. Ninety-four percent of the final ICCs were at least 'good' (≥.60) and 66.7% were 'excellent' (≥.75), and 95% of the ratings exceeded the 60% or better agreement threshold between raters and the gold standard. Raters can be trained to provide reliable A-CRA feedback for large-scale dissemination projects.

A comparison of treatment outcomes for adolescent community reinforcement approach participants with and without co-occurring problems.

This study examined the relationship between Adolescent Community Reinforcement Approach (A-CRA) participation with treatment engagement, retention, and satisfaction, and with substance use and emotional problem outcomes. Participants had substance use disorders (SUD) only or co-occurring substance use and psychiatric problems. Those with co-occurring problems reported more days of substance use and emotional problems at intake to treatment than those with SUD only. All groups received equivalent exposure to A-CRA during treatment implementation. At the 12-month follow-up, adolescents classified as externalizers (n = 468) or those with both externalizing and internalizing problems (n = 674) had significantly greater improvement in their days of abstinence and substance problems relative to adolescents with substance use disorders only (n = 666). Additionally, adolescents reporting symptoms of internalizing (n = 154), externalizing, or both externalizing and internalizing disorders had significantly greater improvements in days of emotional problems relative to adolescents with SUD only.

Longitudinal change mechanisms for substance use and illegal activity for adolescents in treatment.

The current study investigated: (a) the relationships of exposure to the Adolescent Community Reinforcement Approach (A-CRA) with reductions in substance use, illegal activity, and juvenile justice system involvement in adolescents diagnosed with a substance use disorder, and (b) the pathways by which reductions in the target behaviors were achieved. This study is a secondary data analysis of longitudinal data from a large-scale implementation effort for A-CRA. The sample consisted of 1,467 adolescents who presented to substance use treatment and reported past-year engagement in illegal activity. Participants had an average age of 15.8 years (SD = 1.3) and were 25% female, 14% African American, 29% Hispanic, 35% Caucasian, 16% mixed ethnicity, and 6% other ethnicity. Path analyses provided support that participation in A-CRA had a significant, direct association with reduced substance use; a significant, indirect association with reduced illegal activity through reductions in substance use; and a significant indirect association with reduced juvenile justice system involvement through reductions in both substance use and illegal activity. In addition, post hoc analyses using a bootstrapping strategy provided evidence that reductions in substance use partially mediated the relationship between A-CRA and illegal activity.

A randomized trial of assertive continuing care and contingency management for adolescents with substance use disorders.

OBJECTIVE: Most adolescents relapse within 90 days of discharge from residential substance use treatment. We hypothesized that contingency management (CM), assertive continuing care (ACC), and their combination (CM + ACC) would each be more effective than usual continuing care (UCC). METHOD: Following residential treatment, 337 adolescents were randomized to 4 continuing care conditions: UCC alone, CM, ACC, or CM + ACC. UCC was available across all conditions. Outcome measures over 12 months included percentage of days abstinent from alcohol, heavy alcohol, marijuana, and any alcohol or other drugs (AOD) using self-reports and toxicology testing and remission status at 12 months. RESULTS: CM had significantly higher rates of abstinence than UCC for heavy alcohol use, t(297) = 2.50, p < .01, d = 0.34; any alcohol use, t(297) = 2.58, p < .01, d = 0.36; or any AOD use, t(297) = 2.12, p = .01, d = 0.41; and had a higher rate in remission, odds ratio (OR) = 2.45, 90% confidence interval (CI) [1.18, 5.08], p = .02. ACC had significantly higher rates of abstinence than UCC from heavy alcohol use, t(297) = 2.66, p < .01, d = 0.31; any alcohol use, t(297) = 2.63, p < .01, d = 0.30; any marijuana use, t(297) = 1.95, p = .02, d = 0.28; or any AOD use, t(297) = 1.88, p = .02, d = 0.30; and had higher rates in remission, OR = 2.31, 90% CI [1.10, 4.85], p = .03. The ACC + CM condition was not significantly different from UCC on any outcomes. CONCLUSIONS: CM and ACC are promising continuing care approaches after residential treatment. Future research should seek to further improve their effectiveness.

Comparison of the Addiction Severity Index (ASI) and the Global Appraisal of Individual Needs (GAIN) in predicting the effectiveness of drug treatment programs for pregnant and postpartum women.

This study conducts a within-subject comparison of the Addiction Severity Index (ASI) and the Global Appraisal of Individual Needs (GAIN) to assess change in alcohol and other drug treatment outcomes for pregnant and postpartum women. Data are from 139 women who were pregnant or who had children under 11 months old and were admitted to residential drug treatment, then re-interviewed 6 months postdischarge (83% follow-up rate). The ASI and GAIN change measures were compared on their ability to detect changes in alcohol and drug use, medical and HIV risk issues, employment issues, legal problems, family and recovery environment characteristics, and psychological/emotional issues. The measures were similar in their ability to detect treatment outcomes, and ASI and GAIN change scores were moderately correlated with each other. The GAIN scales had equal or slightly higher coefficient alpha values than the ASI composite scores. The GAIN also includes an HIV risk scale, which is particularly important for pregnant and postpartum women. These results suggest that the GAIN is comparable with the ASI and can be used for treatment research with pregnant and postpartum women.

Using pay for performance to improve treatment implementation for adolescent substance use disorders: results from a cluster randomized trial.

OBJECTIVE: To test whether pay for performance (P4P) is an effective method to improve adolescent substance use disorder treatment implementation and efficacy. DESIGN: Cluster randomized trial. SETTING: Community-based treatment organizations. PARTICIPANTS: Twenty-nine community-based treatment organizations, 105 therapists, and 986 adolescent patients (953 with complete data). INTERVENTION: Community-based treatment organizations were assigned to 1 of the following conditions: the implementation-as-usual (IAU) control condition or the P4P experimental condition. In addition to delivering the same evidence-based treatment (ie, using the Adolescent Community Reinforcement Approach [A-CRA]), each organization received standardized levels of funding, training, and coaching from the treatment developers. Therapists in the P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (ie, A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions (ie, target A-CRA) that has been found to be associated with significantly improved patient outcomes. MAIN OUTCOME MEASURES: Outcomes included ACRA competence (ie, a therapist-level implementation measure), target A-CRA (ie, a patient-level implementation measure), and remission status (ie, a patient-level treatment effectiveness measure). RESULTS: Relative to therapists in the IAU control condition, therapists in the P4P condition were significantly more likely to demonstrate A-CRA competence (24.0% vs 8.9%; event rate ratio, 2.24; 95% CI, 1.12- 4.48; P=.02). Relative to patients in the IAU control condition, patients in the P4P condition were significantly more likely to receive target A-CRA (17.3% vs 2.5%; odds ratio, 5.19; 95% CI, 1.53-17.62; P=.01). However, no significant differences were found between conditions with regard to patients' end-of-treatment remission status. CONCLUSION: Pay for performance can be an effective method of improving treatment implementation. TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01016704

Treatment staff turnover in organizations implementing evidence-based practices: turnover rates and their association with client outcomes.

High staff turnover has been described as a problem for the substance use disorder treatment field. This assertion is based primarily on the assumption that staff turnover adversely impacts treatment delivery and effectiveness. This assumption, however, has not been empirically tested. In this study, we computed annualized rates of turnover for treatment staff (N = 249) participating in an evidence-based practice implementation initiative and examined the association between organizational-level rates of staff turnover and client-level outcomes. Annualized rates of staff turnover were 31% for clinicians and 19% for clinical supervisors. In addition, multilevel analyses did not reveal the expected relationship between staff turnover and poorer client-level outcomes. Rather, organizational-level rates of staff turnover were found to have a significant positive association with two measures of treatment effectiveness: less involvement in illegal activity and lower social risk. Possible explanations for these findings are discussed.

Training and retaining staff to competently deliver an evidence-based practice: the role of staff attributes and perceptions of organizational functioning.

Within the context of an initiative to implement evidence-based practices (EBPs) for adolescents with substance use disorders, this study examined the extent to which staff factors measured at an initial EBP training workshop were predictive of EBP competence and turnover status of staff (N = 121) measured 6, 9, and 12 months posttraining. By the final assessment point, 52.3% of staff transitioned to the employed/EBP-competent category, 26.6% transitioned to the not employed/not EBP-competent category, 4.6% transitioned to the not employed/EBP-competent category, and 16.5% had not transitioned out of the initial category. Multilevel multinomial regression analysis identified several measures that were significant predictors of staff transitions to the not employed/not EBP-competent category (e.g., program needs, job satisfaction, burnout) and transitions to the employed/EBP-competent category (e.g., months in position, pressures for change, influence). Findings have implications for the development and testing of strategies to train and retain staff to deliver EBPs in practice settings.

Adolescent Community Reinforcement Approach outcomes differ among emerging adults and adolescents.

One fifth of all public treatment admissions are emerging adults, and few studies have considered whether treatments are developmentally appropriate. This study compares outcomes between adolescents and emerging adults with substance use disorders who received the Adolescent Community Reinforcement Approach (A-CRA). Propensity score matching was used to create a weighted comparison group of adolescents (n = 151) who had similar demographic characteristics, clinical severity, and treatment retention as the group of emerging adults (n = 152). We examined age differences in abstinence and other psychosocial outcomes at the last available follow-up. Emerging adults and adolescents both reduced their substance use at follow-up. However, emerging adults were less likely to be abstinent and in remission and had more days of alcohol use when compared with adolescents. This study's findings are consistent with prior work on emerging adults. Additional research should examine features of interventions that are most effective in addressing the developmental needs of emerging adults.

A Large-scale Dissemination and Implementation Model for Evidence-based Treatment and Continuing Care.

Multiple evidence-based treatments for adolescents with substance use disorders are available; however, the diffusion of these treatments in practice remains minimal. A dissemination and implementation model incorporating research-based training components for simultaneous implementation across 33 dispersed sites and over 200 clinical staff is described. Key elements for the diffusion of the Adolescent Community Reinforcement Approach and Assertive Continuing Care were: (a) three years of funding to support local implementation; (b) comprehensive training, including a 3.5 day workshop, bi-weekly coaching calls, and ongoing performance feedback facilitated by a web tool; (c) a clinician certification process; (d) a supervisor certification process to promote long-term sustainability; and (e) random fidelity reviews after certification. Process data are summarized for 167 clinicians and 64 supervisors.

Gender and racial differences in treatment process and outcome among participants in the adolescent community reinforcement approach.

Increasingly, evidence-based treatments are being implemented by community treatment providers, and it is important to understand whether they can be implemented with similar quality and equivalent effectiveness across gender and racial groups. This study examined whether initiation, engagement, dosage, treatment satisfaction, or outcomes for adolescents who received the Adolescent Community Reinforcement Approach (A-CRA) in a large implementation effort were equivalent by gender or racial group. Analyses of data from 2,141 adolescents representing 33 sites across the United States revealed no significant differences for initiation, engagement, or retention by gender or race. Ninety-six percent of the sample reported being satisfied with treatment; however, male adolescents had significantly higher rates of treatment satisfaction than female adolescents, and African American adolescents had significantly higher rates of treatment satisfaction than Caucasian adolescents. A subset of the initial sample (n = 1,819) was used to investigate outcomes. All racial groups had significant increases in days abstinent from alcohol and other drugs and in the percentage in recovery across the measurement period but did not differ from one another at the six-month follow-up. Female adolescents had a higher percentage of days abstinent from alcohol and other drugs and were more likely to be in recovery at the six-month follow-up than male adolescents. Overall, process indicators suggest the intervention was well implemented across gender and racial groups and equally effective across racial groups, with males having equivalent gains in abstinence and recovery compared with females despite males having greater intake severity and differential outcomes at six months.