Using brief reflections to capture and evaluate end-user engagement: a case example using the COMPASS study.

BACKGROUND: Use of participatory research methods is increasing in research trials. Once partnerships are established with end-users, there is less guidance about processes research teams can use to successfully incorporate end-user feedback. The current study describes the use of a brief reflections process to systematically examine and evaluate the impact of end-user feedback on study conduct. METHODS: The Comparative Effectiveness of Trauma-Focused and Non-Trauma- Focused Treatment Strategies for PTSD among those with Co-Occurring SUD (COMPASS) study was a randomized controlled trial to determine the effectiveness of trauma-focused psychotherapy versus non-trauma-focused psychotherapy for Veterans with co-occurring posttraumatic stress disorder and substance use disorder who were entering substance use treatment within the Department of Veterans Affairs. We developed and paired a process of "brief reflections" with our end-user engagement methods as part of a supplemental evaluation of the COMPASS study engagement plan. Brief reflections were 30-minute semi-structured discussions with the COMPASS Team following meetings with three study engagement panels about feedback received regarding study issues. To evaluate the impact of panel feedback, 16 reflections were audio-recorded, transcribed, rapidly analyzed, and integrated with other study data sources. RESULTS: Brief reflections revealed that the engagement panels made recommended changes in eight areas: enhancing recruitment; study assessment completion; creating uniformity across Study Coordinators; building Study Coordinator connection to Veteran participants; mismatch between study procedures and clinical practice; therapist skill with patients with active substance use; therapist burnout; and dissemination of study findings. Some recommendations positively impact study conduct while others had mixed impact. Reflections were iterative and led to emergent processes that included revisiting previously discussed topics, cross-pollination of ideas across panels, and sparking solutions amongst the Team when the panels did not make any recommendations or recommendations were not feasible. CONCLUSIONS: When paired with end-user engagement methods, brief reflections can facilitate systematic examination of end-user input, particularly when the engagement strategy is robust. Reflections offer a forum of accountability for researchers to give careful thought to end-user recommendations and make timely improvements to the study conduct. Reflections can also facilitate evaluation of these recommendations and reveal end-user-driven strategies that can effectively improve study conduct. TRIAL REGISTRATION: ClinicalTrials.gov (NCT04581434) on October 9, 2020; https://clinicaltrials.gov/ct2/show/study/NCT04581434?term=NCT04581434&draw=2&rank=1 .

Co-occurring implementation strategies: The effects of academic detailing for opioid use disorder campaign on the advancing pharmacological treatments for opioid use disorder (ADaPT-OUD) study.

Background: Barriers at the system, clinician, and patient level limit access to medications for opioid use disorder (MOUD). The Advancing Pharmacological Treatments for Opioid Use Disorder (ADaPT-OUD) study implemented an external facilitation strategy within the Veterans Health Administration (VHA) aimed at facility-level barriers to improve uptake of MOUD. During ADaPT-OUD, an independent Academic Detailing Services Opioid Agonist Treatment of OUD Campaign was co-occurring and aimed to increase evidence-based practice for OUD at the clinician level. While both these initiatives aim to increase MOUD reach, they address different barriers and did not intentionally collaborate. Thus, understanding the interaction between these two independent implementation initiatives and their effect on MOUD reach will further inform and mold future implementation efforts of MOUD. Methods: This was a secondary analysis of the ADaPT-OUD study that included 35 VHA facilities in the lowest quartile of MOUD reach; eight received the ADaPT-OUD external facilitation and 27 matched sites received implementation as usual. The number of academic detailing (AD) visits during ADaPT-OUD was used as a proxy for the intensity of Academic Detailing for OUD Campaign activity. The interaction between external facilitation status and AD intensity was evaluated by comparing the change in facility-level MOUD reach. Results: There was a general increase in the number of AD visits, in both external facilitation and implementation as usual sites, over the course of ADaPT-OUD's implementation period. A non-statistically significant, positively sloped, linear relationship was observed between average number of AD visits per quarter and change in MOUD reach in facilities also receiving ADaPT-OUD external facilitation that was not observed in the implementation as usual sites. Conclusion: Co-occurring initiatives focusing on different barriers to MOUD access have the potential to further increase MOUD in low-performing facilities, but further research into timing, quality, and collaboration between initiatives are warranted.

Medication treatment of opioid use disorder (MOUD) is a key element in addressing the opioid epidemic. The development, approval, and effectiveness of buprenorphine and naltrexone have expanded access to MOUD from specialty opioid treatment programs to office-based treatment. However, uptake of these evidence-based treatments across the Veterans Health Administration (VHA) is variable. To address this gap in care within the VHA, The Advancing Pharmacological Treatment for Opioid Use Disorder (ADaPT-OUD) study implemented an external facilitation strategy aimed at facility-level barriers at low-adopting VHA facilities while the VHA Pharmacy Benefits Management Academic Detailing Services Opioid Agonist Treatment of OUD Campaign implemented academic detailing with the goal to address clinician-level barriers. This article evaluates the effect these two co-occurring and independent initiatives had on each other and MOUD reach. The results suggest a trend toward a positive synergistic relationship between the two initiatives, that warrants further study and evaluation to inform further implementation efforts.

Costs of implementing a multi-site facilitation intervention to increase access to medication treatment for opioid use disorder.

BACKGROUND: The United States has been grappling with the opioid epidemic, which has resulted in over 75,000 opioid-related deaths between April 2020 and 2021. Evidence-based pharmaceutical interventions (buprenorphine, methadone, and naltrexone) are available to reduce opioid-related overdoses and deaths. However, adoption of these medications for opioid use disorder has been stifled due to individual- and system-level barriers. External facilitation is an evidence-based implementation intervention that has been used to increase access to medication for opioid use disorder (MOUD), but the implementation costs of external facilitation have not been assessed. We sought to measure the facility-level direct costs of implementing an external facilitation intervention for MOUD to provide decision makers with estimates of the resources needed to implement this evidence-based program. METHODS: We performed a cost analysis of the pre-implementation and implementation phases, including an itemization of external facilitation team and local site labor costs. We used labor estimates from the Bureau of Labor and Statistics, and sensitivity analyses were performed using labor estimates from the Veterans Health Administration (VHA) Financial Management System general ledger data. RESULTS: The average total costs for implementing an external facilitation intervention for MOUD per site was $18,847 (SD 6717) and ranged between $11,320 and $31,592. This translates to approximately $48 per patient with OUD. Sites with more encounters and participants with higher salaries in attendance had higher costs. This was driven mostly by the labor involved in planning and implementation activities. The average total cost of the pre-implementation and implementation activities were $1031 and $17,816 per site, respectively. In the sensitivity analysis, costs for VHA were higher than BLS estimates likely due to higher wages. CONCLUSIONS: Implementing external facilitation to increase MOUD prescribing may be affordable depending on the payer's budget constraints. Our study reported that there were variations in the time invested at each phase of implementation and the number and type of participants involved with implementing an external facilitation intervention. Participant composition played an important role in total implementation costs, and decision makers will need to identify the most efficient and optimal number of stakeholders to involve in their implementation plans.

What Contributes to Sustainability? Examining Access to Medications for Opioid Use Disorder in Low-Adopting VHA Facilities.

BACKGROUND: Successful implementation can increase the availability of evidence-based treatments but continued patient access can be threatened if there is not deliberate focus on sustainment. Real-world examples are needed to elucidate contributors to sustainability. OBJECTIVE: We examined sustainability of outcomes of a study which tested a 12-month external facilitation intervention. The study evaluated change in access to medications for opioid use disorder (MOUD) in Veterans Health Administration (VHA) facilities in the lowest quartile of MOUD prescribing. DESIGN: Convergent mixed-methods design. PARTICIPANTS: Thirty-nine providers and leaders from eight VHA facilities. APPROACH: Thirty-minute post-implementation telephone interviews explored whether barriers identified pre-implementation were successfully addressed, the presence of any new challenges, helpfulness of external facilitation, and plans for sustaining MOUD access. Interviews were analyzed using a rapid turn-around approach. VHA administrative data were used to characterize the facilities and assess their ratio of patients with an OUD diagnosis receiving MOUD (MOUD/OUD ratio) at the end of a 9-month sustainability period. KEY RESULTS: Commonly reported contributors to sustained MOUD access included national attention on the opioid epidemic, accountability created by study participation, culture shift in MOUD acceptability, leadership support, and plans to build on initial progress. Frequently reported barriers included staffing issues and lack of MOUD-devoted time; the need to overhaul existing policies, practices, and/or processes; and fear and anxiety about MOUD prescribing. All facilities either maintained MOUD/OUD ratio improvement (n = 2) or further improved (n = 6) at the end of sustainability. Facilities with the highest and lowest ratio at the end of sustainability used a team-based approach to MOUD delivery; however, organizational setting differences may have impacted overall MOUD access. CONCLUSIONS: Ensuring stable and consistent staff, and sufficient time dedicated to MOUD are critical to sustaining access to evidence-based treatment in low-adopting facilities. This study highlights the importance of investing in local, system-level changes to improve and sustain access to effective treatments.

Healthcare quality measures in implementation research: advantages, risks and lessons learned.

Implementation studies evaluate strategies to move evidence-based practices into routine clinical practice. Often, implementation scientists use healthcare quality measures to evaluate the integration of an evidence-based clinical practice into real-world healthcare settings. Healthcare quality measures have standardized definitions and are a method to operationalize and monitor guideline-congruent care. Implementation scientists can access existing data on healthcare quality measures through various sources (e.g. operations-calculated), or they can calculate the measures directly from healthcare claims and administrative data (i.e. researcher-calculated). Implementation scientists need a better understanding of the advantages and disadvantages of these methods of obtaining healthcare quality data for designing, planning and executing an implementation study. The purpose of this paper is to describe the advantages, risks and lessons learned when using operations- versus researcher-calculated healthcare quality measures in site selection, implementation monitoring and implementation outcome evaluation. A key lesson learned was that relying solely on operations-calculated healthcare quality measures during an implementation study poses risks to site selection, accurate feedback on implementation progress to stakeholders, and the integrity of study results. A possible solution is using operations-calculated quality measures for monitoring of evidence-based practice uptake and researcher-calculated measures for site section and outcomes evaluation. This approach provides researchers greater control over the data and consistency of the measurement from site selection to outcomes evaluation while still retaining measures that are familiar and understood by key stakeholders whom implementation scientists need to engage in practice change efforts.

Comparative effectiveness of trauma-focused and non-trauma-focused psychotherapy for PTSD among veterans with comorbid substance use disorders: Protocol & rationale for a randomized clinical trial.

BACKGROUND: Co-occurrence of posttraumatic stress disorder (PTSD) and substance use disorders (SUDs) is common and concurrent treatment is recommended. Relatively little is known about which evidence-based psychotherapies for PTSD are most effective for patients with varying substance use profiles. We aim to examine the comparative effectiveness of trauma-focused therapy (TFT) and non-trauma-focused therapy (NTFT) among Veterans with PTSD and SUD. TFT has been found to be effective among those with PTSD/SUD, though effects are smaller and rates of treatment non-completion are higher than in those without SUD. NTFTs suggested for the treatment of PTSD, such as Present Centered Therapy, (PCT) have not been examined among those with co-occurring SUD, despite lower rates of treatment dropout. We will also examine the comparative effectiveness of TFT and NTFT for patients with varying SUD severity, type of substances used, and patient treatment preference. METHOD: 420 Veterans with PTSD and SUD will be randomized in a prospective, pragmatic comparative effectiveness trial at 14 Veterans Health Administration facilities. Participants will receive either TFT (Prolonged Exposure or Cognitive Processing Therapy) or NTFT (PCT) after enrolling in concurrent SUD treatment-as-usual. Assessments will occur at baseline, posttreatment, 3- and 6 -months posttreatment. Main outcomes are PTSD symptom severity and PTSD treatment dropout. Clinician, patient, and leadership stakeholder panels advise study activities, and a process evaluation will identify strategies to enhance the implementation of evidence-based PTSD treatments in SUD care settings. CONCLUSIONS: Results will provide critical information to guide clinicians when recommending PTSD treatments to patients with comorbid SUD. CLINICALTRIALS: gov Identifier: NCT04581434.

Are x-waiver trainings enough? Facilitators and barriers to buprenorphine prescribing after x-waiver trainings.

BACKGROUND: In the United States, an x-waiver credential is necessary to prescribe buprenorphine medication treatment for opioid use disorder (B-MOUD). Historically, this process has required certified training, which could be a barrier to obtaining an x-waiver and subsequently prescribing. To address this barrier, the US recently removed the training requirement for some clinicians. We sought to determine if clinicians who attended x-waiver training went on to obtain an x-waiver and prescribe B-MOUD, and to examine what facilitated or impeded B-MOUD prescribing. METHODS: In September 2020, we conducted a cross-sectional, electronic survey of attendees of 15 in-person x-waiver pieces of training from June 2018 to January 2020 within the Veterans Health Administration (VHA). Of the attendees (n = 321), we surveyed current VHA clinicians who recalled taking the training. The survey assessed whether clinicians obtained the x-waiver, had prescribed B-MOUD, and barriers or facilitators that influenced B-MOUD prescribing. RESULTS: Of 251 eligible participants, 62 (24.7%) responded to the survey, including 27 (43.5%) physicians, 16 (25.8%) advanced practice clinicians, and 12 (19.4%) pharmacists. Of the 43 clinicians who could prescribe, 29 (67.4%) had obtained their x-waiver and 16 (37.2%) had reported prescribing B-MOUD. Prominent barriers to prescribing B-MOUD included a lack of supporting clinical staff and competing demands on time. The primary facilitator to prescribing was leadership support. CONCLUSION AND SCIENTIFIC SIGNIFICANCE: Nine months after x-waiver training, two-thirds of clinicians with prescribing credentials had obtained their x-waiver and one-third were prescribing B-MOUD. Removing the x-waiver training may not have the intended policy effect as other barriers to B-MOUD prescribing persist.

Advancing Pharmacological Treatments for Opioid Use Disorder (ADaPT-OUD): an Implementation Trial in Eight Veterans Health Administration Facilities.

BACKGROUND: Identifying effective strategies to improve access to medication treatments for opioid use disorder (MOUD) is imperative. Within the Veterans Health Administration (VHA), provision of MOUD varies significantly, requiring development and testing of implementation strategies that target facilities with low provision of MOUD. OBJECTIVE: Determine the effectiveness of external facilitation in increasing the provision of MOUD among VHA facilities with low baseline provision of MOUD compared to matched controls. DESIGN: Pre-post, block randomized study designed to compare facility-level outcomes in a stratified sample of eligible facilities. Four blocks (two intervention facilities in each) were defined by median splits of both the ratio of patients with OUD receiving MOUD and number of patients with OUD not currently receiving MOUD (i.e., number of actionable patients). Intervention facilities participated in a 12-month implementation intervention. PARTICIPANTS: VHA facilities in the lowest quartile of MOUD provision (35 facilities), eight of which were randomly assigned to participate in the intervention (two per block) with twenty-seven serving as matched controls by block. INTERVENTION: External facilitation included assessment of local barriers/facilitators, formation of a local implementation team, a site visit for action planning and training/education, cross-facility quarterly calls, monthly coaching calls, and consultation. MAIN MEASURES: Pre- to post-change in the facility-level ratio of patients with an OUD diagnosis receiving MOUD compared to control facilities. KEY RESULTS: Intervention facilities significantly increased the ratio of patients with OUD receiving MOUD from an average of 18% at baseline to 30% 1 year later, with an absolute difference of 12% (95% confidence interval [CI]: 6.6%, 17.0%). The difference in differences between intervention and control facilities was 3.0% (95% CI: - 0.2%. 6.7%). The impact of the intervention varied by block, with smaller, less complex facilities more likely to outperform matched controls. CONCLUSIONS: Intensive external facilitation improved the adoption of MOUD in most low-performing facilities and may enhance adoption beyond other interventions less tailored to individual facility contexts.

Fluctuations in barriers to medication treatment for opioid use disorder prescribing over the course of a one-year external facilitation intervention.

BACKGROUND: The Veterans Health Administration (VHA) is invested in expanding access to medication treatment for opioid use disorder (MOUD) to save lives. Access varies across VHA facilities and, thus, requires implementation strategies to promote system-wide adoption of MOUD. We conducted a 12-month study employing external facilitation that targeted MOUD treatment among low-adopting VHA facilities. In this study, we sought to evaluate the patterns of perceived barriers over 1 year of external implementation facilitation using the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework. METHODS: We randomly selected eight VHA facilities from the bottom quartile of the proportion of Veterans with an OUD diagnosis receiving MOUD (< 21%). The 1-year external implementation intervention included developmental evaluation to tailor the facilitation, an on-site visit, and monthly facilitation calls. Facilitators recorded detailed notes for each call on a structured template. Qualitative data was analyzed by coding and mapping barriers to the constructs in the i-PARIHS framework (Innovation, Recipients, Context). We identified emerging themes within each construct by month. RESULTS: Barriers related to the Innovation, such as provider perception of the need for MOUD in their setting, were minimal throughout the 12-month study. Barriers related to Recipients were predominant and fluctuated over time. Recipient barriers were common during the initial months when providers did not have the training and waivers necessary to prescribe MOUD. Once additional providers (Recipients) were trained and waivered to prescribe MOUD, Recipient barriers dropped and then resurfaced as the facilities worked to expand MOUD prescribing to other clinics. Context barriers, such as restrictions on which clinics could prescribe MOUD and fragmented communication across clinics regarding the management of patients receiving MOUD, emerged more prominently in the middle of the study. CONCLUSIONS: VHA facilities participating in 12-month external facilitation interventions experienced fluctuations in barriers to MOUD prescribing with contextual barriers emerging after a facilitated reduction in recipient- level barriers. Adoption of MOUD prescribing in low-adopting VHA facilities requires continual reassessment, monitoring, and readjustment of implementation strategies over time to meet challenges. Although i-PARIHS was useful in categorizing most barriers, the lack of conceptual clarity was a concern for some constructs.

Early impacts of a multi-faceted implementation strategy to increase use of medication treatments for opioid use disorder in the Veterans Health Administration.

BACKGROUND: Despite the risk of negative sequelae from opioid use disorder (OUD) and clinical guidelines for the use of effective medication treatment for OUD (M-OUD), many Veterans Health Administration (VHA) providers and facilities lag in providing M-OUD. An intensive external facilitation intervention may enhance uptake in low-adopting VHA facilities by engaging stakeholders from multiple clinical settings within a facility (e.g., mental health, primary care, pain specialty clinic, substance use disorder clinics). Our study identified pre-intervention determinants of implementation through qualitative interviews, described strategies employed during the first 6 months of intensive external facilitation, and explored patterns of implementation determinants in relation to early outcomes. METHODS: Guided by the integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework, we interviewed stakeholders at low-adopting VHA facilities prior to external facilitation, employed a rapid qualitative analytic process, presented findings during facility visits, and collaboratively created facilitation action plans to achieve goals set by the facilities that would increase M-OUD uptake. The primary outcome was the Substance Use Disorder (SUD)-16, which is a VHA facility-level performance metric consisting of the percent of patients receiving M-OUD among those with an OUD diagnosis. We examined the relationship between pre-implementation factors and 6-month SUD-16 outcomes. RESULTS: Across eight VHA facilities, we interviewed 68 participants. Implementation determinants included barriers and facilitators across innovation, context, and recipients constructs of i-PARIHS. Each facility selected goals based on the qualitative results. At 6 months, two facilities achieved most goals and two facilities demonstrated progress. The SUD-16 from baseline to 6 months significantly improved in two facilities (8.4% increase (95 % confidence interval [CI] 4.4-12.4) and 9.9% increase (95% CI 3.6-16.2), respectively). Six-month implementation outcomes showed that the extent to which M-OUD aligns with existing clinical practices and values was a primary factor at all facilities, with six of eight facilities perceiving it as both a barrier and facilitator. External health system barriers were most challenging for facilities with the smallest change in SUD-16. CONCLUSIONS: Early impacts of a multi-faceted implementation approach demonstrated a strong signal for positively impacting M-OUD prescribing in low-adopting VHA facilities. This signal indicates that external facilitation can influence adoption of M-OUD at the facility level in the early implementation phase. These short-term wins experienced by stakeholders may encourage continued adoption and long-term sustainability M-OUD.

Response to coronavirus 2019 in Veterans Health Administration facilities participating in an implementation initiative to enhance access to medication for opioid use disorder.

The actions needed to mitigate the spread of the coronavirus 2019 (COVID-19) have forged rapid paradigm shifts across healthcare delivery. In a time of crisis, continued access to and delivery of medication for opioid use disorder (M-OUD) is essential to save lives. However, prior to COVID-19, large variability in M-OUD adoption existed across the Veteran Health Administration (VHA) and it is unknown whether the COVID-19 pandemic exacerbated this divide. For the past two years, our team worked with eight VHA facilities to enhance adoption of M-OUD through a multi-component implementation intervention. This commentary explores these providers' responses to COVID-19 and the subsequent impact on their progress toward increasing adoption of M-OUD. Briefly, the loosening of regulatory restrictions fostered accelerated adoption of M-OUD, rapid support for telehealth offered a mechanism to increase M-OUD access, and reevaluation of current practices surrounding M-OUD strengthened adoption. Overall, during the COVID-19 crisis, facilities and providers responded positively to the call for increased access to M-OUD and appropriate care of patients with OUD. The VHA providers' responses and continued progress in enhancing M-OUD amidst a crisis may, in part, be attributable to their participation in an implementation effort prior to COVID-19 that established resources, expert support, and a community of practice. We anticipate the themes presented are generalizable to other healthcare systems grappling to deliver care to patients with OUD during a crisis. We propose areas of future research and quality improvement to continue to provide access and high quality, life-saving care to patients with OUD.

Advancing pharmacological treatments for opioid use disorder (ADaPT-OUD): protocol for testing a novel strategy to improve implementation of medication-assisted treatment for veterans with opioid use disorders in low-performing facilities.

BACKGROUND: In the US, emergency room visits and overdoses related to prescription opioids have soared and the rates of illicit opioid use, including heroin and fentanyl, are increasing. Opioid use disorder (OUD) is associated with higher morbidity and mortality, higher HIV and HCV infection rates, and criminal behavior. Opioid agonist therapy (OAT; methadone and buprenorphine) is proven to be effective in treating OUD and decreasing its negative consequences. While the efficacy of OAT has been established, too few providers prescribe OAT to patients with OUD due to patient, provider, or system factors. While the Veterans Health Administration (VHA) has made great strides in OAT implementation, national treatment rates remain low (35% of patients with OUD) and several facilities continue to have much lower prescribing rates. METHODS: Eight VA sites with low baseline prescribing rates (lowest quartile, < 21%) were randomly selected from the 35 low prescribing sites to receive an intensive external facilitation implementation intervention to increase OAT prescribing rates. The intervention includes a site-specific developmental evaluation, a kick-off site visit, and 12 months of ongoing facilitation. The developmental evaluation includes qualitative interviews with patients, substance use disorders clinic staff, and primary care and general mental health leadership to assess site-level barriers. The site visit includes: (1) a review of site-specific barriers and potential implementation strategies; (2) instruction on using available dashboards to track prescribing rates and identify actionable patients; and (3) education on OAT, including, if requested, buprenorphine certification training for prescribers. On-going facilitation consists of monthly conference calls with individual site teams and expert clinical consultation. The primary outcomes is the proportion of Veterans with OUD initiating and sustaining OAT, with intervention sites expected to have larger increases in prescribing compared to control sites. Final qualitative interviews and a cost assessment will inform future implementation efforts. DISCUSSION: This project will examine and respond to barriers encountered in low prescribing VHA clinics allowing refinement of an intervention to enhance access to medication treatment for OUD in additional facilities.

Variations in evidence-based clinical practices in nine United States Veterans Administration opioid agonist therapy clinics.

BACKGROUND: Opioid agonist therapy (OAT) for opioid dependence has a strong evidence base, but clinical practice often does not conform to evidence-based practices. The goal of the OpiATE Initiative is to improve patient outcomes by implementing four evidence-based practices in United States Veterans Administration OAT clinics: (1) long-term maintenance orientation, (2) adequate dosing, (3) adequate counseling, and (4) use of contingency management. METHODS: The OpiATE monitoring system (OMS) was developed to help clinics assess concordance with evidence-based practices. For each patient, counselors record current agonist dose, recent counseling frequency, length of treatment, and urine toxicology results. For patients with sub-standard agonist doses, an algorithm was used to determine if the current dose was clinically appropriate. Maintenance orientation was assessed using the abstinence orientation scale. RESULTS: Concordance with counseling recommendations was uniformly high, concordance with maintenance orientation and dosing recommendations varied widely across clinics, and concordance with contingency management principles was low. Abstinence orientation scores were negatively correlated with dose and patient retention. Dose was negatively correlated with percent of urine screens positive for non-medical opioids and other illicit substances. CONCLUSIONS: The OMS was well accepted by clinic staff. Wide variability in clinical practices and outcomes across clinics supports the importance of individualizing quality improvement strategies to address specific performance gaps.

Beliefs about evidence-based practices in addiction treatment: a survey of Veterans Administration program leaders.

The purpose of this study was to determine Veterans Administration addiction treatment program leaders' familiarity with evidence-based practices, understanding of and attitudes toward existing VA treatment guidelines, the extent to which specific practices should be implemented, and perceived barriers to implementation. Two hundred and twenty surveys were mailed to program leaders between November 1999 and May 2000. One hundred and seventy-four (79%) were completed, representing 135 out of 162 (83%) facilities. Program leaders saw guidelines as educational tools that improved quality of care and could be implemented into existing programs. However, they also perceived staff resistance to implementation. The most strongly cited barriers to implementation were lack of administrative support, insufficient staff time, and lack of skills or knowledge. Several treatments were seen as strongly evidentiary, but were not widely implemented, suggesting possible foci for future translation studies.