Study protocol for a factorial-randomized controlled trial evaluating the implementation, costs, effectiveness, and sustainment of digital therapeutics for substance use disorder in primary care (DIGITS Trial).

BACKGROUND: Experts recommend that treatment for substance use disorder (SUD) be integrated into primary care. The Digital Therapeutics for Opioids and Other SUD (DIGITS) Trial tests strategies for implementing reSET® and reSET-O®, which are prescription digital therapeutics for SUD and opioid use disorder, respectively, that include the community reinforcement approach, contingency management, and fluency training to reinforce concept mastery. This purpose of this trial is to test whether two implementation strategies improve implementation success (Aim 1) and achieve better population-level cost effectiveness (Aim 2) over a standard implementation approach. METHODS/DESIGN: The DIGITS Trial is a hybrid type III cluster-randomized trial. It examines outcomes of implementation strategies, rather than studying clinical outcomes of a digital therapeutic. It includes 22 primary care clinics from a healthcare system in Washington State and patients with unhealthy substance use who visit clinics during an active implementation period (up to one year). Primary care clinics implemented reSET and reSET-O using a multifaceted implementation strategy previously used by clinical leaders to roll-out smartphone apps ("standard implementation" including discrete strategies such as clinician training, electronic health record tools). Clinics were randomized as 21 sites in a 2x2 factorial design to receive up to two added implementation strategies: (1) practice facilitation, and/or (2) health coaching. Outcome data are derived from electronic health records and logs of digital therapeutic usage. Aim 1's primary outcomes include reach of the digital therapeutics to patients and fidelity of patients' use of the digital therapeutics to clinical recommendations. Substance use and engagement in SUD care are additional outcomes. In Aim 2, population-level cost effectiveness analysis will inform the economic benefit of the implementation strategies compared to standard implementation. Implementation is monitored using formative evaluation, and sustainment will be studied for up to one year using qualitative and quantitative research methods. DISCUSSION: The DIGITS Trial uses an experimental design to test whether implementation strategies increase and improve the delivery of digital therapeutics for SUDs when embedded in a large healthcare system. It will provide data on the potential benefits and cost-effectiveness of alternative implementation strategies. CLINICALTRIALS: gov Identifier: NCT05160233 (Submitted 12/3/2021). https://clinicaltrials.gov/ct2/show/NCT05160233.

Practical assessment of DSM-5 alcohol use disorder criteria in routine care: High test-retest reliability of an Alcohol Symptom Checklist.

BACKGROUND: Alcohol use disorder (AUD) is underdiagnosed and undertreated in medical settings, in part due to a lack of AUD assessment instruments that are reliable and practical for use in routine care. This study evaluates the test-retest reliability of a patient-report Alcohol Symptom Checklist questionnaire when it is used in routine care, including primary care and mental health specialty settings. METHODS: We performed a pragmatic test-retest reliability study using electronic health record (EHR) data from Kaiser Permanente Washington, an integrated health system in Washington state. The sample included 454 patients who reported high-risk drinking on a behavioral health screen and completed two Alcohol Symptom Checklists 1 to 21 days apart. Subgroups of these patients who completed both checklists in primary care (n = 271) or mental health settings (n = 79) were also examined. The primary measure was an Alcohol Symptom Checklist on which patients self-reported whether they experienced each of the 11 AUD criteria within the past year, as defined by the Diagnostic and Statistical Manual of Mental Disorders-5th edition (DSM-5). RESULTS: Alcohol Symptom Checklists completed in routine care and documented in EHRs had excellent test-retest reliability for measuring AUD criterion counts (ICC = 0.79, 95% CI: 0.76 to 0.82). Test-retest reliability estimates were also high and not significantly different for the subsamples of patients who completed both checklists in primary care (ICC = 0.82, 95% CI: 0.77 to 0.85) or mental health settings (ICC = 0.74, 95% CI: 0.62 to 0.83). Test-retest reliability was not moderated by having a past two-year AUD diagnosis, nor by the age or sex of the patient completing it. CONCLUSIONS: Alcohol Symptom Checklists can reliably and pragmatically assess AUD criteria in routine care among patients who screen positive for high-risk drinking. The Alcohol Symptom Checklist may be a valuable tool in supporting AUD-related care and monitoring AUD criteria longitudinally in routine primary care and mental health settings.

Practical Assessment of Alcohol Use Disorder in Routine Primary Care: Performance of an Alcohol Symptom Checklist.

BACKGROUND: Alcohol use disorder (AUD) is highly prevalent but underrecognized and undertreated in primary care settings. Alcohol Symptom Checklists can engage patients and providers in discussions of AUD-related care. However, the performance of Alcohol Symptom Checklists when they are used in routine care and documented in electronic health records (EHRs) remains unevaluated. OBJECTIVE: To evaluate the psychometric performance of an Alcohol Symptom Checklist in routine primary care. DESIGN: Cross-sectional study using item response theory (IRT) and differential item functioning analyses of measurement consistency across age, sex, race, and ethnicity. PATIENTS: Patients seen in primary care in the Kaiser Permanente Washington Healthcare System who reported high-risk drinking on the Alcohol Use Disorder Identification Test Consumption screening measure (AUDIT-C ≥ 7) and subsequently completed an Alcohol Symptom Checklist between October 2015 and February 2020. MAIN MEASURE: Alcohol Symptom Checklists with 11 items assessing AUD criteria defined in the Diagnostic and Statistical Manual for Mental Disorders, 5th edition (DSM-5), completed by patients during routine medical care and documented in EHRs. KEY RESULTS: Among 11,464 patients who screened positive for high-risk drinking and completed an Alcohol Symptom Checklist (mean age 43.6 years, 30.5% female), 54.1% reported ≥ 2 DSM-5 AUD criteria (threshold for AUD diagnosis). IRT analyses demonstrated that checklist items measured a unidimensional continuum of AUD severity. Differential item functioning was observed for some demographic subgroups but had minimal impact on accurate measurement of AUD severity, with differences between demographic subgroups attributable to differential item functioning never exceeding 0.42 points of the total symptom count (of a possible range of 0-11). CONCLUSIONS: Alcohol Symptom Checklists used in routine care discriminated AUD severity consistently with current definitions of AUD and performed equitably across age, sex, race, and ethnicity. Integrating symptom checklists into routine care may help inform clinical decision-making around diagnosing and managing AUD.

Routine Assessment of Symptoms of Substance Use Disorders in Primary Care: Prevalence and Severity of Reported Symptoms.

BACKGROUND: Most patients with substance use disorders (SUDs) never receive treatment and SUDs are under-recognized in primary care (PC) where patients can be treated or linked to treatment. Asking PC patients to directly report SUD symptoms on questionnaires might help identify SUDs but to our knowledge, this approach is previously untested. OBJECTIVE: To describe the prevalence and severity of DSM-5 SUD symptoms reported by PC patients as part of routine care. DESIGN: Cross-sectional study using secondary data. PARTICIPANTS: A total of 241,265 adult patients who visited one of 25 PC sites in an integrated health system in Washington state and had alcohol, cannabis, or other drug use screening documented in their EHRs (March 2015-July 2018) were included in main analyses if they had a positive screen for high-risk substance use defined as AUDIT-C score 7-12 points, or report of past-year daily cannabis use or any other drug use. MAIN MEASURES: The main outcome was number of SUD symptoms based on Diagnostic and Statistical Manual, 5th edition (DSM-5), reported on Symptom Checklists (0-11) for alcohol or other drugs: 2-3 mild; 4-5 moderate; 6-11 severe. RESULTS: Of screened patients, 16,776 (5.7%) reported high-risk use of alcohol (2.4%), cannabis (3.9%), and/or other drugs (1.7%), and 65.0-69.9% of those completed Symptom Checklists. Of those with high-risk alcohol use, 52.5% (95% CI 50.9-54.0%) reported ≥ 2 symptoms consistent with mild-severe alcohol use disorders. Of those reporting daily cannabis use, 29.8% (28.6-30.9%) reported ≥ 2 symptoms consistent with mild-severe SUDs. Of those reporting any other drug use, 37.5% (35.7-39.3%) reported ≥ 2 symptoms consistent with mild-severe SUDs. CONCLUSIONS AND RELEVANCE: Many PC patients who screened positive for high-risk substance use reported symptoms consistent with DSM-5 SUDs on self-report Symptom Checklists. Use of SUD Symptom Checklists could support PC providers in making SUD diagnoses and initiating discussions of substance use.

Integration of screening, assessment, and treatment for cannabis and other drug use disorders in primary care: An evaluation in three pilot sites.

BACKGROUND: This pilot study evaluated whether use of evidence-based implementation strategies to integrate care for cannabis and other drug use into primary care (PC) as part of Behavioral Health Integration (BHI) increased diagnosis and treatment of substance use disorders (SUDs). METHODS: Patients who visited the three pilot PC sites were eligible. Implementation strategies included practice coaching, electronic health record decision support, and performance feedback (3/2015-4/2016). BHI introduced annual screening for past-year cannabis and other drug use, a Symptom Checklist for DSM-5 SUDs, and shared decision-making about treatment options. Main analyses tested whether the proportions of PC patients diagnosed with, and treated for, new cannabis or other drug use disorders (CUDs and DUDs, respectively), differed significantly pre- and post-implementation. RESULTS: Of 39,599 eligible patients, 57% and 59% were screened for cannabis and other drug use, respectively. Among PC patients reporting daily cannabis use (2%) or any drug use (1%), 51% and 37%, respectively, completed an SUD Symptom Checklist. The proportion of PC patients with newly diagnosed CUD increased significantly post-implementation (5 v 17 per 10,000 patients, p < 0.0001), but not other DUDs (10 vs 13 per 10,000, p = 0.24). The proportion treated for newly diagnosed CUDs did not increase post-implementation (1 vs 1 per 10,000, p = 0.80), but did for those treated for newly diagnosed other DUDs (1 vs 3 per 10,000, p = 0.038). CONCLUSIONS: A pilot implementation of BHI to increase routine screening and assessment for SUDs was associated with increased new CUD diagnoses and a small increase in treatment of new other DUDs.