External Validation of the eRADAR Risk Score for Detecting Undiagnosed Dementia in Two Real-World Healthcare Systems.

BACKGROUND: Fifty percent of people living with dementia are undiagnosed. The electronic health record (EHR) Risk of Alzheimer's and Dementia Assessment Rule (eRADAR) was developed to identify older adults at risk of having undiagnosed dementia using routinely collected clinical data. OBJECTIVE: To externally validate eRADAR in two real-world healthcare systems, including examining performance over time and by race/ethnicity. DESIGN: Retrospective cohort study PARTICIPANTS: 129,315 members of Kaiser Permanente Washington (KPWA), an integrated health system providing insurance coverage and medical care, and 13,444 primary care patients at University of California San Francisco Health (UCSF), an academic medical system, aged 65 years or older without prior EHR documentation of dementia diagnosis or medication. MAIN MEASURES: Performance of eRADAR scores, calculated annually from EHR data (including vital signs, diagnoses, medications, and utilization in the prior 2 years), for predicting EHR documentation of incident dementia diagnosis within 12 months. KEY RESULTS: A total of 7631 dementia diagnoses were observed at KPWA (11.1 per 1000 person-years) and 216 at UCSF (4.6 per 1000 person-years). The area under the curve was 0.84 (95% confidence interval: 0.84-0.85) at KPWA and 0.79 (0.76-0.82) at UCSF. Using the 90th percentile as the cut point for identifying high-risk patients, sensitivity was 54% (53-56%) at KPWA and 44% (38-51%) at UCSF. Performance was similar over time, including across the transition from International Classification of Diseases, version 9 (ICD-9) to ICD-10 codes, and across racial/ethnic groups (though small samples limited precision in some groups). CONCLUSIONS: eRADAR showed strong external validity for detecting undiagnosed dementia in two health systems with different patient populations and differential availability of external healthcare data for risk calculations. In this study, eRADAR demonstrated generalizability from a research sample to real-world clinical populations, transportability across health systems, robustness to temporal changes in healthcare, and similar performance across larger racial/ethnic groups.

Baseline representativeness of patients in clinics enrolled in the PRimary care Opioid Use Disorders treatment (PROUD) trial: comparison of trial and non-trial clinics in the same health systems.

BACKGROUND: Pragmatic primary care trials aim to test interventions in "real world" health care settings, but clinics willing and able to participate in trials may not be representative of typical clinics. This analysis compared patients in participating and non-participating clinics from the same health systems at baseline in the PRimary care Opioid Use Disorders treatment (PROUD) trial. METHODS: This observational analysis relied on secondary electronic health record and administrative claims data in 5 of 6 health systems in the PROUD trial. The sample included patients 16-90 years at an eligible primary care visit in the 3 years before randomization. Each system contributed 2 randomized PROUD trial clinics and 4 similarly sized non-trial clinics. We summarized patient characteristics in trial and non-trial clinics in the 2 years before randomization ("baseline"). Using mixed-effect regression models, we compared trial and non-trial clinics on a baseline measure of the primary trial outcome (clinic-level patient-years of opioid use disorder (OUD) treatment, scaled per 10,000 primary care patients seen) and a baseline measure of the secondary trial outcome (patient-level days of acute care utilization among patients with OUD). RESULTS: Patients were generally similar between the 10 trial clinics (n = 248,436) and 20 non-trial clinics (n = 341,130), although trial clinics' patients were slightly younger, more likely to be Hispanic/Latinx, less likely to be white, more likely to have Medicaid/subsidized insurance, and lived in less wealthy neighborhoods. Baseline outcomes did not differ between trial and non-trial clinics: trial clinics had 1.0 more patient-year of OUD treatment per 10,000 patients (95% CI: - 2.9, 5.0) and a 4% higher rate of days of acute care utilization than non-trial clinics (rate ratio: 1.04; 95% CI: 0.76, 1.42). CONCLUSIONS: trial clinics and non-trial clinics were similar regarding most measured patient characteristics, and no differences were observed in baseline measures of trial primary and secondary outcomes. These findings suggest trial clinics were representative of comparably sized clinics within the same health systems. Although results do not reflect generalizability more broadly, this study illustrates an approach to assess representativeness of clinics in future pragmatic primary care trials.

Offering nurse care management for opioid use disorder in primary care: Impact on emergency and hospital utilization in a cluster-randomized implementation trial.

BACKGROUND: Patients with opioid use disorder (OUD) have increased emergency and hospital utilization. The PROUD trial showed that implementation of office-based addiction treatment (OBAT) increased OUD medication treatment compared to usual care, but did not decrease acute care utilization in patients with OUD documented pre-randomization (clinicaltrials.gov/study/NCT03407638). This paper reports secondary emergency and hospital utilization outcomes in patients with documented OUD in the PROUD trial. METHODS: This cluster-randomized implementation trial was conducted in 12 clinics from 6 diverse health systems (March 2015-February 2020). Patients who visited trial clinics and had an OUD diagnosis within 3 years pre-randomization were included in primary analyses; secondary analyses added patients with OUD who were new to the clinic or with newly-documented OUD post-randomization. Outcomes included days of emergency care and hospital utilization over 2 years post-randomization. Explanatory outcomes included measures of OUD treatment. Patient-level analyses used mixed-effect regression with clinic-specific random intercepts. RESULTS: Among 1988 patients with documented OUD seen pre-randomization (mean age 49, 53 % female), days of emergency care or hospitalization did not differ between intervention and usual care; OUD treatment also did not differ. In secondary analyses among 1347 patients with OUD post-randomization, there remained no difference in emergency or hospital utilization despite intervention patients receiving 32.2 (95 % CI 4.7, 59.7) more days of OUD treatment relative to usual care. CONCLUSIONS: Implementation of OBAT did not reduce emergency or hospital utilization among patients with OUD, even in the sample with OUD first documented post-randomization in whom the intervention increased treatment.

Nurse Care Management for Opioid Use Disorder Treatment: The PROUD Cluster Randomized Clinical Trial.

Importance: Few primary care (PC) practices treat patients with medications for opioid use disorder (OUD) despite availability of effective treatments. Objective: To assess whether implementation of the Massachusetts model of nurse care management for OUD in PC increases OUD treatment with buprenorphine or extended-release injectable naltrexone and secondarily decreases acute care utilization. Design, Setting, and Participants: The Primary Care Opioid Use Disorders Treatment (PROUD) trial was a mixed-methods, implementation-effectiveness cluster randomized clinical trial conducted in 6 diverse health systems across 5 US states (New York, Florida, Michigan, Texas, and Washington). Two PC clinics in each system were randomized to intervention or usual care (UC) stratified by system (5 systems were notified on February 28, 2018, and 1 system with delayed data use agreement on August 31, 2018). Data were obtained from electronic health records and insurance claims. An implementation monitoring team collected qualitative data. Primary care patients were included if they were 16 to 90 years old and visited a participating clinic from up to 3 years before a system's randomization date through 2 years after. Intervention: The PROUD intervention included 3 components: (1) salary for a full-time OUD nurse care manager; (2) training and technical assistance for nurse care managers; and (3) 3 or more PC clinicians agreeing to prescribe buprenorphine. Main Outcomes and Measures: The primary outcome was a clinic-level measure of patient-years of OUD treatment (buprenorphine or extended-release injectable naltrexone) per 10 000 PC patients during the 2 years postrandomization (follow-up). The secondary outcome, among patients with OUD prerandomization, was a patient-level measure of the number of days of acute care utilization during follow-up. Results: During the baseline period, a total of 130 623 patients were seen in intervention clinics (mean [SD] age, 48.6 [17.7] years; 59.7% female), and 159 459 patients were seen in UC clinics (mean [SD] age, 47.2 [17.5] years; 63.0% female). Intervention clinics provided 8.2 (95% CI, 5.4-∞) more patient-years of OUD treatment per 10 000 PC patients compared with UC clinics (P = .002). Most of the benefit accrued in 2 health systems and in patients new to clinics (5.8 [95% CI, 1.3-∞] more patient-years) or newly treated for OUD postrandomization (8.3 [95% CI, 4.3-∞] more patient-years). Qualitative data indicated that keys to successful implementation included broad commitment to treat OUD in PC from system leaders and PC teams, full financial coverage for OUD treatment, and straightforward pathways for patients to access nurse care managers. Acute care utilization did not differ between intervention and UC clinics (relative rate, 1.16; 95% CI, 0.47-2.92; P = .70). Conclusions and Relevance: The PROUD cluster randomized clinical trial intervention meaningfully increased PC OUD treatment, albeit unevenly across health systems; however, it did not decrease acute care utilization among patients with OUD. Trial Registration: ClinicalTrials.gov Identifier: NCT03407638.

Sex Differences in Comorbid Mental and Substance Use Disorders Among Primary Care Patients With Opioid Use Disorder.

OBJECTIVE: The authors sought to characterize the 3-year prevalence of mental disorders and nonnicotine substance use disorders among male and female primary care patients with documented opioid use disorder across large U.S. health systems. METHODS: This retrospective study used 2014-2016 data from patients ages ≥16 years in six health systems. Diagnoses were obtained from electronic health records or claims data; opioid use disorder treatment with buprenorphine or injectable extended-release naltrexone was determined through prescription and procedure data. Adjusted prevalence of comorbid conditions among patients with opioid use disorder (with or without treatment), stratified by sex, was estimated by fitting logistic regression models for each condition and applying marginal standardization. RESULTS: Females (53.2%, N=7,431) and males (46.8%, N=6,548) had a similar prevalence of opioid use disorder. Comorbid mental disorders among those with opioid use disorder were more prevalent among females (86.4% vs. 74.3%, respectively), whereas comorbid other substance use disorders (excluding nicotine) were more common among males (51.9% vs. 60.9%, respectively). These differences held for those receiving medication treatment for opioid use disorder, with mental disorders being more common among treated females (83% vs. 71%) and other substance use disorders more common among treated males (68% vs. 63%). Among patients with a single mental health condition comorbid with opioid use disorder, females were less likely than males to receive medication treatment for opioid use disorder (15% vs. 20%, respectively). CONCLUSIONS: The high rate of comorbid conditions among patients with opioid use disorder indicates a strong need to supply primary care providers with adequate resources for integrated opioid use disorder treatment.