Predicting Mortality Risk After a Hospital or Emergency Department Visit for Nonfatal Opioid Overdose.

BACKGROUND: Survivors of opioid overdose have substantially increased mortality risk, although this risk is not evenly distributed across individuals. No study has focused on predicting an individual's risk of death after a nonfatal opioid overdose. OBJECTIVE: To predict risk of death after a nonfatal opioid overdose. DESIGN AND PARTICIPANTS: This retrospective cohort study included 9686 Pennsylvania Medicaid beneficiaries with an emergency department or inpatient claim for nonfatal opioid overdose in 2014-2016. The index date was the first overdose claim during this period. EXPOSURES, MAIN OUTCOME, AND MEASURES: Predictor candidates were measured in the 180 days before the index overdose. Primary outcome was 180-day all-cause mortality. Using a gradient boosting machine model, we classified beneficiaries into six subgroups according to their risk of mortality (< 25th percentile of the risk score, 25th to < 50th, 50th to < 75th, 75th to < 90th, 90th to < 98th, ≥ 98th). We then measured receipt of medication for opioid use disorder (OUD), risk mitigation interventions (e.g., prescriptions for naloxone), and prescription opioids filled in the 180 days after the index overdose, by risk subgroup. KEY RESULTS: Of eligible beneficiaries, 347 (3.6%) died within 180 days after the index overdose. The C-statistic of the mortality prediction model was 0.71. In the highest risk subgroup, the observed 180-day mortality rate was 20.3%, while in the lowest risk subgroup, it was 1.5%. Medication for OUD and risk mitigation interventions after overdose were more commonly seen in lower risk groups, while opioid prescriptions were more likely to be used in higher risk groups (both p trends < .001). CONCLUSIONS: A risk prediction model performed well for classifying mortality risk after a nonfatal opioid overdose. This prediction score can identify high-risk subgroups to target interventions to improve outcomes among overdose survivors.

An explainable machine learning framework for predicting the risk of buprenorphine treatment discontinuation for opioid use disorder among commercially insured individuals.

OBJECTIVES: Buprenorphine is an effective evidence-based medication for opioid use disorder (OUD). Yet premature discontinuation undermines treatment effectiveness, increasing the risk of mortality and overdose. We developed and evaluated a machine learning (ML) framework for predicting buprenorphine care discontinuity within 12 months following treatment initiation. METHODS: This retrospective study used United States (US) 2018-2021 MarketScan commercial claims data of insured individuals aged 18-64 who initiated buprenorphine between July 2018 and December 2020 with no buprenorphine prescriptions in the previous six months. We measured buprenorphine prescription discontinuation gaps of ≥30 days within 12 months of initiating treatment. We developed predictive models employing logistic regression, decision tree classifier, random forest, extreme gradient boosting, Adaboost, and random forest-extreme gradient boosting ensemble. We applied recursive feature elimination with cross-validation to reduce dimensionality and identify the most predictive features while maintaining model robustness. For model validation, we used several statistics to evaluate performance, such as C-statistics and precision-recall curves. We focused on two distinct treatment stages: at the time of treatment initiation and one and three months after treatment initiation. We employed SHapley Additive exPlanations (SHAP) analysis that helped us explain the contributions of different features in predicting buprenorphine discontinuation. We stratified patients into risk subgroups based on their predicted likelihood of treatment discontinuation, dividing them into decile subgroups. Additionally, we used a calibration plot to analyze the reliability of the models. RESULTS: A total of 30,373 patients initiated buprenorphine and 14.98% (4551) discontinued treatment. C-statistic varied between 0.56 and 0.76 for the first-stage models including patient-level demographic and clinical variables. Inclusion of proportion of days covered (PDC) measured after one month and three months following treatment initiation significantly increased the models' discriminative power (C-statistics: 0.60 to 0.82). Random forest (C-statistics: 0.76, 0.79 and 0.82 with baseline predictors, one-month PDC and three-months PDC, respectively) outperformed other ML models in discriminative performance in all stages (C-statistics: 0.56 to 0.77). Most influential risk factors of discontinuation included early stage medication adherence, age, and initial days of supply. CONCLUSION: ML algorithms demonstrated a good discriminative power in identifying patients at higher risk of buprenorphine care discontinuity. The proposed framework may help healthcare providers optimize treatment strategies and deliver targeted interventions to improve buprenorphine care continuity.

Developing and validating a machine-learning algorithm to predict opioid overdose in Medicaid beneficiaries in two US states: a prognostic modelling study.

BACKGROUND: Little is known about whether machine-learning algorithms developed to predict opioid overdose using earlier years and from a single state will perform as well when applied to other populations. We aimed to develop a machine-learning algorithm to predict 3-month risk of opioid overdose using Pennsylvania Medicaid data and externally validated it in two data sources (ie, later years of Pennsylvania Medicaid data and data from a different state). METHODS: This prognostic modelling study developed and validated a machine-learning algorithm to predict overdose in Medicaid beneficiaries with one or more opioid prescription in Pennsylvania and Arizona, USA. To predict risk of hospital or emergency department visits for overdose in the subsequent 3 months, we measured 284 potential predictors from pharmaceutical and health-care encounter claims data in 3-month periods, starting 3 months before the first opioid prescription and continuing until loss to follow-up or study end. We developed and internally validated a gradient-boosting machine algorithm to predict overdose using 2013-16 Pennsylvania Medicaid data (n=639 693). We externally validated the model using (1) 2017-18 Pennsylvania Medicaid data (n=318 585) and (2) 2015-17 Arizona Medicaid data (n=391 959). We reported several prediction performance metrics (eg, C-statistic, positive predictive value). Beneficiaries were stratified into risk-score subgroups to support clinical use. FINDINGS: A total of 8641 (1·35%) 2013-16 Pennsylvania Medicaid beneficiaries, 2705 (0·85%) 2017-18 Pennsylvania Medicaid beneficiaries, and 2410 (0·61%) 2015-17 Arizona beneficiaries had one or more overdose during the study period. C-statistics for the algorithm predicting 3-month overdoses developed from the 2013-16 Pennsylvania training dataset and validated on the 2013-16 Pennsylvania internal validation dataset, 2017-18 Pennsylvania external validation dataset, and 2015-17 Arizona external validation dataset were 0·841 (95% CI 0·835-0·847), 0·828 (0·822-0·834), and 0·817 (0·807-0·826), respectively. In external validation datasets, 71 361 (22·4%) of 318 585 2017-18 Pennsylvania beneficiaries were in high-risk subgroups (positive predictive value of 0·38-4·08%; capturing 73% of overdoses in the subsequent 3 months) and 40 041 (10%) of 391 959 2015-17 Arizona beneficiaries were in high-risk subgroups (positive predictive value of 0·19-1·97%; capturing 55% of overdoses). Lower risk subgroups in both validation datasets had few individuals (≤0·2%) with an overdose. INTERPRETATION: A machine-learning algorithm predicting opioid overdose derived from Pennsylvania Medicaid data performed well in external validation with more recent Pennsylvania data and with Arizona Medicaid data. The algorithm might be valuable for overdose risk prediction and stratification in Medicaid beneficiaries. FUNDING: National Institute of Health, National Institute on Drug Abuse, National Institute on Aging.

Dosing profiles of concurrent opioid and benzodiazepine use associated with overdose risk among US Medicare beneficiaries: group-based multi-trajectory models.

BACKGROUND AND AIMS: One-third of opioid (OPI) overdose deaths involve concurrent benzodiazepine (BZD) use. Little is known about concurrent opioid and benzodiazepine use (OPI-BZD) most associated with overdose risk. We aimed to examine associations between OPI-BZD dose and duration trajectories, and subsequent OPI or BZD overdose in US Medicare. DESIGN: Retrospective cohort study. SETTING: US Medicare. PARTICIPANTS: Using a 5% national Medicare data sample (2013-16) of fee-for-service beneficiaries without cancer initiating OPI prescriptions, we identified 37 879 beneficiaries (age ≥ 65 = 59.3%, female = 71.9%, white = 87.6%, having OPI overdose = 0.3%). MEASUREMENTS: During the 6 months following OPI initiation (i.e. trajectory period), we identified OPI-BZD dose and duration patterns using group-based multi-trajectory models, based on average daily morphine milligram equivalents (MME) for OPIs and diazepam milligram equivalents (DME) for BZDs. To label dose levels in each trajectory, we defined OPI use as very low (< 25 MME), low (25-50 MME), moderate (51-90 MME), high (91-150 MME) and very high (>150 MME) dose. Similarly, we defined BZD use as very low (< 10 DME), low (10-20 DME), moderate (21-40 DME), high (41-60 DME) and very high (> 60 DME) dose. Our primary analysis was to estimate the risk of time to first hospital or emergency department visit for OPI overdose within 6 months following the trajectory period using inverse probability of treatment-weighted Cox proportional hazards models. FINDINGS: We identified nine distinct OPI-BZD trajectories: group A: very low OPI (early discontinuation)-very low declining BZD (n = 10 598; 28.0% of the cohort); B: very low OPI (early discontinuation)-very low stable BZD (n = 4923; 13.0%); C: very low OPI (early discontinuation)-medium BZD (n = 4997; 13.2%); D: low OPI-low BZD (n = 5083; 13.4%); E: low OPI-high BZD (n = 3906; 10.3%); F: medium OPI-low BZD (n = 3948; 10.4%); G: very high OPI-high BZD (n = 1371; 3.6%); H: very high OPI-very high BZD (n = 957; 2.5%); and I: very high OPI-low BZD (n = 2096; 5.5%). Compared with group A, five trajectories (32.3% of the study cohort) were associated with increased 6-month OPI overdose risks: E: low OPI-high BZD [hazard ratio (HR) = 3.27, 95% confidence interval (CI) = 1.61-6.63]; F: medium OPI-low BZD (HR = 4.04, 95% CI = 2.06-7.95); G: very high OPI-high BZD (HR = 6.98, 95% CI = 3.11-15.64); H: very high OPI-very high BZD (HR = 4.41, 95% CI = 1.51-12.85); and I: very high OPI-low BZD (HR = 6.50, 95% CI = 3.15-13.42). CONCLUSIONS: Patterns of concurrent opioid and benzodiazepine use most associated with overdose risk among fee-for-service US Medicare beneficiaries initiating opioid prescriptions include very high-dose opioid use (MME > 150), high-dose benzodiazepine use (DME > 40) or medium-dose opioid with low-dose benzodiazepine use.

Integrating human services and criminal justice data with claims data to predict risk of opioid overdose among Medicaid beneficiaries: A machine-learning approach.

Health system data incompletely capture the social risk factors for drug overdose. This study aimed to improve the accuracy of a machine-learning algorithm to predict opioid overdose risk by integrating human services and criminal justice data with health claims data to capture the social determinants of overdose risk. This prognostic study included Medicaid beneficiaries (n = 237,259) in Allegheny County, Pennsylvania enrolled between 2015 and 2018, randomly divided into training, testing, and validation samples. We measured 290 potential predictors (239 derived from Medicaid claims data) in 30-day periods, beginning with the first observed Medicaid enrollment date during the study period. Using a gradient boosting machine, we predicted a composite outcome (i.e., fatal or nonfatal opioid overdose constructed using medical examiner and claims data) in the subsequent month. We compared prediction performance between a Medicaid claims only model to one integrating human services and criminal justice data with Medicaid claims (i.e., integrated model) using several metrics (e.g., C-statistic, number needed to evaluate [NNE] to identify one overdose). Beneficiaries were stratified into risk-score decile subgroups. The samples (training = 79,087, testing = 79,086, validation = 79,086) had similar characteristics (age = 38±18 years, female = 56%, white = 48%, having at least one overdose = 1.7% during study period). Using the validation sample, the integrated model slightly improved on the Medicaid claims only model (C-statistic = 0.885; 95%CI = 0.877-0.892 vs. C-statistic = 0.871; 95%CI = 0.863-0.878), with small corresponding improvements in the NNE and positive predictive value. Nine of the top 30 most important predictors in the integrated model were human services and criminal justice variables. Using the integrated model, approximately 70% of individuals with overdoses were members of the top risk decile (overdose rates in the subsequent month = 47/10,000 beneficiaries). Few individuals in the bottom 9 deciles had overdose episodes (0-12/10,000). Machine-learning algorithms integrating claims and social service and criminal justice data modestly improved opioid overdose prediction among Medicaid beneficiaries for a large U.S. county heavily affected by the opioid crisis.

Using machine learning to predict risk of incident opioid use disorder among fee-for-service Medicare beneficiaries: A prognostic study.

OBJECTIVE: To develop and validate a machine-learning algorithm to improve prediction of incident OUD diagnosis among Medicare beneficiaries with ≥1 opioid prescriptions. METHODS: This prognostic study included 361,527 fee-for-service Medicare beneficiaries, without cancer, filling ≥1 opioid prescriptions from 2011-2016. We randomly divided beneficiaries into training, testing, and validation samples. We measured 269 potential predictors including socio-demographics, health status, patterns of opioid use, and provider-level and regional-level factors in 3-month periods, starting from three months before initiating opioids until development of OUD, loss of follow-up or end of 2016. The primary outcome was a recorded OUD diagnosis or initiating methadone or buprenorphine for OUD as proxy of incident OUD. We applied elastic net, random forests, gradient boosting machine, and deep neural network to predict OUD in the subsequent three months. We assessed prediction performance using C-statistics and other metrics (e.g., number needed to evaluate to identify an individual with OUD [NNE]). Beneficiaries were stratified into subgroups by risk-score decile. RESULTS: The training (n = 120,474), testing (n = 120,556), and validation (n = 120,497) samples had similar characteristics (age ≥65 years = 81.1%; female = 61.3%; white = 83.5%; with disability eligibility = 25.5%; 1.5% had incident OUD). In the validation sample, the four approaches had similar prediction performances (C-statistic ranged from 0.874 to 0.882); elastic net required the fewest predictors (n = 48). Using the elastic net algorithm, individuals in the top decile of risk (15.8% [n = 19,047] of validation cohort) had a positive predictive value of 0.96%, negative predictive value of 99.7%, and NNE of 104. Nearly 70% of individuals with incident OUD were in the top two deciles (n = 37,078), having highest incident OUD (36 to 301 per 10,000 beneficiaries). Individuals in the bottom eight deciles (n = 83,419) had minimal incident OUD (3 to 28 per 10,000). CONCLUSIONS: Machine-learning algorithms improve risk prediction and risk stratification of incident OUD in Medicare beneficiaries.

Evaluation of Machine-Learning Algorithms for Predicting Opioid Overdose Risk Among Medicare Beneficiaries With Opioid Prescriptions.

Importance: Current approaches to identifying individuals at high risk for opioid overdose target many patients who are not truly at high risk. Objective: To develop and validate a machine-learning algorithm to predict opioid overdose risk among Medicare beneficiaries with at least 1 opioid prescription. Design, Setting, and Participants: A prognostic study was conducted between September 1, 2017, and December 31, 2018. Participants (n = 560 057) included fee-for-service Medicare beneficiaries without cancer who filled 1 or more opioid prescriptions from January 1, 2011, to December 31, 2015. Beneficiaries were randomly and equally divided into training, testing, and validation samples. Exposures: Potential predictors (n = 268), including sociodemographics, health status, patterns of opioid use, and practitioner-level and regional-level factors, were measured in 3-month windows, starting 3 months before initiating opioids until loss of follow-up or the end of observation. Main Outcomes and Measures: Opioid overdose episodes from inpatient and emergency department claims were identified. Multivariate logistic regression (MLR), least absolute shrinkage and selection operator-type regression (LASSO), random forest (RF), gradient boosting machine (GBM), and deep neural network (DNN) were applied to predict overdose risk in the subsequent 3 months after initiation of treatment with prescription opioids. Prediction performance was assessed using the C statistic and other metrics (eg, sensitivity, specificity, and number needed to evaluate [NNE] to identify one overdose). The Youden index was used to identify the optimized threshold of predicted score that balanced sensitivity and specificity. Results: Beneficiaries in the training (n = 186 686), testing (n = 186 685), and validation (n = 186 686) samples had similar characteristics (mean [SD] age of 68.0 [14.5] years, and approximately 63% were female, 82% were white, 35% had disabilities, 41% were dual eligible, and 0.60% had at least 1 overdose episode). In the validation sample, the DNN (C statistic = 0.91; 95% CI, 0.88-0.93) and GBM (C statistic = 0.90; 95% CI, 0.87-0.94) algorithms outperformed the LASSO (C statistic = 0.84; 95% CI, 0.80-0.89), RF (C statistic = 0.80; 95% CI, 0.75-0.84), and MLR (C statistic = 0.75; 95% CI, 0.69-0.80) methods for predicting opioid overdose. At the optimized sensitivity and specificity, DNN had a sensitivity of 92.3%, specificity of 75.7%, NNE of 542, positive predictive value of 0.18%, and negative predictive value of 99.9%. The DNN classified patients into low-risk (76.2% [142 180] of the cohort), medium-risk (18.6% [34 579] of the cohort), and high-risk (5.2% [9747] of the cohort) subgroups, with only 1 in 10 000 in the low-risk subgroup having an overdose episode. More than 90% of overdose episodes occurred in the high-risk and medium-risk subgroups, although positive predictive values were low, given the rare overdose outcome. Conclusions and Relevance: Machine-learning algorithms appear to perform well for risk prediction and stratification of opioid overdose, especially in identifying low-risk subgroups that have minimal risk of overdose.

Exploring family and social context through the electronic health record: Physicians' experiences.

INTRODUCTION: There is ample evidence that social and familial context significantly impacts health. However, family and social history templates typically used in clinical practice exclude prompts to explore important contextual information, such as family dynamics, health beliefs, housing, and neighborhood environment. METHOD: At the Residency Program in Social Medicine at Montefiore Medical Center/Albert Einstein College of Medicine in Bronx, NY, we developed and piloted an expanded family and social information (FSI) template in our electronic health record (EHR) system. After 10 physicians used the FSI template during routine clinical practice, we conducted and qualitatively analyzed transcripts of semistructured interviews to assess their experiences. RESULTS: The major themes of physician's experiences using the FSI template included: expanded thinking (promoted thinking and discussion about contextual information), relevancy to care (highlighted important life events, helpful resource for future care or for team-based care), fragmentation (patient narrative difficult to categorize into discrete sections), and abstract phrasing (prompts too abstract and/or too complex to explore well). Some minor themes (themes that were repeated often, but not consistent in all interviews) were also noted: practice demands, educational purpose, and wish list. DISCUSSION: Within our small sample, we found that an expanded family and social information template broadened physicians' clinical thinking during routine visits. We also found that the structure of the EHR and practice demands create significant barriers to exploring a patient's narrative effectively. Themes identified in this research will inform national efforts to prioritize a contextual and biopsychosocial perspective in EHR systems. (PsycINFO Database Record

Myelographic evaluation of cervical spondylosis: patient tolerance and complications.

STUDY DESIGN: Retrospective chart review of documented adverse events in 637 consecutive patients after computed tomogram myelography and follow-up interview of the most recent 100 of these patients. OBJECTIVES: This study assessed documented prevalence of adverse events after diagnostic myelography in cervical spondylotic patients and compared with perceived adverse events and satisfaction in a subset of the same cohort of patients. SUMMARY OF BACKGROUND DATA: There are some data that suggest complimentary benefits of myelography to magnetic resonance imaging. However, given the invasive nature of myelography, there are little data documenting the adverse events and patient experience with myelography to guide informed consent and physician choice of this study. METHODS: We analyzed the records of 637 consecutive patients (364 males and 273 females) after myelography. Five hundred forty-four patients (group 1) had a cervical approach and 93 (group 2) had a lumbar approach. The last 100 consecutive patients (85 in group 1 and 15 in group 2) were asked questions that addressed patient perceived adverse reactions, pain levels, and satisfaction. RESULTS: There was a 4.4% (28/637) prevalence of documented abnormal reactions. Group 1 had a 4.9% (25/506) prevalence of adverse reactions compared with 3.4% (3/89) in group 2. Overall 6.6% (42/637) had to have their myelographic procedures converted. Group 1 had 7% (38/544) converted to the lumbar approach group 2 had 4.3% (4/93) converted to the cervical approach. Thirty percent of the 100 patients interviewed felt they had an unexpected reaction (28 group 1 and 2 group 2). When interviewed, 14% of patients had maximum pain scores of 10 during the procedure and 8% (all group 1) felt worse pain after the procedure was completed. Six group 1 and 2 group 2 patients would not have the procedure again even when recommended by the surgeon. There was no statistically significant difference between complication rates, conversion rates, or patient perceived unexpected reactions between the 2 groups (beta=0.90). CONCLUSIONS: This paper demonstrated the discrepancy between documented adverse events with computed tomogram myelography and patient reported tolerance as recorded by telephone follow-up. The cervical approach had a greater degree of patient perceived discomfort and a trend toward higher documented and patient reported adverse events and rate of approach conversion to a lumbar approach (P>0.5). When choosing myelography to evaluate patients with cervical spondylosis, the surgeon should consider the low patient tolerance and frequent adverse reactions that often go undocumented.