Towards global model generalizability: independent cross-site feature evaluation for patient-level risk prediction models using the OHDSI network.

BACKGROUND: Predictive models show promise in healthcare, but their successful deployment is challenging due to limited generalizability. Current external validation often focuses on model performance with restricted feature use from the original training data, lacking insights into their suitability at external sites. Our study introduces an innovative methodology for evaluating features during both the development phase and the validation, focusing on creating and validating predictive models for post-surgery patient outcomes with improved generalizability. METHODS: Electronic health records (EHRs) from 4 countries (United States, United Kingdom, Finland, and Korea) were mapped to the OMOP Common Data Model (CDM), 2008-2019. Machine learning (ML) models were developed to predict post-surgery prolonged opioid use (POU) risks using data collected 6 months before surgery. Both local and cross-site feature selection methods were applied in the development and external validation datasets. Models were developed using Observational Health Data Sciences and Informatics (OHDSI) tools and validated on separate patient cohorts. RESULTS: Model development included 41 929 patients, 14.6% with POU. The external validation included 31 932 (UK), 23 100 (US), 7295 (Korea), and 3934 (Finland) patients with POU of 44.2%, 22.0%, 15.8%, and 21.8%, respectively. The top-performing model, Lasso logistic regression, achieved an area under the receiver operating characteristic curve (AUROC) of 0.75 during local validation and 0.69 (SD = 0.02) (averaged) in external validation. Models trained with cross-site feature selection significantly outperformed those using only features from the development site through external validation (P < .05). CONCLUSIONS: Using EHRs across four countries mapped to the OMOP CDM, we developed generalizable predictive models for POU. Our approach demonstrates the significant impact of cross-site feature selection in improving model performance, underscoring the importance of incorporating diverse feature sets from various clinical settings to enhance the generalizability and utility of predictive healthcare models.

"Diving in the deep-end and swimming": a mixed methods study using normalization process theory to evaluate a learning collaborative approach for the implementation of palliative care practices in hemodialysis centers.

BACKGROUND: Normalization Process Theory (NPT) is an implementation theory that can be used to explain how and why implementation strategies work or not in particular circumstances. We used it to understand the mechanisms that lead to the adoption and routinization of palliative care within hemodialysis centers. METHODS: We employed a longitudinal, mixed methods approach to comprehensively evaluate the implementation of palliative care practices among ten hemodialysis centers participating in an Institute for Healthcare Improvement Breakthrough- Series learning collaborative. Qualitative methods included longitudinal observations of collaborative activities, and interviews with implementers at the end of the study. We used an inductive and deductive approach to thematic analysis informed by NPT constructs (coherence, cognitive participation, collective action, reflexive monitoring) and implementation outcomes. The NoMAD survey, which measures NPT constructs, was completed by implementers at each hemodialysis center during early and late implementation. RESULTS: The four mechanisms posited in NPT had a dynamic and layered relationship during the implementation process. Collaborative participants participated because they believed in the value and legitimacy of palliative care for patients receiving hemodialysis and thus had high levels of cognitive participation at the start. Didactic Learning Sessions were important for building practice coherence, and sense-making was solidified through testing new skills in practice and first-hand observation during coaching visits by an expert. Collective action was hampered by limited time among team members and practical issues such as arranging meetings with patients. Reflexive monitoring of the positive benefit to patient and family experiences was key in shifting mindsets from disease-centric towards a patient-centered model of care. NoMAD survey scores showed modest improvement over time, with collective action having the lowest scores. CONCLUSIONS: NPT was a useful framework for understanding the implementation of palliative care practices within hemodialysis centers. We found a nonlinear relationship among the mechanisms which is reflected in our model of implementation of palliative care practices through a learning collaborative. These findings suggest that the implementation of complex practices such as palliative care may be more successful through iterative learning and practice opportunities as the mechanisms for change are layered and mutually reinforcing. TRIAL REGISTRATION: ClinicalTrials.gov, NCT04125537 . Registered 14 October 2019 - Retrospectively registered.

Expansion of Abdominal Aortic Aneurysm Screening and Ultrasound Utilization and Diagnosis.

This cohort study uses a deidentified national administrative claims database to assess the association of eligibility expansion with abdominal aortic aneurysm screening and diagnosis.

Postoperative opioid prescribing patients with diabetes: Opportunities for personalized pain management.

BACKGROUND: Opioids are commonly prescribed for postoperative pain, but may lead to prolonged use and addiction. Diabetes impairs nerve function, complicates pain management, and makes opioid prescribing particularly challenging. METHODS: This retrospective observational study included a cohort of postoperative patients from a multisite academic health system to assess the relationship between diabetes, pain, and prolonged opioid use (POU), 2008-2019. POU was defined as a new opioid prescription 3-6 months after discharge. The odds that a patient had POU was assessed using multivariate logistic regression controlling for patient factors (e.g., demographic and clinical factors, as well as prior pain and opiate use). FINDINGS: A total of 43,654 patients were included, 12.4% with diabetes. Patients with diabetes had higher preoperative pain scores (2.1 vs 1.9, p<0.001) and lower opioid naïve rates (58.7% vs 68.6%, p<0.001). Following surgery, patients with diabetes had higher rates of POU (17.7% vs 12.7%, p<0.001) despite receiving similar opioid prescriptions at discharge. Patients with Type I diabetes were more likely to have POU compared to other patients (Odds Ratio [OR]: 2.22; 95% Confidence Interval [CI]:1.69-2.90 and OR:1.44, CI: 1.33-1.56, respectively). INTERPRETATION: In conclusion, surgical patients with diabetes are at increased risk for POU even after controlling for likely covariates, yet they receive similar postoperative opiate therapy. The results suggest a more tailored approach to diabetic postoperative pain management is warranted.

Prediction of opioid-related outcomes in a medicaid surgical population: Evidence to guide postoperative opiate therapy and monitoring.

BACKGROUND: Treatment of surgical pain is a common reason for opioid prescriptions. Being able to predict which patients are at risk for opioid abuse, dependence, and overdose (opioid-related adverse outcomes [OR-AE]) could help physicians make safer prescription decisions. We aimed to develop a machine-learning algorithm to predict the risk of OR-AE following surgery using Medicaid data with external validation across states. METHODS: Five machine learning models were developed and validated across seven US states (90-10 data split). The model output was the risk of OR-AE 6-months following surgery. The models were evaluated using standard metrics and area under the receiver operating characteristic curve (AUC) was used for model comparison. We assessed calibration for the top performing model and generated bootstrap estimations for standard deviations. Decision curves were generated for the top-performing model and logistic regression. RESULTS: We evaluated 96,974 surgical patients aged 15 and 64. During the 6-month period following surgery, 10,464 (10.8%) patients had an OR-AE. Outcome rates were significantly higher for patients with depression (17.5%), diabetes (13.1%) or obesity (11.1%). The random forest model achieved the best predictive performance (AUC: 0.877; F1-score: 0.57; recall: 0.69; precision:0.48). An opioid disorder diagnosis prior to surgery was the most important feature for the model, which was well calibrated and had good discrimination. CONCLUSIONS: A machine learning models to predict risk of OR-AE following surgery performed well in external validation. This work could be used to assist pain management following surgery for Medicaid beneficiaries and supports a precision medicine approach to opioid prescribing.

Cost of Care for Patients With Cirrhosis.

INTRODUCTION: There are limited longitudinal data on the cost of treating patients with cirrhosis, which hampers value-based improvement initiatives. METHODS: We conducted a retrospective cohort study of patients with cirrhosis seen in the Veterans Affairs health care system from 2011 to 2015. Patients were followed up through 2019. We identified a sex-matched and age-matched control cohort without cirrhosis. We estimated incremental annual health care costs attributable to cirrhosis for 4 years overall and in subgroups based on severity (compensated, decompensated), cirrhosis complications (ascites, encephalopathy, varices, hepatocellular cancer, acute kidney injury), and comorbidity (Deyo index). RESULTS: We compared 39,361 patients with cirrhosis with 138,964 controls. The incremental adjusted costs for caring of patients with cirrhosis were $35,029 (95% confidence interval $32,473-$37,585) during the first year and ranged from $14,216 to $17,629 in the subsequent 3 years. Cirrhosis complications accounted for most of these costs. Costs of managing patients with hepatic encephalopathy (year 1 cost, $50,080) or ascites ($50,364) were higher than the costs of managing patients with varices ($20,488) or hepatocellular cancer ($37,639) in the first year. Patients with acute kidney injury or those who had multimorbidity were the most costly at $64,413 and $66,653 in the first year, respectively. DISCUSSION: Patients with cirrhosis had substantially higher health care costs than matched controls and multimorbid patients had even higher costs. Cirrhosis complications accounted for most of the excess cost, so preventing complications has the largest potential for cost saving and could serve as targets for improvement.

Integrating Patient and Expert Perspectives to Conceptualize High-Quality Palliative Cancer Care for Symptoms in the US Veterans Health Administration: A Qualitative Study.

Quality measurement is typically the domain of clinical experts and health system leaders; patient/caregiver perspectives are rarely solicited. We aimed to describe and integrate clinician and patient/caregiver conceptualizations of high-quality palliative symptom care for patients receiving care for advanced cancer within the US Veterans Health Administration in the context of existing quality measures. We conducted a secondary qualitative analysis of transcripts from prioritization discussions of process quality measures relevant to cancer palliative care. These discussions occurred during 2 modified RAND-UCLA appropriateness panels: a panel of 10 palliative care clinical expert stakeholders (7 physicians, 2 nurses, 1 social worker) and a panel of 9 patients/caregivers with cancer experience. Discussions were recorded, transcribed, and independently double-coded using an a priori logical framework. Content analysis was used to identify subthemes within codes and axial coding was used to identify crosscutting themes. Patients/caregivers and clinical experts contributed important perspectives to 3 crosscutting themes. First, proactive elicitation of symptoms is critical. Patients/caregivers especially emphasized importance of comprehensive and proactive screening and assessment, especially for pain and mental health. Second, screening and assessment alone is not enough; information elicited from patients must inform care. Measuring screening/assessment and management care processes separately has important limitations. Lastly, high-quality symptom management can be broadly defined if it is patient-centered; high-quality care takes an individualized approach and might include non-medical or non-pharmacological symptom management. Integrating the perspectives of clinical experts and patients/caregivers is critical for health systems to consider as they design and implement quality measures for palliative cancer care.

Most privately insured patients do not receive federally recommended abdominal aortic aneurysm screening.

OBJECTIVE: Since 2005, the United States Preventative Services Task Force has recommended abdominal aortic aneurysm (AAA) ultrasound screening for 65- to 75-year-old male ever-smokers. Integrated health systems such as Kaiser Permanente and the Veterans Affairs (VA) health care system report 74% to 79% adherence, but compliance rates in the private sector are unknown. METHODS: The IBM Marketscan Commercial and Medicare Supplemental databases (2006-2017) were queried for male ever-smokers continuously enrolled from age 65 to 75 years. Exclusion criteria were previous history of AAA, connective tissue disorder, and aortic surgery. Patients with abdominal computed tomographic or magnetic resonance imaging from ages 65 to 75 years were also excluded. Screening was defined as a complete abdominal, retroperitoneal, or aortic ultrasound. A logistic mixed-effects model utilizing state as a random intercept was used to identify patient characteristics associated with screening. RESULTS: Of 35,154 eligible patients, 13,612 (38.7%) underwent screening. Compliance varied by state, ranging from 24.4% in Minnesota to 51.6% in Montana (P < .05). Screening activity increased yearly, with 0.7% of screening activity occurring in 2008 vs 22.2% in 2016 (P <.05). In a logistic mixed-effects model adjusting for state as a random intercept, history of hypertension (odds ratio [OR], 1.07; 95% confidence interval [CI], 1.03-1.13), coronary artery disease (OR, 1.17; 95% CI, 1.10-1.22), congestive heart failure (OR, 1.14; 95% CI, 1.01-1.22), diabetes (OR, 1.1; 95% CI, 1.06-1.16), and chronic kidney disease (OR, 1.4; 95% CI, 1.24-1.53) were associated with screening. Living outside of a census-designated metropolitan area was negatively associated with screening (OR, 0.92; 95% CI, 0.87-0.97). CONCLUSIONS: In a private claims database representing 250 million claimants, 38.7% of eligible patients received United States Preventative Services Task Force-recommended AAA screening. Compliance was nearly one-half that of integrated health systems and was significantly lower for patients living outside of metropolitan areas. Efforts to improve early detection of AAA should include targeting non-metropolitan areas and modifying Medicare reimbursement and incentivization strategies to improve guideline adherence.

Utilizing remote access for electronic medical records reduces overall electronic medical record time for vascular surgery residents.

OBJECTIVE: Survey data suggests that surgical residents spend 20% to 30% of training time using the electronic medical record (EMR), raising concerns about burnout and insufficient operative experience. We characterize trainee EMR activity in the vascular surgery service of a quaternary care center to identify modifiable factors associated with high EMR use. METHODS: Resident activity while on the vascular surgery service was queried from the EMR. Weekends and holidays were excluded to focus on typical staffing periods. Variables including daily time spent, post-graduate year (PGY), remote access via mobile device or personal laptop, and patient census including operative caseload were extracted. Univariate analysis was performed with t tests and χ2 tests where appropriate. We then fit a linear mixed-effects model with normalized daily EMR time as the outcome variable, random slopes for resident and patient census, and fixed effects of PGY level, academic year, and fractional time spent using remote access. RESULTS: EMR activity for 53 residents from July 2015 to June 2019 was included. The mean daily EMR usage was 1.6 hours, ranging from 3.6 hours per day in PGY1 residents to 1.1 hours in PGY4 to 5 residents. Across all PGYs, the most time-consuming EMR activities were chart review (43.0%-46.6%) and notes review (22.4%-27.0%). In the linear mixed-effects model, increased patient census was associated with increased daily EMR usage (Coefficient = 0.61, P-value < .001). Resident seniority (Coefficient = -1.2, P-value < .001) and increased remote access (Coefficient = -0.44, P-value < .001) were associated with reduced daily EMR usage. Over the study period, total EMR usage decreased significantly from the 2015/2016 academic year to the 2018/2019 academic year (mean difference, 2.4 hours vs 1.78; P-value < .001). CONCLUSIONS: In an audit of EMR activity logs on a vascular surgery service, mean EMR time was 1.6 hours a day, which is lower than survey estimates. Resident seniority and remote access utilization were associated with reduced time spent on the EMR, independent of patient census. Although increasing EMR accessibility via mobile devices and personal computers have been hypothesized to contribute to poor work-life balance, our study suggests a possible time-saving effect by enabling expedient access for data review, which constitutes the majority of resident EMR activity. Further research in other institutions and specialties is needed for external validation and exploring implications for resident wellness initiatives.

The steatosis-associated fibrosis estimator (SAFE) score: A tool to detect low-risk NAFLD in primary care.

BACKGROUND: NAFLD is common in primary care. Liver fibrosis stage 2 or higher (≥F2) increases future risk of morbidity and mortality. We developed and validated a score to aid in the initial assessment of liver fibrosis for NAFLD in primary care. METHODS: Data from patients with biopsy-proven NAFLD were extracted from the NASH Clinical Research Network observational study ( n = 676). Using logistic regression and machine-learning methods, we constructed prediction models to distinguish ≥F2 from F0/1. The models were tested in participants in a trial ("FLINT," n = 280) and local patients with NAFLD with magnetic resonance elastography data ( n = 130). The final model was applied to examinees in the National Health and Nutrition Examination Survey (NHANES) III ( n = 11,953) to correlate with long-term mortality. RESULTS: A multivariable logistic regression model was selected as the Steatosis-Associated Fibrosis Estimator (SAFE) score, which consists of age, body mass index, diabetes, platelets, aspartate and alanine aminotransferases, and globulins (total serum protein minus albumin). The model yielded areas under receiver operating characteristic curves ≥0.80 in distinguishing F0/1 from ≥F2 in testing data sets, consistently higher than those of Fibrosis-4 and NAFLD Fibrosis Scores. The negative predictive values in ruling out ≥F2 at SAFE of 0 were 88% and 92% in the two testing sets. In the NHANES III set, survival up to 25 years of subjects with SAFE < 0 was comparable to that of those without steatosis ( p = 0.34), whereas increasing SAFE scores correlated with shorter survival with an adjusted HR of 1.53 ( p < 0.01) for subjects with SAFE > 100. CONCLUSION: The SAFE score, which uses widely available variables to estimate liver fibrosis in patients diagnosed with NAFLD, may be used in primary care to recognize low-risk NAFLD.

Methamphetamine-associated heart failure: a systematic review of observational studies.

OBJECTIVE: To conduct a systematic review of observational studies on methamphetamine-associated heart failure (MethHF) . METHODS: Six databases were searched for original publications on the topic. Title/abstract and included full-text publications were reviewed in duplicate. Data extraction and critical appraisal for risk of bias were performed in duplicate. RESULTS: Twenty-one studies are included in the final analysis. Results could not be combined because of heterogeneity in study design, population, comparator, and outcome assessment. Overall risk of bias is moderate due to the presence of confounders, selection bias and poor matching; overall certainty in the evidence is very low. MethHF is increasing in prevalence, affects diverse racial/ethnic/sociodemographic groups with a male predominance; up to 44% have preserved left-ventricular ejection fraction. MethHF is associated with significant morbidity including worse heart failure symptoms compared with non-methamphetamine related heart failure. Female sex, methamphetamine abstinence and guideline-directed heart failure therapy are associated with improved outcomes. Chamber dimensions on echocardiography and fibrosis on biopsy predict the extent of recovery after abstinence. CONCLUSIONS: The increasing prevalence of MethHF with associated morbidity underscores the urgent need for well designed prospective studies of people who use methamphetamine to accurately assess the epidemiology, clinical features, disease trajectory and outcomes of MethHF. Methamphetamine abstinence is an integral part of MethHF treatment; increased availability of effective non-pharmacological interventions for treatment of methamphetamine addiction is an essential first step. Availability of effective pharmacological treatment for methamphetamine addiction will further support MethHF treatment. Using harm reduction principles in an integrated addiction/HF treatment programme will bolster efforts to stem the increasing tide of MethHF.

Long-term opioid therapy trajectories and overdose in patients with and without cancer.

Objective: Pain is experienced by most patients with cancer and opioids are a cornerstone of management. Our objectives were (1) to identify patterns or trajectories of long-term opioid therapy (LTOT) and their correlates among patients with and without cancer and (2) to assess the association between trajectories and risk for opioid overdose, considering the potential moderating role of cancer. Methods and Analysis: We conducted a retrospective cohort study among individuals in the US Veterans Health Administration (VHA) database with incident LTOT with and without cancer (N=44,351; N=285,772, respectively) between 2010-2017. We investigated the relationship between LTOT trajectory and all International Classification of Diseases-9 and 10-defined accidental and intentional opioid-related overdoses. Results: Trajectories of opioid receipt observed in patients without cancer and replicated in patients with cancer were: low-dose/stable trend, low-dose/de-escalating trend, moderate-dose/stable trend, moderate-dose/escalating with quadratic downturn trend, and high-dose/escalating with quadratic downturn trend. Time to first overdose was significantly predicted by higher-dose and escalating trajectories; the two low-dose trajectories conferred similar, lower risk. Conditional hazard ratios (99% CI) for the moderate-dose, moderate-dose/escalating with quadratic downturn and high-dose/escalating with quadratic downturn trends were 1·84 (1·18, 2·85), 2·56 (1·54, 4·25), and 2·41 (1·37, 4·26), respectively. Effects of trajectories on time to overdose did not differ by presence of cancer; inferences were replicated when restricting to patients with stage 3/4 cancer. Conclusion: Patients with cancer face opioid overdose risks like patients without cancer. Future studies should seek to expand and address our knowledge about opioid risk in cancer patients. Trial registration: None.

Changes in postoperative opioid prescribing across three diverse healthcare systems, 2010-2020.

Objective: The opioid crisis brought scrutiny to opioid prescribing. Understanding how opioid prescribing patterns and corresponding patient outcomes changed during the epidemic is essential for future targeted policies. Many studies attempt to model trends in opioid prescriptions therefore understanding the temporal shift in opioid prescribing patterns across populations is necessary. This study characterized postoperative opioid prescribing patterns across different populations, 2010-2020. Data Source: Administrative data from Veteran Health Administration (VHA), six Medicaid state programs and an Academic Medical Center (AMC). Data extraction: Surgeries were identified using the Clinical Classifications Software. Study Design: Trends in average daily discharge Morphine Milligram Equivalent (MME), postoperative pain and subsequent opioid prescription were compared using regression and likelihood ratio test statistics. Principal Findings: The cohorts included 595,106 patients, with populations that varied considerably in demographics. Over the study period, MME decreased significantly at VHA (37.5-30.1; p = 0.002) and Medicaid (41.6-31.3; p = 0.019), and increased at AMC (36.9-41.7; p < 0.001). Persistent opioid users decreased after 2015 in VHA (p < 0.001) and Medicaid (p = 0.002) and increase at the AMC (p = 0.003), although a low rate was maintained. Average postoperative pain scores remained constant over the study period. Conclusions: VHA and Medicaid programs decreased opioid prescribing over the past decade, with differing response times and rates. In 2020, these systems achieved comparable opioid prescribing patterns and outcomes despite having very different populations. Acknowledging and incorporating these temporal distribution shifts into data learning models is essential for robust and generalizable models.

Implementation and Effectiveness of a Learning Collaborative to Improve Palliative Care for Seriously Ill Hemodialysis Patients.

BACKGROUND AND OBJECTIVES: Limited implementation of palliative care practices in hemodialysis may contribute to end-of-life care that is intensive and not patient centered. We determined whether a learning collaborative for hemodialysis center providers improved delivery of palliative care best practices. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: Ten US hemodialysis centers participated in a pre-post study targeting seriously ill patients between April 2019 and September 2020. Three practices were prioritized: screening for serious illness, goals of care discussions, and use of a palliative dialysis care pathway. The collaborative educational bundle consisted of learning sessions, communication skills training, and implementation support. The primary outcome was change in the probability of complete advance care planning documentation among seriously ill patients. Health care utilization was a secondary outcome, and implementation outcomes of acceptability, adoption, feasibility, and penetration were assessed using mixed methods. RESULTS: One center dropped out due to the coronavirus disease 2019 pandemic. Among the remaining nine centers, 20% (273 of 1395) of patients were identified as seriously ill preimplementation, and 16% (203 of 1254) were identified as seriously ill postimplementation. From the preimplementation to postimplementation period, the adjusted probability of complete advance care planning documentation among seriously ill patients increased by 34.5 percentage points (95% confidence interval, 4.4 to 68.5). There was no difference in mortality or in utilization of palliative hemodialysis, hospice referral, or hemodialysis discontinuation. Screening for serious illness was widely adopted, and goals of care discussions were adopted with incomplete integration. There was limited adoption of a palliative dialysis care pathway. CONCLUSIONS: A learning collaborative for hemodialysis centers spanning the coronavirus disease 2019 pandemic was associated with adoption of serious illness screening and goals of care discussions as well as improved documentation of advance care planning for seriously ill patients. CLINICAL TRIAL REGISTRY NAME AND REGISTRATION NUMBER: Pathways Project: Kidney Supportive Care, NCT04125537.

Interruptive Electronic Alerts for Choosing Wisely Recommendations: A Cluster Randomized Controlled Trial.

OBJECTIVE: To assess the efficacy of interruptive electronic alerts in improving adherence to the American Board of Internal Medicine's Choosing Wisely recommendations to reduce unnecessary laboratory testing. MATERIALS AND METHODS: We administered 5 cluster randomized controlled trials simultaneously, using electronic medical record alerts regarding prostate-specific antigen (PSA) testing, acute sinusitis treatment, vitamin D testing, carotid artery ultrasound screening, and human papillomavirus testing. For each alert, we assigned 5 outpatient clinics to an interruptive alert and 5 were observed as a control. Primary and secondary outcomes were the number of postalert orders per 100 patients at each clinic and number of triggered alerts divided by orders, respectively. Post hoc analysis evaluated whether physicians experiencing interruptive alerts reduced their alert-triggering behaviors. RESULTS: Median postalert orders per 100 patients did not differ significantly between treatment and control groups; absolute median differences ranging from 0.04 to 0.40 for PSA testing. Median alerts per 100 orders did not differ significantly between treatment and control groups; absolute median differences ranged from 0.004 to 0.03. In post hoc analysis, providers receiving alerts regarding PSA testing in men were significantly less likely to trigger additional PSA alerts than those in the control sites (Incidence Rate Ratio 0.12, 95% CI [0.03-0.52]). DISCUSSION: Interruptive point-of-care alerts did not yield detectable changes in the overall rate of undesired orders or the order-to-alert ratio between active and silent sites. Complementary behavioral or educational interventions are likely needed to improve efforts to curb medical overuse. CONCLUSION: Implementation of interruptive alerts at the time of ordering was not associated with improved adherence to 5 Choosing Wisely guidelines. TRIAL REGISTRATION: NCT02709772.

Cost-effectiveness of computed tomography versus ultrasound-based surveillance following endovascular aortic repair of intact infrarenal abdominal aortic aneurysms.

BACKGROUND: While Society for Vascular Surgery guidelines recommend computed tomography angiography (CTA) or ultrasound for surveillance following infrarenal endovascular aortic repair (EVAR), there is a lack of consensus regarding optimal timing and modalities. We hypothesized that ultrasound-based approaches would be more cost-effective and developed a cost-effectiveness analysis to estimate the lifetime costs and outcomes of various strategies. METHODS: We developed a decision tree with nested Markov models to compare five surveillance strategies: yearly CTA, yearly CDU, yearly CEU, CTA at first year followed by CDU, and CTA at first year followed by CEU. The model accounted for differential sensitivity, specificity, and risk of acute kidney injury after CTA, and was implemented on a monthly cycle with a willingness-to-pay threshold of $50,000 per quality-adjusted life year (QALY) and 3% annual discounting. RESULTS: Under base case assumptions, the CTA-CDU strategy was cost effective with a lifetime cost of $77950 for 7.74 QALYs. In sensitivity analysis, the CTA-CDU approach remained cost-effective when CEU specificity was less than 95%, and risk of acute kidney injury following CTA was less than 20%. At diagnostic sensitivities below 75% for CEU and 55% for CDU, a yearly CTA strategy maximized QALYs. CONCLUSIONS: A hybrid strategy in which CTA is performed in the first year and CDU is performed annually thereafter is the most cost-effective strategy for infrarenal EVAR surveillance in patients with less than a 20% risk of contrast-induced nephropathy. If the sensitivity of CEU and CDU are at the lower end of plausible estimates, a yearly CTA strategy is reasonable. Further research should aim to identify patients who may benefit from alternative surveillance strategies.

Gaps in standardized postoperative pain management quality measures: A systematic review.

BACKGROUND: The goal of this study was an assessment of availability postoperative pain management quality measures and National Quality Forum-endorsed measures. Postoperative pain is an important clinical timepoint because poor pain control can lead to patient suffering, chronic opiate use, and/or chronic pain. Quality measures can guide best practices, but it is unclear whether there are measures for managing pain after surgery. METHODS: The National Quality Forum Quality Positioning System, Agency for Healthcare Research and Quality Indicators, and Centers for Medicare and Medicaid Services Measures Inventory Tool databases were searched in November 2019. We conducted a systematic literature review to further identify quality measures in research publications, clinical practice guidelines, and gray literature for the period between March 11, 2015 and March 11, 2020. RESULTS: Our systematic review yielded 1,328 publications, of which 206 were pertinent. Nineteen pain management quality measures were identified from the quality measure databases, and 5 were endorsed by National Quality Forum. The National Quality Forum measures were not specific to postoperative pain management. Three of the non-endorsed measures were specific to postoperative pain. CONCLUSION: The dearth of published postoperative pain management quality measures, especially National Quality Forum-endorsed measures, highlights the need for more rigorous evidence and widely endorsed postoperative pain quality measures to guide best practices.

Patient and Caregiver Prioritization of Palliative and End-of-Life Cancer Care Quality Measures.

BACKGROUND: Development and prioritization of quality measures typically relies on experts in clinical medicine, but patients and their caregivers may have different perspectives on quality measurement priorities. OBJECTIVE: To inform priorities for health system implementation of palliative cancer and end-of-life care quality measures by eliciting perspectives of patients and caregivers. DESIGN: Using modified RAND-UCLA Appropriateness Panel methods and materials tailored for knowledgeable lay participants, we convened a panel to rate cancer palliative care process quality measure concepts before and after a 1-day, in-person meeting. PARTICIPANTS: Nine patients and caregivers with experience living with or caring for patients with cancer. MAIN MEASURES: Panelists rated each concept on importance for providing patient- and family-centered care on a nine-point scale and each panelist nominated five highest priority measure concepts ("top 5"). KEY RESULTS: Cancer patient and caregiver panelists rated all measure concepts presented as highly important to patient- and family- centered care (median rating ≥ 7) in pre-panel (mean rating range, 6.9-8.8) and post-panel ratings (mean rating range, 7.2-8.9). Forced choice nominations of the "top 5" helped distinguish similarly rated measure concepts. Measure concepts nominated into the "top 5" by three or more panelists included two measure concepts of communication (goals of care discussions and discussion of prognosis), one measure concept on providing comprehensive assessments of patients, and three on symptoms including pain management plans, improvement in pain, and depression management plans. Patients and caregivers nominated one additional measure concept (pain screening) back into consideration, bringing the total number of measure concepts under consideration to 21. CONCLUSIONS: Input from cancer patients and caregivers helped identify quality measurement priorities for health system implementation. Forced choice nominations were useful to discriminate concepts with the highest perceived importance. Our approach serves as a model for incorporating patient and caregiver priorities in quality measure development and implementation.

Two mental models of integrated care for advanced liver disease: qualitative study of multidisciplinary health professionals.

OBJECTIVES: The purpose of this paper is to present two divergent mental models of integrated advanced liver disease (AdvLD) care among 26 providers who treat patients with AdvLD. SETTING: 3 geographically dispersed United States Veterans Health Administration health systems. PARTICIPANTS: 26 professionals (20 women and 6 men) participated, including 9 (34.6%) gastroenterology, hepatology, and transplant physicians, 2 (7.7%) physician assistants, 7 (27%) nurses and nurse practitioners, 3 (11.5%) social workers and psychologists, 4 (15.4%) palliative care providers and 1 (3.8%) pharmacist. MAIN OUTCOME MEASURES: We conducted qualitative in-depth interviews of providers caring for patients with AdvLD. We used framework analysis to identify two divergent mental models of integrated AdvLD care. These models vary in timing of initiating various constituents of care, philosophy of integration, and supports and resources needed to achieve each model. RESULTS: Clinicians described integrated care as an approach that incorporates elements of curative care, symptom and supportive care, advance care planning and end-of-life services from a multidisciplinary team. Analysis revealed two mental models that varied in how and when these constituents are delivered. One mental model involves sequential transitions between constituents of care, and the second mental model involves synchronous application of the various constituents. Participants described elements of teamwork and coordination supports necessary to achieve integrated AdvLD care. Many discussed the importance of having a multidisciplinary team integrating supportive care, symptom management and palliative care with liver disease care. CONCLUSIONS: Health professionals agree on the constituents of integrated AdvLD care but describe two competing mental models of how these constituents are integrated. Health systems can promote integrated care by assembling multidisciplinary teams, and providing teamwork and coordination supports, and training that facilitates patient-centred AdvLD care.