Surgical prioritization based on decision model outcomes is not sensitive to differences between the health-related quality of life values estimates of physicians and citizens.

PURPOSE: Decision models can be used to support allocation of scarce surgical resources. These models incorporate health-related quality of life (HRQoL) values that can be determined using physician panels. The predominant opinion is that one should use values obtained from citizens. We investigated whether physicians give different HRQoL values to citizens and evaluate whether such differences impact decision model outcomes. METHODS: A two-round Delphi study was conducted. Citizens estimated HRQoL of pre- and post-operative health states for ten surgeries using a visual analogue scale. These values were compared using Bland-Altman analysis with HRQoL values previously obtained from physicians. Impact on decision model outcomes was evaluated by calculating the correlation between the rankings of surgeries established using the physicians' and the citizens' values. RESULTS: A total of 71 citizens estimated HRQoL. Citizens' values on the VAS scale were - 0.07 points (95% CI - 0.12 to - 0.01) lower than the physicians' values. The correlation between the rankings of surgeries based on citizens' and physicians' values was 0.96 (p < 0.001). CONCLUSION: Physicians put higher values on health states than citizens. However, these differences only result in switches between adjacent entries in the ranking. It would seem that HRQoL values obtained from physicians are adequate to inform decision models during crises.

Minimizing population health loss due to scarcity in OR capacity: validation of quality of life input.

OBJECTIVES: A previously developed decision model to prioritize surgical procedures in times of scarce surgical capacity used quality of life (QoL) primarily derived from experts in one center. These estimates are key input of the model, and might be more context-dependent than the other input parameters (age, survival). The aim of this study was to validate our model by replicating these QoL estimates. METHODS: The original study estimated QoL of patients in need of commonly performed procedures in live expert-panel meetings. This study replicated this procedure using a web-based Delphi approach in a different hospital. The new QoL scores were compared with the original scores using mixed effects linear regression. The ranking of surgical procedures based on combined QoL values from the validation and original study was compared to the ranking based solely on the original QoL values. RESULTS: The overall mean difference in QoL estimates between the validation study and the original study was - 0.11 (95% CI: -0.12 - -0.10). The model output (DALY/month delay) based on QoL data from both studies was similar to the model output based on the original data only: The Spearman's correlation coefficient between the ranking of all procedures before and after including the new QoL estimates was 0.988. DISCUSSION: Even though the new QoL estimates were systematically lower than the values from the original study, the ranking for urgency based on health loss per unit of time delay of procedures was consistent. This underscores the robustness and generalizability of the decision model for prioritization of surgical procedures.

Minimising population health loss in times of scarce surgical capacity: a modelling study for surgical procedures performed in nonacademic hospitals.

BACKGROUND: The burden of the COVID-19 pandemic resulted in a reduction of available health care capacity for regular care. To guide prioritisation of semielective surgery in times of scarcity, we previously developed a decision model to quantify the expected health loss due to delay of surgery, in an academic hospital setting. The aim of this study is to validate our decision model in a nonacademic setting and include additional elective surgical procedures. METHODS: In this study, we used the previously published three-state cohort state-transition model, to evaluate the health effects of surgery postponement for 28 surgical procedures commonly performed in nonacademic hospitals. Scientific literature and national registries yielded nearly all input parameters, except for the quality of life (QoL) estimates which were obtained from experts using the Delphi method. Two expert panels, one from a single nonacademic hospital and one from different nonacademic hospitals in the Netherlands, were invited to estimate QoL weights. We compared estimated model results (disability adjusted life years (DALY)/month of surgical delay) based on the QoL estimates from the two panels by calculating the mean difference and the correlation between the ranks of the different surgical procedures. The eventual model was based on the combined QoL estimates from both panels. RESULTS: Pacemaker implantation was associated with the most DALY/month of surgical delay (0.054 DALY/month, 95% CI: 0.025-0.103) and hemithyreoidectomy with the least DALY/month (0.006 DALY/month, 95% CI: 0.002-0.009). The overall mean difference of QoL estimates between the two panels was 0.005 (95% CI -0.014-0.004). The correlation between ranks was 0.983 (p < 0.001). CONCLUSIONS: Our study provides an overview of incurred health loss due to surgical delay for surgeries frequently performed in nonacademic hospitals. The quality of life estimates currently used in our model are robust and validate towards a different group of experts. These results enrich our earlier published results on academic surgeries and contribute to prioritising a more complete set of surgeries.

Development and internal validation of a clinical prediction model using machine learning algorithms for 90 day and 2 year mortality in femoral neck fracture patients aged 65 years or above.

PURPOSE: Preoperative prediction of mortality in femoral neck fracture patients aged 65 years or above may be valuable in the treatment decision-making. A preoperative clinical prediction model can aid surgeons and patients in the shared decision-making process, and optimize care for elderly femoral neck fracture patients. This study aimed to develop and internally validate a clinical prediction model using machine learning (ML) algorithms for 90 day and 2 year mortality in femoral neck fracture patients aged 65 years or above. METHODS: A retrospective cohort study at two trauma level I centers and three (non-level I) community hospitals was conducted to identify patients undergoing surgical fixation for a femoral neck fracture. Five different ML algorithms were developed and internally validated and assessed by discrimination, calibration, Brier score and decision curve analysis. RESULTS: In total, 2478 patients were included with 90 day and 2 year mortality rates of 9.1% (n = 225) and 23.5% (n = 582) respectively. The models included patient characteristics, comorbidities and laboratory values. The stochastic gradient boosting algorithm had the best performance for 90 day mortality prediction, with good discrimination (c-statistic = 0.74), calibration (intercept = - 0.05, slope = 1.11) and Brier score (0.078). The elastic-net penalized logistic regression algorithm had the best performance for 2 year mortality prediction, with good discrimination (c-statistic = 0.70), calibration (intercept = - 0.03, slope = 0.89) and Brier score (0.16). The models were incorporated into a freely available web-based application, including individual patient explanations for interpretation of the model to understand the reasoning how the model made a certain prediction: https://sorg-apps.shinyapps.io/hipfracturemortality/ CONCLUSIONS: The clinical prediction models show promise in estimating mortality prediction in elderly femoral neck fracture patients. External and prospective validation of the models may improve surgeon ability when faced with the treatment decision-making. LEVEL OF EVIDENCE: Prognostic Level II.

Feasibility of Machine Learning and Logistic Regression Algorithms to Predict Outcome in Orthopaedic Trauma Surgery.

BACKGROUND: Statistical models using machine learning (ML) have the potential for more accurate estimates of the probability of binary events than logistic regression. The present study used existing data sets from large musculoskeletal trauma trials to address the following study questions: (1) Do ML models produce better probability estimates than logistic regression models? (2) Are ML models influenced by different variables than logistic regression models? METHODS: We created ML and logistic regression models that estimated the probability of a specific fracture (posterior malleolar involvement in distal spiral tibial shaft and ankle fractures, scaphoid fracture, and distal radial fracture) or adverse event (subsequent surgery [after distal biceps repair or tibial shaft fracture], surgical site infection, and postoperative delirium) using 9 data sets from published musculoskeletal trauma studies. Each data set was split into training (80%) and test (20%) subsets. Fivefold cross-validation of the training set was used to develop the ML models. The best-performing model was then assessed in the independent testing data. Performance was assessed by (1) discrimination (c-statistic), (2) calibration (slope and intercept), and (3) overall performance (Brier score). RESULTS: The mean c-statistic was 0.01 higher for the logistic regression models compared with the best ML models for each data set (range, -0.01 to 0.06). There were fewer variables strongly associated with variation in the ML models, and many were dissimilar from those in the logistic regression models. CONCLUSIONS: The observation that ML models produce probability estimates comparable with logistic regression models for binary events in musculoskeletal trauma suggests that their benefit may be limited in this context.

Minimizing Population Health Loss in Times of Scarce Surgical Capacity During the Coronavirus Disease 2019 Crisis and Beyond: A Modeling Study.

OBJECTIVES: Coronavirus disease 2019 has put unprecedented pressure on healthcare systems worldwide, leading to a reduction of the available healthcare capacity. Our objective was to develop a decision model to estimate the impact of postponing semielective surgical procedures on health, to support prioritization of care from a utilitarian perspective. METHODS: A cohort state-transition model was developed and applied to 43 semielective nonpediatric surgical procedures commonly performed in academic hospitals. Scenarios of delaying surgery from 2 weeks were compared with delaying up to 1 year and no surgery at all. Model parameters were based on registries, scientific literature, and the World Health Organization Global Burden of Disease study. For each surgical procedure, the model estimated the average expected disability-adjusted life-years (DALYs) per month of delay. RESULTS: Given the best available evidence, the 2 surgical procedures associated with most DALYs owing to delay were bypass surgery for Fontaine III/IV peripheral arterial disease (0.23 DALY/month, 95% confidence interval [CI]: 0.13-0.36) and transaortic valve implantation (0.15 DALY/month, 95% CI: 0.09-0.24). The 2 surgical procedures with the least DALYs were placing a shunt for dialysis (0.01, 95% CI: 0.005-0.01) and thyroid carcinoma resection (0.01, 95% CI: 0.01-0.02). CONCLUSION: Expected health loss owing to surgical delay can be objectively calculated with our decision model based on best available evidence, which can guide prioritization of surgical procedures to minimize population health loss in times of scarcity. The model results should be placed in the context of different ethical perspectives and combined with capacity management tools to facilitate large-scale implementation.