Validation of the RIM Score-COVID in the Spanish SEMI-COVID-19 Registry.

The significant impact of COVID-19 worldwide has made it necessary to develop tools to identify patients at high risk of severe disease and death. This work aims to validate the RIM Score-COVID in the SEMI-COVID-19 Registry. The RIM Score-COVID is a simple nomogram with high predictive capacity for in-hospital death due to COVID-19 designed using clinical and analytical parameters of patients diagnosed in the first wave of the pandemic. The nomogram uses five variables measured on arrival to the emergency department (ED): age, sex, oxygen saturation, C-reactive protein level, and neutrophil-to-platelet ratio. Validation was performed in the Spanish SEMI-COVID-19 Registry, which included consecutive patients hospitalized with confirmed COVID-19 in Spain. The cohort was divided into three time periods: T1 from February 1 to June 10, 2020 (first wave), T2 from June 11 to December 31, 2020 (second wave, pre-vaccination period), and T3 from January 1 to December 5, 2021 (vaccination period). The model's accuracy in predicting in-hospital COVID-19 mortality was assessed using the area under the receiver operating characteristics curve (AUROC). Clinical and laboratory data from 22,566 patients were analyzed: 15,976 (70.7%) from T1, 4,233 (18.7%) from T2, and 2,357 from T3 (10.4%). AUROC of the RIM Score-COVID in the entire SEMI-COVID-19 Registry was 0.823 (95%CI 0.819-0.827) and was 0.834 (95%CI 0.830-0.839) in T1, 0.792 (95%CI 0.781-0.803) in T2, and 0.799 (95%CI 0.785-0.813) in T3. The RIM Score-COVID is a simple, easy-to-use method for predicting in-hospital COVID-19 mortality that uses parameters measured in most EDs. This tool showed good predictive ability in successive disease waves.

Improving prediction of COVID-19 mortality using machine learning in the Spanish SEMI-COVID-19 registry.

COVID-19 is responsible for high mortality, but robust machine learning-based predictors of mortality are lacking. To generate a model for predicting mortality in patients hospitalized with COVID-19 using Gradient Boosting Decision Trees (GBDT). The Spanish SEMI-COVID-19 registry includes 24,514 pseudo-anonymized cases of patients hospitalized with COVID-19 from 1 February 2020 to 5 December 2021. This registry was used as a GBDT machine learning model, employing the CatBoost and BorutaShap classifier to select the most relevant indicators and generate a mortality prediction model by risk level, ranging from 0 to 1. The model was validated by separating patients according to admission date, using the period 1 February to 31 December 2020 (first and second waves, pre-vaccination period) for training, and 1 January to 30 November 2021 (vaccination period) for the test group. An ensemble of ten models with different random seeds was constructed, separating 80% of the patients for training and 20% from the end of the training period for cross-validation. The area under the receiver operating characteristics curve (AUC) was used as a performance metric. Clinical and laboratory data from 23,983 patients were analyzed. CatBoost mortality prediction models achieved an AUC performance of 84.76 (standard deviation 0.45) for patients in the test group (potentially vaccinated patients not included in model training) using 16 features. The performance of the 16-parameter GBDT model for predicting COVID-19 hospital mortality, although requiring a relatively large number of predictors, shows a high predictive capacity.