Development and validation of a prediction model for early mortality after transcatheter aortic valve implantation (TAVI) based on the Netherlands Heart Registration (NHR): The TAVI-NHR risk model.

BACKGROUND: The currently available mortality prediction models (MPM) have suboptimal performance when predicting early mortality (30-days) following transcatheter aortic valve implantation (TAVI) on various external populations. We developed and validated a new TAVI-MPM based on a large number of predictors with recent data from a national heart registry. METHODS: We included all TAVI-patients treated in the Netherlands between 2013 and 2018, from the Netherlands Heart Registration. We used logistic-regression analysis based on the Akaike Information Criterion for variable selection. We multiply imputed missing values, but excluded variables with >30% missing values. For internal validation, we used ten-fold cross-validation. For temporal (prospective) validation, we used the 2018-data set for testing. We assessed discrimination by the c-statistic, predicted probability accuracy by the Brier score, and calibration by calibration graphs, and calibration-intercept and calibration slope. We compared our new model to the updated ACC-TAVI and IRRMA MPMs on our population. RESULTS: We included 9144 TAVI-patients. The observed early mortality was 4.0%. The final MPM had 10 variables, including: critical-preoperative state, procedure-acuteness, body surface area, serum creatinine, and diabetes-mellitus status. The median c-statistic was 0.69 (interquartile range [IQR] 0.646-0.75). The median Brier score was 0.038 (IQR 0.038-0.040). No signs of miscalibration were observed. The c-statistic's temporal-validation was 0.71 (95% confidence intervals 0.64-0.78). Our model outperformed the updated currently available MPMs ACC-TAVI and IRRMA (p value < 0.05). CONCLUSION: The new TAVI-model used additional variables and showed fair discrimination and good calibration. It outperformed the updated currently available TAVI-models on our population. The model's good calibration benefits preprocedural risk-assessment and patient counseling.

Update and, internal and temporal-validation of the FRANCE-2 and ACC-TAVI early-mortality prediction models for Transcatheter Aortic Valve Implantation (TAVI) using data from the Netherlands heart registration (NHR).

BACKGROUND: The predictive performance of the models FRANCE-2 and ACC-TAVI for early-mortality after Transcatheter Aortic Valve Implantation (TAVI) can decline over time and can be enhanced by updating them on new populations. We aim to update and internally and temporally validate these models using a recent TAVI-cohort from the Netherlands Heart Registration (NHR). METHODS: We used data of TAVI-patients treated in 2013-2017. For each original-model, the best update-method (model-intercept, model-recalibration, or model-revision) was selected by a closed-testing procedure. We internally validated both updated models with 1000 bootstrap samples. We also updated the models on the 2013-2016 dataset and temporally validated them on the 2017-dataset. Performance measures were the Area-Under ROC-curve (AU-ROC), Brier-score, and calibration graphs. RESULTS: We included 6177 TAVI-patients, with 4.5% observed early-mortality. The selected update-method for FRANCE-2 was model-intercept-update. Internal validation showed an AU-ROC of 0.63 (95%CI 0.62-0.66) and Brier-score of 0.04 (0.04-0.05). Calibration graphs show that it overestimates early-mortality. In temporal-validation, the AU-ROC was 0.61 (0.53-0.67).The selected update-method for ACC-TAVI was model-revision. In internal-validation, the AU-ROC was 0.63 (0.63-0.66) and Brier-score was 0.04 (0.04-0.05). The updated ACC-TAVI calibrates well up to a probability of 20%, and subsequently underestimates early-mortality. In temporal-validation the AU-ROC was 0.65 (0.58-0.72). CONCLUSION: Internal-validation of the updated models FRANCE-2 and ACC-TAVI with data from the NHR demonstrated improved performance, which was better than in external-validation studies and comparable to the original studies. In temporal-validation, ACC-TAVI outperformed FRANCE-2 because it suffered less from changes over time.

External validation of existing prediction models of 30-day mortality after Transcatheter Aortic Valve Implantation (TAVI) in the Netherlands Heart Registration.

BACKGROUND: Several mortality prediction models (MPM) are used for predicting early (30-day) mortality following transcatheter aortic valve implantation (TAVI). Little is known about their predictive performance in external TAVI populations. We aim to externally validate established MPMs on a large TAVI dataset from the Netherlands Heart Registration (NHR). METHODS: We included data from NHR-patients who underwent TAVI during 2013-2017. We calculated the predicted mortalities per MPM. We assessed the predictive performance by discrimination (Area Under Receiver Operating-characteristic Curve, AU-ROC); the Area Under Precision-Recall Curve, AU-PRC; calibration (using calibration-intercept and calibration-slope); Brier Score and Brier Skill Score. We also assessed the predictive performance among subgroups: tertiles of mortality-risk for non-survivors, gender, and access-route. RESULTS: We included 6177 TAVI-patients with an observed early-mortality rate of 4.5% (n = 280). We applied seven MPMs (STS, EuroSCORE-I, EuroSCORE-II, ACC-TAVI, FRANCE-2, OBSERVANT, and German-AV) on our cohort. The highest AU-ROCs were 0.64 (95%CI 0.61-0.67) for ACC-TAVI and 0.63 (95%CI 0.60-0.67) for FRANCE-2. All MPMs had a very low AU-PRC of ≤0.09. ACC-TAVI had the best calibration-intercept and calibration-slope. Brier Score values ranged between 0.043 and 0.063. Brier Skill Score ranged between -0.47 and 0.004. ACC-TAVI and FRANCE-2 predicted high mortality-risk better than other MPMs. ACC-TAVI outperformed other MPMs in different subgroups. CONCLUSION: The ACC-TAVI model has relatively the best predictive performance. However, all models have poor predictive performance. Because of the poor discrimination, miscalibration and limited accuracy of the models there is a need to update the existing models or develop new TAVI-specific models for local populations.