Machine Learning to Develop and Internally Validate a Predictive Model for Post-operative Delirium in a Prospective, Observational Clinical Cohort Study of Older Surgical Patients.
J Gen Intern Med
; 36(2): 265-273, 2021 02.
Article
em En
| MEDLINE
| ID: mdl-33078300
ABSTRACT
BACKGROUND:
Our objective was to assess the performance of machine learning methods to predict post-operative delirium using a prospective clinical cohort.METHODS:
We analyzed data from an observational cohort study of 560 older adults (≥ 70 years) without dementia undergoing major elective non-cardiac surgery. Post-operative delirium was determined by the Confusion Assessment Method supplemented by a medical chart review (N = 134, 24%). Five machine learning algorithms and a standard stepwise logistic regression model were developed in a training sample (80% of participants) and evaluated in the remaining hold-out testing sample. We evaluated three overlapping feature sets, restricted to variables that are readily available or minimally burdensome to collect in clinical settings, including interview and medical record data. A large feature set included 71 potential predictors. A smaller set of 18 features was selected by an expert panel using a consensus process, and this smaller feature set was considered with and without a measure of pre-operative mental status.RESULTS:
The area under the receiver operating characteristic curve (AUC) was higher in the large feature set conditions (range of AUC, 0.62-0.71 across algorithms) versus the selected feature set conditions (AUC range, 0.53-0.57). The restricted feature set with mental status had intermediate AUC values (range, 0.53-0.68). In the full feature set condition, algorithms such as gradient boosting, cross-validated logistic regression, and neural network (AUC = 0.71, 95% CI 0.58-0.83) were comparable with a model developed using traditional stepwise logistic regression (AUC = 0.69, 95% CI 0.57-0.82). Calibration for all models and feature sets was poor.CONCLUSIONS:
We developed machine learning prediction models for post-operative delirium that performed better than chance and are comparable with traditional stepwise logistic regression. Delirium proved to be a phenotype that was difficult to predict with appreciable accuracy.Palavras-chave
Texto completo:
1
Coleções:
01-internacional
Base de dados:
MEDLINE
Assunto principal:
Delírio
/
Aprendizado de Máquina
Tipo de estudo:
Diagnostic_studies
/
Etiology_studies
/
Incidence_studies
/
Observational_studies
/
Prognostic_studies
/
Risk_factors_studies
Limite:
Aged
/
Humans
Idioma:
En
Revista:
J Gen Intern Med
Assunto da revista:
MEDICINA INTERNA
Ano de publicação:
2021
Tipo de documento:
Article
País de afiliação:
Estados Unidos