RESUMO
High-quality medical data is critical to the development and implementation of machine learning (ML) algorithms in healthcare; however, security, and privacy concerns continue to limit access. We sought to determine the utility of "synthetic data" in training ML algorithms for the detection of tuberculosis (TB) from inflammatory biomarker profiles. A retrospective dataset (A) comprised of 278 patients was used to generate synthetic datasets (B, C, and D) for training models prior to secondary validation on a generalization dataset. ML models trained and validated on the Dataset A (real) demonstrated an accuracy of 90%, a sensitivity of 89% (95% CI, 83-94%), and a specificity of 100% (95% CI, 81-100%). Models trained using the optimal synthetic dataset B showed an accuracy of 91%, a sensitivity of 93% (95% CI, 87-96%), and a specificity of 77% (95% CI, 50-93%). Synthetic datasets C and D displayed diminished performance measures (respective accuracies of 71% and 54%). This pilot study highlights the promise of synthetic data as an expedited means for ML algorithm development.
RESUMO
Sepsis is the primary cause of burn-related mortality and morbidity. Traditional indicators of sepsis exhibit poor performance when used in this unique population due to their underlying hypermetabolic and inflammatory response following burn injury. To address this challenge, we developed the Machine Intelligence Learning Optimizer (MILO), an automated machine learning (ML) platform, to automatically produce ML models for predicting burn sepsis. We conducted a retrospective analysis of 211 adult patients (age ≥ 18 years) with severe burn injury (≥ 20% total body surface area) to generate training and test datasets for ML applications. The MILO approach was compared against an exhaustive "non-automated" ML approach as well as standard statistical methods. For this study, traditional multivariate logistic regression (LR) identified seven predictors of burn sepsis when controlled for age and burn size (OR 2.8, 95% CI 1.99-4.04, P = 0.032). The area under the ROC (ROC-AUC) when using these seven predictors was 0.88. Next, the non-automated ML approach produced an optimal model based on LR using 16 out of the 23 features from the study dataset. Model accuracy was 86% with ROC-AUC of 0.96. In contrast, MILO identified a k-nearest neighbor-based model using only five features to be the best performer with an accuracy of 90% and a ROC-AUC of 0.96. Machine learning augments burn sepsis prediction. MILO identified models more quickly, with less required features, and found to be analytically superior to traditional ML approaches. Future studies are needed to clinically validate the performance of MILO-derived ML models for sepsis prediction.
Assuntos
Queimaduras , Bases de Dados Factuais , Aprendizado de Máquina , Modelos Biológicos , Sepse , Adulto , Fatores Etários , Queimaduras/metabolismo , Queimaduras/mortalidade , Queimaduras/patologia , Intervalo Livre de Doença , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Valor Preditivo dos Testes , Sepse/metabolismo , Sepse/mortalidade , Sepse/patologia , Taxa de SobrevidaRESUMO
Severely burned and non-burned trauma patients are at risk for acute kidney injury (AKI). The study objective was to assess the theoretical performance of artificial intelligence (AI)/machine learning (ML) algorithms to augment AKI recognition using the novel biomarker, neutrophil gelatinase associated lipocalin (NGAL), combined with contemporary biomarkers such as N-terminal pro B-type natriuretic peptide (NT-proBNP), urine output (UOP), and plasma creatinine. Machine learning approaches including logistic regression (LR), k-nearest neighbor (k-NN), support vector machine (SVM), random forest (RF), and deep neural networks (DNN) were used in this study. The AI/ML algorithm helped predict AKI 61.8 (32.5) hours faster than the Kidney Disease and Improving Global Disease Outcomes (KDIGO) criteria for burn and non-burned trauma patients. NGAL was analytically superior to traditional AKI biomarkers such as creatinine and UOP. With ML, the AKI predictive capability of NGAL was further enhanced when combined with NT-proBNP or creatinine. The use of AI/ML could be employed with NGAL to accelerate detection of AKI in at-risk burn and non-burned trauma patients.
Assuntos
Injúria Renal Aguda/diagnóstico , Algoritmos , Biomarcadores/análise , Queimaduras/complicações , Aprendizado de Máquina , Ferimentos e Lesões/complicações , Injúria Renal Aguda/etiologia , Injúria Renal Aguda/metabolismo , Proteínas de Fase Aguda/metabolismo , Adulto , Inteligência Artificial , Creatinina/metabolismo , Feminino , Humanos , Testes de Função Renal , Lipocalina-2/metabolismo , Masculino , Peptídeo Natriurético Encefálico/metabolismo , Fragmentos de Peptídeos/metabolismo , Projetos PilotoRESUMO
BACKGROUND: Burn critical care represents a high impact population that may benefit from artificial intelligence and machine learning (ML). Acute kidney injury (AKI) recognition in burn patients could be enhanced by ML. The goal of this study was to determine the theoretical performance of ML in augmenting AKI recognition. METHODS: We developed ML models using the k-nearest neighbor (k-NN) algorithm. The ML models were trained-tested with clinical laboratory data for 50 adult burn patients that had neutrophil gelatinase associated lipocalin (NGAL), urine output (UOP), creatinine, and N-terminal B-type natriuretic peptide (NT-proBNP) measured within the first 24 h of admission. RESULTS: Half of patients (50%) in the dataset experienced AKI within the first week following admission. ML models containing NGAL, creatinine, UOP, and NT-proBNP achieved 90-100% accuracy for identifying AKI. ML models containing only NT-proBNP and creatinine achieved 80-90% accuracy. Mean time-to-AKI recognition using UOP and/or creatinine alone was achieved within 42.7 ± 23.2 h post-admission vs. within 18.8 ± 8.1 h via the ML-algorithm. CONCLUSIONS: The performance of UOP and creatinine for predicting AKI could be enhanced by with a ML algorithm using a k-NN approach when NGAL is not available. Additional studies are needed to verify performance of ML for burn-related AKI.