Your browser doesn't support javascript.
loading
A Framework for Using Real-World Data and Health Outcomes Modeling to Evaluate Machine Learning-Based Risk Prediction Models.
Rodriguez, Patricia J; Veenstra, David L; Heagerty, Patrick J; Goss, Christopher H; Ramos, Kathleen J; Bansal, Aasthaa.
Afiliação
  • Rodriguez PJ; The Comparative Health Outcomes, Policy & Economics (CHOICE) Institute, University of Washington, Seattle, WA, USA. Electronic address: prodrig@uw.edu.
  • Veenstra DL; The Comparative Health Outcomes, Policy & Economics (CHOICE) Institute, University of Washington, Seattle, WA, USA.
  • Heagerty PJ; Department of Biostatistics, University of Washington, Seattle, WA, USA.
  • Goss CH; Division of Pulmonary, Critical Care and Sleep Medicine, Department of Medicine, University of Washington, Seattle, WA, USA; Division of Pulmonology, Department of Pediatrics, University of Washington, Seattle, WA, USA.
  • Ramos KJ; Division of Pulmonary, Critical Care and Sleep Medicine, Department of Medicine, University of Washington, Seattle, WA, USA.
  • Bansal A; The Comparative Health Outcomes, Policy & Economics (CHOICE) Institute, University of Washington, Seattle, WA, USA. Electronic address: abansal@uw.edu.
Value Health ; 25(3): 350-358, 2022 03.
Article em En | MEDLINE | ID: mdl-35227445
OBJECTIVES: We propose a framework of health outcomes modeling with dynamic decision making and real-world data (RWD) to evaluate the potential utility of novel risk prediction models in clinical practice. Lung transplant (LTx) referral decisions in cystic fibrosis offer a complex case study. METHODS: We used longitudinal RWD for a cohort of adults (n = 4247) from the Cystic Fibrosis Foundation Patient Registry to compare outcomes of an LTx referral policy based on machine learning (ML) mortality risk predictions to referral based on (1) forced expiratory volume in 1 second (FEV1) alone and (2) heterogenous usual care (UC). We then developed a patient-level simulation model to project number of patients referred for LTx and 5-year survival, accounting for transplant availability, organ allocation policy, and heterogenous treatment effects. RESULTS: Only 12% of patients (95% confidence interval 11%-13%) were referred for LTx over 5 years under UC, compared with 19% (18%-20%) under FEV1 and 20% (19%-22%) under ML. Of 309 patients who died before LTx referral under UC, 31% (27%-36%) would have been referred under FEV1 and 40% (35%-45%) would have been referred under ML. Given a fixed supply of organs, differences in referral time did not lead to significant differences in transplants, pretransplant or post-transplant deaths, or overall survival in 5 years. CONCLUSIONS: Health outcomes modeling with RWD may help to identify novel ML risk prediction models with high potential real-world clinical utility and rule out further investment in models that are unlikely to offer meaningful real-world benefits.
Assuntos
Palavras-chave

Texto completo: 1 Coleções: 01-internacional Base de dados: MEDLINE Assunto principal: Encaminhamento e Consulta / Coleta de Dados / Transplante de Pulmão / Avaliação de Resultados em Cuidados de Saúde / Aprendizado de Máquina Tipo de estudo: Etiology_studies / Observational_studies / Prognostic_studies / Risk_factors_studies Limite: Humans Idioma: En Ano de publicação: 2022 Tipo de documento: Article

Texto completo: 1 Coleções: 01-internacional Base de dados: MEDLINE Assunto principal: Encaminhamento e Consulta / Coleta de Dados / Transplante de Pulmão / Avaliação de Resultados em Cuidados de Saúde / Aprendizado de Máquina Tipo de estudo: Etiology_studies / Observational_studies / Prognostic_studies / Risk_factors_studies Limite: Humans Idioma: En Ano de publicação: 2022 Tipo de documento: Article