Development and validation of a machine-learning prediction model to improve abdominal aortic aneurysm screening.

OBJECTIVE: Despite recommendations by the United States Preventive Services Task Force and the Society for Vascular Surgery, adoption of screening for abdominal aortic aneurysms (AAAs) remains low. One challenge is the low prevalence of AAAs in the unscreened population, and therefore a low detection rate for AAA screenings. We sought to use machine learning to identify factors associated with the presence of AAAs and create a model to identify individuals at highest risk for AAAs, with the aim of increasing the detection rate of AAA screenings. METHODS: A machine-learning model was trained using longitudinal medical records containing lab results, medications, and other data from our institutional database. A retrospective cohort study was performed identifying current or past smoking in patients aged 65 to 75 years and stratifying the patients by sex and smoking status as well as determining which patients had a confirmed diagnosis of AAA. The model was then adjusted to maximize fairness between sexes without significantly reducing precision and validated using six-fold cross validation. RESULTS: Validation of the algorithm on the single-center institutional data utilized 18,660 selected patients over 2 years and identified 314 AAAs. There were 41 factors identified in the medical record included in the machine-learning algorithm, with several factors never having been previously identified to be associated with AAAs. With an estimated 100 screening ultrasounds completed monthly, detection of AAAs is increased with a lift of 200% using the algorithm as compared with screening based on guidelines. The increased detection of AAAs in the model-selected individuals is statistically significant across all cutoff points. CONCLUSIONS: By utilizing a machine-learning model, we created a novel algorithm to detect patients who are at high risk for AAAs. By selecting individuals at greatest risk for targeted screening, this algorithm resulted in a 200% lift in the detection of AAAs when compared with standard screening guidelines. Using machine learning, we also identified several new factors associated with the presence of AAAs. This automated process has been integrated into our current workflows to improve screening rates and yield of high-risk individuals for AAAs.

Crowd-sourced machine learning prediction of long COVID using data from the National COVID Cohort Collaborative.

BACKGROUND: While many patients seem to recover from SARS-CoV-2 infections, many patients report experiencing SARS-CoV-2 symptoms for weeks or months after their acute COVID-19 ends, even developing new symptoms weeks after infection. These long-term effects are called post-acute sequelae of SARS-CoV-2 (PASC) or, more commonly, Long COVID. The overall prevalence of Long COVID is currently unknown, and tools are needed to help identify patients at risk for developing long COVID. METHODS: A working group of the Rapid Acceleration of Diagnostics-radical (RADx-rad) program, comprised of individuals from various NIH institutes and centers, in collaboration with REsearching COVID to Enhance Recovery (RECOVER) developed and organized the Long COVID Computational Challenge (L3C), a community challenge aimed at incentivizing the broader scientific community to develop interpretable and accurate methods for identifying patients at risk of developing Long COVID. From August 2022 to December 2022, participants developed Long COVID risk prediction algorithms using the National COVID Cohort Collaborative (N3C) data enclave, a harmonized data repository from over 75 healthcare institutions from across the United States (U.S.). FINDINGS: Over the course of the challenge, 74 teams designed and built 35 Long COVID prediction models using the N3C data enclave. The top 10 teams all scored above a 0.80 Area Under the Receiver Operator Curve (AUROC) with the highest scoring model achieving a mean AUROC of 0.895. Included in the top submission was a visualization dashboard that built timelines for each patient, updating the risk of a patient developing Long COVID in response to clinical events. INTERPRETATION: As a result of L3C, federal reviewers identified multiple machine learning models that can be used to identify patients at risk for developing Long COVID. Many of the teams used approaches in their submissions which can be applied to future clinical prediction questions. FUNDING: Research reported in this RADx® Rad publication was supported by the National Institutes of Health. Timothy Bergquist, Johanna Loomba, and Emily Pfaff were supported by Axle Subcontract: NCATS-STSS-P00438.