RESUMEN
BACKGROUND: Timely diagnosis of structural heart disease improves patient outcomes, yet many remain underdiagnosed. While population screening with echocardiography is impractical, ECG-based prediction models can help target high-risk patients. We developed a novel ECG-based machine learning approach to predict multiple structural heart conditions, hypothesizing that a composite model would yield higher prevalence and positive predictive values to facilitate meaningful recommendations for echocardiography. METHODS: Using 2 232 130 ECGs linked to electronic health records and echocardiography reports from 484 765 adults between 1984 to 2021, we trained machine learning models to predict the presence or absence of any of 7 echocardiography-confirmed diseases within 1 year. This composite label included the following: moderate or severe valvular disease (aortic/mitral stenosis or regurgitation, tricuspid regurgitation), reduced ejection fraction <50%, or interventricular septal thickness >15 mm. We tested various combinations of input features (demographics, laboratory values, structured ECG data, ECG traces) and evaluated model performance using 5-fold cross-validation, multisite validation trained on 1 site and tested on 10 independent sites, and simulated retrospective deployment trained on pre-2010 data and deployed in 2010. RESULTS: Our composite rECHOmmend model used age, sex, and ECG traces and had a 0.91 area under the receiver operating characteristic curve and a 42% positive predictive value at 90% sensitivity, with a composite label prevalence of 17.9%. Individual disease models had area under the receiver operating characteristic curves from 0.86 to 0.93 and lower positive predictive values from 1% to 31%. Area under the receiver operating characteristic curves for models using different input features ranged from 0.80 to 0.93, increasing with additional features. Multisite validation showed similar results to cross-validation, with an aggregate area under the receiver operating characteristic curve of 0.91 across our independent test set of 10 clinical sites after training on a separate site. Our simulated retrospective deployment showed that for ECGs acquired in patients without preexisting structural heart disease in the year 2010, 11% were classified as high risk and 41% (4.5% of total patients) developed true echocardiography-confirmed disease within 1 year. CONCLUSIONS: An ECG-based machine learning model using a composite end point can identify a high-risk population for having undiagnosed, clinically significant structural heart disease while outperforming single-disease models and improving practical utility with higher positive predictive values. This approach can facilitate targeted screening with echocardiography to improve underdiagnosis of structural heart disease.
Asunto(s)
Cardiopatías , Aprendizaje Automático , Adulto , Ecocardiografía , Electrocardiografía , Cardiopatías/diagnóstico por imagen , Cardiopatías/epidemiología , Humanos , Estudios RetrospectivosRESUMEN
BACKGROUND: Several large trials have employed age or clinical features to select patients for atrial fibrillation (AF) screening to reduce strokes. We hypothesized that a machine learning (ML) model trained to predict AF risk from 12lead electrocardiogram (ECG) would be more efficient than criteria based on clinical variables in indicating a population for AF screening to potentially prevent AF-related stroke. METHODS: We retrospectively included all patients with clinical encounters in Geisinger without a prior history of AF. Incidence of AF within 1 year and AF-related strokes within 3 years of the encounter were identified. AF-related stroke was defined as a stroke where AF was diagnosed at the time of stroke or within a year after the stroke. The efficiency of five methods was evaluated for selecting a cohort for AF screening. The methods were selected from four clinical trials (mSToPS, GUARD-AF, SCREEN-AF and STROKESTOP) and the ECG-based ML model. We simulated patient selection for the five methods between the years 2011 and 2014 and evaluated outcomes for 1 year intervals between 2012 and 2015, resulting in a total of twenty 1-year periods. Patients were considered eligible if they met the criteria before the start of the given 1-year period or within that period. The primary outcomes were numbers needed to screen (NNS) for AF and AF-associated stroke. RESULTS: The clinical trial models indicated large proportions of the population with a prior ECG for AF screening (up to 31%), coinciding with NNS ranging from 14 to 18 for AF and 249-359 for AF-associated stroke. At comparable sensitivity, the ECG ML model indicated a modest number of patients for screening (14%) and had the highest efficiency in NNS for AF (7.3; up to 60% reduction) and AF-associated stroke (223; up to 38% reduction). CONCLUSIONS: An ECG-based ML risk prediction model is more efficient than contemporary AF-screening criteria based on age alone or age and clinical features at indicating a population for AF screening to potentially prevent AF-related strokes.
Asunto(s)
Fibrilación Atrial , Accidente Cerebrovascular , Humanos , Fibrilación Atrial/complicaciones , Fibrilación Atrial/diagnóstico , Fibrilación Atrial/tratamiento farmacológico , Electrocardiografía , Estudios Retrospectivos , Tamizaje Masivo , Accidente Cerebrovascular/diagnósticoRESUMEN
BACKGROUND: Atrial fibrillation (AF) is associated with substantial morbidity, especially when it goes undetected. If new-onset AF could be predicted, targeted screening could be used to find it early. We hypothesized that a deep neural network could predict new-onset AF from the resting 12-lead ECG and that this prediction may help identify those at risk of AF-related stroke. METHODS: We used 1.6 M resting 12-lead digital ECG traces from 430 000 patients collected from 1984 to 2019. Deep neural networks were trained to predict new-onset AF (within 1 year) in patients without a history of AF. Performance was evaluated using areas under the receiver operating characteristic curve and precision-recall curve. We performed an incidence-free survival analysis for a period of 30 years following the ECG stratified by model predictions. To simulate real-world deployment, we trained a separate model using all ECGs before 2010 and evaluated model performance on a test set of ECGs from 2010 through 2014 that were linked to our stroke registry. We identified the patients at risk for AF-related stroke among those predicted to be high risk for AF by the model at different prediction thresholds. RESULTS: The area under the receiver operating characteristic curve and area under the precision-recall curve were 0.85 and 0.22, respectively, for predicting new-onset AF within 1 year of an ECG. The hazard ratio for the predicted high- versus low-risk groups over a 30-year span was 7.2 (95% CI, 6.9-7.6). In a simulated deployment scenario, the model predicted new-onset AF at 1 year with a sensitivity of 69% and specificity of 81%. The number needed to screen to find 1 new case of AF was 9. This model predicted patients at high risk for new-onset AF in 62% of all patients who experienced an AF-related stroke within 3 years of the index ECG. CONCLUSIONS: Deep learning can predict new-onset AF from the 12-lead ECG in patients with no previous history of AF. This prediction may help identify patients at risk for AF-related strokes.
Asunto(s)
Fibrilación Atrial/diagnóstico , Aprendizaje Profundo/normas , Accidente Cerebrovascular/etiología , Fibrilación Atrial/complicaciones , Electrocardiografía , Femenino , Humanos , Masculino , Redes Neurales de la Computación , Accidente Cerebrovascular/mortalidad , Análisis de SupervivenciaRESUMEN
Machine learning promises to assist physicians with predictions of mortality and of other future clinical events by learning complex patterns from historical data, such as longitudinal electronic health records. Here we show that a convolutional neural network trained on raw pixel data in 812,278 echocardiographic videos from 34,362 individuals provides superior predictions of one-year all-cause mortality. The model's predictions outperformed the widely used pooled cohort equations, the Seattle Heart Failure score (measured in an independent dataset of 2,404 patients with heart failure who underwent 3,384 echocardiograms), and a machine learning model involving 58 human-derived variables from echocardiograms and 100 clinical variables derived from electronic health records. We also show that cardiologists assisted by the model substantially improved the sensitivity of their predictions of one-year all-cause mortality by 13% while maintaining prediction specificity. Large unstructured datasets may enable deep learning to improve a wide range of clinical prediction models.
Asunto(s)
Aprendizaje Profundo , Ecocardiografía/estadística & datos numéricos , Insuficiencia Cardíaca/diagnóstico por imagen , Insuficiencia Cardíaca/mortalidad , Interpretación de Imagen Asistida por Computador/estadística & datos numéricos , Anciano , Bases de Datos Factuales , Ecocardiografía/métodos , Registros Electrónicos de Salud/estadística & datos numéricos , Femenino , Insuficiencia Cardíaca/patología , Humanos , Masculino , Persona de Mediana Edad , Curva ROC , Estudios Retrospectivos , Análisis de SupervivenciaRESUMEN
BACKGROUND: Heart failure is a prevalent, costly disease for which new value-based payment models demand optimized population management strategies. OBJECTIVES: This study sought to generate a strategy for managing populations of patients with heart failure by leveraging large clinical datasets and machine learning. METHODS: Geisinger electronic health record data were used to train machine learning models to predict 1-year all-cause mortality in 26,971 patients with heart failure who underwent 276,819 clinical episodes. There were 26 clinical variables (demographics, laboratory test results, medications), 90 diagnostic codes, 41 electrocardiogram measurements and patterns, 44 echocardiographic measurements, and 8 evidence-based "care gaps": flu vaccine, blood pressure of <130/80 mm Hg, A1c of <8%, cardiac resynchronization therapy, and active medications (active angiotensin-converting enzyme inhibitor/angiotensin II receptor blocker/angiotensin receptor-neprilysin inhibitor, aldosterone receptor antagonist, hydralazine, and evidence-based beta-blocker) were collected. Care gaps represented actionable variables for which associations with all-cause mortality were modeled from retrospective data and then used to predict the benefit of prospective interventions in 13,238 currently living patients. RESULTS: Machine learning models achieved areas under the receiver-operating characteristic curve (AUCs) of 0.74 to 0.77 in a split-by-year training/test scheme, with the nonlinear XGBoost model (AUC: 0.77) outperforming linear logistic regression (AUC: 0.74). Out of 13,238 currently living patients, 2,844 were predicted to die within a year, and closing all care gaps was predicted to save 231 of these lives. Prioritizing patients for intervention by using the predicted reduction in 1-year mortality risk outperformed all other priority rankings (e.g., random selection or Seattle Heart Failure risk score). CONCLUSIONS: Machine learning can be used to priority-rank patients most likely to benefit from interventions to optimize evidence-based therapies. This approach may prove useful for optimizing heart failure population health management teams within value-based payment models.
Asunto(s)
Manejo de la Enfermedad , Insuficiencia Cardíaca/terapia , Aprendizaje Automático , Vigilancia de la Población/métodos , Medición de Riesgo/métodos , Anciano , Anciano de 80 o más Años , Femenino , Insuficiencia Cardíaca/epidemiología , Humanos , Masculino , Persona de Mediana Edad , Morbilidad/tendencias , Curva ROC , Estudios Retrospectivos , Estados Unidos/epidemiologíaRESUMEN
The electrocardiogram (ECG) is a widely used medical test, consisting of voltage versus time traces collected from surface recordings over the heart1. Here we hypothesized that a deep neural network (DNN) can predict an important future clinical event, 1-year all-cause mortality, from ECG voltage-time traces. By using ECGs collected over a 34-year period in a large regional health system, we trained a DNN with 1,169,662 12-lead resting ECGs obtained from 253,397 patients, in which 99,371 events occurred. The model achieved an area under the curve (AUC) of 0.88 on a held-out test set of 168,914 patients, in which 14,207 events occurred. Even within the large subset of patients (n = 45,285) with ECGs interpreted as 'normal' by a physician, the performance of the model in predicting 1-year mortality remained high (AUC = 0.85). A blinded survey of cardiologists demonstrated that many of the discriminating features of these normal ECGs were not apparent to expert reviewers. Finally, a Cox proportional-hazard model revealed a hazard ratio of 9.5 (P < 0.005) for the two predicted groups (dead versus alive 1 year after ECG) over a 25-year follow-up period. These results show that deep learning can add substantial prognostic information to the interpretation of 12-lead resting ECGs, even in cases that are interpreted as normal by physicians.