Clinical usability of deep learning-based saliency maps for occlusion myocardial infarction identification from the prehospital 12-Lead electrocardiogram.

INTRODUCTION: Deep learning (DL) models offer improved performance in electrocardiogram (ECG)-based classification over rule-based methods. However, for widespread adoption by clinicians, explainability methods, like saliency maps, are essential. METHODS: On a subset of 100 ECGs from patients with chest pain, we generated saliency maps using a previously validated convolutional neural network for occlusion myocardial infarction (OMI) classification. Three clinicians reviewed ECG-saliency map dyads, first assessing the likelihood of OMI from standard ECGs and then evaluating clinical relevance and helpfulness of the saliency maps, as well as their confidence in the model's predictions. Questions were answered on a Likert scale ranging from +3 (most useful/relevant) to -3 (least useful/relevant). RESULTS: The adjudicated accuracy of the three clinicians matched the DL model when considering area under the receiver operating characteristics curve (AUC) and F1 score (AUC 0.855 vs. 0.872, F1 score = 0.789 vs. 0.747). On average, clinicians found saliency maps slightly clinically relevant (0.96 ± 0.92) and slightly helpful (0.66 ± 0.98) in identifying or ruling out OMI but had higher confidence in the model's predictions (1.71 ± 0.56). Clinicians noted that leads I and aVL were often emphasized, even when obvious ST changes were present in other leads. CONCLUSION: In this clinical usability study, clinicians deemed saliency maps somewhat helpful in enhancing explainability of DL-based ECG models. The spatial convolutional layers across the 12 leads in these models appear to contribute to the discrepancy between ECG segments considered most relevant by clinicians and segments that drove DL model predictions.

Use of Artificial Intelligence in Improving Outcomes in Heart Disease: A Scientific Statement From the American Heart Association.

A major focus of academia, industry, and global governmental agencies is to develop and apply artificial intelligence and other advanced analytical tools to transform health care delivery. The American Heart Association supports the creation of tools and services that would further the science and practice of precision medicine by enabling more precise approaches to cardiovascular and stroke research, prevention, and care of individuals and populations. Nevertheless, several challenges exist, and few artificial intelligence tools have been shown to improve cardiovascular and stroke care sufficiently to be widely adopted. This scientific statement outlines the current state of the art on the use of artificial intelligence algorithms and data science in the diagnosis, classification, and treatment of cardiovascular disease. It also sets out to advance this mission, focusing on how digital tools and, in particular, artificial intelligence may provide clinical and mechanistic insights, address bias in clinical studies, and facilitate education and implementation science to improve cardiovascular and stroke outcomes. Last, a key objective of this scientific statement is to further the field by identifying best practices, gaps, and challenges for interested stakeholders.

Ventricular tachycardia and in-hospital mortality in the intensive care unit.

Background: Continuous electrocardiographic (ECG) monitoring is used to identify ventricular tachycardia (VT), but false alarms occur frequently. Objective: The purpose of this study was to assess the rate of 30-day in-hospital mortality associated with VT alerts generated from bedside ECG monitors to those from a new algorithm among intensive care unit (ICU) patients. Methods: We conducted a retrospective cohort study in consecutive adult ICU patients at an urban academic medical center and compared current bedside monitor VT alerts, VT alerts from a new-unannotated algorithm, and true-annotated VT. We used survival analysis to explore the association between VT alerts and mortality. Results: We included 5679 ICU admissions (mean age 58 ± 17 years; 48% women), 503 (8.9%) experienced 30-day in-hospital mortality. A total of 30.1% had at least 1 current bedside monitor VT alert, 14.3% had a new-unannotated algorithm VT alert, and 11.6% had true-annotated VT. Bedside monitor VT alert was not associated with increased rate of 30-day mortality (adjusted hazard ratio [aHR] 1.06; 95% confidence interval [CI] 0.88-1.27), but there was an association for VT alerts from our new-unannotated algorithm (aHR 1.38; 95% CI 1.12-1.69) and true-annotated VT(aHR 1.39; 95% CI 1.12-1.73). Conclusion: Unannotated and annotated-true VT were associated with increased rate of 30-day in-hospital mortality, whereas current bedside monitor VT was not. Our new algorithm may accurately identify high-risk VT; however, prospective validation is needed.

Machine learning for ECG diagnosis and risk stratification of occlusion myocardial infarction.

Patients with occlusion myocardial infarction (OMI) and no ST-elevation on presenting electrocardiogram (ECG) are increasing in numbers. These patients have a poor prognosis and would benefit from immediate reperfusion therapy, but, currently, there are no accurate tools to identify them during initial triage. Here we report, to our knowledge, the first observational cohort study to develop machine learning models for the ECG diagnosis of OMI. Using 7,313 consecutive patients from multiple clinical sites, we derived and externally validated an intelligent model that outperformed practicing clinicians and other widely used commercial interpretation systems, substantially boosting both precision and sensitivity. Our derived OMI risk score provided enhanced rule-in and rule-out accuracy relevant to routine care, and, when combined with the clinical judgment of trained emergency personnel, it helped correctly reclassify one in three patients with chest pain. ECG features driving our models were validated by clinical experts, providing plausible mechanistic links to myocardial injury.

Unsupervised machine learning identifies symptoms of indigestion as a predictor of acute decompensation and adverse cardiac events in patients with heart failure presenting to the emergency department.

BACKGROUND: Patients with known heart failure (HF) present to emergency departments (ED) with a plethora of symptoms. Although symptom clusters have been suggested as prognostic features, accurately triaging HF patients is a longstanding challenge. OBJECTIVES: We sought to use machine learning to identify subtle phenotypes of patient symptoms and evaluate their diagnostic and prognostic value among HF patients seeking emergency care. METHODS: This was a secondary analysis of a prospective cohort study of consecutive patients seen in the ED for chest pain or equivalent symptoms. Independent reviewers extracted clinical data from charts, including nine categories of subjective symptoms reported during initial evaluation. The diagnostic outcome was acute HF exacerbation and prognostic outcome was 30-day major adverse cardiac events (MACE). Outcomes were adjudicated by two independent reviewers. K-means clustering was used to derive latent patient symptom clusters, and their associations with outcomes were assessed using multivariate logistic regression. RESULTS: Sample included 438 patients (age 65±14 years; 45% female, 49% Black, 18% HF exacerbation, 32% MACE). K-means clustering identified three presentation phenotypes: patients with dyspnea only (Cluster A, 40%); patients with indigestion, with or without dyspnea (Cluster B, 23%); patients with neither dyspnea nor indigestion (Cluster C, 37%). Compared to Cluster C, indigestion was a significant predictor of acute HF exacerbation (OR=1.8, 95%CI=1.0-3.4) and 30-day MACE (OR=1.8, 95%CI=1.0-3.1), independent of age, sex, race, and other comorbidities. CONCLUSION: Indigestion symptoms in patients with known HF signify excess risk of adverse events, suggesting that these patients should be triaged as high-risk during initial ED evaluation.

Incorporation of Serial 12-Lead Electrocardiogram With Machine Learning to Augment the Out-of-Hospital Diagnosis of Non-ST Elevation Acute Coronary Syndrome.

STUDY OBJECTIVE: Ischemic electrocardiogram (ECG) changes are subtle and transient in patients with suspected non-ST-segment elevation (NSTE)-acute coronary syndrome. However, the out-of-hospital ECG is not routinely used during subsequent evaluation at the emergency department. Therefore, we sought to compare the diagnostic performance of out-of-hospital and ED ECG and evaluate the incremental gain of artificial intelligence-augmented ECG analysis. METHODS: This prospective observational cohort study recruited patients with out-of-hospital chest pain. We retrieved out-of-hospital-ECG obtained by paramedics in the field and the first ED ECG obtained by nurses during inhospital evaluation. Two independent and blinded reviewers interpreted ECG dyads in mixed order per practice recommendations. Using 179 morphological ECG features, we trained, cross-validated, and tested a random forest classifier to augment non ST-elevation acute coronary syndrome (NSTE-ACS) diagnosis. RESULTS: Our sample included 2,122 patients (age 59 [16]; 53% women; 44% Black, 13.5% confirmed acute coronary syndrome). The rate of diagnostic ST elevation and ST depression were 5.9% and 16.2% on out-of-hospital-ECG and 6.1% and 12.4% on ED ECG, with ∼40% of changes seen on out-of-hospital-ECG persisting and ∼60% resolving. Using expert interpretation of out-of-hospital-ECG alone gave poor baseline performance with area under the receiver operating characteristic (AUC), sensitivity, and negative predictive values of 0.69, 0.50, and 0.92. Using expert interpretation of serial ECG changes enhanced this performance (AUC 0.80, sensitivity 0.61, and specificity 0.93). Interestingly, augmenting the out-of-hospital-ECG alone with artificial intelligence algorithms boosted its performance (AUC 0.83, sensitivity 0.75, and specificity 0.95), yielding a net reclassification improvement of 29.5% against expert ECG interpretation. CONCLUSION: In this study, 60% of diagnostic ST changes resolved prior to hospital arrival, making the ED ECG suboptimal for the inhospital evaluation of NSTE-ACS. Using serial ECG changes or incorporating artificial intelligence-augmented analyses would allow correctly reclassifying one in 4 patients with suspected NSTE-ACS.

Exploring decision making 'noise' when interpreting the electrocardiogram in the context of cardiac cath lab activation.

In this commentary paper, we discuss the use of the electrocardiogram to help clinicians make diagnostic and patient referral decisions in acute care settings. The paper discusses the factors that are likely to contribute to the variability and noise in the clinical decision making process for catheterization lab activation. These factors include the variable competence in reading ECGs, the intra/inter rater reliability, the lack of standard ECG training, the various ECG machine and filter settings, cognitive biases (such as automation bias which is the tendency to agree with the computer-aided diagnosis or AI diagnosis), the order of the information being received, tiredness or decision fatigue as well as ECG artefacts such as the signal noise or lead misplacement. We also discuss potential research questions and tools that could be used to mitigate this 'noise' and improve the quality of ECG based decision making.

Remote and wearable ECG devices with diagnostic abilities in adults: A state-of-the-science scoping review.

The electrocardiogram (ECG) records the electrical activity in the heart in real time, providing an important opportunity to detecting various cardiac pathologies. The 12-lead ECG currently serves as the "standard" ECG acquisition technique for diagnostic purposes for many cardiac pathologies other than arrhythmias. However, the technical aspects of acquiring a 12-lead ECG are not easy. and its usage currently is restricted to trained medical personnel, which limits the scope of its usefulness. Remote and wearable ECG devices have attempted to bridge this gap by enabling patients to take their own ECG using a simplified method at the expense of a reduced number of leads, usually a single-lead ECG. In this review, we summarize the studies that investigated the use of remote ECG devices and their clinical utility in diagnosing cardiac pathologies. Eligible studies discussed Food and Drug Administration-cleared, commercially available devices that were validated in an adult population. We summarize technical logistics of signal quality and device reliability, dimensional and functional features, and diagnostic value. Our synthesis shows that reduced-set ECG wearables have huge potential for long-term monitoring, particularly if paired with real-time notification techniques. Such capabilities make them primarily useful for abnormal rhythm detection, and there is sufficient evidence that a remote ECG device can be superior to the traditional 12-lead ECG in diagnosing specific arrhythmias such as atrial fibrillation. However, this review identifies important challenges faced by this technology and highlights the limited availability of clinical research examining their usefulness.

A clinician's guide to understanding and critically appraising machine learning studies: a checklist for Ruling Out Bias Using Standard Tools in Machine Learning (ROBUST-ML).

Developing functional machine learning (ML)-based models to address unmet clinical needs requires unique considerations for optimal clinical utility. Recent debates about the rigours, transparency, explainability, and reproducibility of ML models, terms which are defined in this article, have raised concerns about their clinical utility and suitability for integration in current evidence-based practice paradigms. This featured article focuses on increasing the literacy of ML among clinicians by providing them with the knowledge and tools needed to understand and critically appraise clinical studies focused on ML. A checklist is provided for evaluating the rigour and reproducibility of the four ML building blocks: data curation, feature engineering, model development, and clinical deployment. Checklists like this are important for quality assurance and to ensure that ML studies are rigourously and confidently reviewed by clinicians and are guided by domain knowledge of the setting in which the findings will be applied. Bridging the gap between clinicians, healthcare scientists, and ML engineers can address many shortcomings and pitfalls of ML-based solutions and their potential deployment at the bedside.

The role of machine learning applications in diagnosing and assessing critical and non-critical CHD: a scoping review.

Machine learning uses historical data to make predictions about new data. It has been frequently applied in healthcare to optimise diagnostic classification through discovery of hidden patterns in data that may not be obvious to clinicians. Congenital Heart Defect (CHD) machine learning research entails one of the most promising clinical applications, in which timely and accurate diagnosis is essential. The objective of this scoping review is to summarise the application and clinical utility of machine learning techniques used in paediatric cardiology research, specifically focusing on approaches aiming to optimise diagnosis and assessment of underlying CHD. Out of 50 full-text articles identified between 2015 and 2021, 40% focused on optimising the diagnosis and assessment of CHD. Deep learning and support vector machine were the most commonly used algorithms, accounting for an overall diagnostic accuracy > 0.80. Clinical applications primarily focused on the classification of auscultatory heart sounds, transthoracic echocardiograms, and cardiac MRIs. The range of these applications and directions of future research are discussed in this scoping review.