Evaluation of deep learning estimation of whole heart anatomy from automated cardiovascular magnetic resonance short- and long-axis analyses in UK Biobank.

AIMS: Standard methods of heart chamber volume estimation in cardiovascular magnetic resonance (CMR) typically utilize simple geometric formulae based on a limited number of slices. We aimed to evaluate whether an automated deep learning neural network prediction of 3D anatomy of all four chambers would show stronger associations with cardiovascular risk factors and disease than standard volume estimation methods in the UK Biobank. METHODS AND RESULTS: A deep learning network was adapted to predict 3D segmentations of left and right ventricles (LV, RV) and atria (LA, RA) at ∼1 mm isotropic resolution from CMR short- and long-axis 2D segmentations obtained from a fully automated machine learning pipeline in 4723 individuals with cardiovascular disease (CVD) and 5733 without in the UK Biobank. Relationships between volumes at end-diastole (ED) and end-systole (ES) and risk/disease factors were quantified using univariate, multivariate, and logistic regression analyses. Strength of association between deep learning volumes and standard volumes was compared using the area under the receiving operator characteristic curve (AUC). Univariate and multivariate associations between deep learning volumes and most risk and disease factors were stronger than for standard volumes (higher R2 and more significant P-values), particularly for sex, age, and body mass index. AUCs for all logistic regressions were higher for deep learning volumes than standard volumes (P < 0.001 for all four chambers at ED and ES). CONCLUSION: Neural network reconstructions of whole heart volumes had significantly stronger associations with CVD and risk factors than standard volume estimation methods in an automatic processing pipeline.

Hybrid artificial intelligence outcome prediction using features extraction from stress perfusion cardiac magnetic resonance images and electronic health records.

Background: Prediction of clinical outcomes in coronary artery disease (CAD) has been conventionally achieved using clinical risk factors. The relationship between imaging features and outcome is still not well understood. This study aims to use artificial intelligence to link image features with mortality outcome. Methods: A retrospective study was performed on patients who had stress perfusion cardiac magnetic resonance (SP-CMR) between 2011 and 2021. The endpoint was all-cause mortality. Convolutional neural network (CNN) was used to extract features from stress perfusion images, and multilayer perceptron (MLP) to extract features from electronic health records (EHRs), both networks were concatenated in a hybrid neural network (HNN) to predict study endpoint. Image CNN was trained to predict study endpoint directly from images. HNN and image CNN were compared with a linear clinical model using area under the curve (AUC), F1 scores, and McNemar's test. Results: Total of 1,286 cases were identified, with 201 death events (16%). The clinical model had good performance (AUC =80%, F1 score =37%). Best Image CNN model showed AUC =72% and F1 score =38%. HNN outperformed the other two models (AUC =82%, F1 score =43%). McNemar's test showed statistical difference between image CNN and both clinical model (P<0.01) and HNN (P<0.01). There was no significant difference between HNN and clinical model (P=0.15). Conclusions: Death in patients with suspected or known CAD can be predicted directly from stress perfusion images without clinical knowledge. Prediction can be improved by HNN that combines clinical and SP-CMR images.

Multi-Ethnic Study of Atherosclerosis: Relationship between Left Ventricular Shape at Cardiac MRI and 10-year Outcomes.

Background Left ventricular (LV) subclinical remodeling is associated with adverse outcomes and indicates mechanisms of disease development. Standard metrics such as LV mass and volumes may not capture the full range of remodeling. Purpose To quantify the relationship between LV three-dimensional shape at MRI and incident cardiovascular events over 10 years. Materials and Methods In this retrospective study, 5098 participants from the Multi-Ethnic Study of Atherosclerosis who were free of clinical cardiovascular disease underwent cardiac MRI from 2000 to 2002. LV shape models were automatically generated using a machine learning workflow. Event-specific remodeling signatures were computed using partial least squares regression, and random survival forests were used to determine which features were most associated with incident heart failure (HF), coronary heart disease (CHD), and cardiovascular disease (CVD) events over a 10-year follow-up period. The discrimination improvement of adding LV shape to traditional cardiovascular risk factors, coronary artery calcium scores, and N-terminal pro-brain natriuretic peptide levels was assessed using the index of prediction accuracy and time-dependent area under the receiver operating characteristic curve (AUC). Kaplan-Meier survival curves were used to illustrate the ability of remodeling signatures to predict the end points. Results Overall, 4618 participants had sufficient three-dimensional MRI information to generate patient-specific LV models (mean age, 60.6 years ± 9.9 [SD]; 2540 women). Among these participants, 147 had HF, 317 had CHD, and 455 had CVD events. The addition of LV remodeling signatures to traditional cardiovascular risk factors improved the mean AUC for 10-year survival prediction and achieved better performance than LV mass and volumes; HF (AUC, 0.83 ± 0.01 and 0.81 ± 0.01, respectively; P < .05), CHD (AUC, 0.77 ± 0.01 and 0.75 ± 0.01, respectively; P < .05), and CVD (AUC, 0.78 ± 0.0 and 0.76 ± 0.0, respectively; P < .05). Kaplan-Meier analysis demonstrated that participants with high-risk HF remodeling signatures had a 10-year survival rate of 56% compared with 95% for those with low-risk scores. Conclusion Left ventricular event-specific remodeling signatures were more predictive of heart failure, coronary heart disease, and cardiovascular disease events over 10 years than standard mass and volume measures and enable an automatic personalized medicine approach to tracking remodeling. © RSNA, 2022 Online supplemental material is available for this article.

Emerging Techniques in Cardiac Magnetic Resonance Imaging.

Cardiovascular disease is the leading cause of death and a significant contributor of health care costs. Noninvasive imaging plays an essential role in the management of patients with cardiovascular disease. Cardiac magnetic resonance (MR) can noninvasively assess heart and vascular abnormalities, including biventricular structure/function, blood hemodynamics, myocardial tissue composition, microstructure, perfusion, metabolism, coronary microvascular function, and aortic distensibility/stiffness. Its ability to characterize myocardial tissue composition is unique among alternative imaging modalities in cardiovascular disease. Significant growth in cardiac MR utilization, particularly in Europe in the last decade, has laid the necessary clinical groundwork to position cardiac MR as an important imaging modality in the workup of patients with cardiovascular disease. Although lack of availability, limited training, physician hesitation, and reimbursement issues have hampered widespread clinical adoption of cardiac MR in the United States, growing clinical evidence will ultimately overcome these challenges. Advances in cardiac MR techniques, particularly faster image acquisition, quantitative myocardial tissue characterization, and image analysis have been critical to its growth. In this review article, we discuss recent advances in established and emerging cardiac MR techniques that are expected to strengthen its capability in managing patients with cardiovascular disease. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 1.

Right-left ventricular shape variations in tetralogy of Fallot: associations with pulmonary regurgitation.

BACKGROUND: Relationships between right ventricular (RV) and left ventricular (LV) shape and function may be useful in determining optimal timing for pulmonary valve replacement in patients with repaired tetralogy of Fallot (rTOF). However, these are multivariate and difficult to quantify. We aimed to quantify variations in biventricular shape associated with pulmonary regurgitant volume (PRV) in rTOF using a biventricular atlas. METHODS: In this cross-sectional retrospective study, a biventricular shape model was customized to cardiovascular magnetic resonance (CMR) images from 88 rTOF patients (median age 16, inter-quartile range 11.8-24.3 years). Morphometric scores quantifying biventricular shape at end-diastole and end-systole were computed using principal component analysis. Multivariate linear regression was used to quantify biventricular shape associations with PRV, corrected for age, sex, height, and weight. Regional associations were confirmed by univariate correlations with distances and angles computed from the models, as well as global systolic strains computed from changes in arc length from end-diastole to end-systole. RESULTS: PRV was significantly associated with 5 biventricular morphometric scores, independent of covariates, and accounted for 12.3% of total shape variation (p < 0.05). Increasing PRV was associated with RV dilation and basal bulging, in conjunction with decreased LV septal-lateral dimension (LV flattening) and systolic septal motion towards the RV (all p < 0.05). Increased global RV radial, longitudinal, circumferential and LV radial systolic strains were significantly associated with increased PRV (all p < 0.05). CONCLUSION: A biventricular atlas of rTOF patients quantified multivariate relationships between left-right ventricular morphometry and wall motion with pulmonary regurgitation. Regional RV dilation, LV reduction, LV septal-lateral flattening and increased RV strain were all associated with increased pulmonary regurgitant volume. Morphometric scores provide simple metrics linking mechanisms for structural and functional alteration with important clinical indices.

Deep Learning Analysis of Cardiac MRI in Legacy Datasets: Multi-Ethnic Study of Atherosclerosis.

The Multi-Ethnic Study of Atherosclerosis (MESA), begun in 2000, was the first large cohort study to incorporate cardiovascular magnetic resonance (CMR) to study the mechanisms of cardiovascular disease in over 5,000 initially asymptomatic participants, and there is now a wealth of follow-up data over 20 years. However, the imaging technology used to generate the CMR images is no longer in routine use, and methods trained on modern data fail when applied to such legacy datasets. This study aimed to develop a fully automated CMR analysis pipeline that leverages the ability of machine learning algorithms to enable extraction of additional information from such a large-scale legacy dataset, expanding on the original manual analyses. We combined the original study analyses with new annotations to develop a set of automated methods for customizing 3D left ventricular (LV) shape models to each CMR exam and build a statistical shape atlas. We trained VGGNet convolutional neural networks using a transfer learning sequence between two-chamber, four-chamber, and short-axis MRI views to detect landmarks. A U-Net architecture was used to detect the endocardial and epicardial boundaries in short-axis images. The landmark detection network accurately predicted mitral valve and right ventricular insertion points with average error distance <2.5 mm. The agreement of the network with two observers was excellent (intraclass correlation coefficient >0.9). The segmentation network produced average Dice score of 0.9 for both myocardium and LV cavity. Differences between the manual and automated analyses were small, i.e., <1.0 ± 2.6 mL/m2 for indexed LV volume, 3.0 ± 6.4 g/m2 for indexed LV mass, and 0.6 ± 3.3% for ejection fraction. In an independent atlas validation dataset, the LV atlas built from the fully automated pipeline showed similar statistical relationships to an atlas built from the manual analysis. Hence, the proposed pipeline is not only a promising framework to automatically assess additional measures of ventricular function, but also to study relationships between cardiac morphologies and future cardiac events, in a large-scale population study.

Artificial Intelligence in Cardiac Imaging With Statistical Atlases of Cardiac Anatomy.

In many cardiovascular pathologies, the shape and motion of the heart provide important clues to understanding the mechanisms of the disease and how it progresses over time. With the advent of large-scale cardiac data, statistical modeling of cardiac anatomy has become a powerful tool to provide automated, precise quantification of the status of patient-specific heart geometry with respect to reference populations. Powered by supervised or unsupervised machine learning algorithms, statistical cardiac shape analysis can be used to automatically identify and quantify the severity of heart diseases, to provide morphometric indices that are optimally associated with clinical factors, and to evaluate the likelihood of adverse outcomes. Recently, statistical cardiac atlases have been integrated with deep neural networks to enable anatomical consistency of cardiac segmentation, registration, and automated quality control. These combinations have already shown significant improvements in performance and avoid gross anatomical errors that could make the results unusable. This current trend is expected to grow in the near future. Here, we aim to provide a mini review highlighting recent advances in statistical atlasing of cardiac function in the context of artificial intelligence in cardiac imaging.