A deep learning approach for fully automated cardiac shape modeling in tetralogy of Fallot.

BACKGROUND: Cardiac shape modeling is a useful computational tool that has provided quantitative insights into the mechanisms underlying dysfunction in heart disease. The manual input and time required to make cardiac shape models, however, limits their clinical utility. Here we present an end-to-end pipeline that uses deep learning for automated view classification, slice selection, phase selection, anatomical landmark localization, and myocardial image segmentation for the automated generation of three-dimensional, biventricular shape models. With this approach, we aim to make cardiac shape modeling a more robust and broadly applicable tool that has processing times consistent with clinical workflows. METHODS: Cardiovascular magnetic resonance (CMR) images from a cohort of 123 patients with repaired tetralogy of Fallot (rTOF) from two internal sites were used to train and validate each step in the automated pipeline. The complete automated pipeline was tested using CMR images from a cohort of 12 rTOF patients from an internal site and 18 rTOF patients from an external site. Manually and automatically generated shape models from the test set were compared using Euclidean projection distances, global ventricular measurements, and atlas-based shape mode scores. RESULTS: The mean absolute error (MAE) between manually and automatically generated shape models in the test set was similar to the voxel resolution of the original CMR images for end-diastolic models (MAE = 1.9 ± 0.5 mm) and end-systolic models (MAE = 2.1 ± 0.7 mm). Global ventricular measurements computed from automated models were in good agreement with those computed from manual models. The average mean absolute difference in shape mode Z-score between manually and automatically generated models was 0.5 standard deviations for the first 20 modes of a reference statistical shape atlas. CONCLUSIONS: Using deep learning, accurate three-dimensional, biventricular shape models can be reliably created. This fully automated end-to-end approach dramatically reduces the manual input required to create shape models, thereby enabling the rapid analysis of large-scale datasets and the potential to deploy statistical atlas-based analyses in point-of-care clinical settings. Training data and networks are available from cardiacatlas.org.

Non-invasive localization of post-infarct ventricular tachycardia exit sites to guide ablation planning: a computational deep learning platform utilizing the 12-lead electrocardiogram and intracardiac electrograms from implanted devices.

AIMS: Existing strategies that identify post-infarct ventricular tachycardia (VT) ablation target either employ invasive electrophysiological (EP) mapping or non-invasive modalities utilizing the electrocardiogram (ECG). Their success relies on localizing sites critical to the maintenance of the clinical arrhythmia, not always recorded on the 12-lead ECG. Targeting the clinical VT by utilizing electrograms (EGM) recordings stored in implanted devices may aid ablation planning, enhancing safety and speed and potentially reducing the need of VT induction. In this context, we aim to develop a non-invasive computational-deep learning (DL) platform to localize VT exit sites from surface ECGs and implanted device intracardiac EGMs. METHODS AND RESULTS: A library of ECGs and EGMs from simulated paced beats and representative post-infarct VTs was generated across five torso models. Traces were used to train DL algorithms to localize VT sites of earliest systolic activation; first tested on simulated data and then on a clinically induced VT to show applicability of our platform in clinical settings. Localization performance was estimated via localization errors (LEs) against known VT exit sites from simulations or clinical ablation targets. Surface ECGs successfully localized post-infarct VTs from simulated data with mean LE = 9.61 ± 2.61 mm across torsos. VT localization was successfully achieved from implanted device intracardiac EGMs with mean LE = 13.10 ± 2.36 mm. Finally, the clinically induced VT localization was in agreement with the clinical ablation volume. CONCLUSION: The proposed framework may be utilized for direct localization of post-infarct VTs from surface ECGs and/or implanted device EGMs, or in conjunction with efficient, patient-specific modelling, enhancing safety and speed of ablation planning.

Automated quantification of myocardial tissue characteristics from native T1 mapping using neural networks with uncertainty-based quality-control.

BACKGROUND: Tissue characterisation with cardiovascular magnetic resonance (CMR) parametric mapping has the potential to detect and quantify both focal and diffuse alterations in myocardial structure not assessable by late gadolinium enhancement. Native T1 mapping in particular has shown promise as a useful biomarker to support diagnostic, therapeutic and prognostic decision-making in ischaemic and non-ischaemic cardiomyopathies. METHODS: Convolutional neural networks (CNNs) with Bayesian inference are a category of artificial neural networks which model the uncertainty of the network output. This study presents an automated framework for tissue characterisation from native shortened modified Look-Locker inversion recovery ShMOLLI T1 mapping at 1.5 T using a Probabilistic Hierarchical Segmentation (PHiSeg) network (PHCUMIS 119-127, 2019). In addition, we use the uncertainty information provided by the PHiSeg network in a novel automated quality control (QC) step to identify uncertain T1 values. The PHiSeg network and QC were validated against manual analysis on a cohort of the UK Biobank containing healthy subjects and chronic cardiomyopathy patients (N=100 for the PHiSeg network and N=700 for the QC). We used the proposed method to obtain reference T1 ranges for the left ventricular (LV) myocardium in healthy subjects as well as common clinical cardiac conditions. RESULTS: T1 values computed from automatic and manual segmentations were highly correlated (r=0.97). Bland-Altman analysis showed good agreement between the automated and manual measurements. The average Dice metric was 0.84 for the LV myocardium. The sensitivity of detection of erroneous outputs was 91%. Finally, T1 values were automatically derived from 11,882 CMR exams from the UK Biobank. For the healthy cohort, the mean (SD) corrected T1 values were 926.61 (45.26), 934.39 (43.25) and 927.56 (50.36) for global, interventricular septum and free-wall respectively. CONCLUSIONS: The proposed pipeline allows for automatic analysis of myocardial native T1 mapping and includes a QC process to detect potentially erroneous results. T1 reference values were presented for healthy subjects and common clinical cardiac conditions from the largest cohort to date using T1-mapping images.

Improved co-registration of ex-vivo and in-vivo cardiovascular magnetic resonance images using heart-specific flexible 3D printed acrylic scaffold combined with non-rigid registration.

BACKGROUND: Ex-vivo cardiovascular magnetic resonance (CMR) imaging has played an important role in the validation of in-vivo CMR characterization of pathological processes. However, comparison between in-vivo and ex-vivo imaging remains challenging due to shape changes occurring between the two states, which may be non-uniform across the diseased heart. A novel two-step process to facilitate registration between ex-vivo and in-vivo CMR was developed and evaluated in a porcine model of chronic myocardial infarction (MI). METHODS: Seven weeks after ischemia-reperfusion MI, 12 swine underwent in-vivo CMR imaging with late gadolinium enhancement followed by ex-vivo CMR 1 week later. Five animals comprised the control group, in which ex-vivo imaging was undertaken without any support in the LV cavity, 7 animals comprised the experimental group, in which a two-step registration optimization process was undertaken. The first step involved a heart specific flexible 3D printed scaffold generated from in-vivo CMR, which was used to maintain left ventricular (LV) shape during ex-vivo imaging. In the second step, a non-rigid co-registration algorithm was applied to align in-vivo and ex-vivo data. Tissue dimension changes between in-vivo and ex-vivo imaging were compared between the experimental and control group. In the experimental group, tissue compartment volumes and thickness were compared between in-vivo and ex-vivo data before and after non-rigid registration. The effectiveness of the alignment was assessed quantitatively using the DICE similarity coefficient. RESULTS: LV cavity volume changed more in the control group (ratio of cavity volume between ex-vivo and in-vivo imaging in control and experimental group 0.14 vs 0.56, p < 0.0001) and there was a significantly greater change in the short axis dimensions in the control group (ratio of short axis dimensions in control and experimental group 0.38 vs 0.79, p < 0.001). In the experimental group, prior to non-rigid co-registration the LV cavity contracted isotropically in the ex-vivo condition by less than 20% in each dimension. There was a significant proportional change in tissue thickness in the healthy myocardium (change = 29 ± 21%), but not in dense scar (change = - 2 ± 2%, p = 0.034). Following the non-rigid co-registration step of the process, the DICE similarity coefficients for the myocardium, LV cavity and scar were 0.93 (±0.02), 0.89 (±0.01) and 0.77 (±0.07) respectively and the myocardial tissue and LV cavity volumes had a ratio of 1.03 and 1.00 respectively. CONCLUSIONS: The pattern of the morphological changes seen between the in-vivo and the ex-vivo LV differs between scar and healthy myocardium. A 3D printed flexible scaffold based on the in-vivo shape of the LV cavity is an effective strategy to minimize morphological changes in the ex-vivo LV. The subsequent non-rigid registration step further improved the co-registration and local comparison between in-vivo and ex-vivo data.

A Deep Learning-Based Integrated Framework for Quality-Aware Undersampled Cine Cardiac MRI Reconstruction and Analysis.

Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this article, we present a fully-automated, quality-controlled integrated framework for reconstruction, segmentation and downstream analysis of undersampled cine CMR data. The framework produces high quality reconstructions and segmentations, leading to undersampling factors that are optimised on a scan-by-scan basis. This results in reduced scan times and automated analysis, enabling robust and accurate estimation of functional biomarkers. To demonstrate the feasibility of the proposed approach, we perform simulations of radial k-space acquisitions using in-vivo cine CMR data from 270 subjects from the UK Biobank (with synthetic phase) and in-vivo cine CMR data from 16 healthy subjects (with real phase). The results demonstrate that the optimal undersampling factor varies for different subjects by approximately 1 to 2 seconds per slice. We show that our method can produce quality-controlled images in a mean scan time reduced from 12 to 4 seconds per slice, and that image quality is sufficient to allow clinically relevant parameters to be automatically estimated to lie within 5% mean absolute difference.

Addressing Deep Learning Model Calibration Using Evidential Neural Networks And Uncertainty-Aware Training.

In terms of accuracy, deep learning (DL) models have had considerable success in classification problems for medical imaging applications. However, it is well-known that the outputs of such models, which typically utilise the SoftMax function in the final classification layer can be over-confident, i.e. they are poorly calibrated. Two competing solutions to this problem have been proposed: uncertainty-aware training and evidential neural networks (ENNs). In this paper we perform an investigation into the improvements to model calibration that can be achieved by each of these approaches individually, and their combination. We perform experiments on two classification tasks: a simpler MNIST digit classification task and a more complex and realistic medical imaging artefact detection task using Phase Contrast Cardiac Magnetic Resonance images. The experimental results demonstrate that model calibration can suffer when the task becomes challenging enough to require a higher capacity model. However, in our complex artefact detection task we saw an improvement in calibration for both a low and higher capacity model when implementing both the ENN and uncertainty-aware training together, indicating that this approach can offer a promising way to improve calibration in such settings. The findings highlight the potential use of these approaches to improve model calibration in a complex application, which would in turn improve clinician trust in DL models.

Hemodynamic Determinants of Elevated Blood Pressure and Hypertension in the Middle to Older-Age UK Population: A UK Biobank Imaging Study.

BACKGROUND: Increased systemic vascular resistance and, in older people, reduced aortic distensibility, are thought to be the hemodynamic determinants of primary hypertension but cardiac output could also be important. We examined the hemodynamics of elevated blood pressure and hypertension in the middle to older-aged UK population participating in the UK Biobank imaging studies. METHODS: Cardiac output, systemic vascular resistance, and aortic distensibility were measured from cardiac magnetic resonance imaging in 31 112 (distensibility in 21 178) participants (46.3% male, mean age±SD 63±7 years). Body composition including visceral adipose tissue volume and abdominal subcutaneous adipose tissue volume were measured in 19 645 participants. RESULTS: Participants with higher blood pressure had higher cardiac output (higher by 17.9±26.6% in hypertensive compared with those with optimal blood pressure) and higher systemic vascular resistance (higher by 11.4±27.9% in hypertensive compared with those with optimal blood pressure). These differences were little changed after adjustment for body size and adiposity. The contribution of cardiac output relative to systemic vascular resistance was more marked in younger compared with older subjects. Aortic distensibility decreased with age and was lower in participants with higher compared with lower blood pressure but with a greater difference in younger compared with older subjects. CONCLUSIONS: In the middle to older-aged UK population, cardiac output plays an important role in contributing to elevated mean arterial blood pressure, particularly in younger compared with older subjects. Reduced aortic distensibility contributes to a rise in pulse pressure and systolic blood pressure at all ages.

Cardiac MRI to guide heart failure and atrial fibrillation drug discovery: a Mendelian randomization analysis.

Background: drug development and disease prevention of heart failure (HF) and atrial fibrillation (AF) are impeded by a lack of robust early-stage surrogates. We determined to what extent cardiac magnetic resonance (CMR) measurements act as surrogates for the development of HF or AF in healthy individuals. Methods: Genetic data was sourced on the association with 22 atrial and ventricular CMR measurements. Mendelian randomization was used to determine CMR associations with atrial fibrillation (AF), heart failure (HF), non-ischemic cardiomyopathy (CMP), and dilated cardiomyopathy (DCM). Additionally, for the CMR surrogates of AF and HF, we explored their association with non-cardiac traits. Results: In total we found that 9 CMR measures were associated with the development of HF, 7 with development of non-ischemic CMR, 6 with DCM, and 12 with AF. biventricular ejection fraction (EF), biventricular or end-systolic volumes (ESV) and left-ventricular (LV) end diastolic volume (EDV) were associated with all 4 cardiac outcomes. Increased LV-MVR (mass to volume ratio) affected HF (odds ratio (OR) 0.83, 95%CI 0.79; 0.88), and DCM (OR 0.26, 95%CI 0.20; 0.34. We were able to identify 9 CMR surrogates for HF and/or AF (including LV-MVR, biventricular EDV, ESV, and right-ventricular EF) which associated with non-cardiac traits such as blood pressure, lung function traits, BMI, cardioembolic stroke, and late-onset Alzheimer's disease. Conclusion: CMR measurements may act as surrogate endpoints for the development of HF (including non-ischemic CMP and DCM) or AF. Additionally, we show that changes in cardiac function and structure measured through CMR, may affect diseases of other organs leading to lung disease or late-onset Alzheimer's disease.

Cardiovascular imaging research priorities.

OBJECTIVES: Two interlinked surveys were organised by the British Heart Foundation Data Science Centre, which aimed to establish national priorities for cardiovascular imaging research. METHODS: First a single time point public survey explored their views of cardiovascular imaging research. Subsequently, a three-phase modified Delphi prioritisation exercise was performed by researchers and healthcare professionals. Research questions were submitted by a diverse range of stakeholders to the question 'What are the most important research questions that cardiovascular imaging should be used to address?'. Of these, 100 research questions were prioritised based on their positive impact for patients. The 32 highest rated questions were further prioritised based on three domains: positive impact for patients, potential to reduce inequalities in healthcare and ability to be implemented into UK healthcare practice in a timely manner. RESULTS: The public survey was completed by 354 individuals, with the highest rated areas relating to improving treatment, quality of life and diagnosis. In the second survey, 506 research questions were submitted by diverse stakeholders. Prioritisation was performed by 90 researchers or healthcare professionals in the first round and 64 in the second round. The highest rated questions were 'How do we ensure patients have equal access to cardiovascular imaging when it is needed?' and 'How can we use cardiovascular imaging to avoid invasive procedures'. There was general agreement between healthcare professionals and researchers regarding priorities for the positive impact for patients and least agreement for their ability to be implemented into UK healthcare practice in a timely manner. There was broad overlap between the prioritised research questions and the results of the public survey. CONCLUSIONS: We have identified priorities for cardiovascular imaging research, incorporating the views of diverse stakeholders. These priorities will be useful for researchers, funders and other organisations planning future research.

Uncertainty aware training to improve deep learning model calibration for classification of cardiac MR images.

Quantifying uncertainty of predictions has been identified as one way to develop more trustworthy artificial intelligence (AI) models beyond conventional reporting of performance metrics. When considering their role in a clinical decision support setting, AI classification models should ideally avoid confident wrong predictions and maximise the confidence of correct predictions. Models that do this are said to be well calibrated with regard to confidence. However, relatively little attention has been paid to how to improve calibration when training these models, i.e. to make the training strategy uncertainty-aware. In this work we: (i) evaluate three novel uncertainty-aware training strategies with regard to a range of accuracy and calibration performance measures, comparing against two state-of-the-art approaches, (ii) quantify the data (aleatoric) and model (epistemic) uncertainty of all models and (iii) evaluate the impact of using a model calibration measure for model selection in uncertainty-aware training, in contrast to the normal accuracy-based measures. We perform our analysis using two different clinical applications: cardiac resynchronisation therapy (CRT) response prediction and coronary artery disease (CAD) diagnosis from cardiac magnetic resonance (CMR) images. The best-performing model in terms of both classification accuracy and the most common calibration measure, expected calibration error (ECE) was the Confidence Weight method, a novel approach that weights the loss of samples to explicitly penalise confident incorrect predictions. The method reduced the ECE by 17% for CRT response prediction and by 22% for CAD diagnosis when compared to a baseline classifier in which no uncertainty-aware strategy was included. In both applications, as well as reducing the ECE there was a slight increase in accuracy from 69% to 70% and 70% to 72% for CRT response prediction and CAD diagnosis respectively. However, our analysis showed a lack of consistency in terms of optimal models when using different calibration measures. This indicates the need for careful consideration of performance metrics when training and selecting models for complex high risk applications in healthcare.

An artificial intelligence tool for automated analysis of large-scale unstructured clinical cine cardiac magnetic resonance databases.

Aims: Artificial intelligence (AI) techniques have been proposed for automating analysis of short-axis (SAX) cine cardiac magnetic resonance (CMR), but no CMR analysis tool exists to automatically analyse large (unstructured) clinical CMR datasets. We develop and validate a robust AI tool for start-to-end automatic quantification of cardiac function from SAX cine CMR in large clinical databases. Methods and results: Our pipeline for processing and analysing CMR databases includes automated steps to identify the correct data, robust image pre-processing, an AI algorithm for biventricular segmentation of SAX CMR and estimation of functional biomarkers, and automated post-analysis quality control to detect and correct errors. The segmentation algorithm was trained on 2793 CMR scans from two NHS hospitals and validated on additional cases from this dataset (n = 414) and five external datasets (n = 6888), including scans of patients with a range of diseases acquired at 12 different centres using CMR scanners from all major vendors. Median absolute errors in cardiac biomarkers were within the range of inter-observer variability: <8.4 mL (left ventricle volume), <9.2 mL (right ventricle volume), <13.3 g (left ventricular mass), and <5.9% (ejection fraction) across all datasets. Stratification of cases according to phenotypes of cardiac disease and scanner vendors showed good performance across all groups. Conclusion: We show that our proposed tool, which combines image pre-processing steps, a domain-generalizable AI algorithm trained on a large-scale multi-domain CMR dataset and quality control steps, allows robust analysis of (clinical or research) databases from multiple centres, vendors, and cardiac diseases. This enables translation of our tool for use in fully automated processing of large multi-centre databases.

Druggable proteins influencing cardiac structure and function: Implications for heart failure therapies and cancer cardiotoxicity.

Dysfunction of either the right or left ventricle can lead to heart failure (HF) and subsequent morbidity and mortality. We performed a genome-wide association study (GWAS) of 16 cardiac magnetic resonance (CMR) imaging measurements of biventricular function and structure. Cis-Mendelian randomization (MR) was used to identify plasma proteins associating with CMR traits as well as with any of the following cardiac outcomes: HF, non-ischemic cardiomyopathy, dilated cardiomyopathy (DCM), atrial fibrillation, or coronary heart disease. In total, 33 plasma proteins were prioritized, including repurposing candidates for DCM and/or HF: IL18R (providing indirect evidence for IL18), I17RA, GPC5, LAMC2, PA2GA, CD33, and SLAF7. In addition, 13 of the 25 druggable proteins (52%; 95% confidence interval, 0.31 to 0.72) could be mapped to compounds with known oncological indications or side effects. These findings provide leads to facilitate drug development for cardiac disease and suggest that cardiotoxicities of several cancer treatments might represent mechanism-based adverse effects.

Aortic Distensibility Measured by Automated Analysis of Magnetic Resonance Imaging Predicts Adverse Cardiovascular Events in UK Biobank.

Background Automated analysis of cardiovascular magnetic resonance images provides the potential to assess aortic distensibility in large populations. The aim of this study was to compare the prediction of cardiovascular events by automated cardiovascular magnetic resonance with those of other simple measures of aortic stiffness suitable for population screening. Methods and Results Aortic distensibility was measured from automated segmentation of aortic cine cardiovascular magnetic resonance using artificial intelligence in 8435 participants. The associations of distensibility, brachial pulse pressure, and stiffness index (obtained by finger photoplethysmography) with conventional risk factors was examined by multivariable regression and incident cardiovascular events by Cox proportional-hazards regression. Mean (±SD) distensibility values for men and women were 1.77±1.15 and 2.10±1.45 (P<0.0001) 10-3 mm Hg-1, respectively. There was a good correlation between automatically and manually obtained systolic and diastolic aortic areas (r=0.980 and r=0.985, respectively). In regression analysis, distensibility associated with age, mean arterial pressure, heart rate, weight, and plasma glucose but not male sex, cholesterol or current smoking. During an average follow-up of 2.8±1.3 years, 86 participants experienced cardiovascular events 6 of whom died. Higher distensibility was associated with reduced risk of cardiovascular events (adjusted hazard ratio [HR], 0.61 per log unit of distensibility; P=0.016). There was no evidence of an association between pulse pressure (adjusted HR 1.00; P=0.715) or stiffness index (adjusted HR, 1.02; P=0.535) and risk of cardiovascular events. Conclusions Automated cardiovascular magnetic resonance-derived aortic distensibility may be incorporated into routine clinical imaging. It shows a similar association to cardiovascular risk factors as other measures of arterial stiffness and predicts new-onset cardiovascular events, making it a useful tool for the measurement of vascular aging and associated cardiovascular risk.

Beyond Simpson's Rule: Accounting for Orientation and Ellipticity Assumptions.

Simpson's biplane rule (SBR) is considered the gold standard method for left ventricle (LV) volume quantification from echocardiography but relies on a summation-of-disks approach that makes assumptions about LV orientation and cross-sectional shape. We aim to identify key limiting factors in SBR and to develop a new robust standard for volume quantification. Three methods for computing LV volume were studied: (i) SBR, (ii) addition of a truncated basal cone (TBC) to SBR and (iii) a novel method of basal-oriented disks (BODs). Three retrospective cohorts representative of the young, adult healthy and heart failure populations were used to study the impact of anatomical variations in volume computations. Results reveal how basal slanting can cause over- and underestimation of volume, with errors by SBR and TBC >10 mL for slanting angles >6°. Only the BOD method correctly accounted for basal slanting, reducing relative volume errors by SBR from -2.23 ± 2.21% to -0.70 ± 1.91% in the adult population and similar qualitative performance in the other two cohorts. In conclusion, the summation of basal oriented disks, a novel interpretation of SBR, is a more accurate and precise method for estimating LV volume.

Fairness in Cardiac Magnetic Resonance Imaging: Assessing Sex and Racial Bias in Deep Learning-Based Segmentation.

Background: Artificial intelligence (AI) techniques have been proposed for automation of cine CMR segmentation for functional quantification. However, in other applications AI models have been shown to have potential for sex and/or racial bias. The objective of this paper is to perform the first analysis of sex/racial bias in AI-based cine CMR segmentation using a large-scale database. Methods: A state-of-the-art deep learning (DL) model was used for automatic segmentation of both ventricles and the myocardium from cine short-axis CMR. The dataset consisted of end-diastole and end-systole short-axis cine CMR images of 5,903 subjects from the UK Biobank database (61.5 ± 7.1 years, 52% male, 81% white). To assess sex and racial bias, we compared Dice scores and errors in measurements of biventricular volumes and function between patients grouped by race and sex. To investigate whether segmentation bias could be explained by potential confounders, a multivariate linear regression and ANCOVA were performed. Results: Results on the overall population showed an excellent agreement between the manual and automatic segmentations. We found statistically significant differences in Dice scores between races (white ∼94% vs. minority ethnic groups 86-89%) as well as in absolute/relative errors in volumetric and functional measures, showing that the AI model was biased against minority racial groups, even after correction for possible confounders. The results of a multivariate linear regression analysis showed that no covariate could explain the Dice score bias between racial groups. However, for the Mixed and Black race groups, sex showed a weak positive association with the Dice score. The results of an ANCOVA analysis showed that race was the main factor that can explain the overall difference in Dice scores between racial groups. Conclusion: We have shown that racial bias can exist in DL-based cine CMR segmentation models when training with a database that is sex-balanced but not race-balanced such as the UK Biobank.

A multimodal deep learning model for cardiac resynchronisation therapy response prediction.

We present a novel multimodal deep learning framework for cardiac resynchronisation therapy (CRT) response prediction from 2D echocardiography and cardiac magnetic resonance (CMR) data. The proposed method first uses the 'nnU-Net' segmentation model to extract segmentations of the heart over the full cardiac cycle from the two modalities. Next, a multimodal deep learning classifier is used for CRT response prediction, which combines the latent spaces of the segmentation models of the two modalities. At test time, this framework can be used with 2D echocardiography data only, whilst taking advantage of the implicit relationship between CMR and echocardiography features learnt from the model. We evaluate our pipeline on a cohort of 50 CRT patients for whom paired echocardiography/CMR data were available, and results show that the proposed multimodal classifier results in a statistically significant improvement in accuracy compared to the baseline approach that uses only 2D echocardiography data. The combination of multimodal data enables CRT response to be predicted with 77.38% accuracy (83.33% sensitivity and 71.43% specificity), which is comparable with the current state-of-the-art in machine learning-based CRT response prediction. Our work represents the first multimodal deep learning approach for CRT response prediction.

Prevalence and Disease Expression of Pathogenic and Likely Pathogenic Variants Associated With Inherited Cardiomyopathies in the General Population.

BACKGROUND: Pathogenic and likely pathogenic variants associated with arrhythmogenic right ventricular cardiomyopathy (ARVC), dilated cardiomyopathy (DCM), and hypertrophic cardiomyopathy (HCM) are recommended to be reported as secondary findings in genome sequencing studies. This provides opportunities for early diagnosis, but also fuels uncertainty in variant carriers (G+), since disease penetrance is incomplete. We assessed the prevalence and disease expression of G+ in the general population. METHODS: We identified pathogenic and likely pathogenic variants associated with ARVC, DCM and/or HCM in 200 643 UK Biobank individuals, who underwent whole exome sequencing. We calculated the prevalence of G+ and analyzed the frequency of cardiomyopathy/heart failure diagnosis. In undiagnosed individuals, we analyzed early signs of disease expression using available electrocardiography and cardiac magnetic resonance imaging data. RESULTS: We found a prevalence of 1:578, 1:251, and 1:149 for pathogenic and likely pathogenic variants associated with ARVC, DCM and HCM respectively. Compared with controls, cardiovascular mortality was higher in DCM G+ (odds ratio 1.67 [95% CI 1.04; 2.59], P=0.030), but similar in ARVC and HCM G+ (P≥0.100). Cardiomyopathy or heart failure diagnosis were more frequent in DCM G+ (odds ratio 3.66 [95% CI 2.24; 5.81], P=4.9×10-7) and HCM G+ (odds ratio 3.03 [95% CI 1.98; 4.56], P=5.8×10-7), but comparable in ARVC G+ (P=0.172). In contrast, ARVC G+ had more ventricular arrhythmias (P=3.3×10-4). In undiagnosed individuals, left ventricular ejection fraction was reduced in DCM G+ (P=0.009). CONCLUSIONS: In the general population, pathogenic and likely pathogenic variants associated with ARVC, DCM, or HCM are not uncommon. Although G+ have increased mortality and morbidity, disease penetrance in these carriers from the general population remains low (1.2-3.1%). Follow-up decisions in case of incidental findings should not be based solely on a variant, but on multiple factors, including family history and disease expression.

Deep Learning for Classification and Selection of Cine CMR Images to Achieve Fully Automated Quality-Controlled CMR Analysis From Scanner to Report.

Introduction: Deep learning demonstrates great promise for automated analysis of CMR. However, existing limitations, such as insufficient quality control and selection of target acquisitions from the full CMR exam, are holding back the introduction of deep learning tools in the clinical environment. This study aimed to develop a framework for automated detection and quality-controlled selection of standard cine sequences images from clinical CMR exams, prior to analysis of cardiac function. Materials and Methods: Retrospective study of 3,827 subjects that underwent CMR imaging. We used a total of 119,285 CMR acquisitions, acquired with scanners of different magnetic field strengths and from different vendors (1.5T Siemens and 1.5T and 3.0T Phillips). We developed a framework to select one good acquisition for each conventional cine class. The framework consisted of a first pre-processing step to exclude still acquisitions; two sequential convolutional neural networks (CNN), the first (CNNclass) to classify acquisitions in standard cine views (2/3/4-chamber and short axis), the second (CNNQC) to classify acquisitions according to image quality and orientation; a final algorithm to select one good acquisition of each class. For each CNN component, 7 state-of-the-art architectures were trained for 200 epochs, with cross entropy loss and data augmentation. Data were divided into 80% for training, 10% for validation, and 10% for testing. Results: CNNclass selected cine CMR acquisitions with accuracy ranging from 0.989 to 0.998. Accuracy of CNNQC reached 0.861 for 2-chamber, 0.806 for 3-chamber, and 0.859 for 4-chamber. The complete framework was presented with 379 new full CMR studies, not used for CNN training/validation/testing, and selected one good 2-, 3-, and 4-chamber acquisition from each study with sensitivity to detect erroneous cases of 89.7, 93.2, and 93.9%, respectively. Conclusions: We developed an accurate quality-controlled framework for automated selection of cine acquisitions prior to image analysis. This framework is robust and generalizable as it was developed on multivendor data and could be used at the beginning of a pipeline for automated cine CMR analysis to obtain full automatization from scanner to report.

Automated Localization of Focal Ventricular Tachycardia From Simulated Implanted Device Electrograms: A Combined Physics-AI Approach.

Background: Focal ventricular tachycardia (VT) is a life-threating arrhythmia, responsible for high morbidity rates and sudden cardiac death (SCD). Radiofrequency ablation is the only curative therapy against incessant VT; however, its success is dependent on accurate localization of its source, which is highly invasive and time-consuming. Objective: The goal of our study is, as a proof of concept, to demonstrate the possibility of utilizing electrogram (EGM) recordings from cardiac implantable electronic devices (CIEDs). To achieve this, we utilize fast and accurate whole torso electrophysiological (EP) simulations in conjunction with convolutional neural networks (CNNs) to automate the localization of focal VTs using simulated EGMs. Materials and Methods: A highly detailed 3D torso model was used to simulate ∼4000 focal VTs, evenly distributed across the left ventricle (LV), utilizing a rapid reaction-eikonal environment. Solutions were subsequently combined with lead field computations on the torso to derive accurate electrocardiograms (ECGs) and EGM traces, which were used as inputs to CNNs to localize focal sources. We compared the localization performance of a previously developed CNN architecture (Cartesian probability-based) with our novel CNN algorithm utilizing universal ventricular coordinates (UVCs). Results: Implanted device EGMs successfully localized VT sources with localization error (8.74 mm) comparable to ECG-based localization (6.69 mm). Our novel UVC CNN architecture outperformed the existing Cartesian probability-based algorithm (errors = 4.06 mm and 8.07 mm for ECGs and EGMs, respectively). Overall, localization was relatively insensitive to noise and changes in body compositions; however, displacements in ECG electrodes and CIED leads caused performance to decrease (errors 16-25 mm). Conclusion: EGM recordings from implanted devices may be used to successfully, and robustly, localize focal VT sources, and aid ablation planning.

Artificial Intelligence in Cardiac MRI: Is Clinical Adoption Forthcoming?

Artificial intelligence (AI) refers to the area of knowledge that develops computerised models to perform tasks that typically require human intelligence. These algorithms are programmed to learn and identify patterns from "training data," that can be subsequently applied to new datasets, without being explicitly programmed to do so. AI is revolutionising the field of medical imaging and in particular of Cardiovascular Magnetic Resonance (CMR) by providing deep learning solutions for image acquisition, reconstruction and analysis, ultimately supporting the clinical decision making. Numerous methods have been developed over recent years to enhance and expedite CMR data acquisition, image reconstruction, post-processing and analysis; along with the development of promising AI-based biomarkers for a wide spectrum of cardiac conditions. The exponential rise in the availability and complexity of CMR data has fostered the development of different AI models. Integration in clinical routine in a meaningful way remains a challenge. Currently, innovations in this field are still mostly presented in proof-of-concept studies with emphasis on the engineering solutions; often recruiting small patient cohorts or relying on standardised databases such as Multi-ethnic Study on atherosclerosis (MESA), UK Biobank and others. The wider incorporation of clinically valid endpoints such as symptoms, survival, need and response to treatment remains to be seen. This review briefly summarises the current principles of AI employed in CMR and explores the relevant prospective observational studies in cardiology patient cohorts. It provides an overview of clinical studies employing undersampled reconstruction techniques to speed up the scan encompassing cine imaging, whole-heart imaging, multi-parametric mapping and magnetic resonance fingerprinting along with the clinical utility of AI applications in image post-processing, and analysis. Specific focus is given to studies that have incorporated CMR-derived prediction models for prognostication in cardiac disease. It also discusses current limitations and proposes potential developments to enable multi-disciplinary collaboration for improved evidence-based medicine. AI is an extremely promising field and the timely integration of clinician's input in the ingenious technical investigator's paradigm holds promise for a bright future in the medical field.