A review of evaluation approaches for explainable AI with applications in cardiology.

Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This review details the evaluation of XAI in cardiac AI applications and has found that, of the studies examined, 37% evaluated XAI quality using literature results, 11% used clinicians as domain-experts, 11% used proxies or statistical analysis, with the remaining 43% not assessing the XAI used at all. We aim to inspire additional studies within healthcare, urging researchers not only to apply XAI methods but to systematically assess the resulting explanations, as a step towards developing trustworthy and safe models. Supplementary Information: The online version contains supplementary material available at 10.1007/s10462-024-10852-w.

Myocardial Strain Measured by Cardiac Magnetic Resonance Predicts Cardiovascular Morbidity and Death.

BACKGROUND: Myocardial strain using cardiac magnetic resonance (CMR) is a sensitive marker for predicting adverse outcomes in many cardiac disease states, but the prognostic value in the general population has not been studied conclusively. OBJECTIVES: The goal of this study was to assess the independent prognostic value of CMR feature tracking (FT)-derived LV global longitudinal (GLS), circumferential (GCS), and radial strain (GRS) metrics in predicting adverse outcomes (heart failure, myocardial infarction, stroke, and death). METHODS: Participants from the UK Biobank population imaging study were included. Univariable and multivariable Cox models were used for each outcome and each strain marker (GLS, GCS, GRS) separately. The multivariable models were tested with adjustment for prognostically important clinical features and conventional global LV imaging markers relevant for each outcome. RESULTS: Overall, 45,700 participants were included in the study (average age 65 ± 8 years), with a median follow-up period of 3 years. All univariable and multivariable models demonstrated that lower absolute GLS, GCS, and GRS were associated with increased incidence of heart failure, myocardial infarction, stroke, and death. All strain markers were independent predictors (incrementally above some respective conventional LV imaging markers) for the morbidity outcomes, but only GLS predicted death independently: (HR: 1.18; 95% CI: 1.07-1.30). CONCLUSIONS: In the general population, LV strain metrics derived using CMR-FT in radial, circumferential, and longitudinal directions are strongly and independently predictive of heart failure, myocardial infarction, and stroke, but only GLS is independently predictive of death in an adult population cohort.

Left Ventricular Trabeculations at Cardiac MRI: Reference Ranges and Association with Cardiovascular Risk Factors in UK Biobank.

Background The extent of left ventricular (LV) trabeculation and its relationship with cardiovascular (CV) risk factors is unclear. Purpose To apply automated segmentation to UK Biobank cardiac MRI scans to (a) assess the association between individual characteristics and CV risk factors and trabeculated LV mass (LVM) and (b) establish normal reference ranges in a selected group of healthy UK Biobank participants. Materials and Methods In this cross-sectional secondary analysis, prospectively collected data from the UK Biobank (2006 to 2010) were retrospectively analyzed. Automated segmentation of trabeculations was performed using a deep learning algorithm. After excluding individuals with known CV diseases, White adults without CV risk factors (reference group) and those with preexisting CV risk factors (hypertension, hyperlipidemia, diabetes mellitus, or smoking) (exposed group) were compared. Multivariable regression models, adjusted for potential confounders (age, sex, and height), were fitted to evaluate the associations between individual characteristics and CV risk factors and trabeculated LVM. Results Of 43 038 participants (mean age, 64 years ± 8 [SD]; 22 360 women), 28 672 individuals (mean age, 66 years ± 7; 14 918 men) were included in the exposed group, and 7384 individuals (mean age, 60 years ± 7; 4729 women) were included in the reference group. Higher body mass index (BMI) (ß = 0.66 [95% CI: 0.63, 0.68]; P < .001), hypertension (ß = 0.42 [95% CI: 0.36, 0.48]; P < .001), and higher physical activity level (ß = 0.15 [95% CI: 0.12, 0.17]; P < .001) were associated with higher trabeculated LVM. In the reference group, the median trabeculated LVM was 6.3 g (IQR, 4.7-8.5 g) for men and 4.6 g (IQR, 3.4-6.0 g) for women. Median trabeculated LVM decreased with age for men from 6.5 g (IQR, 4.8-8.7 g) at age 45-50 years to 5.9 g (IQR, 4.3-7.8 g) at age 71-80 years (P = .03). Conclusion Higher trabeculated LVM was observed with hypertension, higher BMI, and higher physical activity level. Age- and sex-specific reference ranges of trabeculated LVM in a healthy middle-aged White population were established. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Kawel-Boehm in this issue.

Phenotyping left ventricular systolic dysfunction in asymptomatic individuals for improved risk stratification.

AIMS: Left ventricular systolic dysfunction (LSVD) is a heterogeneous condition with several factors influencing prognosis. Better phenotyping of asymptomatic individuals can inform preventative strategies. This study aims to explore the clinical phenotypes of LVSD in initially asymptomatic subjects and their association with clinical outcomes and cardiovascular abnormalities through multi-dimensional data clustering. METHODS AND RESULTS: Clustering analysis was performed on 60 clinically available variables from 1563 UK Biobank participants without pre-existing heart failure (HF) and with left ventricular ejection fraction (LVEF) < 50% on cardiovascular magnetic resonance (CMR) assessment. Risks of developing HF, other cardiovascular events, death, and a composite of major adverse cardiovascular events (MACE) associated with clusters were investigated. Cardiovascular imaging characteristics, not included in the clustering analysis, were also evaluated. Three distinct clusters were identified, differing considerably in lifestyle habits, cardiovascular risk factors, electrocardiographic parameters, and cardiometabolic profiles. A stepwise increase in risk profile was observed from Cluster 1 to Cluster 3, independent of traditional risk factors and LVEF. Compared with Cluster 1, the lowest risk subset, the risk of MACE ranged from 1.42 [95% confidence interval (CI): 1.03-1.96; P < 0.05] for Cluster 2 to 1.72 (95% CI: 1.36-2.35; P < 0.001) for Cluster 3. Cluster 3, the highest risk profile, had features of adverse cardiovascular imaging with the greatest LV re-modelling, myocardial dysfunction, and decrease in arterial compliance. CONCLUSIONS: Clustering of clinical variables identified three distinct risk profiles and clinical trajectories of LVSD amongst initially asymptomatic subjects. Improved characterization may facilitate tailored interventions based on the LVSD sub-type and improve clinical outcomes.

Ischemic Heart Disease and Vascular Risk Factors Are Associated With Accelerated Brain Aging.

BACKGROUND: Ischemic heart disease (IHD) has been linked with poor brain outcomes. The brain magnetic resonance imaging-derived difference between predicted brain age and actual chronological age (brain-age delta in years, positive for accelerated brain aging) may serve as an effective means of communicating brain health to patients to promote healthier lifestyles. OBJECTIVES: The authors investigated the impact of prevalent IHD on brain aging, potential underlying mechanisms, and its relationship with dementia risk, vascular risk factors, cardiovascular structure, and function. METHODS: Brain age was estimated in subjects with prevalent IHD (n = 1,341) using a Bayesian ridge regression model with 25 structural (volumetric) brain magnetic resonance imaging features and built using UK Biobank participants with no prevalent IHD (n = 35,237). RESULTS: Prevalent IHD was linked to significantly accelerated brain aging (P < 0.001) that was not fully mediated by microvascular injury. Brain aging (positive brain-age delta) was associated with increased risk of dementia (OR: 1.13 [95% CI: 1.04-1.22]; P = 0.002), vascular risk factors (such as diabetes), and high adiposity. In the absence of IHD, brain aging was also associated with cardiovascular structural and functional changes typically observed in aging hearts. However, such alterations were not linked with risk of dementia. CONCLUSIONS: Prevalent IHD and coexisting vascular risk factors are associated with accelerated brain aging and risk of dementia. Positive brain-age delta representing accelerated brain aging may serve as an effective communication tool to show the impact of modifiable risk factors and disease supporting preventative strategies.

Mitral Annular Disjunction Assessed Using CMR Imaging: Insights From the UK Biobank Population Study.

BACKGROUND: Mitral annular disjunction is the atrial displacement of the mural mitral valve leaflet hinge point within the atrioventricular junction. Said to be associated with malignant ventricular arrhythmias and sudden death, its prevalence in the general population is not known. OBJECTIVES: The purpose of this study was to assess the frequency of occurrence and extent of mitral annular disjunction in a large population cohort. METHODS: The authors assessed the cardiac magnetic resonance (CMR) images in 2,646 Caucasian subjects enrolled in the UK Biobank imaging study, measuring the length of disjunction at 4 points around the mitral annulus, assessing for presence of prolapse or billowing of the leaflets, and for curling motion of the inferolateral left ventricular wall. RESULTS: From 2,607 included participants, the authors found disjunction in 1,990 (76%) cases, most commonly at the anterior and inferior ventricular wall. The authors found inferolateral disjunction, reported as clinically important, in 134 (5%) cases. Prolapse was more frequent in subjects with disjunction (odds ratio [OR]: 2.5; P = 0.02), with positive associations found between systolic curling and disjunction at any site (OR: 3.6; P < 0.01), and systolic curling and prolapse (OR: 71.9; P < 0.01). CONCLUSIONS: This large-scale study shows that disjunction is a common finding when using CMR. Disjunction at the inferolateral ventricular wall, however, was rare. The authors found associations between disjunction and both prolapse and billowing of the mural mitral valve leaflet. These findings support the notion that only extensive inferolateral disjunction, when found, warrants consideration of further investigation, but disjunction elsewhere in the annulus should be considered a normal finding.

Predicting post-contrast information from contrast agent free cardiac MRI using machine learning: Challenges and methods.

Objectives: Currently, administering contrast agents is necessary for accurately visualizing and quantifying presence, location, and extent of myocardial infarction (MI) with cardiac magnetic resonance (CMR). In this study, our objective is to investigate and analyze pre- and post-contrast CMR images with the goal of predicting post-contrast information using pre-contrast information only. We propose methods and identify challenges. Methods: The study population consists of 272 retrospectively selected CMR studies with diagnoses of MI (n = 108) and healthy controls (n = 164). We describe a pipeline for pre-processing this dataset for analysis. After data feature engineering, 722 cine short-axis (SAX) images and segmentation mask pairs were used for experimentation. This constitutes 506, 108, and 108 pairs for the training, validation, and testing sets, respectively. We use deep learning (DL) segmentation (UNet) and classification (ResNet50) models to discover the extent and location of the scar and classify between the ischemic cases and healthy cases (i.e., cases with no regional myocardial scar) from the pre-contrast cine SAX image frames, respectively. We then capture complex data patterns that represent subtle signal and functional changes in the cine SAX images due to MI using optical flow, rate of change of myocardial area, and radiomics data. We apply this dataset to explore two supervised learning methods, namely, the support vector machines (SVM) and the decision tree (DT) methods, to develop predictive models for classifying pre-contrast cine SAX images as being a case of MI or healthy. Results: Overall, for the UNet segmentation model, the performance based on the mean Dice score for the test set (n = 108) is 0.75 (±0.20) for the endocardium, 0.51 (±0.21) for the epicardium and 0.20 (±0.17) for the scar. For the classification task, the accuracy, F1 and precision scores of 0.68, 0.69, and 0.64, respectively, were achieved with the SVM model, and of 0.62, 0.63, and 0.72, respectively, with the DT model. Conclusion: We have presented some promising approaches involving DL, SVM, and DT methods in an attempt to accurately predict contrast information from non-contrast images. While our initial results are modest for this challenging task, this area of research still poses several open problems.

Quantification of Epicardial Adipose Tissue Volume and Attenuation for Cardiac CT Scans Using Deep Learning in a Single Multi-Task Framework.

Background: Recent studies have shown that epicardial adipose tissue (EAT) is an independent atrial fibrillation (AF) prognostic marker and has influence on the myocardial function. In computed tomography (CT), EAT volume (EATv) and density (EATd) are parameters that are often used to quantify EAT. While increased EATv has been found to correlate with the prevalence and the recurrence of AF after ablation therapy, higher EATd correlates with inflammation due to arrest of lipid maturation and with high risk of plaque presence and plaque progression. Automation of the quantification task diminishes the variability in readings introduced by different observers in manual quantification and results in high reproducibility of studies and less time-consuming analysis. Our objective is to develop a fully automated quantification of EATv and EATd using a deep learning (DL) framework. Methods: We proposed a framework that consists of image classification and segmentation DL models and performs the task of selecting images with EAT from all the CT images acquired for a patient, and the task of segmenting the EAT from the output images of the preceding task. EATv and EATd are estimated using the segmentation masks to define the region of interest. For our experiments, a 300-patient dataset was divided into two subsets, each consisting of 150 patients: Dataset 1 (41,979 CT slices) for training the DL models, and Dataset 2 (36,428 CT slices) for evaluating the quantification of EATv and EATd. Results: The classification model achieved accuracies of 98% for precision, recall and F 1 scores, and the segmentation model achieved accuracies in terms of mean ( ± std.) and median dice similarity coefficient scores of 0.844 ( ± 0.19) and 0.84, respectively. Using the evaluation set (Dataset 2), our approach resulted in a Pearson correlation coefficient of 0.971 ( R 2 = 0.943) between the label and predicted EATv, and the correlation coefficient of 0.972 ( R 2 = 0.945) between the label and predicted EATd. Conclusions: We proposed a framework that provides a fast and robust strategy for accurate EAT segmentation, and volume (EATv) and attenuation (EATd) quantification tasks. The framework will be useful to clinicians and other practitioners for carrying out reproducible EAT quantification at patient level or for large cohorts and high-throughput projects.

New Imaging Signatures of Cardiac Alterations in Ischaemic Heart Disease and Cerebrovascular Disease Using CMR Radiomics.

Background: Ischaemic heart disease (IHD) and cerebrovascular disease are two closely inter-related clinical entities. Cardiovascular magnetic resonance (CMR) radiomics may capture subtle cardiac changes associated with these two diseases providing new insights into the brain-heart interactions. Objective: To define the CMR radiomics signatures for IHD and cerebrovascular disease and study their incremental value for disease discrimination over conventional CMR indices. Methods: We analysed CMR images of UK Biobank's subjects with pre-existing IHD, ischaemic cerebrovascular disease, myocardial infarction (MI), and ischaemic stroke (IS) (n = 779, 267, 525, and 107, respectively). Each disease group was compared with an equal number of healthy controls. We extracted 446 shape, first-order, and texture radiomics features from three regions of interest (right ventricle, left ventricle, and left ventricular myocardium) in end-diastole and end-systole defined from segmentation of short-axis cine images. Systematic feature selection combined with machine learning (ML) algorithms (support vector machine and random forest) and 10-fold cross-validation tests were used to build the radiomics signature for each condition. We compared the discriminatory power achieved by the radiomics signature with conventional indices for each disease group, using the area under the curve (AUC), receiver operating characteristic (ROC) analysis, and paired t-test for statistical significance. A third model combining both radiomics and conventional indices was also evaluated. Results: In all the study groups, radiomics signatures provided a significantly better disease discrimination than conventional indices, as suggested by AUC (IHD:0.82 vs. 0.75; cerebrovascular disease: 0.79 vs. 0.77; MI: 0.87 vs. 0.79, and IS: 0.81 vs. 0.72). Similar results were observed with the combined models. In IHD and MI, LV shape radiomics were dominant. However, in IS and cerebrovascular disease, the combination of shape and intensity-based features improved the disease discrimination. A notable overlap of the radiomics signatures of IHD and cerebrovascular disease was also found. Conclusions: This study demonstrates the potential value of CMR radiomics over conventional indices in detecting subtle cardiac changes associated with chronic ischaemic processes involving the brain and heart, even in the presence of more heterogeneous clinical pictures. Radiomics analysis might also improve our understanding of the complex mechanisms behind the brain-heart interactions during ischaemia.

Brain age estimation at tract group level and its association with daily life measures, cardiac risk factors and genetic variants.

Brain age can be estimated using different Magnetic Resonance Imaging (MRI) modalities including diffusion MRI. Recent studies demonstrated that white matter (WM) tracts that share the same function might experience similar alterations. Therefore, in this work, we sought to investigate such issue focusing on five WM bundles holding that feature that is Association, Brainstem, Commissural, Limbic and Projection fibers, respectively. For each tract group, we estimated brain age for 15,335 healthy participants from United Kingdom Biobank relying on diffusion MRI data derived endophenotypes, Bayesian ridge regression modeling and 10 fold-cross validation. Furthermore, we estimated brain age for an Ensemble model that gathers all the considered WM bundles. Association analysis was subsequently performed between the estimated brain age delta as resulting from the six models, that is for each tract group as well as for the Ensemble model, and 38 daily life style measures, 14 cardiac risk factors and cardiovascular magnetic resonance imaging features and genetic variants. The Ensemble model that used all tracts from all fiber groups (FG) performed better than other models to estimate brain age. Limbic tracts based model reached the highest accuracy with a Mean Absolute Error (MAE) of 5.08, followed by the Commissural ([Formula: see text]), Association ([Formula: see text]), and Projection ([Formula: see text]) ones. The Brainstem tracts based model was the less accurate achieving a MAE of 5.86. Accordingly, our study suggests that the Limbic tracts experience less brain aging or allows for more accurate estimates compared to other tract groups. Moreover, the results suggest that Limbic tract leads to the largest number of significant associations with daily lifestyle factors than the other tract groups. Lastly, two SNPs were significantly (p value [Formula: see text]) associated with brain age delta in the Projection fibers. Those SNPs are mapped to HIST1H1A and SLC17A3 genes.

Medical image segmentation automatic quality control: A multi-dimensional approach.

In clinical applications, using erroneous segmentations of medical images can have dramatic consequences. Current approaches dedicated to medical image segmentation automatic quality control do not predict segmentation quality at slice-level (2D), resulting in sub-optimal evaluations. Our 2D-based deep learning method simultaneously performs quality control at 2D-level and 3D-level for cardiovascular MR image segmentations. We compared it with 3D approaches by training both on 36,540 (2D) / 3842 (3D) samples to predict Dice Similarity Coefficients (DSC) for 4 different structures from the left ventricle, i.e., trabeculations (LVT), myocardium (LVM), papillary muscles (LVPM) and blood (LVC). The 2D-based method outperformed the 3D method. At the 2D-level, the mean absolute errors (MAEs) of the DSC predictions for 3823 samples, were 0.02, 0.02, 0.05 and 0.02 for LVM, LVC, LVT and LVPM, respectively. At the 3D-level, for 402 samples, the corresponding MAEs were 0.02, 0.01, 0.02 and 0.04. The method was validated in a clinical practice evaluation against semi-qualitative scores provided by expert cardiologists for 1016 subjects of the UK BioBank. Finally, we provided evidence that a multi-level QC could be used to enhance clinical measurements derived from image segmentations.

Adverse cardiovascular magnetic resonance phenotypes are associated with greater likelihood of incident coronavirus disease 2019: findings from the UK Biobank.

BACKGROUND: Coronavirus disease 2019 (COVID-19) disproportionately affects older people. Observational studies suggest indolent cardiovascular involvement after recovery from acute COVID-19. However, these findings may reflect pre-existing cardiac phenotypes. AIMS: We tested the association of baseline cardiovascular magnetic resonance (CMR) phenotypes with incident COVID-19. METHODS: We studied UK Biobank participants with CMR imaging and COVID-19 testing. We considered left and right ventricular (LV, RV) volumes, ejection fractions, and stroke volumes, LV mass, LV strain, native T1, aortic distensibility, and arterial stiffness index. COVID-19 test results were obtained from Public Health England. Co-morbidities were ascertained from self-report and hospital episode statistics (HES). Critical care admission and death were from HES and death register records. We investigated the association of each cardiovascular measure with COVID-19 test result in multivariable logistic regression models adjusting for age, sex, ethnicity, deprivation, body mass index, smoking, diabetes, hypertension, high cholesterol, and prior myocardial infarction. RESULTS: We studied 310 participants (n = 70 positive). Median age was 63.8 [57.5, 72.1] years; 51.0% (n = 158) were male. 78.7% (n = 244) were tested in hospital, 3.5% (n = 11) required critical care admission, and 6.1% (n = 19) died. In fully adjusted models, smaller LV/RV end-diastolic volumes, smaller LV stroke volume, and poorer global longitudinal strain were associated with significantly higher odds of COVID-19 positivity. DISCUSSION: We demonstrate association of pre-existing adverse CMR phenotypes with greater odds of COVID-19 positivity independent of classical cardiovascular risk factors. CONCLUSIONS: Observational reports of cardiovascular involvement after COVID-19 may, at least partly, reflect pre-existing cardiac status rather than COVID-19 induced alterations.

A Systematic Quality Scoring Analysis to Assess Automated Cardiovascular Magnetic Resonance Segmentation Algorithms.

BACKGROUND: The quantitative measures used to assess the performance of automated methods often do not reflect the clinical acceptability of contouring. A quality-based assessment of automated cardiac magnetic resonance (CMR) segmentation more relevant to clinical practice is therefore needed. OBJECTIVE: We propose a new method for assessing the quality of machine learning (ML) outputs. We evaluate the clinical utility of the proposed method as it is employed to systematically analyse the quality of an automated contouring algorithm. METHODS: A dataset of short-axis (SAX) cine CMR images from a clinically heterogeneous population (n = 217) were manually contoured by a team of experienced investigators. On the same images we derived automated contours using a ML algorithm. A contour quality scoring application randomly presented manual and automated contours to four blinded clinicians, who were asked to assign a quality score from a predefined rubric. Firstly, we analyzed the distribution of quality scores between the two contouring methods across all clinicians. Secondly, we analyzed the interobserver reliability between the raters. Finally, we examined whether there was a variation in scores based on the type of contour, SAX slice level, and underlying disease. RESULTS: The overall distribution of scores between the two methods was significantly different, with automated contours scoring better than the manual (OR (95% CI) = 1.17 (1.07-1.28), p = 0.001; n = 9401). There was substantial scoring agreement between raters for each contouring method independently, albeit it was significantly better for automated segmentation (automated: AC2 = 0.940, 95% CI, 0.937-0.943 vs manual: AC2 = 0.934, 95% CI, 0.931-0.937; p = 0.006). Next, the analysis of quality scores based on different factors was performed. Our approach helped identify trends patterns of lower segmentation quality as observed for left ventricle epicardial and basal contours with both methods. Similarly, significant differences in quality between the two methods were also found in dilated cardiomyopathy and hypertension. CONCLUSIONS: Our results confirm the ability of our systematic scoring analysis to determine the clinical acceptability of automated contours. This approach focused on the contours' clinical utility could ultimately improve clinicians' confidence in artificial intelligence and its acceptability in the clinical workflow.