Clinical assessment of an AI tool for measuring biventricular parameters on cardiac MR.

Introduction: Cardiac magnetic resonance (CMR) is of diagnostic and prognostic value in a range of cardiopulmonary conditions. Current methods for evaluating CMR studies are laborious and time-consuming, contributing to delays for patients. As the demand for CMR increases, there is a growing need to automate this process. The application of artificial intelligence (AI) to CMR is promising, but the evaluation of these tools in clinical practice has been limited. This study assessed the clinical viability of an automatic tool for measuring cardiac volumes on CMR. Methods: Consecutive patients who underwent CMR for any indication between January 2022 and October 2022 at a single tertiary centre were included prospectively. For each case, short-axis CMR images were segmented by the AI tool and manually to yield volume, mass and ejection fraction measurements for both ventricles. Automated and manual measurements were compared for agreement and the quality of the automated contours was assessed visually by cardiac radiologists. Results: 462 CMR studies were included. No statistically significant difference was demonstrated between any automated and manual measurements (p > 0.05; independent T-test). Intraclass correlation coefficient and Bland-Altman analysis showed excellent agreement across all metrics (ICC > 0.85). The automated contours were evaluated visually in 251 cases, with agreement or minor disagreement in 229 cases (91.2%) and failed segmentation in only a single case (0.4%). The AI tool was able to provide automated contours in under 90 s. Conclusions: Automated segmentation of both ventricles on CMR by an automatic tool shows excellent agreement with manual segmentation performed by CMR experts in a retrospective real-world clinical cohort. Implementation of the tool could improve the efficiency of CMR reporting and reduce delays between imaging and diagnosis.

Establishing minimally important differences for cardiac MRI end-points in pulmonary arterial hypertension.

BACKGROUND: Cardiac magnetic resonance (CMR) is the gold standard technique to assess biventricular volumes and function, and is increasingly being considered as an end-point in clinical studies. Currently, with the exception of right ventricular (RV) stroke volume and RV end-diastolic volume, there is only limited data on minimally important differences (MIDs) reported for CMR metrics. Our study aimed to identify MIDs for CMR metrics based on US Food and Drug Administration recommendations for a clinical outcome measure that should reflect how a patient "feels, functions or survives". METHODS: Consecutive treatment-naïve patients with pulmonary arterial hypertension (PAH) between 2010 and 2022 who had two CMR scans (at baseline prior to treatment and 12 months following treatment) were identified from the ASPIRE registry. All patients were followed up for 1 additional year after the second scan. For both scans, cardiac measurements were obtained from a validated fully automated segmentation tool. The MID in CMR metrics was determined using two distribution-based (0.5sd and minimal detectable change) and two anchor-based (change difference and generalised linear model regression) methods benchmarked to how a patient "feels" (emPHasis-10 quality of life questionnaire), "functions" (incremental shuttle walk test) or "survives" for 1-year mortality to changes in CMR measurements. RESULTS: 254 patients with PAH were included (mean±sd age 53±16 years, 79% female and 66% categorised as intermediate risk based on the 2022 European Society of Cardiology/European Respiratory Society risk score). We identified a 5% absolute increase in RV ejection fraction and a 17 mL decrease in RV end-diastolic or end-systolic volumes as the MIDs for improvement. Conversely, a 5% decrease in RV ejection fraction and a 10 mL increase in RV volumes were associated with worsening. CONCLUSIONS: This study establishes clinically relevant CMR MIDs for how a patient "feels, functions or survives" in response to PAH treatment. These findings provide further support for the use of CMR as a clinically relevant clinical outcome measure and will aid trial size calculations for studies using CMR.

Plain language summaryPulmonary arterial hypertension (PAH) is a disease of the vessels of the lung that causes their narrowing and stiffening. As a result, the heart pumping blood into these diseased lung vessels has to work harder and eventually gets worn out. PAH can affect patients' ability to function in daily activities and impact their quality of life. It also reduces their life expectancy dramatically. Patients are, therefore, often monitored and undergo several investigations to adapt treatment according to their situation. These investigations include a survey of how a patient feels (the emPHasis-10 questionnaire), functions (walking test) and how well the heart is coping with the disease (MRI of the heart). Until now, it is unclear how changes on MRI of the heart reflect changes in how a patient feels and functions. Our study identified patients that had the emPHasis-10 questionnaire, walking test and MRI of the heart at both the time of PAH diagnosis and one year later. This allowed us to compare how the changes in the different tests relate to each other. And because previous research identified thresholds for important changes in the emPHasis-10 questionnaire and the walking tests, we were able to use these tests as a benchmark for changes in the MRI of the heart. Our study identified thresholds for change on heart MRI that might indicate whether a patient has improved or worsened. This finding might have implications for how patients are monitored in clinical practice and future research on PAH treatments.

Validation of Artificial Intelligence Cardiac MRI Measurements: Relationship to Heart Catheterization and Mortality Prediction.

Background Cardiac MRI measurements have diagnostic and prognostic value in the evaluation of cardiopulmonary disease. Artificial intelligence approaches to automate cardiac MRI segmentation are emerging but require clinical testing. Purpose To develop and evaluate a deep learning tool for quantitative evaluation of cardiac MRI functional studies and assess its use for prognosis in patients suspected of having pulmonary hypertension. Materials and Methods A retrospective multicenter and multivendor data set was used to develop a deep learning-based cardiac MRI contouring model using a cohort of patients suspected of having cardiopulmonary disease from multiple pathologic causes. Correlation with same-day right heart catheterization (RHC) and scan-rescan repeatability was assessed in prospectively recruited participants. Prognostic impact was assessed using Cox proportional hazard regression analysis of 3487 patients from the ASPIRE (Assessing the Severity of Pulmonary Hypertension In a Pulmonary Hypertension Referral Centre) registry, including a subset of 920 patients with pulmonary arterial hypertension. The generalizability of the automatic assessment was evaluated in 40 multivendor studies from 32 centers. Results The training data set included 539 patients (mean age, 54 years ± 20 [SD]; 315 women). Automatic cardiac MRI measurements were better correlated with RHC parameters than were manual measurements, including left ventricular stroke volume (r = 0.72 vs 0.68; P = .03). Interstudy repeatability of cardiac MRI measurements was high for all automatic measurements (intraclass correlation coefficient range, 0.79-0.99) and similarly repeatable to manual measurements (all paired t test P > .05). Automated right ventricle and left ventricle cardiac MRI measurements were associated with mortality in patients suspected of having pulmonary hypertension. Conclusion An automatic cardiac MRI measurement approach was developed and tested in a large cohort of patients, including a broad spectrum of right ventricular and left ventricular conditions, with internal and external testing. Fully automatic cardiac MRI assessment correlated strongly with invasive hemodynamics, had prognostic value, were highly repeatable, and showed excellent generalizability. Clinical trial registration no. NCT03841344 Published under a CC BY 4.0 license. Online supplemental material is available for this article. See also the editorial by Ambale-Venkatesh and Lima in this issue. An earlier incorrect version appeared online. This article was corrected on June 27, 2022.

Training and clinical testing of artificial intelligence derived right atrial cardiovascular magnetic resonance measurements.

BACKGROUND: Right atrial (RA) area predicts mortality in patients with pulmonary hypertension, and is recommended by the European Society of Cardiology/European Respiratory Society pulmonary hypertension guidelines. The advent of deep learning may allow more reliable measurement of RA areas to improve clinical assessments. The aim of this study was to automate cardiovascular magnetic resonance (CMR) RA area measurements and evaluate the clinical utility by assessing repeatability, correlation with invasive haemodynamics and prognostic value. METHODS: A deep learning RA area CMR contouring model was trained in a multicentre cohort of 365 patients with pulmonary hypertension, left ventricular pathology and healthy subjects. Inter-study repeatability (intraclass correlation coefficient (ICC)) and agreement of contours (DICE similarity coefficient (DSC)) were assessed in a prospective cohort (n = 36). Clinical testing and mortality prediction was performed in n = 400 patients that were not used in the training nor prospective cohort, and the correlation of automatic and manual RA measurements with invasive haemodynamics assessed in n = 212/400. Radiologist quality control (QC) was performed in the ASPIRE registry, n = 3795 patients. The primary QC observer evaluated all the segmentations and recorded them as satisfactory, suboptimal or failure. A second QC observer analysed a random subcohort to assess QC agreement (n = 1018). RESULTS: All deep learning RA measurements showed higher interstudy repeatability (ICC 0.91 to 0.95) compared to manual RA measurements (1st observer ICC 0.82 to 0.88, 2nd observer ICC 0.88 to 0.91). DSC showed high agreement comparing automatic artificial intelligence and manual CMR readers. Maximal RA area mean and standard deviation (SD) DSC metric for observer 1 vs observer 2, automatic measurements vs observer 1 and automatic measurements vs observer 2 is 92.4 ± 3.5 cm2, 91.2 ± 4.5 cm2 and 93.2 ± 3.2 cm2, respectively. Minimal RA area mean and SD DSC metric for observer 1 vs observer 2, automatic measurements vs observer 1 and automatic measurements vs observer 2 was 89.8 ± 3.9 cm2, 87.0 ± 5.8 cm2 and 91.8 ± 4.8 cm2. Automatic RA area measurements all showed moderate correlation with invasive parameters (r = 0.45 to 0.66), manual (r = 0.36 to 0.57). Maximal RA area could accurately predict elevated mean RA pressure low and high-risk thresholds (area under the receiver operating characteristic curve artificial intelligence = 0.82/0.87 vs manual = 0.78/0.83), and predicted mortality similar to manual measurements, both p < 0.01. In the QC evaluation, artificial intelligence segmentations were suboptimal at 108/3795 and a low failure rate of 16/3795. In a subcohort (n = 1018), agreement by two QC observers was excellent, kappa 0.84. CONCLUSION: Automatic artificial intelligence CMR derived RA size and function are accurate, have excellent repeatability, moderate associations with invasive haemodynamics and predict mortality.