Cardiovascular Magnetic Resonance Radiomics to Identify Components of the Extracellular Matrix in Dilated Cardiomyopathy.

BACKGROUND: Current cardiovascular magnetic resonance sequences cannot discriminate between different myocardial extracellular space (ECSs), including collagen, noncollagen, and inflammation. We sought to investigate whether cardiovascular magnetic resonance radiomics analysis can distinguish between noncollagen and inflammation from collagen in dilated cardiomyopathy. METHODS: We identified data from 132 patients with dilated cardiomyopathy scheduled for an invasive septal biopsy who underwent cardiovascular magnetic resonance at 3 T. Cardiovascular magnetic resonance imaging protocol included native and postcontrast T1 mapping and late gadolinium enhancement (LGE). Radiomic features were computed from the midseptal myocardium, near the biopsy region, on native T1, extracellular volume (ECV) map, and LGE images. Principal component analysis was used to reduce the number of radiomic features to 5 principal radiomics. Moreover, a correlation analysis was conducted to identify radiomic features exhibiting a strong correlation (r>0.9) with the 5 principal radiomics. Biopsy samples were used to quantify ECS, myocardial fibrosis, and inflammation. RESULTS: Four histopathological phenotypes were identified: low collagen (n=20), noncollagenous ECS expansion (n=49), mild to moderate collagenous ECS expansion (n=42), and severe collagenous ECS expansion (n=21). Noncollagenous expansion was associated with the highest risk of myocardial inflammation (65%). Although native T1 and ECV provided high diagnostic performance in differentiating severe fibrosis (C statistic, 0.90 and 0.90, respectively), their performance in differentiating between noncollagen and mild to moderate collagenous expansion decreased (C statistic: 0.59 and 0.55, respectively). Integration of ECV principal radiomics provided better discrimination and reclassification between noncollagen and mild to moderate collagen (C statistic, 0.79; net reclassification index, 0.83 [95% CI, 0.45-1.22]; P<0.001). There was a similar trend in the addition of native T1 principal radiomics (C statistic, 0.75; net reclassification index, 0.93 [95% CI, 0.56-1.29]; P<0.001) and LGE principal radiomics (C statistic, 0.74; net reclassification index, 0.59 [95% CI, 0.19-0.98]; P=0.004). Five radiomic features per sequence were identified with correlation analysis. They showed a similar improvement in performance for differentiating between noncollagen and mild to moderate collagen (native T1, ECV, LGE C statistic, 0.75, 0.77, and 0.71, respectively). These improvements remained significant when confined to a single radiomic feature (native T1, ECV, LGE C statistic, 0.71, 0.70, and 0.64, respectively). CONCLUSIONS: Radiomic features extracted from native T1, ECV, and LGE provide incremental information that improves our capability to discriminate noncollagenous expansion from mild to moderate collagen and could be useful for detecting subtle chronic inflammation in patients with dilated cardiomyopathy.

Scanner-Independent MyoMapNet for Accelerated Cardiac MRI T1 Mapping Across Vendors and Field Strengths.

BACKGROUND: In cardiac T1 mapping, a series of T1 -weighted (T1 w) images are collected and numerically fitted to a two or three-parameter model of the signal recovery to estimate voxel-wise T1 values. To reduce the scan time, one can collect fewer T1 w images, albeit at the cost of precision or/and accuracy. Recently, the feasibility of using a neural network instead of conventional two- or three-parameter fit modeling has been demonstrated. However, prior studies used data from a single vendor and field strength; therefore, the generalizability of the models has not been established. PURPOSE: To develop and evaluate an accelerated cardiac T1 mapping approach based on MyoMapNet, a convolution neural network T1 estimator that can be used across different vendors and field strengths by incorporating the relevant scanner information as additional inputs to the model. STUDY TYPE: Retrospective, multicenter. POPULATION: A total of 1423 patients with known or suspected cardiac disease (808 male, 57 ± 16 years), from three centers, two vendors (Siemens, Philips), and two field strengths (1.5 T, 3 T). The data were randomly split into 60% training, 20% validation, and 20% testing. FIELD STRENGTH/SEQUENCE: A 1.5 T and 3 T, Modified Look-Locker inversion recovery (MOLLI) for native and postcontrast T1 . ASSESSMENT: Scanner-independent MyoMapNet (SI-MyoMapNet) was developed by altering the deep learning (DL) architecture of MyoMapNet to incorporate scanner vendor and field strength as inputs. Epicardial and endocardial contours and blood pool (by manually drawing a large region of interest in the blood pool) of the left ventricle were manually delineated by three readers, with 2, 8, and 9 years of experience, and SI-MyoMapNet myocardial and blood pool T1 values (calculated from four T1 w images) were compared with conventional MOLLI T1 values (calculated from 8 to 11 T1 w images). STATISTICAL TESTS: Equivalency test with 95% confidence interval (CI), linear regression slope, Pearson correlation coefficient (r), Bland-Altman analysis. RESULTS: The proposed SI-MyoMapNet successfully created T1 maps. Native and postcontrast T1 values measured from SI-MyoMapNet were strongly correlated with MOLLI, despite using only four T1 w images, at both field-strengths and vendors (all r > 0.86). For native T1 , SI-MyoMapNet and MOLLI were in good agreement for myocardial and blood T1 values in institution 1 (myocardium: 5 msec, 95% CI [3, 8]; blood: -10 msec, 95%CI [-16, -4]), in institution 2 (myocardium: 6 msec, 95% CI [0, 11]; blood: 0 msec, [-18, 17]), and in institution 3 (myocardium: 7 msec, 95% CI [-8, 22]; blood: 8 msec, [-14, 30]). Similar results were observed for postcontrast T1 . DATA CONCLUSION: Inclusion of field strength and vendor as additional inputs to the DL architecture allows generalizability of MyoMapNet across different vendors or field strength. EVIDENCE LEVEL: 2. TECHNICAL EFFICACY: Stage 2.

Accelerated Cardiac MRI Cine with Use of Resolution Enhancement Generative Adversarial Inline Neural Network.

Background Cardiac cine can benefit from deep learning-based image reconstruction to reduce scan time and/or increase spatial and temporal resolution. Purpose To develop and evaluate a deep learning model that can be combined with parallel imaging or compressed sensing (CS). Materials and Methods The deep learning model was built on the enhanced super-resolution generative adversarial inline neural network, trained with use of retrospectively identified cine images and evaluated in participants prospectively enrolled from September 2021 to September 2022. The model was applied to breath-hold electrocardiography (ECG)-gated segmented and free-breathing real-time cine images collected with reduced spatial resolution with use of generalized autocalibrating partially parallel acquisitions (GRAPPA) or CS. The deep learning model subsequently restored spatial resolution. For comparison, GRAPPA-accelerated cine images were collected. Diagnostic quality and artifacts were evaluated by two readers with use of Likert scales and compared with use of Wilcoxon signed-rank tests. Agreement for left ventricle (LV) function, volume, and strain was assessed with Bland-Altman analysis. Results The deep learning model was trained on 1616 patients (mean age ± SD, 56 years ± 16; 920 men) and evaluated in 181 individuals, 126 patients (mean age, 57 years ± 16; 77 men) and 55 healthy subjects (mean age, 27 years ± 10; 15 men). In breath-hold ECG-gated segmented cine and free-breathing real-time cine, the deep learning model and GRAPPA showed similar diagnostic quality scores (2.9 vs 2.9, P = .41, deep learning vs GRAPPA) and artifact score (4.4 vs 4.3, P = .55, deep learning vs GRAPPA). Deep learning acquired more sections per breath-hold than GRAPPA (3.1 vs one section, P < .001). In free-breathing real-time cine, the deep learning showed a similar diagnostic quality score (2.9 vs 2.9, P = .21, deep learning vs GRAPPA) and lower artifact score (3.9 vs 4.3, P < .001, deep learning vs GRAPPA). For both sequences, the deep learning model showed excellent agreement for LV parameters, with near-zero mean differences and narrow limits of agreement compared with GRAPPA. Conclusion Deep learning-accelerated cardiac cine showed similarly accurate quantification of cardiac function, volume, and strain to a standardized parallel imaging method. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Vannier and Wang in this issue.

Improving accuracy of myocardial T1 estimation in MyoMapNet.

PURPOSE: To improve the accuracy and robustness of T1 estimation by MyoMapNet, a deep learning-based approach using 4 inversion-recovery T1 -weighted images for cardiac T1 mapping. METHODS: MyoMapNet is a fully connected neural network for T1 estimation of an accelerated cardiac T1 mapping sequence, which collects 4 T1 -weighted images by a single Look-Locker inversion-recovery experiment (LL4). MyoMapNet was originally trained using in vivo data from the modified Look-Locker inversion recovery sequence, which resulted in significant bias and sensitivity to various confounders. This study sought to train MyoMapNet using signals generated from numerical simulations and phantom MR data under multiple simulated confounders. The trained model was then evaluated by phantom data scanned using new phantom vials that differed from those used for training. The performance of the new model was compared with modified Look-Locker inversion recovery sequence and saturation-recovery single-shot acquisition for measuring native and postcontrast T1 in 25 subjects. RESULTS: In the phantom study, T1 values measured by LL4 with MyoMapNet were highly correlated with reference values from the spin-echo sequence. Furthermore, the estimated T1 had excellent robustness to changes in flip angle and off-resonance. Native and postcontrast myocardium T1 at 3 Tesla measured by saturation-recovery single-shot acquisition, modified Look-Locker inversion recovery sequence, and MyoMapNet were 1483 ± 46.6 ms and 791 ± 45.8 ms, 1169 ± 49.0 ms and 612 ± 36.0 ms, and 1443 ± 57.5 ms and 700 ± 57.5 ms, respectively. The corresponding extracellular volumes were 22.90% ± 3.20%, 28.88% ± 3.48%, and 30.65% ± 3.60%, respectively. CONCLUSION: Training MyoMapNet with numerical simulations and phantom data will improve the estimation of myocardial T1 values and increase its robustness to confounders while also reducing the overall T1 mapping estimation time to only 4 heartbeats.

Quantification of changes in myocardial T1 * values with exercise cardiac MRI using a free-breathing non-electrocardiograph radial imaging.

PURPOSE: To develop and evaluate a free breathing non-electrocardiograph (ECG) myocardial T1 * mapping sequence using radial imaging to quantify the changes in myocardial T1 * between rest and exercise (T1 *reactivity ) in exercise cardiac MRI (Ex-CMR). METHODS: A free-running T1 * sequence was developed using a saturation pulse followed by three Look-Locker inversion-recovery experiments. Each Look-Locker continuously acquired data as radial trajectory using a low flip-angle spoiled gradient-echo readout. Self-navigation was performed with a temporal resolution of ∼100 ms for retrospectively extracting respiratory motion. The mid-diastole phase for every cardiac cycle was retrospectively detected on the recorded electrocardiogram signal using an empirical model. Multiple measurements were performed to obtain mean value to reduce effects from the free-breathing acquisition. Finally, data acquired at both mid-diastole and end-expiration are picked and reconstructed by a low-rank plus sparsity constraint algorithm. The performance of this sequence was evaluated by simulations, phantoms, and in vivo studies at rest and after physiological exercise. RESULTS: Numerical simulation demonstrated that changes in T1 * are related to the changes in T1 ; however, other factors such as breathing motion could influence T1 * measurements. Phantom T1 * values measured using free-running T1 * mapping sequence had good correlation with spin-echo T1 values and was insensitive to heart rate. In the Ex-CMR study, the measured T1 * reactivity was 10% immediately after exercise and declined over time. CONCLUSION: The free-running T1 * mapping sequence allows free-breathing non-ECG quantification of changes in myocardial T1 * with physiological exercise. Although, absolute myocardial T1 * value is sensitive to various confounders such as B1 and B0 inhomogeneity, quantification of its change may be useful in revealing myocardial tissue properties with exercise.

Impact of deep learning architectures on accelerated cardiac T1 mapping using MyoMapNet.

The objective of the current study was to investigate the performance of various deep learning (DL) architectures for MyoMapNet, a DL model for T1 estimation using accelerated cardiac T1 mapping from four T1 -weighted images collected after a single inversion pulse (Look-Locker 4 [LL4]). We implemented and tested three DL architectures for MyoMapNet: (a) a fully connected neural network (FC), (b) convolutional neural networks (VGG19, ResNet50), and (c) encoder-decoder networks with skip connections (ResUNet, U-Net). Modified Look-Locker inversion recovery (MOLLI) images from 749 patients at 3 T were used for training, validation, and testing. The first four T1 -weighted images from MOLLI5(3)3 and/or MOLLI4(1)3(1)2 protocols were extracted to create accelerated cardiac T1 mapping data. We also prospectively collected data from 28 subjects using MOLLI and LL4 to further evaluate model performance. Despite rigorous training, conventional VGG19 and ResNet50 models failed to produce anatomically correct T1 maps, and T1 values had significant errors. While ResUNet yielded good quality maps, it significantly underestimated T1 . Both FC and U-Net, however, yielded excellent image quality with good T1 accuracy for both native (FC/U-Net/MOLLI = 1217 ± 64/1208 ± 61/1199 ± 61 ms, all p < 0.05) and postcontrast myocardial T1 (FC/U-Net/MOLLI = 578 ± 57/567 ± 54/574 ± 55 ms, all p < 0.05). In terms of precision, the U-Net model yielded better T1 precision compared with the FC architecture (standard deviation of 61 vs. 67 ms for the myocardium for native [p < 0.05], and 31 vs. 38 ms [p < 0.05], for postcontrast). Similar findings were observed in prospectively collected LL4 data. It was concluded that U-Net and FC DL models in MyoMapNet enable fast myocardial T1 mapping using only four T1 -weighted images collected from a single LL sequence with comparable accuracy. U-Net also provides a slight improvement in precision.

Accelerated cardiac T1 mapping in four heartbeats with inline MyoMapNet: a deep learning-based T1 estimation approach.

PURPOSE: To develop and evaluate MyoMapNet, a rapid myocardial T1 mapping approach that uses fully connected neural networks (FCNN) to estimate T1 values from four T1-weighted images collected after a single inversion pulse in four heartbeats (Look-Locker, LL4). METHOD: We implemented an FCNN for MyoMapNet to estimate T1 values from a reduced number of T1-weighted images and corresponding inversion-recovery times. We studied MyoMapNet performance when trained using native, post-contrast T1, or a combination of both. We also explored the effects of number of T1-weighted images (four and five) for native T1. After rigorous training using in-vivo modified Look-Locker inversion recovery (MOLLI) T1 mapping data of 607 patients, MyoMapNet performance was evaluated using MOLLI T1 data from 61 patients by discarding the additional T1-weighted images. Subsequently, we implemented a prototype MyoMapNet and LL4 on a 3 T scanner. LL4 was used to collect T1 mapping data in 27 subjects with inline T1 map reconstruction by MyoMapNet. The resulting T1 values were compared to MOLLI. RESULTS: MyoMapNet trained using a combination of native and post-contrast T1-weighted images had excellent native and post-contrast T1 accuracy compared to MOLLI. The FCNN model using four T1-weighted images yields similar performance compared to five T1-weighted images, suggesting that four T1 weighted images may be sufficient. The inline implementation of LL4 and MyoMapNet enables successful acquisition and reconstruction of T1 maps on the scanner. Native and post-contrast myocardium T1 by MOLLI and MyoMapNet was 1170 ± 55 ms vs. 1183 ± 57 ms (P = 0.03), and 645 ± 26 ms vs. 630 ± 30 ms (P = 0.60), and native and post-contrast blood T1 was 1820 ± 29 ms vs. 1854 ± 34 ms (P = 0.14), and 508 ± 9 ms vs. 514 ± 15 ms (P = 0.02), respectively. CONCLUSION: A FCNN, trained using MOLLI data, can estimate T1 values from only four T1-weighted images. MyoMapNet enables myocardial T1 mapping in four heartbeats with similar accuracy as MOLLI with inline map reconstruction.

Deformation-encoding Deep Learning Transformer for High-Frame-Rate Cardiac Cine MRI.

Purpose To develop a deep learning model for increasing cardiac cine frame rate while maintaining spatial resolution and scan time. Materials and Methods A transformer-based model was trained and tested on a retrospective sample of cine images from 5840 patients (mean age, 55 years ± 19 [SD]; 3527 male patients) referred for clinical cardiac MRI from 2003 to 2021 at nine centers; images were acquired using 1.5- and 3-T scanners from three vendors. Data from three centers were used for training and testing (4:1 ratio). The remaining data were used for external testing. Cines with downsampled frame rates were restored using linear, bicubic, and model-based interpolation. The root mean square error between interpolated and original cine images was modeled using ordinary least squares regression. In a prospective study of 49 participants referred for clinical cardiac MRI (mean age, 56 years ± 13; 25 male participants) and 12 healthy participants (mean age, 51 years ± 16; eight male participants), the model was applied to cines acquired at 25 frames per second (fps), thereby doubling the frame rate, and these interpolated cines were compared with actual 50-fps cines. The preference of two readers based on perceived temporal smoothness and image quality was evaluated using a noninferiority margin of 10%. Results The model generated artifact-free interpolated images. Ordinary least squares regression analysis accounting for vendor and field strength showed lower error (P < .001) with model-based interpolation compared with linear and bicubic interpolation in internal and external test sets. The highest proportion of reader choices was "no preference" (84 of 122) between actual and interpolated 50-fps cines. The 90% CI for the difference between reader proportions favoring collected (15 of 122) and interpolated (23 of 122) high-frame-rate cines was -0.01 to 0.14, indicating noninferiority. Conclusion A transformer-based deep learning model increased cardiac cine frame rates while preserving both spatial resolution and scan time, resulting in images with quality comparable to that of images obtained at actual high frame rates. Keywords: Functional MRI, Heart, Cardiac, Deep Learning, High Frame Rate Supplemental material is available for this article. © RSNA, 2024.

Weakly Supervised Tumor Detection in PET Using Class Response for Treatment Outcome Prediction.

It is proven that radiomic characteristics extracted from the tumor region are predictive. The first step in radiomic analysis is the segmentation of the lesion. However, this task is time consuming and requires a highly trained physician. This process could be automated using computer-aided detection (CAD) tools. Current state-of-the-art methods are trained in a supervised learning setting, which requires a lot of data that are usually not available in the medical imaging field. The challenge is to train one model to segment different types of tumors with only a weak segmentation ground truth. In this work, we propose a prediction framework including a 3D tumor segmentation in positron emission tomography (PET) images, based on a weakly supervised deep learning method, and an outcome prediction based on a 3D-CNN classifier applied to the segmented tumor regions. The key step is to locate the tumor in 3D. We propose to (1) calculate two maximum intensity projection (MIP) images from 3D PET images in two directions, (2) classify the MIP images into different types of cancers, (3) generate the class activation maps through a multitask learning approach with a weak prior knowledge, and (4) segment the 3D tumor region from the two 2D activation maps with a proposed new loss function for the multitask. The proposed approach achieves state-of-the-art prediction results with a small data set and with a weak segmentation ground truth. Our model was tested and validated for treatment response and survival in lung and esophageal cancers on 195 patients, with an area under the receiver operating characteristic curve (AUC) of 67% and 59%, respectively, and a dice coefficient of 73% and 0.77% for tumor segmentation.

AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics.

Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.

Multi-task multi-scale learning for outcome prediction in 3D PET images.

BACKGROUND AND OBJECTIVES: Predicting patient response to treatment and survival in oncology is a prominent way towards precision medicine. To this end, radiomics has been proposed as a field of study where images are used instead of invasive methods. The first step in radiomic analysis in oncology is lesion segmentation. However, this task is time consuming and can be physician subjective. Automated tools based on supervised deep learning have made great progress in helping physicians. However, they are data hungry, and annotated data remains a major issue in the medical field where only a small subset of annotated images are available. METHODS: In this work, we propose a multi-task, multi-scale learning framework to predict patient's survival and response. We show that the encoder can leverage multiple tasks to extract meaningful and powerful features that improve radiomic performance. We also show that subsidiary tasks serve as an inductive bias so that the model can better generalize. RESULTS: Our model was tested and validated for treatment response and survival in esophageal and lung cancers, with an area under the ROC curve of 77% and 71% respectively, outperforming single-task learning methods. CONCLUSIONS: Multi-task multi-scale learning enables higher performance of radiomic analysis by extracting rich information from intratumoral and peritumoral regions.

Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation.

This paper presents an automatic classification segmentation tool for helping screening COVID-19 pneumonia using chest CT imaging. The segmented lesions can help to assess the severity of pneumonia and follow-up the patients. In this work, we propose a new multitask deep learning model to jointly identify COVID-19 patient and segment COVID-19 lesion from chest CT images. Three learning tasks: segmentation, classification and reconstruction are jointly performed with different datasets. Our motivation is on the one hand to leverage useful information contained in multiple related tasks to improve both segmentation and classification performances, and on the other hand to deal with the problems of small data because each task can have a relatively small dataset. Our architecture is composed of a common encoder for disentangled feature representation with three tasks, and two decoders and a multi-layer perceptron for reconstruction, segmentation and classification respectively. The proposed model is evaluated and compared with other image segmentation techniques using a dataset of 1369 patients including 449 patients with COVID-19, 425 normal ones, 98 with lung cancer and 397 of different kinds of pathology. The obtained results show very encouraging performance of our method with a dice coefficient higher than 0.88 for the segmentation and an area under the ROC curve higher than 97% for the classification.