Fully automated contrast selection of joint bright- and black-blood late gadolinium enhancement imaging for robust myocardial scar assessment.

PURPOSE: Joint bright- and black-blood MRI techniques provide improved scar localization and contrast. Black-blood contrast is obtained after the visual selection of an optimal inversion time (TI) which often results in uncertainties, inter- and intra-observer variability and increased workload. In this work, we propose an artificial intelligence-based algorithm to enable fully automated TI selection and simplify myocardial scar imaging. METHODS: The proposed algorithm first localizes the left ventricle using a U-Net architecture. The localized left cavity centroid is extracted and a squared region of interest ("focus box") is created around the resulting pixel. The focus box is then propagated on each image and the sum of the pixel intensity inside is computed. The smallest sum corresponds to the image with the lowest intensity signal within the blood pool and healthy myocardium, which will provide an ideal scar-to-blood contrast. The image's corresponding TI is considered optimal. The U-Net was trained to segment the epicardium in 177 patients with binary cross-entropy loss. The algorithm was validated retrospectively in 152 patients, and the agreement between the algorithm and two magnetic resonance (MR) operators' prediction of TI values was calculated using the Fleiss' kappa coefficient. Thirty focus box sizes, ranging from 2.3mm2 to 20.3cm2, were tested. Processing times were measured. RESULTS: The U-Net's Dice score was 93.0 ± 0.1%. The proposed algorithm extracted TI values in 2.7 ± 0.1 s per patient (vs. 16.0 ± 8.5 s for the operator). An agreement between the algorithm's prediction and the MR operators' prediction was found in 137/152 patients (κ= 0.89), for an optimal focus box of size 2.3cm2. CONCLUSION: The proposed fully-automated algorithm has potential of reducing uncertainties, variability, and workload inherent to manual approaches with promise for future clinical implementation for joint bright- and black-blood MRI.

Reconstruction-driven motion estimation for motion-compensated MR CINE imaging.

In cardiac CINE, motion-compensated MR reconstruction (MCMR) is an effective approach to address highly undersampled acquisitions by incorporating motion information between frames. In this work, we propose a novel perspective for addressing the MCMR problem and a more integrated and efficient solution to the MCMR field. Contrary to state-of-the-art (SOTA) MCMR methods which break the original problem into two sub-optimization problems, i.e. motion estimation and reconstruction, we formulate this problem as a single entity with one single optimization. Our approach is unique in that the motion estimation is directly driven by the ultimate goal, reconstruction, but not by the canonical motion-warping loss (similarity measurement between motion-warped images and target images). We align the objectives of motion estimation and reconstruction, eliminating the drawbacks of artifacts-affected motion estimation and therefore error-propagated reconstruction. Further, we can deliver high-quality reconstruction and realistic motion without applying any regularization/smoothness loss terms, circumventing the non-trivial weighting factor tuning. We evaluate our method on two datasets: 1) an in-house acquired 2D CINE dataset for the retrospective study and 2) the public OCMR cardiac dataset for the prospective study. The conducted experiments indicate that the proposed MCMR framework can deliver artifact-free motion estimation and high-quality MR images even for imaging accelerations up to 20x, outperforming SOTA non-MCMR and MCMR methods in both qualitative and quantitative evaluation across all experiments.

Predictive uncertainty in deep learning-based MR image reconstruction using deep ensembles: Evaluation on the fastMRI data set.

PURPOSE: To estimate pixel-wise predictive uncertainty for deep learning-based MR image reconstruction and to examine the impact of domain shifts and architecture robustness. METHODS: Uncertainty prediction could provide a measure for robustness of deep learning (DL)-based MR image reconstruction from undersampled data. DL methods bear the risk of inducing reconstruction errors like in-painting of unrealistic structures or missing pathologies. These errors may be obscured by visual realism of DL reconstruction and thus remain undiscovered. Furthermore, most methods are task-agnostic and not well calibrated to domain shifts. We propose a strategy that estimates aleatoric (data) and epistemic (model) uncertainty, which entails training a deep ensemble (epistemic) with nonnegative log-likelihood (aleatoric) loss in addition to the conventional applied losses terms. The proposed procedure can be paired with any DL reconstruction, enabling investigations of their predictive uncertainties on a pixel level. Five different architectures were investigated on the fastMRI database. The impact on the examined uncertainty of in-distributional and out-of-distributional data with changes to undersampling pattern, imaging contrast, imaging orientation, anatomy, and pathology were explored. RESULTS: Predictive uncertainty could be captured and showed good correlation to normalized mean squared error. Uncertainty was primarily focused along the aliased anatomies and on hyperintense and hypointense regions. The proposed uncertainty measure was able to detect disease prevalence shifts. Distinct predictive uncertainty patterns were observed for changing network architectures. CONCLUSION: The proposed approach enables aleatoric and epistemic uncertainty prediction for DL-based MR reconstruction with an interpretable examination on a pixel level.

An Empirical Approach to Derive Water T1 from Multiparametric MR Images Using an Automated Pipeline and Comparison With Liver Stiffness.

BACKGROUND: Water T1 of the liver has been shown to be promising in discriminating the progressive forms of fatty liver diseases, inflammation, and fibrosis, yet proper correction for iron and lipid is required. PURPOSE: To examine the feasibility of an empirical approach for iron and lipid correction when measuring imaging-based T1 and to validate this approach by spectroscopy on in vivo data. STUDY TYPE: Retrospective. POPULATION: Next to mixed lipid-iron phantoms, individuals with different hepatic lipid content were investigated, including people with type 1 diabetes (N = 15, %female = 15.6, age = 43.5 ± 14.0), or type 2 diabetes mellitus (N = 21, %female = 28.9, age = 59.8 ± 9.7) and healthy volunteers (N = 9, %female = 11.1, age = 58.0 ± 8.1). FIELD STRENGTH/SEQUENCES: 3 T, balanced steady-state free precession MOdified Look-Locker Inversion recovery (MOLLI), multi- and dual-echo gradient echo Dixon, gradient echo magnetic resonance elastography (MRE). ASSESSMENT: T1 values were measured in phantoms to determine the respective correction factors. The correction was tested in vivo and validated by proton magnetic resonance spectroscopy (1 H-MRS). The quantification of liver T1 based on automatic segmentation was compared to the T1 values based on manual segmentation. The association of T1 with MRE-derived liver stiffness was evaluated. STATISTICAL TESTS: Bland-Altman plots and intraclass correlation coefficients (ICCs) were used for MOLLI vs. 1 H-MRS agreement and to compare liver T1 values from automatic vs. manual segmentation. Pearson's r correlation coefficients for T1 with hepatic lipids and liver stiffness were determined. A P-value of 0.05 was considered statistically significant. RESULTS: MOLLI T1 values after correction were found in better agreement with the 1 H-MRS-derived water T1 (ICC = 0.60 [0.37; 0.76]) in comparison with the uncorrected T1 values (ICC = 0.18 [-0.09; 0.44]). Automatic quantification yielded similar liver T1 values (ICC = 0.9995 [0.9991; 0.9997]) as with manual segmentation. A significant correlation of T1 with liver stiffness (r = 0.43 [0.11; 0.67]) was found. A marked and significant reduction in the correlation strength of T1 with liver stiffness (r = 0.05 [-0.28; 0.38], P = 0.77) was found after correction for hepatic lipid content. DATA CONCLUSION: Imaging-based correction factors enable accurate estimation of water T1 in vivo. LEVEL OF EVIDENCE: 1 TECHNICAL EFFICACY: Stage 1.

Deep learning-based age estimation from clinical Computed Tomography image data of the thorax and abdomen in the adult population.

Aging is an important risk factor for disease, leading to morphological change that can be assessed on Computed Tomography (CT) scans. We propose a deep learning model for automated age estimation based on CT- scans of the thorax and abdomen generated in a clinical routine setting. These predictions could serve as imaging biomarkers to estimate a "biological" age, that better reflects a patient's true physical condition. A pre-trained ResNet-18 model was modified to predict chronological age as well as to quantify its aleatoric uncertainty. The model was trained using 1653 non-pathological CT-scans of the thorax and abdomen of subjects aged between 20 and 85 years in a 5-fold cross-validation scheme. Generalization performance as well as robustness and reliability was assessed on a publicly available test dataset consisting of thorax-abdomen CT-scans of 421 subjects. Score-CAM saliency maps were generated for interpretation of model outputs. We achieved a mean absolute error of 5.76 ± 5.17 years with a mean uncertainty of 5.01 ± 1.44 years after 5-fold cross-validation. A mean absolute error of 6.50 ± 5.17 years with a mean uncertainty of 6.39 ± 1.46 years was obtained on the test dataset. CT-based age estimation accuracy was largely uniform across all age groups and between male and female subjects. The generated saliency maps highlighted especially the lumbar spine and abdominal aorta. This study demonstrates, that accurate and generalizable deep learning-based automated age estimation is feasible using clinical CT image data. The trained model proved to be robust and reliable. Methods of uncertainty estimation and saliency analysis improved the interpretability.

Impact of Tracer Dose Reduction in [18 F]-Labelled Fluorodeoxyglucose-Positron Emission Tomography ([18 F]-FDG)-PET) on Texture Features and Histogram Indices: A Study in Homogeneous Tissues of Phantom and Patient.

BACKGROUND: Histogram indices (HIs) and texture features (TFs) are considered to play an important role in future oncologic PET-imaging and it is unknown how these indices are affected by changes of tracer doses. A randomized undersampling of PET list mode data enables a simulation of tracer dose reduction. We performed a phantom study to compare HIs/TFs of simulated and measured tracer dose reductions and evaluated changes of HIs/TFs in the liver of patients with PETs from simulated reduced tracer doses. Overall, 42 HIs/TFs were evaluated in a NEMA phantom at measured and simulated doses (stepwise reduction of [18 F] from 100% to 25% of the measured dose). [18 F]-FDG-PET datasets of 15 patients were simulated from 3.0 down to 0.5 MBq/kgBW in intervals of 0.25 MBq/kgBW. HIs/TFs were calculated from two VOIs placed in physiological tissue of the right and left liver lobe and linear correlations and coefficients of variation analysis were performed. RESULTS: All 42 TFs did not differ significantly in measured and simulated doses (p > 0.05). Also, 40 TFs showed the same behaviour over dose reduction regarding differences in the same group (measured or simulated), and for 26 TFs a linear behaviour over dose reduction for measured and simulated doses could be validated. Out of these, 13 TFs could be identified, which showed a linear change in TF value in both the NEMA phantom and patient data and therefore should maintain the same informative value when transferred in a dose reduction setting. Out of this Homogeneity 2, Entropy and Zone size non-uniformity are of special interest because they have been described as preferentially considerable for tumour heterogeneity characterization. CONCLUSIONS: We could show that there was no significant difference of measured and simulated HIs/TFs in the phantom study and most TFs reveal a linear behaviour over dose reduction, when tested in homogeneous tissue. This indicates that texture analysis in PET might be robust to dose modulations.

Multiparametric Oncologic Hybrid Imaging: Machine Learning Challenges and Opportunities.

BACKGROUND: Machine learning (ML) is considered an important technology for future data analysis in health care. METHODS: The inherently technology-driven fields of diagnostic radiology and nuclear medicine will both benefit from ML in terms of image acquisition and reconstruction. Within the next few years, this will lead to accelerated image acquisition, improved image quality, a reduction of motion artifacts and - for PET imaging - reduced radiation exposure and new approaches for attenuation correction. Furthermore, ML has the potential to support decision making by a combined analysis of data derived from different modalities, especially in oncology. In this context, we see great potential for ML in multiparametric hybrid imaging and the development of imaging biomarkers. RESULTS AND CONCLUSION: In this review, we will describe the basics of ML, present approaches in hybrid imaging of MRI, CT, and PET, and discuss the specific challenges associated with it and the steps ahead to make ML a diagnostic and clinical tool in the future. KEY POINTS: · ML provides a viable clinical solution for the reconstruction, processing, and analysis of hybrid imaging obtained from MRI, CT, and PET..

Identification of radiomic biomarkers in a set of four skeletal muscle groups on Dixon MRI of the NAKO MR study.

In this work, we propose a processing pipeline for the extraction and identification of meaningful radiomics biomarkers in skeletal muscle tissue as displayed using Dixon-weighted MRI. Diverse and robust radiomics features can be identified that may be of aid in the accurate quantification e.g. varying degrees of sarcopenia in respective muscles of large cohorts. As such, the approach comprises the texture feature extraction from raw data based on well established approaches, such as a nnU-Net neural network and the Pyradiomics toolbox, a subsequent selection according to adequate conditions for the muscle tissue of the general population, and an importance-based ranking to further narrow the amount of meaningful features with respect to auxiliary targets. The performance was investigated with respect to the included auxiliary targets, namely age, body mass index (BMI), and fat fraction (FF). Four skeletal muscles with different fiber architecture were included: the mm. glutaei, m. psoas, as well as the extensors and adductors of the thigh. The selection allowed for a reduction from 1015 available texture features to 65 for age, 53 for BMI, and 36 for FF from the available fat/water contrast images considering all muscles jointly. Further, the dependence of the importance rankings calculated for the auxiliary targets on validation sets (in a cross-validation scheme) was investigated by boxplots. In addition, significant differences between subgroups of respective auxiliary targets as well as between both sexes were shown to be present within the ten lowest ranked features by means of Kruskal-Wallis H-tests and Mann-Whitney U-tests. The prediction performance for the selected features and the ranking scheme were verified on validation sets by a random forest based multi-class classification, with strong area under the curve (AUC) values of the receiver operator characteristic (ROC) of 73.03 ± 0.70 % and 73.63 ± 0.70 % for the water and fat images in age, 80.68 ± 0.30 % and 88.03 ± 0.89 % in BMI, as well as 98.36 ± 0.03 % and 98.52 ± 0.09 % in FF.

Physics-Driven Deep Learning for Computational Magnetic Resonance Imaging: Combining physics and machine learning for improved medical imaging.

Physics-driven deep learning methods have emerged as a powerful tool for computational magnetic resonance imaging (MRI) problems, pushing reconstruction performance to new limits. This article provides an overview of the recent developments in incorporating physics information into learning-based MRI reconstruction. We consider inverse problems with both linear and non-linear forward models for computational MRI, and review the classical approaches for solving these. We then focus on physics-driven deep learning approaches, covering physics-driven loss functions, plug-and-play methods, generative models, and unrolled networks. We highlight domain-specific challenges such as real- and complex-valued building blocks of neural networks, and translational applications in MRI with linear and non-linear forward models. Finally, we discuss common issues and open challenges, and draw connections to the importance of physics-driven learning when combined with other downstream tasks in the medical imaging pipeline.

Free-breathing Arterial Spin Labeling MRI for the Detection of Pulmonary Embolism.

Background Arterial spin labeling (ASL) MRI can be used to assess organ perfusion but has yet to be implemented for perfusion evaluation of the lung. Purpose To evaluate pseudo-continuous ASL (PCASL) MRI for the detection of acute pulmonary embolism (PE) and its potential as an alternative to CT pulmonary angiography (CTPA). Materials and Methods Between November 2020 and November 2021, 97 patients (median age, 61 years; 48 women) with suspected PE were enrolled in this prospective study. PCASL MRI was performed within a 72-hour period following CTPA under free-breathing conditions and included three orthogonal planes. The pulmonary trunk was labeled during systole, and the image was acquired during diastole of the subsequent cardiac cycle. Additionally, multisection, coronal, balanced, steady-state free-precession imaging was carried out. Two radiologists blindly assessed overall image quality, artifacts, and diagnostic confidence (five-point Likert scale, 5 = best). Patients were categorized as positive or negative for PE, and a lobe-wise assessment in PCASL MRI and CTPA was conducted. Sensitivity and specificity were calculated on a patient level with the final clinical diagnosis serving as the reference standard. Interchangeability between MRI and CTPA was also tested with use of an individual equivalence index (IEI). Results PCASL MRI was performed successfully in all patients with high scores for image quality, artifact, and diagnostic confidence (κ ≥ .74). Of the 97 patients, 38 were positive for PE. PCASL MRI depicted PE correctly in 35 of 38 patients with three false-positive and three false-negative findings, resulting in a sensitivity of 35 of 38 patients (92% [95% CI: 79, 98]) and a specificity of 56 of 59 patients (95% [95% CI: 86, 99]). Interchangeability analysis revealed an IEI of 2.6% (95% CI: 1.2, 3.8). Conclusion Free-breathing pseudo-continuous arterial spin labeling MRI depicted abnormal lung perfusion caused by acute pulmonary embolism and may be useful as a contrast material-free alternative to CT pulmonary angiography for selected patients. German Clinical Trials Register no. DRKS00023599 © RSNA, 2023.

Better Together: Data Harmonization and Cross-Study Analysis of Abdominal MRI Data From UK Biobank and the German National Cohort.

OBJECTIVES: The UK Biobank (UKBB) and German National Cohort (NAKO) are among the largest cohort studies, capturing a wide range of health-related data from the general population, including comprehensive magnetic resonance imaging (MRI) examinations. The purpose of this study was to demonstrate how MRI data from these large-scale studies can be jointly analyzed and to derive comprehensive quantitative image-based phenotypes across the general adult population. MATERIALS AND METHODS: Image-derived features of abdominal organs (volumes of liver, spleen, kidneys, and pancreas; volumes of kidney hilum adipose tissue; and fat fractions of liver and pancreas) were extracted from T1-weighted Dixon MRI data of 17,996 participants of UKBB and NAKO based on quality-controlled deep learning generated organ segmentations. To enable valid cross-study analysis, we first analyzed the data generating process using methods of causal discovery. We subsequently harmonized data from UKBB and NAKO using the ComBat approach for batch effect correction. We finally performed quantile regression on harmonized data across studies providing quantitative models for the variation of image-derived features stratified for sex and dependent on age, height, and weight. RESULTS: Data from 8791 UKBB participants (49.9% female; age, 63 ± 7.5 years) and 9205 NAKO participants (49.1% female, age: 51.8 ± 11.4 years) were analyzed. Analysis of the data generating process revealed direct effects of age, sex, height, weight, and the data source (UKBB vs NAKO) on image-derived features. Correction of data source-related effects resulted in markedly improved alignment of image-derived features between UKBB and NAKO. Cross-study analysis on harmonized data revealed comprehensive quantitative models for the phenotypic variation of abdominal organs across the general adult population. CONCLUSIONS: Cross-study analysis of MRI data from UKBB and NAKO as proposed in this work can be helpful for future joint data analyses across cohorts linking genetic, environmental, and behavioral risk factors to MRI-derived phenotypes and provide reference values for clinical diagnostics.

Automated imaging-based abdominal organ segmentation and quality control in 20,000 participants of the UK Biobank and German National Cohort Studies.

Large epidemiological studies such as the UK Biobank (UKBB) or German National Cohort (NAKO) provide unprecedented health-related data of the general population aiming to better understand determinants of health and disease. As part of these studies, Magnetic Resonance Imaging (MRI) is performed in a subset of participants allowing for phenotypical and functional characterization of different organ systems. Due to the large amount of imaging data, automated image analysis is required, which can be performed using deep learning methods, e. g. for automated organ segmentation. In this paper we describe a computational pipeline for automated segmentation of abdominal organs on MRI data from 20,000 participants of UKBB and NAKO and provide results of the quality control process. We found that approx. 90% of data sets showed no relevant segmentation errors while relevant errors occurred in a varying proportion of data sets depending on the organ of interest. Image-derived features based on automated organ segmentations showed relevant deviations of varying degree in the presence of segmentation errors. These results show that large-scale, deep learning-based abdominal organ segmentation on MRI data is feasible with overall high accuracy, but visual quality control remains an important step ensuring the validity of down-stream analyses in large epidemiological imaging studies.

A whole-body FDG-PET/CT Dataset with manually annotated Tumor Lesions.

We describe a publicly available dataset of annotated Positron Emission Tomography/Computed Tomography (PET/CT) studies. 1014 whole body Fluorodeoxyglucose (FDG)-PET/CT datasets (501 studies of patients with malignant lymphoma, melanoma and non small cell lung cancer (NSCLC) and 513 studies without PET-positive malignant lesions (negative controls)) acquired between 2014 and 2018 were included. All examinations were acquired on a single, state-of-the-art PET/CT scanner. The imaging protocol consisted of a whole-body FDG-PET acquisition and a corresponding diagnostic CT scan. All FDG-avid lesions identified as malignant based on the clinical PET/CT report were manually segmented on PET images in a slice-per-slice (3D) manner. We provide the anonymized original DICOM files of all studies as well as the corresponding DICOM segmentation masks. In addition, we provide scripts for image processing and conversion to different file formats (NIfTI, mha, hdf5). Primary diagnosis, age and sex are provided as non-imaging information. We demonstrate how this dataset can be used for deep learning-based automated analysis of PET/CT data and provide the trained deep learning model.

Development of a Hybrid-Imaging-Based Prognostic Index for Metastasized-Melanoma Patients in Whole-Body 18F-FDG PET/CT and PET/MRI Data.

Besides tremendous treatment success in advanced melanoma patients, the rapid development of oncologic treatment options comes with increasingly high costs and can cause severe life-threatening side effects. For this purpose, predictive baseline biomarkers are becoming increasingly important for risk stratification and personalized treatment planning. Thus, the aim of this pilot study was the development of a prognostic tool for the risk stratification of the treatment response and mortality based on PET/MRI and PET/CT, including a convolutional neural network (CNN) for metastasized-melanoma patients before systemic-treatment initiation. The evaluation was based on 37 patients (19 f, 62 ± 13 y/o) with unresectable metastasized melanomas who underwent whole-body 18F-FDG PET/MRI and PET/CT scans on the same day before the initiation of therapy with checkpoint inhibitors and/or BRAF/MEK inhibitors. The overall survival (OS), therapy response, metastatically involved organs, number of lesions, total lesion glycolysis, total metabolic tumor volume (TMTV), peak standardized uptake value (SULpeak), diameter (Dmlesion) and mean apparent diffusion coefficient (ADCmean) were assessed. For each marker, a Kaplan−Meier analysis and the statistical significance (Wilcoxon test, paired t-test and Bonferroni correction) were assessed. Patients were divided into high- and low-risk groups depending on the OS and treatment response. The CNN segmentation and prediction utilized multimodality imaging data for a complementary in-depth risk analysis per patient. The following parameters correlated with longer OS: a TMTV < 50 mL; no metastases in the brain, bone, liver, spleen or pleura; ≤4 affected organ regions; no metastases; a Dmlesion > 37 mm or SULpeak < 1.3; a range of the ADCmean < 600 mm2/s. However, none of the parameters correlated significantly with the stratification of the patients into the high- or low-risk groups. For the CNN, the sensitivity, specificity, PPV and accuracy were 92%, 96%, 92% and 95%, respectively. Imaging biomarkers such as the metastatic involvement of specific organs, a high tumor burden, the presence of at least one large lesion or a high range of intermetastatic diffusivity were negative predictors for the OS, but the identification of high-risk patients was not feasible with the handcrafted parameters. In contrast, the proposed CNN supplied risk stratification with high specificity and sensitivity.

End-to-End Deep Learning of Non-rigid Groupwise Registration and Reconstruction of Dynamic MRI.

Temporal correlation has been exploited for accelerated dynamic MRI reconstruction. Some methods have modeled inter-frame motion into the reconstruction process to produce temporally aligned image series and higher reconstruction quality. However, traditional motion-compensated approaches requiring iterative optimization of registration and reconstruction are time-consuming, while most deep learning-based methods neglect motion in the reconstruction process. We propose an unrolled deep learning framework with each iteration consisting of a groupwise diffeomorphic registration network (GRN) and a motion-augmented reconstruction network. Specifically, the whole dynamic sequence is registered at once to an implicit template which is used to generate a new set of dynamic images to efficiently exploit the full temporal information of the acquired data via the GRN. The generated dynamic sequence is then incorporated into the reconstruction network to augment the reconstruction performance. The registration and reconstruction networks are optimized in an end-to-end fashion for simultaneous motion estimation and reconstruction of dynamic images. The effectiveness of the proposed method is validated in highly accelerated cardiac cine MRI by comparing with other state-of-the-art approaches.

Cardiac MR: From Theory to Practice.

Cardiovascular disease (CVD) is the leading single cause of morbidity and mortality, causing over 17. 9 million deaths worldwide per year with associated costs of over $800 billion. Improving prevention, diagnosis, and treatment of CVD is therefore a global priority. Cardiovascular magnetic resonance (CMR) has emerged as a clinically important technique for the assessment of cardiovascular anatomy, function, perfusion, and viability. However, diversity and complexity of imaging, reconstruction and analysis methods pose some limitations to the widespread use of CMR. Especially in view of recent developments in the field of machine learning that provide novel solutions to address existing problems, it is necessary to bridge the gap between the clinical and scientific communities. This review covers five essential aspects of CMR to provide a comprehensive overview ranging from CVDs to CMR pulse sequence design, acquisition protocols, motion handling, image reconstruction and quantitative analysis of the obtained data. (1) The basic MR physics of CMR is introduced. Basic pulse sequence building blocks that are commonly used in CMR imaging are presented. Sequences containing these building blocks are formed for parametric mapping and functional imaging techniques. Commonly perceived artifacts and potential countermeasures are discussed for these methods. (2) CMR methods for identifying CVDs are illustrated. Basic anatomy and functional processes are described to understand the cardiac pathologies and how they can be captured by CMR imaging. (3) The planning and conduct of a complete CMR exam which is targeted for the respective pathology is shown. Building blocks are illustrated to create an efficient and patient-centered workflow. Further strategies to cope with challenging patients are discussed. (4) Imaging acceleration and reconstruction techniques are presented that enable acquisition of spatial, temporal, and parametric dynamics of the cardiac cycle. The handling of respiratory and cardiac motion strategies as well as their integration into the reconstruction processes is showcased. (5) Recent advances on deep learning-based reconstructions for this purpose are summarized. Furthermore, an overview of novel deep learning image segmentation and analysis methods is provided with a focus on automatic, fast and reliable extraction of biomarkers and parameters of clinical relevance.

Multiparametric Functional MRI of the Kidney: Current State and Future Trends with Deep Learning Approaches.

BACKGROUND: Until today, assessment of renal function has remained a challenge for modern medicine. In many cases, kidney diseases accompanied by a decrease in renal function remain undetected and unsolved, since neither laboratory tests nor imaging diagnostics provide adequate information on kidney status. In recent years, developments in the field of functional magnetic resonance imaging with application to abdominal organs have opened new possibilities combining anatomic imaging with multiparametric functional information. The multiparametric approach enables the measurement of perfusion, diffusion, oxygenation, and tissue characterization in one examination, thus providing more comprehensive insight into pathophysiological processes of diseases as well as effects of therapeutic interventions. However, application of multiparametric fMRI in the kidneys is still restricted mainly to research areas and transfer to the clinical routine is still outstanding. One of the major challenges is the lack of a standardized protocol for acquisition and postprocessing including efficient strategies for data analysis. This article provides an overview of the most common fMRI techniques with application to the kidney together with new approaches regarding data analysis with deep learning. METHODS: This article implies a selective literature review using the literature database PubMed in May 2021 supplemented by our own experiences in this field. RESULTS AND CONCLUSION: Functional multiparametric MRI is a promising technique for assessing renal function in a more comprehensive approach by combining multiple parameters such as perfusion, diffusion, and BOLD imaging. New approaches with the application of deep learning techniques could substantially contribute to overcoming the challenge of handling the quantity of data and developing more efficient data postprocessing and analysis protocols. Thus, it can be hoped that multiparametric fMRI protocols can be sufficiently optimized to be used for routine renal examination and to assist clinicians in the diagnostics, monitoring, and treatment of kidney diseases in the future. KEY POINTS: · Multiparametric fMRI is a technique performed without the use of radiation, contrast media, and invasive methods.. · Multiparametric fMRI provides more comprehensive insight into pathophysiological processes of kidney diseases by combining functional and structural parameters.. · For broader acceptance of fMRI biomarkers, there is a need for standardization of acquisition, postprocessing, and analysis protocols as well as more prospective studies.. · Deep learning techniques could significantly contribute to an optimization of data acquisition and the postprocessing and interpretation of larger quantities of data.. CITATION FORMAT: · Zhang C, Schwartz M, Küstner T et al. Multiparametric Functional MRI of the Kidney: Current State and Future Trends with Deep Learning Approaches. Fortschr Röntgenstr 2022; 194: 983 - 992.

Multiparametric Oncologic Hybrid Imaging: Machine Learning Challenges and Opportunities.

BACKGROUND: Machine learning (ML) is considered an important technology for future data analysis in health care. METHODS: The inherently technology-driven fields of diagnostic radiology and nuclear medicine will both benefit from ML in terms of image acquisition and reconstruction. Within the next few years, this will lead to accelerated image acquisition, improved image quality, a reduction of motion artifacts and - for PET imaging - reduced radiation exposure and new approaches for attenuation correction. Furthermore, ML has the potential to support decision making by a combined analysis of data derived from different modalities, especially in oncology. In this context, we see great potential for ML in multiparametric hybrid imaging and the development of imaging biomarkers. RESULTS AND CONCLUSION: In this review, we will describe the basics of ML, present approaches in hybrid imaging of MRI, CT, and PET, and discuss the specific challenges associated with it and the steps ahead to make ML a diagnostic and clinical tool in the future. KEY POINTS: · ML provides a viable clinical solution for the reconstruction, processing, and analysis of hybrid imaging obtained from MRI, CT, and PET.. CITATION FORMAT: · Küstner T, Hepp T, Seith F. Multiparametric Oncologic Hybrid Imaging: Machine Learning Challenges and Opportunities. Fortschr Röntgenstr 2022; 194: 605 - 612.

Self-supervised learning-based diffeomorphic non-rigid motion estimation for fast motion-compensated coronary MR angiography.

PURPOSE: To accelerate non-rigid motion corrected coronary MR angiography (CMRA) reconstruction by developing a deep learning based non-rigid motion estimation network and combining this with an efficient implementation of the undersampled motion corrected reconstruction. METHODS: Undersampled and respiratory motion corrected CMRA with overall short scans of 5 to 10 min have been recently proposed. However, image reconstruction with this approach remains lengthy, since it relies on several non-rigid image registrations to estimate the respiratory motion and on a subsequent iterative optimization to correct for motion during the undersampled reconstruction. Here we introduce a self-supervised diffeomorphic non-rigid respiratory motion estimation network, DiRespME-net, to speed up respiratory motion estimation. We couple this with an efficient GPU-based implementation of the subsequent motion-corrected iterative reconstruction. DiRespME-net is based on a U-Net architecture, and is trained in a self-supervised fashion, with a loss enforcing image similarity and spatial smoothness of the motion fields. Motion predicted by DiRespME-net was used for GPU-based motion-corrected CMRA in 12 test subjects and final images were compared to those produced by state-of-the-art reconstruction. Vessel sharpness and visible length of the right coronary artery (RCA) and the left anterior descending (LAD) coronary artery were used as metrics of image quality for comparison. RESULTS: No statistically significant difference in image quality was found between images reconstructed with the proposed approach (MC:DiRespME-net) and a motion-corrected reconstruction using cubic B-splines (MC:Nifty-reg). Visible vessel length was not significantly different between methods (RCA: MC:Nifty-reg 5.7 ± 1.7 cm vs MC:DiRespME-net 5.8 ± 1.7 cm, P = 0.32; LAD: MC:Nifty-reg 7.0 ± 2.6 cm vs MC:DiRespME-net 6.9 ± 2.7 cm, P = 0.81). Similarly, no statistically significant difference between methods was observed in terms of vessel sharpness (RCA: MC:Nifty-reg 60.3 ± 7.2% vs MC:DiRespME-net 61.0 ± 6.8%, P = 0.19; LAD: MC:Nifty-reg 57.4 ± 7.9% vs MC:DiRespME-net 58.1 ± 7.5%, P = 0.27). The proposed approach achieved a 50-fold reduction in computation time, resulting in a total reconstruction time of approximately 20 s. CONCLUSIONS: The proposed self-supervised learning-based motion corrected reconstruction enables fast motion-corrected CMRA image reconstruction, holding promise for integration in clinical routine.