Digital reference object toolkit of breast DCE MRI for quantitative evaluation of image reconstruction and analysis methods.

PURPOSE: To develop a digital reference object (DRO) toolkit to generate realistic breast DCE-MRI data for quantitative assessment of image reconstruction and data analysis methods. METHODS: A simulation framework in a form of DRO toolkit has been developed using the ultrafast and conventional breast DCE-MRI data of 53 women with malignant (n = 25) or benign (n = 28) lesions. We segmented five anatomical regions and performed pharmacokinetic analysis to determine the ranges of pharmacokinetic parameters for each segmented region. A database of the segmentations and their pharmacokinetic parameters is included in the DRO toolkit that can generate a large number of realistic breast DCE-MRI data. We provide two potential examples for our DRO toolkit: assessing the accuracy of an image reconstruction method using undersampled simulated radial k-space data and assessing the impact of the B 1 + $$ {\mathrm{B}}_1^{+} $$ field inhomogeneity on estimated parameters. RESULTS: The estimated pharmacokinetic parameters for each region showed agreement with previously reported values. For the assessment of the reconstruction method, it was found that the temporal regularization resulted in significant underestimation of estimated parameters by up to 57% and 10% with the weighting factor λ = 0.1 and 0.01, respectively. We also demonstrated that spatial discrepancy of v p $$ {v}_p $$ and PS $$ \mathrm{PS} $$ increase to about 33% and 51% without correction for B 1 + $$ {\mathrm{B}}_1^{+} $$ field. CONCLUSION: We have developed a DRO toolkit that includes realistic morphology of tumor lesions along with the expected pharmacokinetic parameter ranges. This simulation framework can generate many images for quantitative assessment of DCE-MRI reconstruction and analysis methods.

A four-dimensional computational model of dynamic contrast-enhanced magnetic resonance imaging measurement of subtle blood-brain barrier leakage.

Dynamic contrast-enhanced MRI (DCE-MRI) is increasingly used to quantify and map the spatial distribution of blood-brain barrier (BBB) leakage in neurodegenerative disease, including cerebral small vessel disease and dementia. However, the subtle nature of leakage and resulting small signal changes make quantification challenging. While simplified one-dimensional simulations have probed the impact of noise, scanner drift, and model assumptions, the impact of spatio-temporal effects such as gross motion, k-space sampling and motion artefacts on parametric leakage maps has been overlooked. Moreover, evidence on which to base the design of imaging protocols is lacking due to practical difficulties and the lack of a reference method. To address these problems, we present an open-source computational model of the DCE-MRI acquisition process for generating four dimensional Digital Reference Objects (DROs), using a high-resolution brain atlas and incorporating realistic patient motion, extra-cerebral signals, noise and k-space sampling. Simulations using the DROs demonstrated a dominant influence of spatio-temporal effects on both the visual appearance of parameter maps and on measured tissue leakage rates. The computational model permits greater understanding of the sensitivity and limitations of subtle BBB leakage measurement and provides a non-invasive means of testing and optimising imaging protocols for future studies.

Systematic assessment of multi-echo dynamic susceptibility contrast MRI using a digital reference object.

PURPOSE: Brain tumor dynamic susceptibility contrast (DSC) MRI is adversely impacted by T1 and T2∗ contrast agent leakage effects that result in inaccurate hemodynamic metrics. While multi-echo acquisitions remove T1 leakage effects, there is no consensus on the optimal set of acquisition parameters. Using a computational approach, we systematically evaluated a wide range of acquisition strategies to determine the optimal multi-echo DSC-MRI perfusion protocol. METHODS: Using a population-based DSC-MRI digital reference object (DRO), we assessed the influence of preload dosing (no preload and full dose preload), field strength (1.5 and 3T), pulse sequence parameters (echo time, repetition time, and flip angle), and leakage correction on relative cerebral blood volume (rCBV) and flow (rCBF) accuracy. We also compared multi-echo DSC-MRI protocols with standard single-echo protocols. RESULTS: Multi-echo DSC-MRI is highly consistent across all protocols, and multi-echo rCBV (with or without use of a preload dose) had higher accuracy than single-echo rCBV. Regression analysis showed that choice of repetition time and flip angle had minimal impact on multi-echo rCBV and rCBV, indicating the potential for significant flexibility in acquisition parameters. The echo time combination had minimal impact on rCBV, though longer echo times should be avoided, particularly at higher field strengths. Leakage correction improved rCBV accuracy in all cases. Multi-echo rCBF was less biased than single-echo rCBF, although rCBF accuracy was reduced overall relative to rCBV. CONCLUSIONS: Multi-echo acquisitions were more robust than single-echo, essentially decoupling both repetition time and flip angle from rCBV accuracy. Multi-echo acquisitions obviate the need for preload dosing, although leakage correction to remove residual T2∗ leakage effects remains compulsory for high rCBV accuracy.

Evaluating Machine Learning-Based MRI Reconstruction Using Digital Image Quality Phantoms.

Quantitative and objective evaluation tools are essential for assessing the performance of machine learning (ML)-based magnetic resonance imaging (MRI) reconstruction methods. However, the commonly used fidelity metrics, such as mean squared error (MSE), structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), often fail to capture fundamental and clinically relevant MR image quality aspects. To address this, we propose evaluation of ML-based MRI reconstruction using digital image quality phantoms and automated evaluation methods. Our phantoms are based upon the American College of Radiology (ACR) large physical phantom but created in k-space to simulate their MR images, and they can vary in object size, signal-to-noise ratio, resolution, and image contrast. Our evaluation pipeline incorporates evaluation metrics of geometric accuracy, intensity uniformity, percentage ghosting, sharpness, signal-to-noise ratio, resolution, and low-contrast detectability. We demonstrate the utility of our proposed pipeline by assessing an example ML-based reconstruction model across various training and testing scenarios. The performance results indicate that training data acquired with a lower undersampling factor and coils of larger anatomical coverage yield a better performing model. The comprehensive and standardized pipeline introduced in this study can help to facilitate a better understanding of the performance and guide future development and advancement of ML-based reconstruction algorithms.

Assessment of perivascular space filtering methods using a three-dimensional computational model.

Growing interest surrounds the assessment of perivascular spaces (PVS) on magnetic resonance imaging (MRI) and their validation as a clinical biomarker of adverse brain health. Nonetheless, the limits of validity of current state-of-the-art segmentation methods are still unclear. Here, we propose an open-source three-dimensional computational framework comprising 3D digital reference objects and evaluate the performance of three PVS filtering methods under various spatiotemporal imaging considerations (including sampling, motion artefacts, and Rician noise). Specifically, we study the performance of the Frangi, Jerman and RORPO filters in enhancing PVS-like structures to facilitate segmentation. Our findings were three-fold. First, as long as voxels are isotropic, RORPO outperforms the other two filters, regardless of imaging quality. Unlike the Frangi and Jerman filters, RORPO's performance does not deteriorate as PVS volume increases. Second, the performance of all "vesselness" filters is heavily influenced by imaging quality, with sampling and motion artefacts being the most damaging for these types of analyses. Third, none of the filters can distinguish PVS from other hyperintense structures (e.g. white matter hyperintensities, stroke lesions, or lacunes) effectively, the area under precision-recall curve dropped substantially (Frangi: from 94.21 [IQR 91.60, 96.16] to 43.76 [IQR 25.19, 63.38]; Jerman: from 94.51 [IQR 91.90, 95.37] to 58.00 [IQR 35.68, 64.87]; RORPO: from 98.72 [IQR 95.37, 98.96] to 71.87 [IQR 57.21, 76.63] without and with other hyperintense structures, respectively). The use of our computational model enables comparing segmentation methods and identifying their advantages and disadvantages, thereby providing means for testing and optimising pipelines for ongoing and future studies.

An Anthropomorphic Digital Reference Object (DRO) for Simulation and Analysis of Breast DCE MRI Techniques.

Advances in accelerated magnetic resonance imaging (MRI) continue to push the bounds on achievable spatial and temporal resolution while maintaining a clinically acceptable image quality. Validation tools, including numerical simulations, are needed to characterize the repeatability and reproducibility of such methods for use in quantitative imaging applications. We describe the development of a simulation framework for analyzing and optimizing accelerated MRI acquisition and reconstruction techniques used in dynamic contrast enhanced (DCE) breast imaging. The simulation framework, in the form of a digital reference object (DRO), consists of four modules that control different aspects of the simulation, including the appearance and physiological behavior of the breast tissue as well as the MRI acquisition settings, to produce simulated k-space data for a DCE breast exam. The DRO design and functionality are described along with simulation examples provided to show potential applications of the DRO. The included simulation results demonstrate the ability of the DRO to simulate a variety of effects including the creation of simulated lesions, tissue enhancement modeled by the generalized kinetic model, T1-relaxation, fat signal precession and saturation, acquisition SNR, and changes in temporal resolution.

A dynamic susceptibility contrast MRI digital reference object for testing software with leakage correction: Effect of background simulation.

PURPOSE: Dynamic susceptibility contrast (DSC)-MRI is a perfusion imaging technique from which useful quantitative imaging biomarkers can be derived. Relative cerebral blood volume (rCBV) is such a biomarker commonly used for evaluating brain tumors. To account for the extravasation of contrast agents in tumors, post-processing leakage correction is often applied to improve rCBV accuracy. Digital reference objects (DRO) are ideal for testing the post-processing software, because the biophysical model used to generate the DRO can be matched to the one that the software uses. This study aims to develop DROs to validate the leakage correction of software using Weisskoff model and to examine the effect of background signal time curves that are required by the model. METHODS: Three DROs were generated using the Weisskoff model, each composed of nine foreground lesion objects with combinations of different levels of rCBV and contrast leakage parameter (K2). Three types of background were implemented for these DROs: (1) a multi-compartment brain-like background, (2) a sphere background with a constant signal time curve, and (3) a sphere background with signal time curve identical to that of the brain-like DRO's white matter (WM). The DROs were then analyzed with an FDA-cleared software with and without leakage correction. Leakage correction was tested with and without brain segmentation. RESULTS: Accuracy of leakage correction was able to be verified using the brain-like phantom and the sphere phantom with WM background. The sphere with constant background did not perform well with leakage correction with or without brain segmentation. The DROs were able to verify that for the particular software tested, leakage correction with brain segmentation achieved the lowest error. CONCLUSIONS: DSC-MRI DROs with biophysical model matched to that of the post-processing software can be well used for the software's validation, provided that the background signals are also properly simulated for generating the reference time curve required by the model. Care needs to be taken to consider the interaction of the design of the DRO with the software's implementation of brain segmentation to extract the reference time curve.

Evaluating the Use of rCBV as a Tumor Grade and Treatment Response Classifier Across NCI Quantitative Imaging Network Sites: Part II of the DSC-MRI Digital Reference Object (DRO) Challenge.

We have previously characterized the reproducibility of brain tumor relative cerebral blood volume (rCBV) using a dynamic susceptibility contrast magnetic resonance imaging digital reference object across 12 sites using a range of imaging protocols and software platforms. As expected, reproducibility was highest when imaging protocols and software were consistent, but decreased when they were variable. Our goal in this study was to determine the impact of rCBV reproducibility for tumor grade and treatment response classification. We found that varying imaging protocols and software platforms produced a range of optimal thresholds for both tumor grading and treatment response, but the performance of these thresholds was similar. These findings further underscore the importance of standardizing acquisition and analysis protocols across sites and software benchmarking.

A Population-Based Digital Reference Object (DRO) for Optimizing Dynamic Susceptibility Contrast (DSC)-MRI Methods for Clinical Trials.

The standardization and broad-scale integration of dynamic susceptibility contrast (DSC)-magnetic resonance imaging (MRI) have been confounded by a lack of consensus on DSC-MRI methodology for preventing potential relative cerebral blood volume inaccuracies, including the choice of acquisition protocols and postprocessing algorithms. Therefore, we developed a digital reference object (DRO), using physiological and kinetic parameters derived from in vivo data, unique voxel-wise 3-dimensional tissue structures, and a validated MRI signal computational approach, aimed at validating image acquisition and analysis methods for accurately measuring relative cerebral blood volume in glioblastomas. To achieve DSC-MRI signals representative of the temporal characteristics, magnitude, and distribution of contrast agent-induced T1 and changes observed across multiple glioblastomas, the DRO's input parameters were trained using DSC-MRI data from 23 glioblastomas (>40 000 voxels). The DRO's ability to produce reliable signals for combinations of pulse sequence parameters and contrast agent dosing schemes unlike those in the training data set was validated by comparison with in vivo dual-echo DSC-MRI data acquired in a separate cohort of patients with glioblastomas. Representative applications of the DRO are presented, including the selection of DSC-MRI acquisition and postprocessing methods that optimize CBV accuracy, determination of the impact of DSC-MRI methodology choices on sample size requirements, and the assessment of treatment response in clinical glioblastoma trials.

Accuracy and robustness of a simple algorithm to measure vessel diameter from B-mode ultrasound images.

Measurement of changes in arterial vessel diameter can be used to assess the state of cardiovascular health, but the use of such measurements as biomarkers is contingent upon the accuracy and robustness of the measurement. This work presents a simple algorithm for measuring diameter from B-mode images derived from vascular ultrasound. The algorithm is based upon Gaussian curve fitting and a Viterbi search process. We assessed the accuracy of the algorithm by measuring the diameter of a digital reference object (DRO) and ultrasound-derived images of a carotid artery. We also assessed the robustness of the algorithm by manipulating the quality of the image. Across a broad range of signal-to-noise ratio and with varying image edge error, the algorithm measured vessel diameter within 0.7% of the creation dimensions of the DRO. This was a similar level of difference (0.8%) to when an ultrasound image was used. When SNR dropped to 18 dB, measurement error increased to 1.3%. When edge position was varied by as much as 10%, measurement error was well maintained between 0.68 and 0.75%. All these errors fall well within the margin of error established by the medical physics community for quantitative ultrasound measurements. We conclude that this simple algorithm provides consistent and accurate measurement of lumen diameter from B-mode images across a broad range of image quality.