Revisiting [Formula: see text]-wavelet compressed-sensing MRI in the era of deep learning.

Following their success in numerous imaging and computer vision applications, deep-learning (DL) techniques have emerged as one of the most prominent strategies for accelerated MRI reconstruction. These methods have been shown to outperform conventional regularized methods based on compressed sensing (CS). However, in most comparisons, CS is implemented with two or three hand-tuned parameters, while DL methods enjoy a plethora of advanced data science tools. In this work, we revisit [Formula: see text]-wavelet CS reconstruction using these modern tools. Using ideas such as algorithm unrolling and advanced optimization methods over large databases that DL algorithms utilize, along with conventional insights from wavelet representations and CS theory, we show that [Formula: see text]-wavelet CS can be fine-tuned to a level close to DL reconstruction for accelerated MRI. The optimized [Formula: see text]-wavelet CS method uses only 128 parameters compared to >500,000 for DL, employs a convex reconstruction at inference time, and performs within <1% of a DL approach that has been used in multiple studies in terms of quantitative quality metrics.

Large-scale 3D non-Cartesian coronary MRI reconstruction using distributed memory-efficient physics-guided deep learning with limited training data.

OBJECT: To enable high-quality physics-guided deep learning (PG-DL) reconstruction of large-scale 3D non-Cartesian coronary MRI by overcoming challenges of hardware limitations and limited training data availability. MATERIALS AND METHODS: While PG-DL has emerged as a powerful image reconstruction method, its application to large-scale 3D non-Cartesian MRI is hindered by hardware limitations and limited availability of training data. We combine several recent advances in deep learning and MRI reconstruction to tackle the former challenge, and we further propose a 2.5D reconstruction using 2D convolutional neural networks, which treat 3D volumes as batches of 2D images to train the network with a limited amount of training data. Both 3D and 2.5D variants of the PG-DL networks were compared to conventional methods for high-resolution 3D kooshball coronary MRI. RESULTS: Proposed PG-DL reconstructions of 3D non-Cartesian coronary MRI with 3D and 2.5D processing outperformed all conventional methods both quantitatively and qualitatively in terms of image assessment by an experienced cardiologist. The 2.5D variant further improved vessel sharpness compared to 3D processing, and scored higher in terms of qualitative image quality. DISCUSSION: PG-DL reconstruction of large-scale 3D non-Cartesian MRI without compromising image size or network complexity is achieved, and the proposed 2.5D processing enables high-quality reconstruction with limited training data.

Signal intensity informed multi-coil encoding operator for physics-guided deep learning reconstruction of highly accelerated myocardial perfusion CMR.

PURPOSE: To develop a physics-guided deep learning (PG-DL) reconstruction strategy based on a signal intensity informed multi-coil (SIIM) encoding operator for highly-accelerated simultaneous multislice (SMS) myocardial perfusion cardiac MRI (CMR). METHODS: First-pass perfusion CMR acquires highly-accelerated images with dynamically varying signal intensity/SNR following the administration of a gadolinium-based contrast agent. Thus, using PG-DL reconstruction with a conventional multi-coil encoding operator leads to analogous signal intensity variations across different time-frames at the network output, creating difficulties in generalization for varying SNR levels. We propose to use a SIIM encoding operator to capture the signal intensity/SNR variations across time-frames in a reformulated encoding operator. This leads to a more uniform/flat contrast at the output of the PG-DL network, facilitating generalizability across time-frames. PG-DL reconstruction with the proposed SIIM encoding operator is compared to PG-DL with conventional encoding operator, split slice-GRAPPA, locally low-rank (LLR) regularized reconstruction, low-rank plus sparse (L + S) reconstruction, and regularized ROCK-SPIRiT. RESULTS: Results on highly accelerated free-breathing first pass myocardial perfusion CMR at three-fold SMS and four-fold in-plane acceleration show that the proposed method improves upon the reconstruction methods use for comparison. Substantial noise reduction is achieved compared to split slice-GRAPPA, and aliasing artifacts reduction compared to LLR regularized reconstruction, L + S reconstruction and PG-DL with conventional encoding. Furthermore, a qualitative reader study indicated that proposed method outperformed all methods. CONCLUSION: PG-DL reconstruction with the proposed SIIM encoding operator improves generalization across different time-frames /SNRs in highly accelerated perfusion CMR.

Physics-Driven Deep Learning for Computational Magnetic Resonance Imaging: Combining physics and machine learning for improved medical imaging.

Physics-driven deep learning methods have emerged as a powerful tool for computational magnetic resonance imaging (MRI) problems, pushing reconstruction performance to new limits. This article provides an overview of the recent developments in incorporating physics information into learning-based MRI reconstruction. We consider inverse problems with both linear and non-linear forward models for computational MRI, and review the classical approaches for solving these. We then focus on physics-driven deep learning approaches, covering physics-driven loss functions, plug-and-play methods, generative models, and unrolled networks. We highlight domain-specific challenges such as real- and complex-valued building blocks of neural networks, and translational applications in MRI with linear and non-linear forward models. Finally, we discuss common issues and open challenges, and draw connections to the importance of physics-driven learning when combined with other downstream tasks in the medical imaging pipeline.

Multi-mask self-supervised learning for physics-guided neural networks in highly accelerated magnetic resonance imaging.

Self-supervised learning has shown great promise because of its ability to train deep learning (DL) magnetic resonance imaging (MRI) reconstruction methods without fully sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network, while the other is used to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a holdout masking operation on the acquired measurements to split them into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared with the parallel imaging method, CG-SENSE, and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully sampled data are available. The results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs as well as supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of signal-to-noise ratio and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared with SSDU. The reader study demonstrates that multi-mask SSDU at R = 8 significantly improves reconstruction compared with single-mask SSDU at R = 8, as well as CG-SENSE at R = 2.

Unsupervised Deep Learning Methods for Biological Image Reconstruction and Enhancement: An overview from a signal processing perspective.

Recently, deep learning approaches have become the main research frontier for biological image reconstruction and enhancement problems thanks to their high performance, along with their ultra-fast inference times. However, due to the difficulty of obtaining matched reference data for supervised learning, there has been increasing interest in unsupervised learning approaches that do not need paired reference data. In particular, self-supervised learning and generative models have been successfully used for various biological imaging applications. In this paper, we overview these approaches from a coherent perspective in the context of classical inverse problems, and discuss their applications to biological imaging, including electron, fluorescence and deconvolution microscopy, optical diffraction tomography and functional neuroimaging.

Self-supervised learning of physics-guided reconstruction neural networks without fully sampled reference data.

PURPOSE: To develop a strategy for training a physics-guided MRI reconstruction neural network without a database of fully sampled data sets. METHODS: Self-supervised learning via data undersampling (SSDU) for physics-guided deep learning reconstruction partitions available measurements into two disjoint sets, one of which is used in the data consistency (DC) units in the unrolled network and the other is used to define the loss for training. The proposed training without fully sampled data is compared with fully supervised training with ground-truth data, as well as conventional compressed-sensing and parallel imaging methods using the publicly available fastMRI knee database. The same physics-guided neural network is used for both proposed SSDU and supervised training. The SSDU training is also applied to prospectively two-fold accelerated high-resolution brain data sets at different acceleration rates, and compared with parallel imaging. RESULTS: Results on five different knee sequences at an acceleration rate of 4 shows that the proposed self-supervised approach performs closely with supervised learning, while significantly outperforming conventional compressed-sensing and parallel imaging, as characterized by quantitative metrics and a clinical reader study. The results on prospectively subsampled brain data sets, in which supervised learning cannot be used due to lack of ground-truth reference, show that the proposed self-supervised approach successfully performs reconstruction at high acceleration rates (4, 6, and 8). Image readings indicate improved visual reconstruction quality with the proposed approach compared with parallel imaging at acquisition acceleration. CONCLUSION: The proposed SSDU approach allows training of physics-guided deep learning MRI reconstruction without fully sampled data, while achieving comparable results with supervised deep learning MRI trained on fully sampled data.

High-fidelity Database-free Deep Learning Reconstruction for Real-time Cine Cardiac MRI.

Real-time cine cardiac MRI provides an ECG-free free-breathing alternative to clinical gold-standard ECG-gated breath-hold segmented cine MRI for evaluation of heart function. Real-time cine MRI data acquisition during free breathing snapshot imaging enables imaging of patient cohorts that cannot be imaged with segmented or breath-hold acquisitions, but requires rapid imaging to achieve sufficient spatial-temporal resolutions. However, at high acceleration rates, conventional reconstruction techniques suffer from residual aliasing and temporal blurring, including advanced methods such as compressed sensing with radial trajectories. Recently, deep learning (DL) reconstruction has emerged as a powerful tool in MRI. However, its utility for free-breathing real-time cine MRI has been limited, as database-learning of spatio-temporal correlations with varying breathing and cardiac motion patterns across subjects has been challenging. Zero-shot self-supervised physics-guided deep learning (PG-DL) reconstruction has been proposed to overcome such challenges of database training by enabling subject-specific training. In this work, we adapt zero-shot PG-DL for real-time cine MRI with a spatio-temporal regularization. We compare our method to TGRAPPA, locally low-rank (LLR) regularized reconstruction and database-trained PG-DL reconstruction, both for retrospectively and prospectively accelerated datasets. Results on highly accelerated real-time Cartesian cine MRI show that the proposed method outperforms other reconstruction methods, both visibly in terms of noise and aliasing, and quantitatively.

High-fidelity Database-free Deep Learning Reconstruction for Real-time Cine Cardiac MRI.

Real-time cine cardiac MRI provides an ECG-free free-breathing alternative to clinical gold-standard ECG-gated breath-hold segmented cine MRI for evaluation of heart function. Real-time cine MRI data acquisition during free breathing snapshot imaging enables imaging of patient cohorts that cannot be imaged with segmented or breath-hold acquisitions, but requires rapid imaging to achieve sufficient spatial-temporal resolutions. However, at high acceleration rates, conventional reconstruction techniques suffer from residual aliasing and temporal blurring, including advanced methods such as compressed sensing with radial trajectories. Recently, deep learning (DL) reconstruction has emerged as a powerful tool in MRI. However, its utility for free-breathing real-time cine MRI has been limited, as database-learning of spatio-temporal correlations with varying breathing and cardiac motion patterns across subjects has been challenging. Zero-shot self-supervised physics-guided deep learning (PG-DL) reconstruction has been proposed to overcome such challenges of database training by enabling subject-specific training. In this work, we adapt zero-shot PG-DL for real-time cine MRI with a spatio-temporal regularization. We compare our method to TGRAPPA, locally low-rank (LLR) regularized reconstruction and database-trained PG-DL reconstruction, both for retrospectively and prospectively accelerated datasets. Results on highly accelerated real-time Cartesian cine MRI show that the proposed method outperforms other reconstruction methods, both visibly in terms of noise and aliasing, and quantitatively.

Signal-Intensity Informed Multi-Coil MRI Encoding Operator for Improved Physics-Guided Deep Learning Reconstruction of Dynamic Contrast-Enhanced MRI.

Dynamic contrast enhanced (DCE) MRI acquires a series of images following the administration of a contrast agent, and plays an important clinical role in diagnosing various diseases. DCE MRI typically necessitates rapid imaging to provide sufficient spatio-temporal resolution and coverage. Conventional MRI acceleration techniques exhibit limited image quality at such high acceleration rates. Recently, deep learning (DL) methods have gained interest for improving highly-accelerated MRI. However, DCE MRI series show substantial variations in SNR and contrast across images. This hinders the quality and generalizability of DL methods, when applied across time frames. In this study, we propose signal intensity informed multi-coil MRI encoding operator for improved DL reconstruction of DCE MRI. The output of the corresponding inverse problem for this forward operator leads to more uniform contrast across time frames, since the proposed operator captures signal intensity variations across time frames while not altering the coil sensitivities. Our results in perfusion cardiac MRI show that high-quality images are reconstructed at very high acceleration rates, with substantial improvement over existing methods.

fastMRI+, Clinical pathology annotations for knee and brain fully sampled magnetic resonance imaging data.

Improving speed and image quality of Magnetic Resonance Imaging (MRI) using deep learning reconstruction is an active area of research. The fastMRI dataset contains large volumes of raw MRI data, which has enabled significant advances in this field. While the impact of the fastMRI dataset is unquestioned, the dataset currently lacks clinical expert pathology annotations, critical to addressing clinically relevant reconstruction frameworks and exploring important questions regarding rendering of specific pathology using such novel approaches. This work introduces fastMRI+, which consists of 16154 subspecialist expert bounding box annotations and 13 study-level labels for 22 different pathology categories on the fastMRI knee dataset, and 7570 subspecialist expert bounding box annotations and 643 study-level labels for 30 different pathology categories for the fastMRI brain dataset. The fastMRI+ dataset is open access and aims to support further research and advancement of medical imaging in MRI reconstruction and beyond.

Application of Deep Neural Networks as a Prescreening Tool to Assign Individualized Absorption Models in Pharmacokinetic Analysis.

A specific model for drug absorption is necessarily assumed in pharmacokinetic (PK) analyses following extravascular dosing. Unfortunately, an inappropriate absorption model may force other model parameters to be poorly estimated. An added complexity arises in population PK analyses when different individuals appear to have different absorption patterns. The aim of this study is to demonstrate that a deep neural network (DNN) can be used to prescreen data and assign an individualized absorption model consistent with either a first-order, Erlang, or split-peak process. Ten thousand profiles were simulated for each of the three aforementioned shapes and used for training the DNN algorithm with a 30% hold-out validation set. During the training phase, a 99.7% accuracy was attained, with 99.4% accuracy during in the validation process. In testing the algorithm classification performance with external patient data, a 93.7% accuracy was reached. This algorithm was developed to prescreen individual data and assign a particular absorption model prior to a population PK analysis. We envision it being used as an efficient prescreening tool in other situations that involve a model component that appears to be variable across subjects. It has the potential to reduce the time needed to perform a manual visual assignment and eliminate inter-assessor variability and bias in assigning a sub-model.

Compressed Sensing MRI with ℓ1-Wavelet Reconstruction Revisited Using Modern Data Science Tools.

Deep learning (DL) has emerged as a powerful tool for improving the reconstruction quality of accelerated MRI. These methods usually show enhanced performance compared to conventional methods, such as compressed sensing (CS) and parallel imaging. However, in most scenarios, CS is implemented with two or three empirically-tuned hyperparameters, while a plethora of advanced data science tools are used in DL. In this work, we revisit ℓ1 -wavelet CS for accelerated MRI using modern data science tools. By using tools like algorithm unrolling and end-to-end training with stochastic gradient descent over large databases that DL algorithms utilize, and combining these with conventional concepts like wavelet sub-band processing and reweighted ℓ1 minimization, we show that ℓ1-wavelet CS can be fine-tuned to a level comparable to DL methods. While DL uses hundreds of thousands of parameters, the proposed optimized ℓ1-wavelet CS with sub-band training and reweighting uses only 128 parameters, and employs a fully-explainable convex reconstruction model.

20-fold Accelerated 7T fMRI Using Referenceless Self-Supervised Deep Learning Reconstruction.

High spatial and temporal resolution across the whole brain is essential to accurately resolve neural activities in fMRI. Therefore, accelerated imaging techniques target improved coverage with high spatio-temporal resolution. Simultaneous multi-slice (SMS) imaging combined with in-plane acceleration are used in large studies that involve ultrahigh field fMRI, such as the Human Connectome Project. However, for even higher acceleration rates, these methods cannot be reliably utilized due to aliasing and noise artifacts. Deep learning (DL) reconstruction techniques have recently gained substantial interest for improving highly-accelerated MRI. Supervised learning of DL reconstructions generally requires fully-sampled training datasets, which is not available for high-resolution fMRI studies. To tackle this challenge, self-supervised learning has been proposed for training of DL reconstruction with only undersampled datasets, showing similar performance to supervised learning. In this study, we utilize a self-supervised physics-guided DL reconstruction on a 5-fold SMS and 4-fold in-plane accelerated 7T fMRI data. Our results show that our self-supervised DL reconstruction produce high-quality images at this 20-fold acceleration, substantially improving on existing methods, while showing similar functional precision and temporal effects in the subsequent analysis compared to a standard 10-fold accelerated acquisition.

High-Fidelity Accelerated MRI Reconstruction by Scan-Specific Fine-Tuning of Physics-Based Neural Networks.

Long scan duration remains a challenge for high-resolution MRI. Deep learning has emerged as a powerful means for accelerated MRI reconstruction by providing data-driven regularizers that are directly learned from data. These data-driven priors typically remain unchanged for future data in the testing phase once they are learned during training. In this study, we propose to use a transfer learning approach to fine-tune these regularizers for new subjects using a self-supervision approach. While the proposed approach can compromise the extremely fast reconstruction time of deep learning MRI methods, our results on knee MRI indicate that such adaptation can substantially reduce the remaining artifacts in reconstructed images. In addition, the proposed approach has the potential to reduce the risks of generalization to rare pathological conditions, which may be unavailable in the training data.

Dense Recurrent Neural Networks for Accelerated MRI: History-Cognizant Unrolling of Optimization Algorithms.

Inverse problems for accelerated MRI typically incorporate domain-specific knowledge about the forward encoding operator in a regularized reconstruction framework. Recently physics-driven deep learning (DL) methods have been proposed to use neural networks for data-driven regularization. These methods unroll iterative optimization algorithms to solve the inverse problem objective function, by alternating between domain-specific data consistency and data-driven regularization via neural networks. The whole unrolled network is then trained end-to-end to learn the parameters of the network. Due to simplicity of data consistency updates with gradient descent steps, proximal gradient descent (PGD) is a common approach to unroll physics-driven DL reconstruction methods. However, PGD methods have slow convergence rates, necessitating a higher number of unrolled iterations, leading to memory issues in training and slower reconstruction times in testing. Inspired by efficient variants of PGD methods that use a history of the previous iterates, we propose a history-cognizant unrolling of the optimization algorithm with dense connections across iterations for improved performance. In our approach, the gradient descent steps are calculated at a trainable combination of the outputs of all the previous regularization units. We also apply this idea to unrolling variable splitting methods with quadratic relaxation. Our results in reconstruction of the fastMRI knee dataset show that the proposed history-cognizant approach reduces residual aliasing artifacts compared to its conventional unrolled counterpart without requiring extra computational power or increasing reconstruction time.

Low-Rank Tensor Models for Improved Multi-Dimensional MRI: Application to Dynamic Cardiac T 1 Mapping.

Multi-dimensional, multi-contrast magnetic resonance imaging (MRI) has become increasingly available for comprehensive and time-efficient evaluation of various pathologies, providing large amounts of data and offering new opportunities for improved image reconstructions. Recently, a cardiac phase-resolved myocardial T 1 mapping method has been introduced to provide dynamic information on tissue viability. Improved spatio-temporal resolution in clinically acceptable scan times is highly desirable but requires high acceleration factors. Tensors are well-suited to describe inter-dimensional hidden structures in such multi-dimensional datasets. In this study, we sought to utilize and compare different tensor decomposition methods, without the use of auxiliary navigator data. We explored multiple processing approaches in order to enable high-resolution cardiac phase-resolved myocardial T 1 mapping. Eight different low-rank tensor approximation and processing approaches were evaluated using quantitative analysis of accuracy and precision in T 1 maps acquired in six healthy volunteers. All methods provided comparable T 1 values. However, the precision was significantly improved using local processing, as well as a direct tensor rank approximation. Low-rank tensor approximation approaches are well-suited to enable dynamic T 1 mapping at high spatio-temporal resolutions.

Locally Low-Rank Tensor Regularization for High-Resolution Quantitative Dynamic MRI.

Quantitative dynamic MRI acquisitions have the potential to diagnose diffuse diseases in conjunction with functional abnormalities. However, their resolutions are limited due to the long acquisition time. Such datasets are multi-dimensional, exhibiting interactions between ≥ 4 dimensions, which cannot be easily identified using sparsity or low-rank matrix methods. Hence, low-rank tensors are a natural fit to model such data. But in the presence of multitude of different tissue types in the field-of-view, it is difficult to find an appropriate value of tensor rank, which avoids under- or over-regularization. In this work, we propose a locally low-rank tensor regularization approach to enable high-resolution quantitative dynamic MRI. We show this approach successfully enables dynamic T 1 mapping at high spatio-temporal resolutions.