Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning.

Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.

Self-Supervised Deep Unrolled Reconstruction Using Regularization by Denoising.

Deep learning methods have been successfully used in various computer vision tasks. Inspired by that success, deep learning has been explored in magnetic resonance imaging (MRI) reconstruction. In particular, integrating deep learning and model-based optimization methods has shown considerable advantages. However, a large amount of labeled training data is typically needed for high reconstruction quality, which is challenging for some MRI applications. In this paper, we propose a novel reconstruction method, named DURED-Net, that enables interpretable self-supervised learning for MR image reconstruction by combining a self-supervised denoising network and a plug-and-play method. We aim to boost the reconstruction performance of Noise2Noise in MR reconstruction by adding an explicit prior that utilizes imaging physics. Specifically, the leverage of a denoising network for MRI reconstruction is achieved using Regularization by Denoising (RED). Experiment results demonstrate that the proposed method requires a reduced amount of training data to achieve high reconstruction quality among the state-of-the-art approaches utilizing Noise2Noise.

Subspace Model-Assisted Deep Learning for Improved Image Reconstruction.

Image reconstruction from limited and/or sparse data is known to be an ill-posed problem and a priori information/constraints have played an important role in solving the problem. Early constrained image reconstruction methods utilize image priors based on general image properties such as sparsity, low-rank structures, spatial support bound, etc. Recent deep learning-based reconstruction methods promise to produce even higher quality reconstructions by utilizing more specific image priors learned from training data. However, learning high-dimensional image priors requires huge amounts of training data that are currently not available in medical imaging applications. As a result, deep learning-based reconstructions often suffer from two known practical issues: a) sensitivity to data perturbations (e.g., changes in data sampling scheme), and b) limited generalization capability (e.g., biased reconstruction of lesions). This paper proposes a new method to address these issues. The proposed method synergistically integrates model-based and data-driven learning in three key components. The first component uses the linear vector space framework to capture global dependence of image features; the second exploits a deep network to learn the mapping from a linear vector space to a nonlinear manifold; the third is an unrolling-based deep network that captures local residual features with the aid of a sparsity model. The proposed method has been evaluated with magnetic resonance imaging data, demonstrating improved reconstruction in the presence of data perturbation and/or novel image features. The method may enhance the practical utility of deep learning-based image reconstruction.

Equilibrated Zeroth-Order Unrolled Deep Network for Parallel MR Imaging.

In recent times, model-driven deep learning has evolved an iterative algorithm into a cascade network by replacing the regularizer's first-order information, such as the (sub)gradient or proximal operator, with a network module. This approach offers greater explainability and predictability compared to typical data-driven networks. However, in theory, there is no assurance that a functional regularizer exists whose first-order information matches the substituted network module. This implies that the unrolled network output may not align with the regularization models. Furthermore, there are few established theories that guarantee global convergence and robustness (regularity) of unrolled networks under practical assumptions. To address this gap, we propose a safeguarded methodology for network unrolling. Specifically, for parallel MR imaging, we unroll a zeroth-order algorithm, where the network module serves as a regularizer itself, allowing the network output to be covered by a regularization model. Additionally, inspired by deep equilibrium models, we conduct the unrolled network before backpropagation to converge to a fixed point and then demonstrate that it can tightly approximate the actual MR image. We also prove that the proposed network is robust against noisy interferences if the measurement data contain noise. Finally, numerical experiments indicate that the proposed network consistently outperforms state-of-the-art MRI reconstruction methods, including traditional regularization and unrolled deep learning techniques.

Imaging-based intelligent spectrometer on a plasmonic rainbow chip.

Compact, lightweight, and on-chip spectrometers are required to develop portable and handheld sensing and analysis applications. However, the performance of these miniaturized systems is usually much lower than their benchtop laboratory counterparts due to oversimplified optical architectures. Here, we develop a compact plasmonic "rainbow" chip for rapid, accurate dual-functional spectroscopic sensing that can surpass conventional portable spectrometers under selected conditions. The nanostructure consists of one-dimensional or two-dimensional graded metallic gratings. By using a single image obtained by an ordinary camera, this compact system can accurately and precisely determine the spectroscopic and polarimetric information of the illumination spectrum. Assisted by suitably trained deep learning algorithms, we demonstrate the characterization of optical rotatory dispersion of glucose solutions at two-peak and three-peak narrowband illumination across the visible spectrum using just a single image. This system holds the potential for integration with smartphones and lab-on-a-chip systems to develop applications for in situ analysis.

SuperMAP: Deep ultrafast MR relaxometry with joint spatiotemporal undersampling.

PURPOSE: To develop an ultrafast and robust MR parameter mapping network using deep learning. THEORY AND METHODS: We design a deep learning framework called SuperMAP that directly converts a series of undersampled (both in k-space and parameter-space) parameter-weighted images into several quantitative maps, bypassing the conventional exponential fitting procedure. We also present a novel technique to simultaneously reconstruct T1rho and T2 relaxation maps within a single scan. Full data were acquired and retrospectively undersampled for training and testing using traditional and state-of-the-art techniques for comparison. Prospective data were also collected to evaluate the trained network. The performance of all methods is evaluated using the parameter qualification errors and other metrics in the segmented regions of interest. RESULTS: SuperMAP achieved accurate T1rho and T2 mapping with high acceleration factors (R = 24 and R = 32). It exploited both spatial and temporal information and yielded low error (normalized mean square error of 2.7% at R = 24 and 2.8% at R = 32) and high resemblance (structural similarity of 97% at R = 24 and 96% at R = 32) to the gold standard. The network trained with retrospectively undersampled data also works well for the prospective data (with a slightly lower acceleration factor). SuperMAP is also superior to conventional methods. CONCLUSION: Our results demonstrate the feasibility of generating superfast MR parameter maps through very few undersampled parameter-weighted images. SuperMAP can simultaneously generate T1rho and T2 relaxation maps in a short scan time.

Hairpin RF resonators for MR imaging transceiver arrays with high inter-channel isolation and B1 efficiency at ultrahigh field 7 T.

Electromagnetic decoupling among a close-fitting or high-density transceiver RF array elements is required to maintain the integrity of the magnetic flux density from individual channel for enhanced performance in detection sensitivity and parallel imaging. High-impedance RF coils have demonstrated to be a prominent design method to circumvent these coupling issues. Yet, inherent characteristics of these coils have ramification on the B1 field efficiency and SNR. In this work, we propose a hairpin high impedance RF resonator design for highly decoupled multichannel transceiver arrays at ultrahigh magnetic fields. Due to the high impedance property of the hairpin resonators, the proposed transceiver array can provide high decoupling performance without using any dedicated decoupling circuit among the resonant elements. Because of elimination of lumped inductors in the resonator circuit, higher B1 field efficiency in imaging subjects can be expected. In order to validate the feasibility of the proposed hairpin RF coils, systematical studies on decoupling performance, field distribution, and SNR are performed, and the results are compared with those obtained from existing high-impedance RF coil, e.g., "self-decoupled RF coil". To further investigate its performance, an 8-channel head coil array using the proposed hairpin resonators loaded with a cylindrical phantom is designed, demonstrating a 19 % increase of the B1+ field intensity compared to the self-decoupled coils at 7 T. Furthermore, the characteristics of the hairpin RF coils are evaluated using a more realistic human head voxel model numerically. The proposed hairpin RF coil provides excellent decoupling performance and superior RF magnetic field efficiency compared to the "self-decoupled" high impedance coils. Bench test of a pair of fabricated hairpin coils prove to be in good accordance with numerical results.

Minimizing Molecular Misidentification in Imaging Low-Abundance Protein Interactions Using Spectroscopic Single-Molecule Localization Microscopy.

Super-resolution microscopy can capture spatiotemporal organizations of protein interactions with resolution down to 10 nm; however, the analyses of more than two proteins involving low-abundance protein are challenging because spectral crosstalk and heterogeneities of individual fluorescent labels result in molecular misidentification. Here we developed a deep learning-based imaging analysis method for spectroscopic single-molecule localization microscopy to minimize molecular misidentification in three-color super-resolution imaging. We characterized the 3-fold reduction of molecular misidentification in the new imaging method using pure samples of different photoswitchable fluorophores and visualized three distinct subcellular proteins in U2-OS cell lines. We further validated the protein counts and interactions of TOMM20, DRP1, and SUMO1 in a well-studied biological process, Staurosporine-induced apoptosis, by comparing the imaging results with Western-blot analyses of different subcellular portions.