MPIGAN: An end-to-end deep based generative framework for high-resolution magnetic particle imaging reconstruction.

BACKGROUND: Magnetic particle imaging (MPI) is a recently developed, non-invasive in vivo imaging technique to map the spatial distribution of superparamagnetic iron oxide nanoparticles (SPIONs) in animal tissues with high sensitivity and speed. It is a challenge to reconstruct images directly from the received signals of MPI device due to the complex physical behavior of the nanoparticles. System matrix and X-space are two commonly used MPI reconstruction methods, where the former is extremely time-consuming and the latter usually produces blurry images. PURPOSE: Currently, we proposed an end-to-end machine learning framework to reconstruct high-resolution MPI images from 1-D voltage signals directly and efficiently. METHODS: The proposed framework, which we termed "MPIGAN", was trained on a large MPI simulation dataset containing 291 597 pairs of high-resolution 2-D phantom images and each image's corresponding voltage signals, so that it was able to accurately capture the nonlinear relationship between the spatial distribution of SPIONs and the received voltage signal, and realized high-resolution MPI image reconstruction. RESULTS: Experiment results showed that, MPIGAN exhibited remarkable abilities in high-resolution MPI image reconstruction. MPIGAN outperformed the traditional methods of system matrix and X-space in recovering the fine-scale structure of magnetic nanoparticles' spatial distribution and achieving enhanced reconstruction performance in both visual effects and quantitative assessments. Moreover, even when the received signals were severely contaminated with noise, MPIGAN could still generate high-quality MPI images. CONCLUSION: Our study provides a promising AI solution for end-to-end, efficient, and high-resolution magnetic particle imaging reconstruction.

Direct multi-dimensional Chebyshev polynomial based reconstruction for magnetic particle imaging.

Magnetic Particle Imaging is a tomographic imaging technique that measures the voltage induced due to magnetization changes of magnetic nanoparticle distributions. The relationship between the received signal and the distribution of the nanoparticels is described by the system function. A common method for image reconstruction is using a measured system function to create a system matrix and set up a regularized linear system of equations. Since the measurement of the system matrix is time-consuming, different methods for acceleration have been proposed. These include modeling the system matrix or using a direct reconstruction method in time, known as X-space reconstruction. In this work, based on the simplified Langevin model of paramagnetism and certain approximations, a direct reconstruction technique for Magnetic Particle Imaging in the frequency domain with two- and three-dimensional Lissajous trajectory excitation is presented. The approach uses Chebyshev polynomials of second kind. During reconstruction, they are weighted with the frequency components of the voltage signal and additional factors and then summed up. To obtain the final nanoparticle distribution, this result is rescaled and deconvolved. It is shown that the approach works for both simulated data and real measurements. The obtained image quality is comparable to a modeled system matrix approach using the same simplified physical assumptions and no relaxation effects. The reconstruction of a 31 × 31 × 31 volume takes less than a second and is up to 25 times faster than the state-of-the-art Kaczmarz reconstruction. Besides, the derivation of the proposed method shows some new theoretical aspects of the system function and its well-known observed similarity to tensor products of Chebyshev polynomials of second kind.

Rapid high-quality PET Patlak parametric image generation based on direct reconstruction and temporal nonlocal neural network.

Parametric imaging based on dynamic positron emission tomography (PET) has wide applications in neurology. Compared to indirect methods, direct reconstruction methods, which reconstruct parametric images directly from the raw PET data, have superior image quality due to better noise modeling and richer information extracted from the PET raw data. For low-dose scenarios, the advantages of direct methods are more obvious. However, the wide adoption of direct reconstruction is inevitably impeded by the excessive computational demand and deficiency of the accessible raw data. In addition, motion modeling inside dynamic PET image reconstruction raises more computational challenges for direct reconstruction methods. In this work, we focused on the 18F-FDG Patlak model, and proposed a data-driven approach which can estimate the motion corrected full-dose direct Patlak images from the dynamic PET reconstruction series, based on a proposed novel temporal non-local convolutional neural network. During network training, direct reconstruction with motion correction based on full-dose dynamic PET sinograms was performed to obtain the training labels. The reconstructed full-dose /low-dose dynamic PET images were supplied as the network input. In addition, a temporal non-local block based on the dynamic PET images was proposed to better recover the structural information and reduce the image noise. During testing, the proposed network can directly output high-quality Patlak parametric images from the full-dose /low-dose dynamic PET images in seconds. Experiments based on 15 full-dose and 15 low-dose 18F-FDG brain datasets were conducted and analyzed to validate the feasibility of the proposed framework. Results show that the proposed framework can generate better image quality than reference methods.

Direct and indirect parameter imaging methods for dynamic PET.

The method of reconstructing parametric images from dynamic positron emission tomography (PET) data with the linear Patlak model has been widely used in scientific research and clinical practice. Whether for direct or indirect image reconstruction, researchers have deeply investigated the associated methods and effects. Among the existing methods, the traditional maximum likelihood expectation maximization (MLEM) reconstruction algorithm is fast but produces a substantial amount of noise. If the parameter images obtained by the MLEM algorithm are postfiltered, a large amount of image edge information is lost. Additionally, although the kernel method has a better noise reduction effect, its calculation costs are very high due to the complexity of the algorithm. Therefore, to obtain parametric images with a high signal-to-noise ratio (SNR) and good retention of detailed information, here, we use guided kernel means (GKM) and dynamic PET image information to conduct guided filtering and perform parametric image reconstruction. We apply this method to direct and indirect reconstruction, and through computer simulations, we show that our proposed method has higher identifiability and a greater SNR than conventional direct and indirect reconstruction methods. We also show that our method produces better images with direct than with indirect reconstruction.

PET imaging of neurotransmission using direct parametric reconstruction.

Receptor ligand-based dynamic Positron Emission Tomography (PET) permits the measurement of neurotransmitter release in the human brain. For single-scan paradigms, the conventional method of estimating changes in neurotransmitter levels relies on fitting a pharmacokinetic model to activity concentration histories extracted after PET image reconstruction. However, due to the statistical fluctuations of activity concentration data at the voxel scale, parametric images computed using this approach often exhibit low signal-to-noise ratio, impeding characterization of neurotransmitter release. Numerous studies have shown that direct parametric reconstruction (DPR) approaches, which combine image reconstruction and kinetic analysis in a unified framework, can improve the signal-to-noise ratio of parametric mapping. However, there is little experience with DPR in imaging of neurotransmission and the performance of the approach in this application has not been evaluated before in humans. In this report, we present and evaluate a DPR methodology that computes 3-D distributions of ligand transport, binding potential (BPND) and neurotransmitter release magnitude (γ) from a dynamic sequence of PET sinograms. The technique employs the linear simplified reference region model (LSRRM) of Alpert et al. (2003), which represents an extension of the simplified reference region model that incorporates time-varying binding parameters due to radioligand displacement by release of neurotransmitter. Estimation of parametric images is performed by gradient-based optimization of a Poisson log-likelihood function incorporating LSRRM kinetics and accounting for the effects of head movement, attenuation, detector sensitivity, random and scattered coincidences. A 11C-raclopride simulation study showed that the proposed approach substantially reduces the bias and variance of voxel-wise γ estimates as compared to standard methods. Moreover, simulations showed that detection of release could be made more reliable and/or conducted using a smaller sample size using the proposed DPR estimator. Likewise, images of BPND computed using DPR had substantially improved bias and variance properties. Application of the method in human subjects was demonstrated using 11C-raclopride dynamic scans and a reward task, confirming the improved quality of the estimated parametric images using the proposed approach.

Direct Distal Renal Artery Aneurysm Repair.

OBJECTIVE: Treatment of renal artery aneurysms (RAA) remains controversial. Endovascular treatment has increased for main trunk and for very distal aneurysms, whereas for lesions located at the bifurcation surgical treatment seems to be a valid option. The goal of this study was to describe the technique of direct reconstruction of RAA and to report on outcomes. METHODS: This study comprised single centre prospective collection of data with retrospective analysis (January 2015 to August 2018) of patients operated on for distal RAA using direct reconstruction. RESULTS: A total of 24 RAA in 21 patients (seven men and 14 women, mean age 59 ± 13 years) was included. History of hypertension was found in 15 patients and renal insufficiency was present in one. Mean pre-operative systolic and diastolic blood pressures were 134 ± 21 mmHg and 74 ± 10 mmHg, and mean pre-operative rates of creatinine and glomerular filtration rate were 67 ± 13 µmol/L and 93 ± 49 mL/min/1.73 m2, respectively. Indications for repair were a diameter >20 mm in seven cases (mean diameter = 25 ± 2 mm) or rapid growth in one case, symptomatic aneurysm in 12 cases (hypertension, haematuria, pain), and a concomitant lesion in four cases (splenic aneurysm, abdominal aortic aneurysm, occlusive visceral artery lesions). All lesions were distal, main artery bifurcation in 22 cases and hilar in two cases. The main aetiology was fibromuscular dysplasia (16 cases) followed by atherosclerosis (seven cases) and one case of Ehlers Danlos Syndrome. In situ reconstruction was possible for 22 RAA, while two cases required kidney autotransplantation. The mean renal ischaemia time was 18 ± 5 min. At two years, the patency rate was 100%, and mean systolic blood pressure decreased (134 mmHg-122 mmHg, p = .047). Renal function was stable from 93 ± 49 pre-operatively to 95 ± 35 mL/min/1.73 m2 in the post-operative course (p = .56). CONCLUSION: Direct reconstruction appears to be efficient for most RAA. This technique is complementary to ex vivo autotransplantation and endovascular treatment.

Total-Body Dynamic Reconstruction and Parametric Imaging on the uEXPLORER.

The world's first 194-cm-long total-body PET/CT scanner (uEXPLORER) has been built by the EXPLORER Consortium to offer a transformative platform for human molecular imaging in clinical research and health care. Its total-body coverage and ultra-high sensitivity provide opportunities for more accurate tracer kinetic analysis in studies of physiology, biochemistry, and pharmacology. The objective of this study was to demonstrate the capability of total-body parametric imaging and to quantify the improvement in image quality and kinetic parameter estimation by direct and kernel reconstruction of the uEXPLORER data. Methods: We developed quantitative parametric image reconstruction methods for kinetic analysis and used them to analyze the first human dynamic total-body PET study. A healthy female subject was recruited, and a 1-h dynamic scan was acquired during and after an intravenous injection of 256 MBq of 18F-FDG. Dynamic data were reconstructed using a 3-dimensional time-of-flight list-mode ordered-subsets expectation maximization (OSEM) algorithm and a kernel-based algorithm with all quantitative corrections implemented in the forward model. The Patlak graphical model was used to analyze the 18F-FDG kinetics in the whole body. The input function was extracted from a region over the descending aorta. For comparison, indirect Patlak analysis from reconstructed frames and direct reconstruction of parametric images from the list-mode data were obtained for the last 30 min of data. Results: Images reconstructed by OSEM showed good quality with low noise, even for the 1-s frames. The image quality was further improved using the kernel method. Total-body Patlak parametric images were obtained using either indirect estimation or direct reconstruction. The direct reconstruction method improved the parametric image quality, having a better contrast-versus-noise tradeoff than the indirect method, with a 2- to 3-fold variance reduction. The kernel-based indirect Patlak method offered image quality similar to the direct Patlak method, with less computation time and faster convergence. Conclusion: This study demonstrated the capability of total-body parametric imaging using the uEXPLORER. Furthermore, the results showed the benefits of kernel-regularized reconstruction and direct parametric reconstruction. Both can achieve superior image quality for tracer kinetic studies compared with the conventional indirect OSEM for total-body imaging.

Image-based Modeling of PSF Deformation with Application to Limited Angle PET Data.

The point-spread-functions (PSFs) of reconstructed images can be deformed due to detector effects such as resolution blurring and parallax error, data acquisition geometry such as insufficient sampling or limited angular coverage in dual-panel PET systems, or reconstruction imperfections/simplifications. PSF deformation decreases quantitative accuracy and its spatial variation lowers consistency of lesion uptake measurement across the imaging field-of-view (FOV). This can be a significant problem with dual panel PET systems even when using TOF data and image reconstruction models of the detector and data acquisition process. To correct for the spatially variant reconstructed PSF distortions we propose to use an image-based resolution model (IRM) that includes such image PSF deformation effects. Originally the IRM was mostly used for approximating data resolution effects of standard PET systems with full angular coverage in a computationally efficient way, but recently it was also used to mitigate effects of simplified geometric projectors. Our work goes beyond this by including into the IRM reconstruction imperfections caused by combination of the limited angle, parallax errors, and any other (residual) deformation effects and testing it for challenging dual panel data with strongly asymmetric and variable PSF deformations. We applied and tested these concepts using simulated data based on our design for a dedicated breast imaging geometry (B-PET) consisting of dual-panel, time-of-flight (TOF) detectors. We compared two image-based resolution models; i) a simple spatially invariant approximation to PSF deformation, which captures only the general PSF shape through an elongated 3D Gaussian function, and ii) a spatially variant model using a Gaussian mixture model (GMM) to more accurately capture the asymmetric PSF shape in images reconstructed from data acquired with the B-PET scanner geometry. Results demonstrate that while both IRMs decrease the overall uptake bias in the reconstructed image, the second one with the spatially variant and accurate PSF shape model is also able to ameliorate the spatially variant deformation effects to provide consistent uptake results independent of the lesion location within the FOV.

Direct parametric reconstruction from undersampled (k, t)-space data in dynamic contrast enhanced MRI.

The Magnetic Resonance Imaging (MRI) signal can be made sensitive to functional parameters that provide information about tissues. In dynamic contrast enhanced (DCE) MRI these functional parameters are related to the microvasculature environment and the concentration changes that occur rapidly after the injection of a contrast agent. Typically DCE images are reconstructed individually and kinetic parameters are estimated by fitting a pharmacokinetic model to the time-enhancement response; these methods can be denoted as "indirect". If undersampling is present to accelerate the acquisition, techniques such as kt-FOCUSS can be employed in the reconstruction step to avoid image degradation. This paper suggests a Bayesian inference framework to estimate functional parameters directly from the measurements at high temporal resolution. The current implementation estimates pharmacokinetic parameters (related to the extended Tofts model) from undersampled (k, t)-space DCE MRI. The proposed scheme is evaluated on a simulated abdominal DCE phantom and prostate DCE data, for fully sampled, 4 and 8-fold undersampled (k, t)-space data. Direct kinetic parameters demonstrate better correspondence (up to 70% higher mutual information) to the ground truth kinetic parameters (of the simulated abdominal DCE phantom) than the ones derived from the indirect methods. For the prostate DCE data, direct kinetic parameters depict the morphology of the tumour better. To examine the impact on cancer diagnosis, a peripheral zone prostate cancer diagnostic model was employed to calculate a probability map for each method.