Distinction of Chaos from Randomness Is Not Possible from the Degree Distribution of the Visibility and Phase Space Reconstruction Graphs.

We investigate whether it is possible to distinguish chaotic time series from random time series using network theory. In this perspective, we selected four methods to generate graphs from time series: the natural, the horizontal, the limited penetrable horizontal visibility graph, and the phase space reconstruction method. These methods claim that the distinction of chaos from randomness is possible by studying the degree distribution of the generated graphs. We evaluated these methods by computing the results for chaotic time series from the 2D Torus Automorphisms, the chaotic Lorenz system, and a random sequence derived from the normal distribution. Although the results confirm previous studies, we found that the distinction of chaos from randomness is not generally possible in the context of the above methodologies.

Image Restoration via Low-Illumination to Normal-Illumination Networks Based on Retinex Theory.

Under low-illumination conditions, the quality of the images collected by the sensor is significantly impacted, and the images have visual problems such as noise, artifacts, and brightness reduction. Therefore, this paper proposes an effective network based on Retinex for low-illumination image enhancement. Inspired by Retinex theory, images are decomposed into two parts in the decomposition network, and sent to the sub-network for processing. The reconstruction network constructs global and local residual convolution blocks to denoize the reflection component. The enhancement network uses frequency information, combined with attention mechanism and residual density network to enhance contrast and improve the details of the illumination component. A large number of experiments on public datasets show that our method is superior to existing methods in both quantitative and visual aspects.

Image Deblurring Using Multi-Stream Bottom-Top-Bottom Attention Network and Global Information-Based Fusion and Reconstruction Network.

Image deblurring has been a challenging ill-posed problem in computer vision. Gaussian blur is a common model for image and signal degradation. The deep learning-based deblurring methods have attracted much attention due to their advantages over the traditional methods relying on hand-designed features. However, the existing deep learning-based deblurring techniques still cannot perform well in restoring the fine details and reconstructing the sharp edges. To address this issue, we have designed an effective end-to-end deep learning-based non-blind image deblurring algorithm. In the proposed method, a multi-stream bottom-top-bottom attention network (MBANet) with the encoder-to-decoder structure is designed to integrate low-level cues and high-level semantic information, which can facilitate extracting image features more effectively and improve the computational efficiency of the network. Moreover, the MBANet adopts a coarse-to-fine multi-scale strategy to process the input images to improve image deblurring performance. Furthermore, the global information-based fusion and reconstruction network is proposed to fuse multi-scale output maps to improve the global spatial information and recurrently refine the output deblurred image. The experiments were done on the public GoPro dataset and the realistic and dynamic scenes (REDS) dataset to evaluate the effectiveness and robustness of the proposed method. The experimental results show that the proposed method generally outperforms some traditional deburring methods and deep learning-based state-of-the-art deblurring methods such as scale-recurrent network (SRN) and denoising prior driven deep neural network (DPDNN) in terms of such quantitative indexes as peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) and human vision.

Phase-sensitive deep reconstruction method for rapid multiparametric MR fingerprinting and quantitative susceptibility mapping in the brain.

INTRODUCTION: This study explores the potential of Magnetic Resonance Fingerprinting (MRF) with a novel Phase-Sensitivity Deep Reconstruction Network (PS-DRONE) for simultaneous quantification of T1, T2, Proton Density, B1+, phase and quantitative susceptibility mapping (QSM). METHODS: Data were acquired at 3 T in vitro and in vivo using an optimized EPI-based MRF sequence. Phantom experiments were conducted using a standardized phantom for T1 and T2 maps and a custom-made agar-based gadolinium phantom for B1 and QSM maps. In vivo experiments included five healthy volunteers and one patient diagnosed with brain metastasis. PSDRONE maps were compared to reference maps obtained through standard imaging sequences. RESULTS: Total scan time was 2 min for 32 slices and a resolution of [1 mm, 1 mm, 4.5 mm]. The reconstruction of T1, T2, Proton Density, B1+ and phase maps were reconstructed within 1 s. In the phantoms, PS-DRONE analysis presented accurate and strongly correlated T1 and T2 maps (r = 0.99) compared to the reference maps. B1 maps from PS-DRONE showed slightly higher values, though still correlated (r = 0.6) with the reference. QSM values showed a small bias but were strongly correlated (r = 0.99) with reference data. In the in vivo analysis, PS-DRONE-derived T1 and T2 values for gray and white matter matched reference values in healthy volunteers. PS-DRONE B1 and QSM maps showed strong correlations with reference values. CONCLUSION: The PS-DRONE network enables concurrent acquisition of T1, T2, PD, B1+, phase and QSM maps, within 2 min of acquisition time and 1 s of reconstruction time.

A progressively dual reconstruction network for plane wave beamforming with both paired and unpaired training data.

High-frame-rate plane wave (PW) imaging suffers from unsatisfactory image quality due to the absence of focus in transmission. Although coherent compounding from tens of PWs can improve PW image quality, it in turn results in a decreased frame rate, which is limited for tracking fast moving tissues. To overcome the trade-off between frame rate and image quality, we propose a progressively dual reconstruction network (PDRN) to achieve adaptive beamforming and enhance the image quality via both supervised and transfer learning in the condition of single or a few PWs transmission. Specifically, the proposed model contains a progressive network and a dual network to form a close loop and provide collaborative supervision for model optimization. The progressive network takes the channel delay of each spatial point as input and progressively learns coherent compounding beamformed data with increased numbers of steered PWs step by step. The dual network learns the downsampling process and reconstructs the beamformed data with decreased numbers of steered PWs, which reduces the space of the possible learning functions and improves the model's discriminative ability. In addition, the dual network is leveraged to perform transfer learning for the training data without sufficient steered PWs. The simulated, in vivo, vocal cords (VCs), and public available CUBDL dataset are collected for model evaluation.

Projection-to-image transform frame: a lightweight block reconstruction network for computed tomography.

Several reconstruction networks have been invented to solve the problem of learning-based computed tomography (CT) reconstruction. However, the application of neural networks to tomographic reconstruction remains challenging due to unacceptable memory space requirements. In this study, we present a novel lightweight block reconstruction network (LBRN), which transforms the reconstruction operator into a deep neural network by unrolling the filter back-projection (FBP) method. Specifically, the proposed network contains two main modules, which respectively correspond to the filter and back-projection of the FBP method. The first module of the LBRN decouples the relationship of the Radon transform between the reconstructed image and the projection data. Therefore, the following module, block back-projection, can use the block reconstruction strategy. Because each image block is only connected with part-filtered projection data, the network structure is greatly simplified and the parameters of the whole network are dramatically reduced. Moreover, this approach is trained end-to-end, working directly from raw projection data, and does not depend on any initial images. Five reconstruction experiments are conducted to evaluate the performance of the proposed LBRN: full angle, low-dose CT, region of interest, metal artifact reduction and a real data experiment. The results of the experiments show that the LBRN can be effectively introduced into the reconstruction process and has outstanding advantages in terms of different reconstruction problems.

3D FRN-ResNet: An Automated Major Depressive Disorder Structural Magnetic Resonance Imaging Data Identification Framework.

Major Depressive Disorder (MDD) is the most prevalent psychiatric disorder, seriously affecting people's quality of life. Manually identifying MDD from structural magnetic resonance imaging (sMRI) images is laborious and time-consuming due to the lack of clear physiological indicators. With the development of deep learning, many automated identification methods have been developed, but most of them stay in 2D images, resulting in poor performance. In addition, the heterogeneity of MDD also results in slightly different changes reflected in patients' brain imaging, which constitutes a barrier to the study of MDD identification based on brain sMRI images. We propose an automated MDD identification framework in sMRI data (3D FRN-ResNet) to comprehensively address these challenges, which uses 3D-ResNet to extract features and reconstruct them based on feature maps. Notably, the 3D FRN-ResNet fully exploits the interlayer structure information in 3D sMRI data and preserves most of the spatial details as well as the location information when converting the extracted features into vectors. Furthermore, our model solves the feature map reconstruction problem in closed form to produce a straightforward and efficient classifier and dramatically improves model performance. We evaluate our framework on a private brain sMRI dataset of MDD patients. Experimental results show that the proposed model exhibits promising performance and outperforms the typical other methods, achieving the accuracy, recall, precision, and F1 values of 0.86776, 0.84237, 0.85333, and 0.84781, respectively.

Stabilizing deep tomographic reconstruction: Part B. Convergence analysis and adversarial attacks.

Due to lack of the kernel awareness, some popular deep image reconstruction networks are unstable. To address this problem, here we introduce the bounded relative error norm (BREN) property, which is a special case of the Lipschitz continuity. Then, we perform a convergence study consisting of two parts: (1) a heuristic analysis on the convergence of the analytic compressed iterative deep (ACID) scheme (with the simplification that the CS module achieves a perfect sparsification), and (2) a mathematically denser analysis (with the two approximations: [1] AT is viewed as an inverse A- 1 in the perspective of an iterative reconstruction procedure and [2] a pseudo-inverse is used for a total variation operator H). Also, we present adversarial attack algorithms to perturb the selected reconstruction networks respectively and, more importantly, to attack the ACID workflow as a whole. Finally, we show the numerical convergence of the ACID iteration in terms of the Lipschitz constant and the local stability against noise.

Stabilizing deep tomographic reconstruction: Part A. Hybrid framework and experimental results.

A recent PNAS paper reveals that several popular deep reconstruction networks are unstable. Specifically, three kinds of instabilities were reported: (1) strong image artefacts from tiny perturbations, (2) small features missed in a deeply reconstructed image, and (3) decreased imaging performance with increased input data. Here, we propose an analytic compressed iterative deep (ACID) framework to address this challenge. ACID synergizes a deep network trained on big data, kernel awareness from compressed sensing (CS)-inspired processing, and iterative refinement to minimize the data residual relative to real measurement. Our study demonstrates that the ACID reconstruction is accurate, is stable, and sheds light on the converging mechanism of the ACID iteration under a bounded relative error norm assumption. ACID not only stabilizes an unstable deep reconstruction network but also is resilient against adversarial attacks to the whole ACID workflow, being superior to classic sparsity-regularized reconstruction and eliminating the three kinds of instabilities.

Co-optimization Learning Network for MRI Segmentation of Ischemic Penumbra Tissues.

Convolutional neural networks (CNNs) have brought hope for the medical image auxiliary diagnosis. However, the shortfall of labeled medical image data is the bottleneck that limits the performance improvement of supervised CNN methods. In addition, annotating a large number of labeled medical image data is often expensive and time-consuming. In this study, we propose a co-optimization learning network (COL-Net) for Magnetic Resonance Imaging (MRI) segmentation of ischemic penumbra tissues. COL-Net base on the limited labeled samples and consists of an unsupervised reconstruction network (R), a supervised segmentation network (S), and a transfer block (T). The reconstruction network extracts the robust features from reconstructing pseudo unlabeled samples, which is the auxiliary branch of the segmentation network. The segmentation network is used to segment the target lesions under the limited labeled samples and the auxiliary of the reconstruction network. The transfer block is used to co-optimization the feature maps between the bottlenecks of the reconstruction network and segmentation network. We propose a mix loss function to optimize COL-Net. COL-Net is verified on the public ischemic penumbra segmentation challenge (SPES) with two dozen labeled samples. Results demonstrate that COL-Net has high predictive accuracy and generalization with the Dice coefficient of 0.79. The extended experiment also shows COL-Net outperforms most supervised segmentation methods. COL-Net is a meaningful attempt to alleviate the limited labeled sample problem in medical image segmentation.

A k-space-to-image reconstruction network for MRI using recurrent neural network.

PURPOSE: Reconstructing the images from undersampled k-space data are an ill-posed inverse problem. As a solution to this problem, we propose a method to reconstruct magnetic resonance (MR) images directly from k-space data using a recurrent neural network. METHODS: A novel neural network architecture named "ETER-net" is developed as a unified solution to reconstruct MR images from undersampled k-space data, where two bi-RNNs and convolutional neural network (CNN) are utilized to perform domain transformation and de-aliasing. To demonstrate the practicality of the proposed method, we conducted model optimization, cross-validation, and network pruning using in-house data from a 3T MRI scanner and public dataset called "FastMRI." RESULTS: The experimental results showed that the proposed method could be utilized for accurate image reconstruction from undersampled k-space data. The size of the proposed model was optimized and cross-validation was performed to show the robustness of the proposed method. For in-house dataset (R = 4), the proposed method provided nMSE = 1.09% and SSIM = 0.938. For "FastMRI" dataset, the proposed method provided nMSE = 1.05 % and SSIM = 0.931 for R = 4, and nMSE = 3.12 % and SSIM = 0.884 for R = 8. The performance of the pruned model trained the loss function including with L2 regularization was consistent for a pruning ratio of up to 70%. CONCLUSIONS: The proposed method is an end-to-end MR image reconstruction method based on recurrent neural networks. It performs direct mapping of the input k-space data and the reconstructed images, operating as a unified solution that is applicable to various scanning trajectories.