3D-deep optical learning: a multimodal and multitask reconstruction framework for optical molecular tomography.

Optical molecular tomography (OMT) is an emerging imaging technique. To date, the poor universality of reconstruction algorithms based on deep learning for various imaged objects and optical probes limits the development and application of OMT. In this study, based on a new mapping representation, a multimodal and multitask reconstruction framework-3D deep optical learning (3DOL), was presented to overcome the limitations of OMT in universality by decomposing it into two tasks, optical field recovery and luminous source reconstruction. Specifically, slices of the original anatomy (provided by computed tomography) and boundary optical measurement of imaged objects serve as inputs of a recurrent convolutional neural network encoded parallel to extract multimodal features, and 2D information from a few axial planes within the samples is explicitly incorporated, which enables 3DOL to recognize different imaged objects. Subsequently, the optical field is recovered under the constraint of the object geometry, and then the luminous source is segmented by a learnable Laplace operator from the recovered optical field, which obtains stable and high-quality reconstruction results with extremely few parameters. This strategy enable 3DOL to better understand the relationship between the boundary optical measurement, optical field, and luminous source to improve 3DOL's ability to work in a wide range of spectra. The results of numerical simulations, physical phantoms, and in vivo experiments demonstrate that 3DOL is a compatible deep-learning approach to tomographic imaging diverse objects. Moreover, the fully trained 3DOL under specific wavelengths can be generalized to other spectra in the 620-900 nm NIR-I window.

An adaptive parameter selection strategy based on maximizing the probability of data for robust fluorescence molecular tomography reconstruction.

To alleviate the ill-posed of the inverse problem in fluorescent molecular tomography (FMT), many regularization methods based on L2 or L1 norm have been proposed. Whereas, the quality of regularization parameters affects the performance of the reconstruction algorithm. Some classical parameter selection strategies usually need initialization of parameter range and high computing costs, which is not universal in the practical application of FMT. In this paper, an universally applicable adaptive parameter selection method based on maximizing the probability of data (MPD) strategy was proposed. This strategy used maximum a posteriori (MAP) estimation and maximum likelihood (ML) estimation to establish a regularization parameters model. The stable optimal regularization parameters can be determined by multiple iterative estimates. Numerical simulations and in vivo experiments show that MPD strategy can obtain stable regularization parameters for both regularization algorithms based on L2 or L1 norm and achieve good reconstruction performance.

Robust transformed l1 metric for fluorescence molecular tomography.

BACKGROUND AND OBJECTIVE: Fluorescence molecular tomography (FMT) is a non-invasive molecular imaging modality that can be used to observe the three-dimensional distribution of fluorescent probes in vivo. FMT is a promising imaging technique in clinical and preclinical research that has attracted significant attention. Numerous regularization based reconstruction algorithms have been proposed. However, traditional algorithms that use the squared l2-norm distance usually exaggerate the influence of noise and measurement and calculation errors, and their robustness cannot be guaranteed. METHODS: In this study, we propose a novel robust transformed l1 (TL1) metric that interpolates l0 and l1 norms through a nonnegative parameter α∈(0,+∞). The TL1 metric looks like the lp-norm with p∈(0,1). These are markedly different because TL1 metric has two properties, boundedness and Lipschitz-continuity, which make the TL1 criterion suitable distance metric, particularly for robustness, owing to its stronger noise suppression. Subsequently, we apply the proposed metric to FMT and build a robust model to reduce the influence of noise. The nonconvexity of the proposed model made direct optimization difficult, and a continuous optimization method was developed to solve the model. The problem was converted into a difference in convex programming problem for the TL1 metric (DCATL1), and the corresponding algorithm converged linearly. RESULTS: Various numerical simulations and in vivo bead-implanted mouse experiments were conducted to verify the performance of the proposed method. The experimental results show that the DCATL1 algorithm is more robust than the state-of-the-art approaches and achieves better source localization and morphology recovery. CONCLUSIONS: The in vivo experiments showed that DCATL1 can be used to visualize the distribution of fluorescent probes inside biological tissues and promote preclinical application in small animals, demonstrating the feasibility and effectiveness of the proposed method.

Multi-target reconstruction strategy based on blind source separation of surface measurement signals in FMT.

Fluorescence molecular tomography (FMT) is a promising molecular imaging technique for tumor detection in the early stage. High-precision multi-target reconstructions are necessary for quantitative analysis in practical FMT applications. The existing reconstruction methods perform well in retrieving a single fluorescent target but may fail in reconstructing a multi-target, which remains an obstacle to the wider application of FMT. In this paper, a novel multi-target reconstruction strategy based on blind source separation (BSS) of surface measurement signals was proposed, which transformed the multi-target reconstruction problem into multiple single-target reconstruction problems. Firstly, by multiple points excitation, multiple groups of superimposed measurement signals conforming to the conditions of BSS were constructed. Secondly, an efficient nonnegative least-correlated component analysis with iterative volume maximization (nLCA-IVM) algorithm was applied to construct the separation matrix, and the superimposed measurement signals were separated into the measurements of each target. Thirdly, the least squares fitting method was combined with BSS to determine the number of fluorophores indirectly. Lastly, each target was reconstructed based on the extracted surface measurement signals. Numerical simulations and in vivo experiments proved that it has the ability of multi-target resolution for FMT. The encouraging results demonstrate the significant effectiveness and potential of our method for practical FMT applications.