Multiview Orthonormalized Partial Least Squares: Regularizations and Deep Extensions.

In this article, we establish a family of subspace-based learning methods for multiview learning using least squares as the fundamental basis. Specifically, we propose a novel unified multiview learning framework called multiview orthonormalized partial least squares (MvOPLSs) to learn a classifier over a common latent space shared by all views. The regularization technique is further leveraged to unleash the power of the proposed framework by providing three types of regularizers on its basic ingredients, including model parameters, decision values, and latent projected points. With a set of regularizers derived from various priors, we not only recast most existing multiview learning methods into the proposed framework with properly chosen regularizers but also propose two novel models. To further improve the performance of the proposed framework, we propose to learn nonlinear transformations parameterized by deep networks. Extensive experiments are conducted on multiview datasets in terms of both feature extraction and cross-modal retrieval. Results show that the subspace-based learning for a common latent space is effective and its nonlinear extension can further boost performance, and more importantly, one of two proposed methods with nonlinear extension can achieve better results than all compared methods.

A block variational procedure for the iterative diagonalization of non-Hermitian random-phase approximation matrices.

We present a technique for the iterative diagonalization of random-phase approximation (RPA) matrices, which are encountered in the framework of time-dependent density-functional theory (TDDFT) and the Bethe-Salpeter equation. The non-Hermitian character of these matrices does not permit a straightforward application of standard iterative techniques used, i.e., for the diagonalization of ground state Hamiltonians. We first introduce a new block variational principle for RPA matrices. We then develop an algorithm for the simultaneous calculation of multiple eigenvalues and eigenvectors, with convergence and stability properties similar to techniques used to iteratively diagonalize Hermitian matrices. The algorithm is validated for simple systems (Na(2) and Na(4)) and then used to compute multiple low-lying TDDFT excitation energies of the benzene molecule.

A Self-Consistent-Field Iteration for Orthogonal Canonical Correlation Analysis.

We propose an efficient algorithm for solving orthogonal canonical correlation analysis (OCCA) in the form of trace-fractional structure and orthogonal linear projections. Even though orthogonality has been widely used and proved to be a useful criterion for visualization, pattern recognition and feature extraction, existing methods for solving OCCA problem are either numerically unstable by relying on a deflation scheme, or less efficient by directly using generic optimization methods. In this paper, we propose an alternating numerical scheme whose core is the sub-maximization problem in the trace-fractional form with an orthogonality constraint. A customized self-consistent-field (SCF) iteration for this sub-maximization problem is devised. It is proved that the SCF iteration is globally convergent to a KKT point and that the alternating numerical scheme always converges. We further formulate a new trace-fractional maximization problem for orthogonal multiset CCA and propose an efficient algorithm with an either Jacobi-style or Gauss-Seidel-style updating scheme based on the SCF iteration. Extensive experiments are conducted to evaluate the proposed algorithms against existing methods, including real-world applications of multi-label classification and multi-view feature extraction. Experimental results show that our methods not only perform competitively to or better than the existing methods but also are more efficient.

Multi-view learning for lymph node metastasis prediction using tumor and nodal radiomics in gastric cancer.

Purpose.This study aims to develop and validate a multi-view learning method by the combination of primary tumor radiomics and lymph node (LN) radiomics for the preoperative prediction of LN status in gastric cancer (GC).Methods.A total of 170 contrast-enhanced abdominal CT images from GC patients were enrolled in this retrospective study. After data preprocessing, two-step feature selection approach including Pearson correlation analysis and supervised feature selection method based on test-time budget (FSBudget) was performed to remove redundance of tumor and LN radiomics features respectively. Two types of discriminative features were then learned by an unsupervised multi-view partial least squares (UMvPLS) for a latent common space on which a logistic regression classifier is trained. Five repeated random hold-out experiments were employed.Results.On 20-dimensional latent common space, area under receiver operating characteristic curve (AUC), precision, accuracy, recall and F1-score are 0.9531 ± 0.0183, 0.9260 ± 0.0184, 0.9136 ± 0.0174, 0.9468 ± 0.0106 and 0.9362 ± 0.0125 for the training cohort respectively, and 0.8984 ± 0.0536, 0.8671 ± 0.0489, 0.8500 ± 0.0599, 0.9118 ± 0.0550 and 0.8882 ± 0.0440 for the validation cohort respectively (reported as mean ± standard deviation). It shows a better discrimination capability than single-view methods, our previous method, and eight baseline methods. When the dimension was reduced to 2, the model not only has effective prediction performance, but also is convenient for data visualization.Conclusions.Our proposed method by integrating radiomics features of primary tumor and LN can be helpful in predicting lymph node metastasis in patients of GC. It shows multi-view learning has great potential for guiding the prognosis and treatment decision-making in GC.

A generalized image quality improvement strategy of cone-beam CT using multiple spectral CT labels in Pix2pix GAN.

Objective.The quantitative and routine imaging capabilities of cone-beam CT (CBCT) are hindered from clinical applications due to the severe shading artifacts of scatter contamination. The scatter correction methods proposed in the literature only consider the anatomy of the scanned objects while disregarding the impact of incident x-ray energy spectra. The multiple-spectral model is in urgent need for CBCT scatter estimation.Approach.In this work, we incorporate the multiple spectral diagnostic multidetector CT labels into the pixel-to-pixel (Pix2pix) GAN to estimate accurate scatter distributions from CBCT projections acquired at various imaging volume sizes and x-ray energy spectra. The Pix2pix GAN combines the residual network as the generator and the PatchGAN as the discriminator to construct the correspondence between the scatter-contaminated projection and scatter distribution. The network architectures and loss function of Pix2pix GAN are optimized to achieve the best performance on projection-to-scatter transition.Results.The CBCT data of a head phantom and abdominal patients are applied to test the performance of the proposed method. The error of the corrected CBCT image using the proposed method is reduced from over 200 HU to be around 20 HU in both phantom and patient studies. The mean structural similarity index of the CT image is improved from 0.2 to around 0.9 after scatter correction using the proposed method compared with the MC-simulation method, which indicates a high similarity of the anatomy in the images before and after the proposed correction. The proposed method achieves higher accuracy of scatter estimation than using the Pix2pix GAN with the U-net generator.Significance.The proposed scheme is an effective solution to the multiple spectral CBCT scatter correction. The scatter-correction software using the proposed model will be available at:https://github.com/YangkangJiang/Cone-beam-CT-scatter-correction-tool.

Probabilistic Structure Learning for EEG/MEG Source Imaging With Hierarchical Graph Priors.

Brain source imaging is an important method for noninvasively characterizing brain activity using Electroencephalogram (EEG) or Magnetoencephalography (MEG) recordings. Traditional EEG/MEG Source Imaging (ESI) methods usually assume the source activities at different time points are unrelated, and do not utilize the temporal structure in the source activation, making the ESI analysis sensitive to noise. Some methods may encourage very similar activation patterns across the entire time course and may be incapable of accounting the variation along the time course. To effectively deal with noise while maintaining flexibility and continuity among brain activation patterns, we propose a novel probabilistic ESI model based on a hierarchical graph prior. Under our method, a spanning tree constraint ensures that activity patterns have spatiotemporal continuity. An efficient algorithm based on an alternating convex search is presented to solve the resulting problem of the proposed model with guaranteed convergence. Comprehensive numerical studies using synthetic data on a realistic brain model are conducted under different levels of signal-to-noise ratio (SNR) from both sensor and source spaces. We also examine the EEG/MEG datasets in two real applications, in which our ESI reconstructions are neurologically plausible. All the results demonstrate significant improvements of the proposed method over benchmark methods in terms of source localization performance, especially at high noise levels.

Learning Low-Dimensional Latent Graph Structures: A Density Estimation Approach.

We aim to automatically learn a latent graph structure in a low-dimensional space from high-dimensional, unsupervised data based on a unified density estimation framework for both feature extraction and feature selection, where the latent structure is considered as a compact and informative representation of the high-dimensional data. Based on this framework, two novel methods are proposed with very different but intuitive learning criteria from existing methods. The proposed feature extraction method can learn a set of embedded points in a low-dimensional space by naturally integrating the discriminative information of the input data with structure learning so that multiple disconnected embedding structures of data can be uncovered. The proposed feature selection method preserves the pairwise distances only on the optimal set of features and selects these features simultaneously. It not only obtains the optimal set of features but also learns both the structure and embeddings for visualization. Extensive experiments demonstrate that our proposed methods can achieve competitive quantitative (often better) results in terms of discriminant evaluation performance and are able to obtain the embeddings of smooth skeleton structures and select optimal features to unveil the correct graph structures of high-dimensional data sets.