Feasibility of using Vis-NIR spectroscopy and PXRF spectrometry to estimate regional soil cadmium concentration.

Conventionally, soil cadmium (Cd) measurements in the laboratory are expensive and time-consuming, involving complex processes of sample preparation and chemical analysis. This study aimed to identify the feasibility of using sensor data of visible near-infrared reflectance (Vis-NIR) spectroscopy and portable X-ray fluorescence spectrometry (PXRF) to estimate regional soil Cd concentration in a time- and cost-saving manner. The sensor data of Vis-NIR and PXRF, and Cd concentrations of 128 surface soils from Yunnan Province, China, were measured. Outer-product analysis (OPA) was used for synthesizing the sensor data and Granger-Ramanathan averaging (GRA) was applied to fuse the model results. Artificial neural network (ANN) models were built using Vis-NIR data, PXRF data, and OPA data, respectively. Results showed that: (1) ANN model based on PXRF data performed better than that based on Vis-NIR data for soil Cd estimation; (2) Fusion methods of both OPA and GRA had higher predictive power (R2) = 0.89, ratios of performance to interquartile range (RPIQ) = 4.14, and lower root mean squared error (RMSE) = 0.06, in ANN model based on OPA fusion; R2 = 0.88, RMSE = 0.06, and RPIQ = 3.53 in GRA model) than those based on either Vis-NIR data or PXRF data. In conclusion, there exists a great potential for the combination of OPA fusion and ANN to estimate soil Cd concentration rapidly and accurately.

Enhancing neural collaborative filtering using hybrid feature selection for recommendation.

The past decade has seen substantial growth in online transactions. Accordingly, many professionals and researchers utilize deep learning models to design and develop recommender systems to suit the needs of online personal services. These systems can model the interactions between users and items. However, existing approaches focus on either modeling global or local item correlation and rarely consider both cases, thus failing to represent user-item correlation very well. Therefore, this article proposes a deep collaborative recommendation system based on a convolutional neural network with an outer product matrix and a hybrid feature selection module to capture local and global higher-order interaction between users and items. Moreover, we incorporated the weights of generalized matrix factorization to optimize the overall network performance and prevent overfitting. Finally, we conducted extensive experiments on two real-world datasets with different sparsity to confirm that our proposed approach outperforms the baseline methods we have used in the experiment.

Rapid Estimation of Soil Pb Concentration Based on Spectral Feature Screening and Multi-Strategy Spectral Fusion.

Traditional methods for obtaining soil heavy metal content are expensive, inefficient, and limited in monitoring range. In order to meet the needs of soil environmental quality evaluation and health status assessment, visible near-infrared spectroscopy and XRF spectroscopy for monitoring heavy metal content in soil have attracted much attention, because of their rapid, nondestructive, economical, and environmentally friendly features. The use of either of these spectra alone cannot meet the accuracy requirements of traditional measurements, while the synergistic use of the two spectra can further improve the accuracy of monitoring heavy metal lead content in soil. Therefore, this study applied various spectral transformations and preprocessing to vis-NIR and XRF spectra; used the whale optimization algorithm (WOA) and competitive adaptive re-weighted sampling (CARS) algorithms to identify feature spectra; designed a combination variable model (CVM) based on multi-layer spectral data fusion, which improved the spectral preprocessing and spectral feature screening process to increase the efficiency of spectral fusion; and established a quantitative model for soil Pb concentration using partial least squares regression (PLSR). The estimation performance of three spectral fusion strategies, CVM, outer-product analysis (OPA), and Granger-Ramanathan averaging (GRA), was discussed. The results showed that the accuracy and efficiency of the CARS algorithm in the fused spectra estimation model were superior to those of the WOA algorithm, with an average coefficient of determination (R2) value of 0.9226 and an average root mean square error (RMSE) of 0.1984. The accuracy of the estimation models established, based on the different spectral types, to predict the Pb content of the soil was ranked as follows: the CVM model > the XRF spectral model > the vis-NIR spectral model. Within the CVM fusion strategy, the estimation model based on CARS and PLSR (CARS_D1+D2) performed the best, with R2 and RMSE values of 0.9546 and 0.2035, respectively. Among the three spectral fusion strategies, CVM had the highest accuracy, OPA had the smallest errors, and GRA showed a more balanced performance. This study provides technical means for on-site rapid estimation of Pb content based on multi-source spectral fusion and lays the foundation for subsequent research on dynamic, real-time, and large-scale quantitative monitoring of soil heavy metal pollution using high-spectral remote sensing images.

Predicting Successes and Failures of Clinical Trials With Outer Product-Based Convolutional Neural Network.

Despite several improvements in the drug development pipeline over the past decade, drug failures due to unexpected adverse effects have rapidly increased at all stages of clinical trials. To improve the success rate of clinical trials, it is necessary to identify potential loser drug candidates that may fail at clinical trials. Therefore, we need to develop reliable models for predicting the outcomes of clinical trials of drug candidates, which have the potential to guide the drug discovery process. In this study, we propose an outer product-based convolutional neural network (OPCNN) model which integrates effectively chemical features of drugs and target-based features. The validation results via 10-fold cross-validations on the dataset used for a data-driven approach PrOCTOR proved that our OPCNN model performs quite well in terms of accuracy, F1-score, Matthews correlation coefficient (MCC), precision, recall, area under the curve (AUC) of the receiver operating characteristic, and area under the precision-recall curve (AUPRC). In particular, the proposed OPCNN model showed the best performance in terms of MCC, which is widely used in biomedicine as a performance metric and is a more reliable statistical measure. Through 10-fold cross-validation experiments, the accuracy of the OPCNN model is as high as 0.9758, F1 score is as high as 0.9868, the MCC reaches 0.8451, the precision is as high as 0.9889, the recall is as high as 0.9893, the AUC is as high as 0.9824, and the AUPRC is as high as 0.9979. The results proved that our OPCNN model shows significantly good prediction performance on outcomes of clinical trials and it can be quite helpful in early drug discovery.

In situ Parallel Training of Analog Neural Network Using Electrochemical Random-Access Memory.

In-memory computing based on non-volatile resistive memory can significantly improve the energy efficiency of artificial neural networks. However, accurate in situ training has been challenging due to the nonlinear and stochastic switching of the resistive memory elements. One promising analog memory is the electrochemical random-access memory (ECRAM), also known as the redox transistor. Its low write currents and linear switching properties across hundreds of analog states enable accurate and massively parallel updates of a full crossbar array, which yield rapid and energy-efficient training. While simulations predict that ECRAM based neural networks achieve high training accuracy at significantly higher energy efficiency than digital implementations, these predictions have not been experimentally achieved. In this work, we train a 3 × 3 array of ECRAM devices that learns to discriminate several elementary logic gates (AND, OR, NAND). We record the evolution of the network's synaptic weights during parallel in situ (on-line) training, with outer product updates. Due to linear and reproducible device switching characteristics, our crossbar simulations not only accurately simulate the epochs to convergence, but also quantitatively capture the evolution of weights in individual devices. The implementation of the first in situ parallel training together with strong agreement with simulation results provides a significant advance toward developing ECRAM into larger crossbar arrays for artificial neural network accelerators, which could enable orders of magnitude improvements in energy efficiency of deep neural networks.

Data fusion for the measurement of potentially toxic elements in soil using portable spectrometers.

Soil contamination posed by potentially toxic elements is becoming more serious under continuously development of industrialization and the abuse of fertilizers and pesticides. The investigation of soil potentially toxic elements is therefore urgently needed to ensure human and other organisms' health. In this study, we investigated the feasibility of the separate and combined use of portable X-ray fluorescence (pXRF) and visible near-infrared reflectance (vis-NIR) sensors for measuring eight potentially toxic elements in soil. Low-level fusion was achieved by the direct combination of the pXRF and vis-NIR spectra; middle-level fusion was achieved by the combination of selected bands of the pXRF and vis-NIR spectra using the Boruta feature selection algorithm; and high-level fusion was conducted by outer-product analysis (OPA) and Granger-Ramanathan averaging (GRA). The estimation accuracy for the eight considered elements were in the following order: Zn > Cu > Ni > Cr > As > Cd > Pb > Hg. The measurement for Cu and Zn could be achieved by pXRF spectra alone with Lin's concordance correlation coefficient (LCCC) values of 0.96 and 0.98, and ratio of performance to interquartile distance (RPIQ) values of 2.36 and 2.69, respectively. The measurement of Ni had the highest model performance for high-level fusion GRA with LCCC of 0.89 and RPIQ of 3.42. The measurements of Cr using middle- and high-level fusion were similar, with LCCC of 0.86 and RPIQ of 2.97. The best estimation accuracy for As, Cd, and Pb were obtained by high-level fusion using OPA, with LCCC >0.72 and RPIQ >1.2. However, Hg measurement by these techniques failed, having an unacceptable performance of LCCC <0.20 and RPIQ <0.75. These results confirm the effectiveness of using portable spectrometers to determine the contents of several potentially toxic elements in soils.