Graph Embedded Intuitionistic Fuzzy Random Vector Functional Link Neural Network for Class Imbalance Learning.

The domain of machine learning is confronted with a crucial research area known as class imbalance (CI) learning, which presents considerable hurdles in the precise classification of minority classes. This issue can result in biased models where the majority class takes precedence in the training process, leading to the underrepresentation of the minority class. The random vector functional link (RVFL) network is a widely used and effective learning model for classification due to its good generalization performance and efficiency. However, it suffers when dealing with imbalanced datasets. To overcome this limitation, we propose a novel graph-embedded intuitionistic fuzzy RVFL for CI learning (GE-IFRVFL-CIL) model incorporating a weighting mechanism to handle imbalanced datasets. The proposed GE-IFRVFL-CIL model offers a plethora of benefits: 1) leveraging graph embedding (GE) to preserve the inherent topological structure of the datasets; 2) employing intuitionistic fuzzy (IF) theory to handle uncertainty and imprecision in the data; and 3) the most important, it tackles CI learning. The amalgamation of a weighting scheme, GE, and IF sets leads to the superior performance of the proposed models on KEEL benchmark imbalanced datasets with and without Gaussian noise. Furthermore, we implemented the proposed GE-IFRVFL-CIL on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset and achieved promising results, demonstrating the model's effectiveness in real-world applications. The proposed GE-IFRVFL-CIL model offers a promising solution to address the CI issue, mitigates the detrimental effect of noise and outliers, and preserves the inherent geometrical structures of the dataset.

Anticandidal effect of Eucalyptus oil and three isolated compounds on cutaneous wound healing in rats.

OBJECTIVE: Poor healing is one of the major complications of microbial contamination of wounds. When the skin is damaged, microorganisms can quickly invade the underlying tissues and cause infections that are potentially life-threatening. As a result, effective therapies are required to handle such pathological disorders. Several bioactivities, including fungicidal and antibacterial properties, have been noted for Eucalyptus essential oils. This study aimed to investigate the effect of Eucalyptus oil (EO) and mixed oils (MO) of Eucalyptus citriodora, citronellol acetate, linalool, and α-pinene on the healing of C. albicans infected wounds in rats. MATERIALS AND METHODS: Essential oils were extracted from the fresh areal parts of Eucalyptus citriodora, Lavandula stricta, and Rosmarinus officinalis then their active compounds were chromatographically isolated and identified using GC/Ms. The in vitro antifungal activities of EO and MO were evaluated against Candida albicans using the Agar well diffusion method. Further, their effect on the healing of C. albicans infected wounds was evaluated via the excision wound rat's model. Percentages of wound contraction, epithelialization period, wound Candida load, and the histopathology of wounded tissues were evaluated to confirm the progression of wound healing. RESULTS: Results of the in vitro tests showed that MO has a potent activity against C. albicans evaluated by an inhibitory zone (IZ) diameter of 23.4 mm and a MIC value of 0.24 g/mL, compared to EO's corresponding values of 13.4 mm and 15.63 g/mL. The beneficial impacts of MO creams in improving the percentage of contraction of C. albicans contaminated wounds were better than those of EO creams. MO 10% cream showed the greatest proportion of wound contraction and epithelialization rate. The beneficial effect of MO was further confirmed by a significant reduction of the fungal load of wounds in addition to histopathological improvement compared to the NC group. CONCLUSIONS: This study suggested the potential of 10% MO cream in enhancing the healing of C. albicans infected wounds upon topical application.

Brain Age Prediction With Improved Least Squares Twin SVR.

Alzheimer's disease (AD) is the prevalent form of dementia and shares many aspects with the aging pattern of the abnormal brain. Machine learning models like support vector regression (SVR) based models have been successfully employed in the estimation of brain age. However, SVR is computationally inefficient than twin support vector machine based models. Hence, different twin support vector machine based models like twin SVR (TSVR), ε-TSVR, and Lagrangian TSVR (LTSVR) models have been used for the regression problems. ε-TSVR and LTSVR models seek a pair of ε-insensitive proximal planes for generation of end regressor. However, SVR and TSVR based models have several drawbacks- i) SVR model is computationally inefficient compared to the TSVR based models. ii) Twin SVM based models involve the computation of matrix inverse which is intractable in real world scenario's. iii) Both TSVR and LTSVR models are based on empirical risk minimization principle and hence may be prone to overfitting. iv) TSVR and LTSVR assume that the matrices appearing in their formulation are positive definite which may not be satisfied in real world scenario's. To overcome these issues, we formulate improved least squares twin support vector regression (ILSTSVR). The proposed ILSTSVR modifies the TSVR by replacing the inequality constraints with the equality constraints and minimizes the slack variables using squares of L2 norm instead of L1. Also, we introduce a different Lagrangian function to avoid the computation of matrix inverses. We evaluated the proposed ILSTSVR model on the subjects including cognitively healthy, mild cognitive impairment and Alzheimer's disease for brain-age estimation. Experimental evaluation and statistical tests demonstrate the efficiency of the proposed ILSTSVR model for brain-age prediction.

Diagnosis of Schizophrenia: A Comprehensive Evaluation.

Machine learning models have been successfully employed in the diagnosis of Schizophrenia disease. The impact of classification models and the feature selection techniques on the diagnosis of Schizophrenia have not been evaluated. Here, we sought to access the performance of classification models along with different feature selection approaches on the structural magnetic resonance imaging data. The data consist of 72 subjects with Schizophrenia and 74 healthy control subjects. We evaluated different classification algorithms based on support vector machine (SVM), random forest, kernel ridge regression and randomized neural networks. Moreover, we evaluated T-Test, Receiver Operator Characteristics (ROC), Wilcoxon, entropy, Bhattacharyya, Minimum Redundancy Maximum Relevance (MRMR) and Neighbourhood Component Analysis (NCA) as the feature selection techniques. Based on the evaluation, SVM based models with Gaussian kernel proved better compared to other classification models and Wilcoxon feature selection emerged as the best feature selection approach. Moreover, in terms of data modality the performance on integration of the grey matter and white matter proved better compared to the performance on the grey and white matter individually. Our evaluation showed that classification algorithms along with the feature selection approaches impact the diagnosis of Schizophrenia disease. This indicates that proper selection of the features and the classification models can improve the diagnosis of Schizophrenia.

Intuitionistic Fuzzy Weighted Least Squares Twin SVMs.

Fuzzy membership is an effective approach used in twin support vector machines (SVMs) to reduce the effect of noise and outliers in classification problems. Fuzzy twin SVMs (TWSVMs) assign membership weights to reduce the effect of outliers, however, it ignores the positioning of the input data samples and hence fails to distinguish between support vectors and noise. To overcome this issue, intuitionistic fuzzy TWSVM combined the concept of intuitionistic fuzzy number with TWSVMs to reduce the effect of outliers and distinguish support vectors from noise. Despite these benefits, TWSVMs and intuitionistic fuzzy TWSVMs still suffer from some drawbacks as: 1) the local neighborhood information is ignored among the data points and 2) they solve quadratic programming problems (QPPs), which is computationally inefficient. To overcome these issues, we propose a novel intuitionistic fuzzy weighted least squares TWSVMs for classification problems. The proposed approach uses local neighborhood information among the data points and also uses both membership and nonmembership weights to reduce the effect of noise and outliers. The proposed approach solves a system of linear equations instead of solving the QPPs which makes the model more efficient. We evaluated the proposed intuitionistic fuzzy weighted least squares TWSVMs on several benchmark datasets to show the efficiency of the proposed model. Statistical analysis is done to quantify the results statistically. As an application, we used the proposed model for the diagnosis of Schizophrenia disease.

Inverse free reduced universum twin support vector machine for imbalanced data classification.

Imbalanced datasets are prominent in real-world problems. In such problems, the data samples in one class are significantly higher than in the other classes, even though the other classes might be more important. The standard classification algorithms may classify all the data into the majority class, and this is a significant drawback of most standard learning algorithms, so imbalanced datasets need to be handled carefully. One of the traditional algorithms, twin support vector machines (TSVM), performed well on balanced data classification but poorly on imbalanced datasets classification. In order to improve the TSVM algorithm's classification ability for imbalanced datasets, recently, driven by the universum twin support vector machine (UTSVM), a reduced universum twin support vector machine for class imbalance learning (RUTSVM) was proposed. The dual problem and finding classifiers involve matrix inverse computation, which is one of RUTSVM's key drawbacks. In this paper, we improve the RUTSVM and propose an improved reduced universum twin support vector machine for class imbalance learning (IRUTSVM). We offer alternative Lagrangian functions to tackle the primal problems of RUTSVM in the suggested IRUTSVM approach by inserting one of the terms in the objective function into the constraints. As a result, we obtain new dual formulation for each optimization problem so that we need not compute inverse matrices neither in the training process nor in finding the classifiers. Moreover, the smaller size of the rectangular kernel matrices is used to reduce the computational time. Extensive testing is carried out on a variety of synthetic and real-world imbalanced datasets, and the findings show that the IRUTSVM algorithm outperforms the TSVM, UTSVM, and RUTSVM algorithms in terms of generalization performance.

Oblique and rotation double random forest.

Random Forest is an ensemble of decision trees based on the bagging and random subspace concepts. As suggested by Breiman, the strength of unstable learners and the diversity among them are the ensemble models' core strength. In this paper, we propose two approaches known as oblique and rotation double random forests. In the first approach, we propose rotation based double random forest. In rotation based double random forests, transformation or rotation of the feature space is generated at each node. At each node different random feature subspace is chosen for evaluation, hence the transformation at each node is different. Different transformations result in better diversity among the base learners and hence, better generalization performance. With the double random forest as base learner, the data at each node is transformed via two different transformations namely, principal component analysis and linear discriminant analysis. In the second approach, we propose oblique double random forest. Decision trees in random forest and double random forest are univariate, and this results in the generation of axis parallel split which fails to capture the geometric structure of the data. Also, the standard random forest may not grow sufficiently large decision trees resulting in suboptimal performance. To capture the geometric properties and to grow the decision trees of sufficient depth, we propose oblique double random forest. The oblique double random forest models are multivariate decision trees. At each non-leaf node, multisurface proximal support vector machine generates the optimal plane for better generalization performance. Also, different regularization techniques (Tikhonov regularization, axis-parallel split regularization, Null space regularization) are employed for tackling the small sample size problems in the decision trees of oblique double random forest. The proposed ensembles of decision trees produce trees with bigger size compared to the standard ensembles of decision trees as bagging is used at each non-leaf node which results in improved performance. The evaluation of the baseline models and the proposed oblique and rotation double random forest models is performed on benchmark 121 UCI datasets and real-world fisheries datasets. Both statistical analysis and the experimental results demonstrate the efficacy of the proposed oblique and rotation double random forest models compared to the baseline models on the benchmark datasets.

Ensemble deep random vector functional link network using privileged information for Alzheimer's disease diagnosis.

In this paper, deep RVFL and its ensembles are enabled to incorporate privileged information, however, the standard RVFL model and its deep models are unable to use privileged information. Privileged information-based approach commonly seen in human learning. To fill this gap, we incorporate learning using privileged information (LUPI) in deep RVFL model and propose deep RVFL with LUPI framework (dRVFL+). Privileged information is available while training the models. To make the model more robust, we propose ensemble deep RVFL+ with LUPI framework (edRVFL+). Unlike traditional ensemble approach wherein multiple base learners are trained, the proposed edRVFL+ optimises a single network and generates an ensemble via optimization at different levels of random projections of the data. Both dRVFL+ and edRVFL+ efficiently utilise the privileged information which results in better generalization performance. In LUPI framework, half of the available features are used as normal features and rest as the privileged features. However, we propose a novel approach for generating the privileged information. To the best of our knowledge, this is first time that a separate privileged information is generated. The proposed models are employed for the diagnosis of Alzheimer's disease. Experimental results show the promising performance of both the proposed models.

Predicting Brain Age Using Machine Learning Algorithms: A Comprehensive Evaluation.

Machine learning (ML) algorithms play a vital role in the brain age estimation frameworks. The impact of regression algorithms on prediction accuracy in the brain age estimation frameworks have not been comprehensively evaluated. Here, we sought to assess the efficiency of different regression algorithms on brain age estimation. To this end, we built a brain age estimation framework based on a large set of cognitively healthy (CH) individuals ( N = 788) as a training set followed by different regression algorithms (22 different algorithms in total). We then quantified each regression-algorithm on independent test sets composed of 88 CH individuals, 70 mild cognitive impairment patients as well as 30 Alzheimer's disease patients. The prediction accuracy in the independent test set (i.e., CH set) varied in regression algorithms mean absolute error (MAE) from 4.63 to 7.14 yrs, R2 from 0.76 to 0.88. The highest and lowest prediction accuracies were achieved by Quadratic Support Vector Regression algorithm (MAE = 4.63 yrs, R2 = 0.88, 95% CI = [-1.26, 1.42]) and Binary Decision Tree algorithm (MAE = 7.14 yrs, R2 = 0.76, 95% CI = [-1.50, 2.62]), respectively. Our experimental results demonstrate that the prediction accuracy in brain age frameworks is affected by regression algorithms, indicating that advanced machine learning algorithms can lead to more accurate brain age predictions in clinical settings.

Classification of Alzheimer's Disease Using Ensemble of Deep Neural Networks Trained Through Transfer Learning.

Alzheimer's disease (AD) is one of the deadliest neurodegenerative diseases ailing the elderly population all over the world. An ensemble of Deep learning (DL) models can learn highly complicated patterns from MRI scans for the detection of AD by utilizing diverse solutions. In this work, we propose a computationally efficient, DL-architecture agnostic, ensemble of deep neural networks, named 'Deep Transfer Ensemble (DTE)' trained using transfer learning for the classification of AD. DTE leverages the complementary feature views and diversity introduced by many different locally optimum solutions reached by individual networks through the randomization of hyper-parameters. DTE achieves an accuracy of 99.05% and 85.27% on two independent splits of the large dataset for cognitively normal (NC) vs AD classification task. For the task of mild cognitive impairment (MCI) vs AD classification, DTE achieves 98.71% and 83.11% respectively on the two independent splits. It also performs reasonable on a small dataset consisting of only 50 samples per class. It achieved a maximum accuracy of 85% for NC vs AD on the small dataset. It also outperformed snapshot ensembles along with several other existing deep models from similar kind of previous works by other researchers.

Identification of chimera using machine learning.

Chimera state refers to the coexistence of coherent and non-coherent phases in identically coupled dynamical units found in various complex dynamical systems. Identification of chimera, on one hand, is essential due to its applicability in various areas including neuroscience and, on the other hand, is challenging due to its widely varied appearance in different systems and the peculiar nature of its profile. Therefore, a simple yet universal method for its identification remains an open problem. Here, we present a very distinctive approach using machine learning techniques to characterize different dynamical phases and identify the chimera state from given spatial profiles generated using various different models. The experimental results show that the performance of the classification algorithms varies for different dynamical models. The machine learning algorithms, namely, random forest, oblique random forest based on Tikhonov, axis-parallel split, and null space regularization achieved more than 96% accuracy for the Kuramoto model. For the logistic maps, random forest and Tikhonov regularization based oblique random forest showed more than 90% accuracy, and for the Hénon map model, random forest, null space, and axis-parallel split regularization based oblique random forest achieved more than 80% accuracy. The oblique random forest with null space regularization achieved consistent performance (more than 83% accuracy) across different dynamical models while the auto-encoder based random vector functional link neural network showed relatively lower performance. This work provides a direction for employing machine learning techniques to identify dynamical patterns arising in coupled non-linear units on large-scale and for characterizing complex spatiotemporal patterns in real-world systems for various applications.

Roflumilast, a phosphodiesterase 4 inhibitor, attenuates cadmium-induced renal toxicity via modulation of NF-κB activation and induction of NQO1 in rats.

OBJECTIVE: In the present study, the protective effect of Roflumilast (ROF, a selective phosphodiesterase (PDE-4) inhibitor) was investigated against cadmium (Cd)-induced nephrotoxicity in rats. METHODS: A total of 24 rats were selected and randomly divided into four groups ( n = 6). Group 1 served as the control; groups 2-4 administered with CdCl2 (3 mg/kg, i.p.) for 7 days; groups 3 and 4 were co-administered with ROF in doses of 0.5 and 1.5 mg/kg, orally for 7 consecutive days. Nephrotoxicity was evaluated by measuring urine volume, urea and creatinine levels in urine and serum. Oxidative stress was confirmed by measuring malondialdehyde (MDA), glutathione (GSH), superoxide dismutase (SOD), and catalase (CAT) levels in kidney tissue followed by histopathological studies. RESULTS: CdCl2 administration results in a significant ( p < 0.01) decrease in urine volume, urea, and creatinine levels in urine, as well as GSH, SOD, and CAT levels in renal tissue. In addition, Cd also produced significantly increased ( p < 0.01) urea and creatinine levels in serum and TBARS levels in renal tissues. Rats treated with ROF significantly ( p < 0.01) restore the altered levels of kidney injury markers, nonenzymatic antioxidant, as well as depleted enzymes in dose-dependent manner. An increased expression of NF-κB p65 and decreased expression of GST and NQO1 in the Cd only treated group were significantly reversed by high dose of ROF (1.5 mg/kg). Histopathological changes were also ameliorated by ROF administration in Cd-treated groups. CONCLUSION: In conclusion, ROF treatment showed protective effect against renal damage and increased oxidative stress induced by Cd administration.