Inversion Method for Transformer Winding Hot Spot Temperature Based on Gated Recurrent Unit and Self-Attention and Temperature Lag.

The hot spot temperature of transformer windings is an important indicator for measuring insulation performance, and its accurate inversion is crucial to ensure the timely and accurate fault prediction of transformers. However, existing studies mostly directly input obtained experimental or operational data into networks to construct data-driven models, without considering the lag between temperatures, which may lead to the insufficient accuracy of the inversion model. In this paper, a method for inverting the hot spot temperature of transformer windings based on the SA-GRU model is proposed. Firstly, temperature rise experiments are designed to collect the temperatures of the entire side and top of the transformer tank, top oil temperature, ambient temperature, the cooling inlet and outlet temperatures, and winding hot spot temperature. Secondly, experimental data are integrated, considering the lag of the data, to obtain candidate input feature parameters. Then, a feature selection algorithm based on mutual information (MI) is used to analyze the correlation of the data and construct the optimal feature subset to ensure the maximum information gain. Finally, Self-Attention (SA) is applied to optimize the Gate Recurrent Unit (GRU) network, establishing the GRU-SA model to perceive the potential patterns between output feature parameters and input feature parameters, achieving the precise inversion of the hot spot temperature of the transformer windings. The experimental results show that considering the lag of the data can more accurately invert the hot spot temperature of the windings. The inversion method proposed in this paper can reduce redundant input features, lower the complexity of the model, accurately invert the changing trend of the hot spot temperature, and achieve higher inversion accuracy than other classical models, thereby obtaining better inversion results.

SINR- and MI-Based Double-Robust Waveform Design.

Owing to cognitive radar breaking the open-loop receiving-transmitting mode of traditional radar, adaptive waveform design for cognitive radar has become a central issue in radar system research. In this paper, the method of radar transmitted waveform design in the presence of clutter is studied. Since exact characterizations of the target and clutter spectra are uncommon in practice, a single-robust transmitted waveform design method is introduced to solve the problem of the imprecise target spectrum or the imprecise clutter spectrum. Furthermore, considering that radar cannot simultaneously obtain precise target and clutter spectra, a novel double-robust transmitted waveform design method is proposed. In this method, the signal-to-interference-plus-noise ratio and mutual information are used as the objective functions, and the optimization models for the double-robust waveform are established under the transmitted energy constraint. The Lagrange multiplier method was used to solve the optimal double-robust transmitted waveform. The simulation results show that the double-robust transmitted waveform can maximize SINR and MI in the worst case; the performance of SINR and MI will degrade if other transmitted waveforms are employed in the radar system.

Cognitive Frequency-Hopping Waveform Design for Dual-Function MIMO Radar-Communications System.

A frequency-hopping (FH)-based dual-function multiple-input multiple-output (MIMO) radar communications system enables implementation of a primary radar operation and a secondary communication function simultaneously. The set of transmit waveforms employed to perform the MIMO radar task is generated using FH codes. For each transmit antenna, the communication operation can be realized by embedding one phase symbol during each FH interval. However, as the radar channel is time-variant, it is necessary for a successive waveform optimization scheme to continually obtain target feature information. This research work aims at enhancing the target detection and feature estimation performance by maximizing the mutual information (MI) between the target response and the target returns, and then minimizing the MI between successive target-scattering signals. The two-step cognitive waveform design strategy is based upon continuous learning from the radar scene. The dynamic information about the target feature is utilized to design FH codes. Simulation results show an improvement in target response extraction, target detection probability and delay-Doppler resolution as the number of iterations increases, while still maintaining high data rate with low bit error rates between the proposed system nodes.

A Single Mutation Increases the Thermostability and Activity of Aspergillus terreus Amine Transaminase.

Enhancing the thermostability of (R)-selective amine transaminases (AT-ATA) will expand its application in the asymmetric synthesis of chiral amines. In this study, mutual information and coevolution networks of ATAs were analyzed by the Mutual Information Server to Infer Coevolution (MISTIC). Subsequently, the amino acids most likely to influence the stability and function of the protein were investigated by alanine scanning and saturation mutagenesis. Four stabilized mutants (L118T, L118A, L118I, and L118V) were successfully obtained. The best mutant, L118T, exhibited an improved thermal stability with a 3.7-fold enhancement in its half-life (t1/2) at 40 °C and a 5.3 °C increase in T5010 compared to the values for the wild-type protein. By the differential scanning fluorimetry (DSF) analysis, the best mutant, L118T, showed a melting temperature (Tm) of 46.4 °C, which corresponded to a 5.0 °C increase relative to the wild-type AT-ATA (41.4 °C). Furthermore, the most stable mutant L118T displayed the highest catalytic efficiency among the four stabilized mutants.

SINR- and MI-Based Maximin Robust Waveform Design.

Due to the uncertainties of radar target prior information in the actual scene, the waveform designed based on radar target prior information cannot meet the needs of detection and parameter estimation performance. In this paper, the optimal waveform design techniques under energy constraints for different tasks are considered. To improve the detection performance of radar systems, a novel waveform design method which can maximize the signal-to-interference-plus-noise ratio (SINR) for known and random extended targets is proposed. To improve the performance of parameter estimation, another waveform design method which can maximize the mutual information (MI) between the radar echo and the random-target spectrum response is also considered. Most of the previous waveform design researches assumed that the prior information of the target spectrum is completely known. However, in the actual scene, the real target spectrum cannot be accurately captured. To simulate this scenario, the real target spectrum was assumed to be within an uncertainty range where the upper and lower bounds are known. Then, the SINR- and MI-based maximin robust waveforms were designed, which could optimize the performance under the most unfavorable conditions. The simulation results show that the designed optimal waveforms based on these two criteria are different, which provides useful guidance for waveform energy allocation in different transmission tasks. However, under the constraint of limited energy, we also found that the performance improvement of SINR or MI in the worst case for single targets is less significant than that of multiple targets.

Efficient Low-PAR Waveform Design Method for Extended Target Estimation Based on Information Theory in Cognitive Radar.

This paper addresses the waveform design problem of cognitive radar for extended target estimation in the presence of signal-dependent clutter, subject to a peak-to-average power ratio (PAR) constraint. Owing to this kind of constraint and the convolution operation of the waveform in the time domain, the formulated optimization problem for maximizing the mutual information (MI) between the target and the received signal is a complex non-convex problem. To this end, an efficient waveform design method based on minimization-maximization (MM) technique is proposed. First, by using the MM approach, the original non-convex problem is converted to a convex problem concerning the matrix variable. Then a trick is used for replacing the matrix variable with the vector variable by utilizing the properties of the Toeplitz matrix. Based on this, the optimization problem can be solved efficiently combined with the nearest neighbor method. Finally, an acceleration scheme is used to improve the convergence speed of the proposed method. The simulation results illustrate that the proposed method is superior to the existing methods in terms of estimation performance when designing the constrained waveform.

Adaptive Waveform Design for MIMO Radar-Communication Transceiver.

The system architecture for an adaptive multiple input multiple output (MIMO) radar-communication transceiver is proposed. A waveform design approach for communication data embedding into MIMO radar pulse using M-ary position phase shift keying (MPPSK) waveforms is introduced. A waveform optimization algorithm for the adaptive system is presented. The algorithm aims to improve the target detection performance by maximizing the relative entropy (RE) between the distributions under existence and absence of the target, and minimizing the mutual information (MI) between the current received signals and the estimated signals in the next time instant. The proposed system adapts its MPPSK modulated inter-pulse duration to suit the time-varying environment. With subsequent iterations of the algorithm, simulation results show an improvement in target impulse response (TIR) estimation and target detection probability. Meanwhile, the system is able to transmit data of several Mbps with low symbol error rates.

Cognitive Radar Waveform Optimization Based on Mutual Information and Kalman filtering.

A new strategy to optimizing the waveforms of cognitive radar under transmitted power constraint is presented. Our scheme is to enhance the performance of target estimation by minimizing the MSE (mean-square error) of the estimates of target scattering coefficients (TSC) based on Kalman filtering and then minimizing mutual information (MI) between the radar target echoes at successive time instants. The two steps are the optimal design of transmission waveform and the selection of a reasonable waveform from the ensemble for emission, respectively. The waveform design technique addresses the problems of target detection and parameter estimation in intelligent transportation system (ITS), where there is a need of extracting the features of target information obtained from different sensors. As the number of iterations increases, simulation results show better TSC estimation from the radar scene provided by the proposed approach as compared with the traditional waveform optimization algorithm. In addition, the proposed algorithm results in improved target detection probability.

Low Probability of Intercept-Based Radar Waveform Design for Spectral Coexistence of Distributed Multiple-Radar and Wireless Communication Systems in Clutter.

In this paper, the problem of low probability of intercept (LPI)-based radar waveform design for distributed multiple-radar system (DMRS) is studied, which consists of multiple radars coexisting with a wireless communication system in the same frequency band. The primary objective of the multiple-radar system is to minimize the total transmitted energy by optimizing the transmission waveform of each radar with the communication signals acting as interference to the radar system, while meeting a desired target detection/characterization performance. Firstly, signal-to-clutter-plus-noise ratio (SCNR) and mutual information (MI) are used as the practical metrics to evaluate target detection and characterization performance, respectively. Then, the SCNR- and MI-based optimal radar waveform optimization methods are formulated. The resulting waveform optimization problems are solved through the well-known bisection search technique. Simulation results demonstrate utilizing various examples and scenarios that the proposed radar waveform design schemes can evidently improve the LPI performance of DMRS without interfering with friendly communications.

A Novel Sensor Selection and Power Allocation Algorithm for Multiple-Target Tracking in an LPI Radar Network.

Radar networks are proven to have numerous advantages over traditional monostatic and bistatic radar. With recent developments, radar networks have become an attractive platform due to their low probability of intercept (LPI) performance for target tracking. In this paper, a joint sensor selection and power allocation algorithm for multiple-target tracking in a radar network based on LPI is proposed. It is found that this algorithm can minimize the total transmitted power of a radar network on the basis of a predetermined mutual information (MI) threshold between the target impulse response and the reflected signal. The MI is required by the radar network system to estimate target parameters, and it can be calculated predictively with the estimation of target state. The optimization problem of sensor selection and power allocation, which contains two variables, is non-convex and it can be solved by separating power allocation problem from sensor selection problem. To be specific, the optimization problem of power allocation can be solved by using the bisection method for each sensor selection scheme. Also, the optimization problem of sensor selection can be solved by a lower complexity algorithm based on the allocated powers. According to the simulation results, it can be found that the proposed algorithm can effectively reduce the total transmitted power of a radar network, which can be conducive to improving LPI performance.

ClearF++: Improved Supervised Feature Scoring Using Feature Clustering in Class-Wise Embedding and Reconstruction.

Feature selection methods are essential for accurate disease classification and identifying informative biomarkers. While information-theoretic methods have been widely used, they often exhibit limitations such as high computational costs. Our previously proposed method, ClearF, addresses these issues by using reconstruction error from low-dimensional embeddings as a proxy for the entropy term in the mutual information. However, ClearF still has limitations, including a nontransparent bottleneck layer selection process, which can result in unstable feature selection. To address these limitations, we propose ClearF++, which simplifies the bottleneck layer selection and incorporates feature-wise clustering to enhance biomarker detection. We compare its performance with other commonly used methods such as MultiSURF and IFS, as well as ClearF, across multiple benchmark datasets. Our results demonstrate that ClearF++ consistently outperforms these methods in terms of prediction accuracy and stability, even with limited samples. We also observe that employing the Deep Embedded Clustering (DEC) algorithm for feature-wise clustering improves performance, indicating its suitability for handling complex data structures with limited samples. ClearF++ offers an improved biomarker prioritization approach with enhanced prediction performance and faster execution. Its stability and effectiveness with limited samples make it particularly valuable for biomedical data analysis.

Mechanism for the Unfolding of the TOP7 Protein in Steered Molecular Dynamics Simulations as Revealed by Mutual Information Analysis.

We employed mutual information (MI) analysis to detect motions affecting the mechanical resistance of the human-engineered protein Top7. The results are based on the MI analysis of pair contact correlations measured in steered molecular dynamics (SMD) trajectories and their statistical dependence on global unfolding. This study is the first application of the MI analysis to SMD forced unfolding, and we furnish specific SMD recommendations for the utility of parameters and options in the TimeScapes package. The MI analysis provided a global overview of the effect of perturbation on the stability of the protein. We also employed a more conventional trajectory analysis for a detailed description of the mechanical resistance of Top7. Specifically, we investigated 1) the hydropathy of the interactions of structural segments, 2) the H2O concentration near residues relevant for unfolding, and 3) the changing hydrogen bonding patterns and main chain dihedral angles. The results show that the application of MI in the study of protein mechanical resistance can be useful for the engineering of more resistant mutants when combined with conventional analysis. We propose a novel mutation design based on the hydropathy of residues that would stabilize the unfolding region by mimicking its more stable symmetry mate. The proposed design process does not involve the introduction of covalent crosslinks, so it has the potential to preserve the conformational space and unfolding pathway of the protein.

A hybrid approach based on multiple Eigenvalues selection (MES) for the automated grading of a brain tumor using MRI.

BACKGROUND AND OBJECTIVE: The manual segmentation, identification, and classification of brain tumor using magnetic resonance (MR) images are essential for making a correct diagnosis. It is, however, an exhausting and time consuming task performed by clinical experts and the accuracy of the results is subject to their point of view. Computer aided technology has therefore been developed to computerize these procedures. METHODS: In order to improve the outcomes and decrease the complications involved in the process of analysing medical images, this study has investigated several methods. These include: a Local Difference in Intensity - Means (LDI-Means) based brain tumor segmentation, Mutual Information (MI) based feature selection, Singular Value Decomposition (SVD) based dimensionality reduction, and both Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP) based brain tumor classification. Also, this study has presented a new method named Multiple Eigenvalues Selection (MES) to choose the most meaningful features as inputs to the classifiers. This combination between unsupervised and supervised techniques formed an effective system for the grading of brain glioma. RESULTS: The experimental results of the proposed method showed an excellent performance in terms of accuracy, recall, specificity, precision, and error rate. They are 91.02%,86.52%, 94.26%, 87.07%, and 0.0897 respectively. CONCLUSION: The obtained results prove the significance and effectiveness of the proposed method in comparison to other state-of-the-art techniques and it can have in the contribution to an early diagnosis of brain glioma.

A correlative study between diffusion and perfusion MR imaging parameters on peripheral arterial disease data.

PURPOSE: The purpose of this study was to correlate diffusion and perfusion quantitative and semi-quantitative MR parameters, on patients with peripheral arterial disease. In addition, we investigated which perfusion model better describes the behavior of the dynamic contrast-enhanced (DCE) MR data signal on ischemic regions of the lower limb. METHODS: Linear and nonlinear least squares algorithms, were incorporated for the quantification of the parameters through a variety of widely used models, able to extract physiological information from each imaging technique. All numerical calculations were implemented in Python 3.5 and include the: Intra voxel incoherent motion for diffusion and Patlak's, Extended Toft's and Gamma Capillary Transit time (GCTT) models for perfusion MRI. RESULTS: Our initial voxel by voxel correlation analysis didn't show any significant correlation based on the Pearson's Correlation metric between diffusion and perfusion parameters. To account for the inherited noise from the raw data, a Gaussian filter was applied to the parametric maps in order for the data to be comparable. By repeating our analysis in the filtered image maps, a good correlation (>0.5) of diffusion and perfusion parameters was achieved. CONCLUSIONS: Perfusion and diffusion MRI quantitative and semi-quantitative parameters can be obtained through a variety of physiological-pharmacokinetic models. This paper compares most of the widely-known models and parameters in both techniques with data from patients with peripheral arterial disease. Initial analysis showed no correlation in the perfusion parametric maps of DWI and DCE MRI data but a good correlation was obtained after smoothing the parametric maps indicating that perfusion information could be obtained from diffusion MRI images in patients with peripheral arterial disease.

Effect of segmentation from different diffusive metric maps on diffusion tensor imaging analysis of the cervical spinal cord.

BACKGROUND: Segmentation is a crucial and necessary step in diffusion tensor imaging (DTI) analysis of the cervical spinal cord. In existing studies, different diffusive metric maps [B0, fractional anisotropy (FA) and axial diffusivity (AD) maps] have been involved in the segmentation of tissues of the cervical spinal cord. The selection of a diffusive metric map for segmentation may affect the accuracy of segmentation and then affect the validity and effectiveness of the extracted diffusive features. However, there are few discussions on this problem. Therefore, this study would like to examine the effect of segmentation based on different diffusive metric maps for DTI analysis of the cervical spinal cord. METHODS: Twenty-nine healthy subjects and thirty patients with cervical spondylotic myelopathy (CSM) were finally included in this study. All subjects accepted DTI scanning at cervical levels from C2 to C7/T1. For healthy subjects, all cervical levels were included for analysis; while, for each patient, only one compressed cervical level was included. After DTI scanning, DTI metrics including B0, FA, AD, radial diffusivity (RD) and mean diffusivity (MD) were calculated. The evaluation was performed to B0, FA and AD maps from two aspects. First, the accuracy of segmentation was evaluated via a comparison between segmentation based on each diffusive metric map and segmentation based on an average image, which was acquired by averaging B0, FA, AD, RD and MD maps. The segmentation was achieved by a semi-automatic segmentation process, and the similarity between two segmentation results was denoted by the intersection of the union (IOU). Second, the diversity of extracted diffusive features was equalized as their performance in the classification of image pixels of different regions of interest (ROIs) and then was evaluated by mutual information (MI) and area under the curve (AUC). One-way ANOVA and Bonferroni's post hoc tests were applied to compare the evaluation results. RESULTS: One-way ANOVA suggested that there were differences (P<0.001) in IOU, MI and AUC values among the three diffusive metric maps for both healthy subjects and patients. The post-hoc tests further indicated that FA performed the best (P<0.001), i.e., the most substantial accuracy of segmentation and the highest diversity in extracted diffusive features. CONCLUSIONS: Different evaluation results had been observed for segmentation based on different diffusive metric maps, suggesting the necessity of selection of diffusive metric maps for segmentation in DTI analysis of the cervical spinal cord. Moreover, FA map is suggested for segmentation due to its best performance in the evaluation.

ClearF: a supervised feature scoring method to find biomarkers using class-wise embedding and reconstruction.

BACKGROUND: Feature selection or scoring methods for the detection of biomarkers are essential in bioinformatics. Various feature selection methods have been developed for the detection of biomarkers, and several studies have employed information-theoretic approaches. However, most of these methods generally require a long processing time. In addition, information-theoretic methods discretize continuous features, which is a drawback that can lead to the loss of information. RESULTS: In this paper, a novel supervised feature scoring method named ClearF is proposed. The proposed method is suitable for continuous-valued data, which is similar to the principle of feature selection using mutual information, with the added advantage of a reduced computation time. The proposed score calculation is motivated by the association between the reconstruction error and the information-theoretic measurement. Our method is based on class-wise low-dimensional embedding and the resulting reconstruction error. Given multi-class datasets such as a case-control study dataset, low-dimensional embedding is first applied to each class to obtain a compressed representation of the class, and also for the entire dataset. Reconstruction is then performed to calculate the error of each feature and the final score for each feature is defined in terms of the reconstruction errors. The correlation between the information theoretic measurement and the proposed method is demonstrated using a simulation. For performance validation, we compared the classification performance of the proposed method with those of various algorithms on benchmark datasets. CONCLUSIONS: The proposed method showed higher accuracy and lower execution time than the other established methods. Moreover, an experiment was conducted on the TCGA breast cancer dataset, and it was confirmed that the genes with the highest scores were highly associated with subtypes of breast cancer.

Mutual Information-Based Brain Network Analysis in Post-stroke Patients With Different Levels of Depression.

Post-stroke depression (PSD) is the most common stroke-related emotional disorder, and it severely affects the recovery process. However, more than half cases are not correctly diagnosed. This study was designed to develop a new method to assess PSD using EEG signal to analyze the specificity of PSD patients' brain network. We have 107 subjects attended in this study (72 stabilized stroke survivors and 35 non-depressed healthy subjects). A Hamilton Depression Rating Scale (HDRS) score was determined for all subjects before EEG data collection. According to HDRS score, the 72 patients were divided into 3 groups: post-stroke non-depression (PSND), post-stroke mild depression (PSMD) and post-stroke depression (PSD). Mutual information (MI)-based graph theory was used to analyze brain network connectivity. Statistical analysis of brain network characteristics was made with a threshold of 10-30% of the strongest MIs. The results showed significant weakened interhemispheric connections and lower clustering coefficient in post-stroke depressed patients compared to those in healthy controls. Stroke patients showed a decreasing trend in the connection between the parietal-occipital and the frontal area as the severity of the depression increased. PSD subjects showed abnormal brain network connectivity and network features based on EEG, suggesting that MI-based brain network may have the potential to assess the severity of depression post stroke.

Functional Semi-Blind Source Separation Identifies Primary Motor Area Without Active Motor Execution.

High time resolution techniques are crucial for investigating the brain in action. Here, we propose a method to identify a section of the upper-limb motor area representation (FS_M1) by means of electroencephalographic (EEG) signals recorded during a completely passive condition (FS_M1bySS). We delivered a galvanic stimulation to the median nerve and we applied to EEG the semi-Blind Source Separation (s-BSS) algorithm named Functional Source Separation (FSS). In order to prove that FS_M1bySS is part of FS_M1, we also collected EEG in a motor condition, i.e. during a voluntary movement task (isometric handgrip) and in a rest condition, i.e. at rest with eyes open and closed. In motor condition, we show that the cortico-muscular coherence (CMC) of FS_M1bySS does not differ from FS_ M1 CMC (0.04 for both sources). Moreover, we show that the FS_M1bySS's ongoing whole band activity during Motor and both rest conditions displays high mutual information and time correlation with FS_M1 (above 0.900 and 0.800, respectively) whereas much smaller ones with the primary somatosensory cortex [Formula: see text] (about 0.300 and 0.500, [Formula: see text]). FS_M1bySS as a marker of the upper-limb FS_M1 representation obtainable without the execution of an active motor task is a great achievement of the FSS algorithm, relevant in most experimental, neurological and psychiatric protocols.

A decomposition model and voxel selection framework for fMRI analysis to predict neural response of visual stimuli.

This paper presents an fMRI signal analysis methodology using geometric mean curve decomposition (GMCD) and mutual information-based voxel selection framework. Previously, the fMRI signal analysis has been conducted using empirical mean curve decomposition (EMCD) model and voxel selection on raw fMRI signal. The erstwhile methodology loses frequency component, while the latter methodology suffers from signal redundancy. Both challenges are addressed by our methodology in which the frequency component is considered by decomposing the raw fMRI signal using geometric mean rather than arithmetic mean and the voxels are selected from EMCD signal using GMCD components, rather than raw fMRI signal. The proposed methodologies are adopted for predicting the neural response. Experimentations are conducted in the openly available fMRI data of six subjects, and comparisons are made with existing decomposition models and voxel selection frameworks. Subsequently, the effect of degree of selected voxels and the selection constraints are analyzed. The comparative results and the analysis demonstrate the superiority and the reliability of the proposed methodology.

Integrative information theoretic network analysis for genome-wide association study of aspirin exacerbated respiratory disease in Korean population.

BACKGROUND: Aspirin Exacerbated Respiratory Disease (AERD) is a chronic medical condition that encompasses asthma, nasal polyposis, and hypersensitivity to aspirin and other non-steroidal anti-inflammatory drugs. Several previous studies have shown that part of the genetic effects of the disease may be induced by the interaction of multiple genetic variants. However, heavy computational cost as well as the complexity of the underlying biological mechanism has prevented a thorough investigation of epistatic interactions and thus most previous studies have typically considered only a small number of genetic variants at a time. METHODS: In this study, we propose a gene network based analysis framework to identify genetic risk factors from a genome-wide association study dataset. We first derive multiple single nucleotide polymorphisms (SNP)-based epistasis networks that consider marginal and epistatic effects by using different information theoretic measures. Each SNP epistasis network is converted into a gene-gene interaction network, and the resulting gene networks are combined as one for downstream analysis. The integrated network is validated on existing knowledgebase of DisGeNET for known gene-disease associations and GeneMANIA for biological function prediction. RESULTS: We demonstrated our proposed method on a Korean GWAS dataset, which has genotype information of 440,094 SNPs for 188 cases and 247 controls. The topological properties of the generated networks are examined for scale-freeness, and we further performed various statistical analyses in the Allergy and Asthma Portal (AAP) using the selected genes from our integrated network. CONCLUSIONS: Our result reveals that there are several gene modules in the network that are of biological significance and have evidence for controlling susceptibility and being related to the treatment of AERD.