MEET: A Multi-Band EEG Transformer for Brain States Decoding.

OBJECTIVE: Electroencephalography (EEG) is among the most widely used and inexpensive neuroimaging techniques. Compared to the CNN or RNN based models, Transformer can better capture the temporal information in EEG signals and focus more on global features of the brain's functional activities. Importantly, according to the multiscale nature of EEG signals, it is crucial to consider the multi-band concept into the design of EEG Transformer architecture. METHODS: We propose a novel Multi-band EEG Transformer (MEET) to represent and analyze the multiscale temporal time series of human brain EEG signals. MEET mainly includes three parts: 1) transform the EEG signals into multi-band images, and preserve the 3D spatial information between electrodes; 2) design a Band Attention Block to compute the attention maps of the stacked multi-band images and infer the fused feature maps; 3) apply the Temporal Self-Attention and Spatial Self-Attention modules to extract the spatiotemporal features for the characterization and differentiation of multi-frame dynamic brain states. RESULTS: The experimental results show that: 1) MEET outperforms state-of-the-art methods on multiple open EEG datasets (SEED, SEED-IV, WM) for brain states classification; 2) MEET demonstrates that 5-bands fusion is the best integration strategy; and 3) MEET identifies interpretable brain attention regions. SIGNIFICANCE: MEET is an interpretable and universal model based on the multiband-multiscale characteristics of EEG. CONCLUSION: The innovative combination of band attention and temporal/spatial self-attention mechanisms in MEET achieves promising data-driven learning of the temporal dependencies and spatial relationships of EEG signals across the entire brain in a holistic and comprehensive fashion.

Differentiating brain states via multi-clip random fragment strategy-based interactive bidirectional recurrent neural network.

EEG is widely adopted to study the brain and brain computer interface (BCI) for its non-invasiveness and low costs. Specifically EEG can be applied to differentiate brain states, which is important for better understanding the working mechanisms of the brain. Recurrent neural network (RNN)-based learning strategy has been widely utilized to differentiate brain states, because its optimization architectures improve the classification performance for differentiating brain states at the group level. However, present classification performance is still far from satisfactory. We have identified two major focal points for improvements: one is about organizing the input EEG signals, and the other is related to the design of the RNN architecture. To optimize the above-mentioned issues and achieve better brain state classification performance, we propose a novel multi-clip random fragment strategy-based interactive bidirectional recurrent neural network (McRFS-IBiRNN) model in this work. This model has two advantages over previous methods. First, the McRFS component is designed to re-organize the input EEG signals to make them more suitable for the RNN architecture. Second, the IBiRNN component is an innovative design to model the RNN layers with interaction connections to enhance the fusion of bidirectional features. By adopting the proposed model, promising brain states classification performances are obtained. For example, 96.97% and 99.34% of individual and group level four-category classification accuracies are successfully obtained on the EEG motor/imagery dataset, respectively. A 99.01% accuracy can be observed for four-category classification tasks with new subjects not seen before, which demonstrates the generalization of our proposed method. Compared with existing methods, our model outperforms them with superior results. Overall, the proposed McRFS-IBiRNN model demonstrates great superiority in differentiating brain states on EEG signals.

MM-GLCM-CNN: A multi-scale and multi-level based GLCM-CNN for polyp classification.

Distinguishing malignant from benign lesions has significant clinical impacts on both early detection and optimal management of those early detections. Convolutional neural network (CNN) has shown great potential in medical imaging applications due to its powerful feature learning capability. However, it is very challenging to obtain pathological ground truth, addition to collected in vivo medical images, to construct objective training labels for feature learning, leading to the difficulty of performing lesion diagnosis. This is contrary to the requirement that CNN algorithms need a large number of datasets for the training. To explore the ability to learn features from small pathologically-proven datasets for differentiation of malignant from benign polyps, we propose a Multi-scale and Multi-level based Gray-level Co-occurrence Matrix CNN (MM-GLCM-CNN). Specifically, instead of inputting the lesions' medical images, the GLCM, which characterizes the lesion heterogeneity in terms of image texture characteristics, is fed into the MM-GLCN-CNN model for the training. This aims to improve feature extraction by introducing multi-scale and multi-level analysis into the construction of lesion texture characteristic descriptors (LTCDs). To learn and fuse multiple sets of LTCDs from small datasets for lesion diagnosis, we further propose an adaptive multi-input CNN learning framework. Furthermore, an Adaptive Weight Network is used to highlight important information and suppress redundant information after the fusion of the LTCDs. We evaluated the performance of MM-GLCM-CNN by the area under the receiver operating characteristic curve (AUC) merit on small private lesion datasets of colon polyps. The AUC score reaches 93.99% with a gain of 1.49% over current state-of-the-art lesion classification methods on the same dataset. This gain indicates the importance of incorporating lesion characteristic heterogeneity for the prediction of lesion malignancy using small pathologically-proven datasets.

Network pharmacology study of the mechanism underlying the therapeutic effect of Zhujing pill and its main component oleanolic acid against diabetic retinopathy.

Diabetic retinopathy (DR) is the leading cause of blindness in the working population worldwide, with few effective drugs available for its treatment in the early stages. The Zhujing pill (ZJP) is well-established to enhance the early symptoms of DR, but the mechanism underlying its therapeutic effect remains unclear. In the present study, we used systems biology and multidirectional pharmacology to screen the main active ingredients of ZJP and retrieved DrugBank and Genecards databases to obtain 'drug-disease' common targets. Using bioinformatics analysis, we obtained the core targets, and potential mechanisms of action of ZJP and its main components for the treatment of DR. Molecular docking was used to predict the binding sites and the binding affinity of the main active ingredients to the core targets. The predicted mechanism was verified in animal experiments. We found that the main active ingredient of ZJP was oleanolic acid, and 63 common 'drug-disease' targets were identified. Topological analysis and cluster analysis based on the protein-protein interaction network of the Metascape database screened the core targets as PRKCA, etc. Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) enrichment analysis showed that these core targets were significantly enriched in the pro-angiogenic pathway of the VEGF signaling pathway. Molecular docking and surface plasmon resonance revealed that ZJP and its main active component, oleanolic acid had the highest binding affinity with PKC-α, the core target of the VEGF signaling pathway. Animal experiments validated that ZJP and oleanolic acid could improve DR.

An Explainable and Generalizable Recurrent Neural Network Approach for Differentiating Human Brain States on EEG Dataset.

Electroencephalogram (EEG) is one of the most widely used brain computer interface (BCI) approaches. Despite the success of existing EEG approaches in brain state recognition studies, it is still challenging to differentiate brain states via explainable and generalizable deep learning approaches. In other words, how to explore meaningful and distinguishing features and how to overcome the huge variability and overfitting problem still need to be further studied. To alleviate these challenges, in this work, a multiple random fragment search-based multilayer recurrent neural network (MRFS-MRNN) is proposed to improve the differentiating performance and explore meaningful patterns. Specifically, an explainable MRNN module is proposed to capture the temporal dependences preserved in EEG time series. Besides, a MRFS module is designed to cut multiple random fragments from the entire EEG signal time course to improve the effectiveness of brain state differentiating ability. MRFS-MRNN is concatenatedto effectively overcome the huge variabilities and overfitting problems. Experiment results demonstrate that the proposed MRFS-MRNN model not only has excellent differentiating performance, but also has good explanation and generalization ability. The classification accuracies reach as high as 95.18% for binary classification and 89.19% for four-category classification on the individual level. Similarly, 95.53% and 85.84% classification accuracies are obtained for the binary and four-category classification on the group level. What's more, 94.28% and 85.43% classification accuracies of binary and four-category classifications are achieved for predicting brand new subjects. The experiment results showed that the proposed method outperformed other state-of-the-art (SOTA) models on the same underlying data and improved the explanation and generalization ability.

A hybrid learning framework for fine-grained interpretation of brain spatiotemporal patterns during naturalistic functional magnetic resonance imaging.

Naturalistic stimuli, including movie, music, and speech, have been increasingly applied in the research of neuroimaging. Relative to a resting-state or single-task state, naturalistic stimuli can evoke more intense brain activities and have been proved to possess higher test-retest reliability, suggesting greater potential to study adaptive human brain function. In the current research, naturalistic functional magnetic resonance imaging (N-fMRI) has been a powerful tool to record brain states under naturalistic stimuli, and many efforts have been devoted to study the high-level semantic features from spatial or temporal representations via N-fMRI. However, integrating both spatial and temporal characteristics of brain activities for better interpreting the patterns under naturalistic stimuli is still underexplored. In this work, a novel hybrid learning framework that comprehensively investigates both the spatial (via Predictive Model) and the temporal [via convolutional neural network (CNN) model] characteristics of the brain is proposed. Specifically, to focus on certain relevant regions from the whole brain, regions of significance (ROS), which contain common spatial activation characteristics across individuals, are selected via the Predictive Model. Further, voxels of significance (VOS), whose signals contain significant temporal characteristics under naturalistic stimuli, are interpreted via one-dimensional CNN (1D-CNN) model. In this article, our proposed framework is applied onto the N-fMRI data during naturalistic classical/pop/speech audios stimuli. The promising performance is achieved via the Predictive Model to differentiate the different audio categories. Especially for distinguishing the classic and speech audios, the accuracy of classification is up to 92%. Moreover, spatial ROS and VOS are effectively obtained. Besides, temporal characteristics of the high-level semantic features are investigated on the frequency domain via convolution kernels of 1D-CNN model, and we effectively bridge the "semantic gap" between high-level semantic features of N-fMRI and low-level acoustic features of naturalistic audios in the frequency domain. Our results provide novel insights on characterizing spatiotemporal patterns of brain activities via N-fMRI and effectively explore the high-level semantic features under naturalistic stimuli, which will further benefit the understanding of the brain working mechanism and the advance of naturalistic stimuli clinical application.

An integrated biorefinery process for co-production of xylose and glucose using maleic acid as efficient catalyst.

This study aims to valorize wheat straw for xylose and glucose recovery using maleic acid in the pretreatment. The process conditions of maleic acid hydrolysis of wheat straw for xylose recovery were optimized by response surface methodology, through which the maximum xylose recovery of 77.12% versus minimum furfural yield of 1.61% were achieved using 70 g/L solid-to-liquid ratio and 0.1 mol/L maleic acid for 40 min at 150 °C. Moreover, 88.58% cellulose conversion was achieved by enzymatic hydrolysis of maleic acid-pretreated wheat straw. Results showed that maleic acid was an effective pretreatment solvent for sugars recovery: 19.88 g xylose and 30.89 g glucose were respectively obtained from 100 g wheat straw due to acidic and enzymatic hydrolysis, with only 0.37 g furfural produced. This study provides a strategy for hydrolyzing wheat straw to produce fermentable sugars with low amount of degradation product.

Improved Release of Monosaccharides and Ferulic Acid Using Enzyme Blends From Aspergillus Niger and Eupenicillium Parvum.

Supplementing commercial xylanase and cellulase with selected debranching enzymes only resulted in slight enhancement of the enzymatic hydrolysis of wheat bran autohydrolysis residues (WBAR) which was obtained at 160°C over a 30-min period of autohdyrolysis, while a blend of enzymes from Aspergillus niger and Eupenicillium parvum achieved synergistic efficacy in this context. Using an equal mixture blend of these enzymes at a 0.5% (w/w) enzyme loading dosage with the addition of ferulic acid esterase (1 U/g substrate), the obtained hydrolysis yields were desirable, including 84.98% of glucose, 84.74% of xylose, 80.24% of arabinose, and 80.86% of ferulic acid. Following further separation using an HP-20 resin, the final ferulic acid recovery levels were as high as 62.5% of the esterified ferulic acid present within the initial WBAR input. Together, these data suggest that a combination of autohydrolysis and enzymatic hydrolysis using crude enzyme blends can efficiently achieve wheat bran enzymatic saccharification and associated ferulic acid release.