[Automatic epilepsy detection with an attention-based multiscale residual network].

The deep learning-based automatic detection of epilepsy electroencephalogram (EEG), which can avoid the artificial influence, has attracted much attention, and its effectiveness mainly depends on the deep neural network model. In this paper, an attention-based multi-scale residual network (AMSRN) was proposed in consideration of the multiscale, spatio-temporal characteristics of epilepsy EEG and the information flow among channels, and it was combined with multiscale principal component analysis (MSPCA) to realize the automatic epilepsy detection. Firstly, MSPCA was used for noise reduction and feature enhancement of original epilepsy EEG. Then, we designed the structure and parameters of AMSRN. Among them, the attention module (AM), multiscale convolutional module (MCM), spatio-temporal feature extraction module (STFEM) and classification module (CM) were applied successively to signal reexpression with attention weighted mechanism as well as extraction, fusion and classification for multiscale and spatio-temporal features. Based on the Children's Hospital Boston-Massachusetts Institute of Technology (CHB-MIT) public dataset, the AMSRN model achieved good results in sensitivity (98.56%), F1 score (98.35%), accuracy (98.41%) and precision (98.43%). The results show that AMSRN can make good use of brain network information flow caused by seizures to enhance the difference among channels, and effectively capture the multiscale and spatio-temporal features of EEG to improve the performance of epilepsy detection.

Decoding motor imagery with a simplified distributed dipoles model at source level.

Motor imagery (MI) based brain computer interface significantly oriented the development of neuro-rehabilitation, and the crucial issue is how to accurately detect the changes of cerebral cortex for MI decoding. The brain activity can be calculated based on the head model and observed scalp EEG, providing insights regarding cortical dynamics by using equivalent current dipoles with high spatial and temporal resolution. Now, all the dipoles within entire cortex or partial regions of interest are directly applied to data representation, this may make the key information weakened or lost, and it is worth studying how to choose the most important from numerous dipoles. In this paper, we devote to building a simplified distributed dipoles model (SDDM), which is combined with convolutional neural network (CNN), generating a MI decoding method at source level (called SDDM-CNN). First, all channels of raw MI-EEG signals are subdivided by a series of bandpass filters with width of 1 Hz, the average energies associated with any sub-band signals are calculated and ranked in a descending order to screen the top n sub-bands; then, the MI-EEG signals over each selected sub-band are mapped into source space by using EEG source imaging technology, and for each scout of neuroanatomical Desikan-Killiany partition, a centered dipole is selected as the most relevant dipole and put together to build a SDDM to reflect the neuroelectric activity of entire cerebral cortex; finally, the 4 dimensional (4D) magnitude matrix is constructed for each SDDM and fused into a novel data representation, which is further input to a well-designed 3DCNN with n parallel branches (nB3DCNN) to extract and classify the comprehensive features from time-frequency-space dimensions. Experiments are carried out on three public datasets, and the average ten-fold CV decoding accuracies achieve 95.09%, 97.98% and 94.53% respectively, and the statistical analysis is fulfilled by standard deviation, kappa value and confusion matrix. Experiment results suggest that it is beneficial to pick out the most sensitive sub-bands in sensor domain, and SDDM can sufficiently describe the dynamic changing of entire cortex, improving decoding performance while greatly reducing number of source signals. Also, nB3DCNN is capable of exploring spatial-temporal features from multi sub-bands.

A dual alignment-based multi-source domain adaptation framework for motor imagery EEG classification.

Domain adaptation, as an important branch of transfer learning, can be applied to cope with data insufficiency and high subject variabilities in motor imagery electroencephalogram (MI-EEG) based brain-computer interfaces. The existing methods generally focus on aligning data and feature distribution; however, aligning each source domain with the informative samples of the target domain and seeking the most appropriate source domains to enhance the classification effect has not been considered. In this paper, we propose a dual alignment-based multi-source domain adaptation framework, denoted DAMSDAF. Based on continuous wavelet transform, all channels of MI-EEG signals are converted respectively and the generated time-frequency spectrum images are stitched to construct multi-source domains and target domain. Then, the informative samples close to the decision boundary are found in the target domain by using entropy, and they are employed to align and reassign each source domain with normalized mutual information. Furthermore, a multi-branch deep network (MBDN) is designed, and the maximum mean discrepancy is embedded in each branch to realign the specific feature distribution. Each branch is separately trained by an aligned source domain, and all the single branch transfer accuracies are arranged in descending order and utilized for weighted prediction of MBDN. Therefore, the most suitable number of source domains with top weights can be automatically determined. Extensive experiments are conducted based on 3 public MI-EEG datasets. DAMSDAF achieves the classification accuracies of 92.56%, 69.45% and 89.57%, and the statistical analysis is performed by the kappa value and t-test. Experimental results show that DAMSDAF significantly improves the transfer effects compared to the present methods, indicating that dual alignment can sufficiently use the different weighted samples and even source domains at different levels as well as realizing optimal selection of multi-source domains.

[Parameter transfer learning based on shallow visual geometry group network and its application in motor imagery classification].

Transfer learning is provided with potential research value and application prospect in motor imagery electroencephalography (MI-EEG)-based brain-computer interface (BCI) rehabilitation system, and the source domain classification model and transfer strategy are the two important aspects that directly affect the performance and transfer efficiency of the target domain model. Therefore, we propose a parameter transfer learning method based on shallow visual geometry group network (PTL-sVGG). First, Pearson correlation coefficient is used to screen the subjects of the source domain, and the short-time Fourier transform is performed on the MI-EEG data of each selected subject to acquire the time-frequency spectrogram images (TFSI). Then, the architecture of VGG-16 is simplified and the block design is carried out, and the modified sVGG model is pre-trained with TFSI of source domain. Furthermore, a block-based frozen-fine-tuning transfer strategy is designed to quickly find and freeze the block with the greatest contribution to sVGG model, and the remaining blocks are fine-tuned by using TFSI of target subjects to obtain the target domain classification model. Extensive experiments are conducted based on public MI-EEG datasets, the average recognition rate and Kappa value of PTL-sVGG are 94.9% and 0.898, respectively. The results show that the subjects' optimization is beneficial to improve the model performance in source domain, and the block-based transfer strategy can enhance the transfer efficiency, realizing the rapid and effective transfer of model parameters across subjects on the datasets with different number of channels. It is beneficial to reduce the calibration time of BCI system, which promote the application of BCI technology in rehabilitation engineering.

Automatic feature extraction and fusion recognition of motor imagery EEG using multilevel multiscale CNN.

A motor imagery EEG (MI-EEG) signal is often selected as the driving signal in an active brain computer interface (BCI) system, and it has been a popular field to recognize MI-EEG images via convolutional neural network (CNN), which poses a potential problem for maintaining the integrity of the time-frequency-space information in MI-EEG images and exploring the feature fusion mechanism in the CNN. However, information is excessively compressed in the present MI-EEG image, and the sequential CNN is unfavorable for the comprehensive utilization of local features. In this paper, a multidimensional MI-EEG imaging method is proposed, which is based on time-frequency analysis and the Clough-Tocher (CT) interpolation algorithm. The time-frequency matrix of each electrode is generated via continuous wavelet transform (WT), and the relevant section of frequency is extracted and divided into nine submatrices, the longitudinal sums and lengths of which are calculated along the directions of frequency and time successively to produce a 3 × 3 feature matrix for each electrode. Then, feature matrix of each electrode is interpolated to coincide with their corresponding coordinates, thereby yielding a WT-based multidimensional image, called WTMI. Meanwhile, a multilevel and multiscale feature fusion convolutional neural network (MLMSFFCNN) is designed for WTMI, which has dense information, low signal-to-noise ratio, and strong spatial distribution. Extensive experiments are conducted on the BCI Competition IV 2a and 2b datasets, and accuracies of 92.95% and 97.03% are yielded based on 10-fold cross-validation, respectively, which exceed those of the state-of-the-art imaging methods. The kappa values and p values demonstrate that our method has lower class skew and error costs. The experimental results demonstrate that WTMI can fully represent the time-frequency-space features of MI-EEG and that MLMSFFCNN is beneficial for improving the collection of multiscale features and the fusion recognition of general and abstract features for WTMI.

A novel decoding method for motor imagery tasks with 4D data representation and 3D convolutional neural networks.

Objective. Motor imagery electroencephalography (MI-EEG) produces one of the most commonly used biosignals in intelligent rehabilitation systems. The newly developed 3D convolutional neural network (3DCNN) is gaining increasing attention for its ability to recognize MI tasks. The key to successful identification of movement intention is dependent on whether the data representation can faithfully reflect the cortical activity induced by MI. However, the present data representation, which is often generated from partial source signals with time-frequency analysis, contains incomplete information. Therefore, it would be beneficial to explore a new type of data representation using raw spatiotemporal dipole information as well as the possible development of a matching 3DCNN.Approach.Based on EEG source imaging and 3DCNN, a novel decoding method for identifying MI tasks is proposed, called ESICNND. MI-EEG is mapped to the cerebral cortex by the standardized low resolution electromagnetic tomography algorithm, and the optimal sampling points of the dipoles are selected as the time of interest to best reveal the difference between any two MI tasks. Then, the initial subject coordinate system is converted to a magnetic resonance imaging coordinate system, followed by dipole interpolation and volume down-sampling; the resulting 3D dipole amplitude matrices are merged at the selected sampling points to obtain 4D dipole feature matrices (4DDFMs). These matrices are augmented by sliding window technology and input into a 3DCNN with a cascading architecture of three modules (3M3DCNN) to perform the extraction and classification of comprehensive features.Main results.Experiments are carried out on two public datasets; the average ten-fold CV classification accuracies reach 88.73% and 96.25%, respectively, and the statistical analysis demonstrates outstanding consistency and stability.Significance.The 4DDFMs reveals the variation of cortical activation in a 3D spatial cube with a temporal dimension and matches the 3M3DCNN well, making full use of the high-resolution spatiotemporal information from all dipoles.

Fuzzy support vector machine with joint optimization of genetic algorithm and fuzzy c-means.

BACKGROUND: Motor imagery electroencephalogram (MI-EEG) play an important role in the field of neurorehabilitation, and a fuzzy support vector machine (FSVM) is one of the most used classifiers. Specifically, a fuzzy c-means (FCM) algorithm was used to membership calculation to deal with the classification problems with outliers or noises. However, FCM is sensitive to its initial value and easily falls into local optima. OBJECTIVE: The joint optimization of genetic algorithm (GA) and FCM is proposed to enhance robustness of fuzzy memberships to initial cluster centers, yielding an improved FSVM (GF-FSVM). METHOD: The features of each channel of MI-EEG are extracted by the improved refined composite multivariate multiscale fuzzy entropy and fused to form a feature vector for a trial. Then, GA is employed to optimize the initial cluster center of FCM, and the fuzzy membership degrees are calculated through an iterative process and further applied to classify two-class MI-EEGs. RESULTS: Extensive experiments are conducted on two publicly available datasets, the average recognition accuracies achieve 99.89% and 98.81% and the corresponding kappa values are 0.9978 and 0.9762, respectively. CONCLUSION: The optimized cluster centers of FCM via GA are almost overlapping, showing great stability, and GF-FSVM obtains higher classification accuracies and higher consistency as well.

[Review of acupuncture treatment for chronic pharyngitis].

A search in the database of CNKI and VIP access was performed to gather relevant literature about acupuncture treatment for chronic pharyngitis to evaluate and analyze the present situation of clinical research. The results indicate that the combination therapy is the major treatment for chronic pharyngitis, especially in the combination of acupuncture and Chinese herbs. There is great progress in clinic research in which proper scientific methodology was adopted. However, it demands further improvement in research quality, cases quality, diagnostic criteria, evaluation standard of efficacy, quality control and effectiveness of treatment. The research design of investigating mechanism is in accordance with traditional theory of TCM. The results suggest that new ideas and innovative approaches and valuable observation indices should be applied to improve research level.

INCOMPOSITA: a MADS-box gene controlling prophyll development and floral meristem identity in Antirrhinum.

INCOMPOSITA (INCO) is a MADS-box transcription factor and member of the functionally diverse StMADS11 clade of the MADS-box family. The most conspicuous feature of inco mutant flowers are prophylls initiated prior to first whorl sepals at lateral positions of the flower primordium. The developing prophylls physically interfere with subsequent floral organ development that results in aberrant floral architecture. INCO, which is controlled by SQUAMOSA, prevents prophyll formation in the wild type, a role that is novel among MADS-box proteins, and we discuss evolutionary implications of this function. Overexpression of INCO or SVP, a structurally related Arabidopsis MADS-box gene involved in the negative control of Arabidopsis flowering time, conditions delayed flowering in transgenic plants, suggesting that SVP and INCO have functions in common. Enhanced flowering of squamosa mutants in the inco mutant background corroborates this potential role of INCO as a floral repressor in Antirrhinum. One further, hitherto hidden, role of INCO is the positive control of Antirrhinum floral meristem identity. This is revealed by genetic interactions between inco and mutants of FLORICAULA, a gene that controls the inflorescence to floral transition, together with SQUAMOSA. The complex regulatory and combinatorial relations between INCO, FLORICAULA and SQUAMOSA are summarised in a model that integrates observations from molecular studies as well as analyses of expression patterns and genetic interactions.