Recognition of the Multi-class Schizophrenia Based on the Resting-State EEG Network Topology.

The clinical therapy of schizophrenia (SCZ) replies on the corresponding accurate and reliable recognition. Although efforts have been paid, the diagnosis of SCZ is still roughly subjective, it is thus urgent to search for related objective physiological parameters. Motivated by the great potential of resting-state networks in underling the brain deficits among different SCZ groups, in this study, we then developed a multi-class feature extraction approach that could effectively extract the spatial network topology and facilitate the recognition of the SCZ, by combining a network structure based supervised learning with an ensemble co-decision strategy. The results demonstrated that the multi-class spatial pattern of the network (MSPN) features outperformed the other conventional electrophysiological features, such as relative power spectrums and network properties, and achieved the highest classification accuracy of 71.58% in the alpha band. These findings did validate that the resting-state MSPN is a promising tool for the clinical assessment of the SCZ.

[Progresses and prospects on frequency recognition methods for steady-state visual evoked potential].

Steady-state visual evoked potential (SSVEP) is one of the commonly used control signals in brain-computer interface (BCI) systems. The SSVEP-based BCI has the advantages of high information transmission rate and short training time, which has become an important branch of BCI research field. In this review paper, the main progress on frequency recognition algorithm for SSVEP in past five years are summarized from three aspects, i.e., unsupervised learning algorithms, supervised learning algorithms and deep learning algorithms. Finally, some frontier topics and potential directions are explored.

Computational exploration of dynamic mechanisms of steady state visual evoked potentials at the whole brain level.

Periodic visual stimulation can induce stable steady-state visual evoked potentials (SSVEPs) distributed in multiple brain regions and has potential applications in both neural engineering and cognitive neuroscience. However, the underlying dynamic mechanisms of SSVEPs at the whole-brain level are still not completely understood. Here, we addressed this issue by simulating the rich dynamics of SSVEPs with a large-scale brain model designed with constraints of neuroimaging data acquired from the human brain. By eliciting activity of the occipital areas using an external periodic stimulus, our model was capable of replicating both the spatial distributions and response features of SSVEPs that were observed in experiments. In particular, we confirmed that alpha-band (8-12 Hz) stimulation could evoke stronger SSVEP responses; this frequency sensitivity was due to nonlinear entrainment and resonance, and could be modulated by endogenous factors in the brain. Interestingly, the stimulus-evoked brain networks also exhibited significant superiority in topological properties near this frequency-sensitivity range, and stronger SSVEP responses were demonstrated to be supported by more efficient functional connectivity at the neural activity level. These findings not only provide insights into the mechanistic understanding of SSVEPs at the whole-brain level but also indicate a bright future for large-scale brain modeling in characterizing the complicated dynamics and functions of the brain.

Inter-subject P300 variability relates to the efficiency of brain networks reconfigured from resting- to task-state: Evidence from a simultaneous event-related EEG-fMRI study.

The P300 event-related potential (ERP) varies across individuals, and exploring this variability deepens our knowledge of the event, and scope for its potential applications. Previous studies exploring the P300 have relied on either electroencephalography (EEG) or functional magnetic resonance imaging (fMRI). We applied simultaneous event-related EEG-fMRI to investigate how the network structure is updated from rest to the P300 task so as to guarantee information processing in the oddball task. We first identified 14 widely distributed regions of interest (ROIs) that were task-associated, including the inferior frontal gyrus and the middle frontal gyrus, etc. The task-activated network was found to closely relate to the concurrent P300 amplitude, and moreover, the individuals with optimized resting-state brain architectures experienced the pruning of network architecture, i.e. decreasing connectivity, when the brain switched from rest to P300 task. Our present simultaneous EEG-fMRI study explored the brain reconfigurations governing the variability in P300 across individuals, which provided the possibility to uncover new biomarkers to predict the potential for personalized control of brain-computer interfaces.

Predicting individual decision-making responses based on single-trial EEG.

Decision-making plays an essential role in the interpersonal interactions and cognitive processing of individuals. There has been increasing interest in being able to predict an individual's decision-making response (i.e., acceptance or rejection). We proposed an electroencephalogram (EEG)-based computational intelligence framework to predict individual responses. Specifically, the discriminative spatial network pattern (DSNP), a supervised learning approach, was applied to single-trial EEG data to extract the DSNP feature from the single-trial brain network. A linear discriminate analysis (LDA) trained on the DSNP features was then used to predict the individual response trial-by-trial. To verify the performance of the proposed DSNP, we recruited two independent subject groups, and recorded the EEGs using two types of EEG systems. The performances of the trial-by-trial predictors achieved an accuracy of 0.88 ±â€¯0.09 for the first dataset, and 0.90 ±â€¯0.10 for the second dataset. These trial-by-trial prediction performances suggested that individual responses could be predicted trial-by-trial by using the specific pattern of single-trial EEG networks, and our proposed method has the potential to establish the biologically inspired artificial intelligence decision system.

Different Decision-Making Responses Occupy Different Brain Networks for Information Processing: A Study Based on EEG and TMS.

This study used large-scale time-varying network analysis to reveal the diverse network patterns during the different decision stages and found that the responses of rejection and acceptance involved different network structures. When participants accept unfair offers, the brain recruits a more bottom-up mechanism with a much stronger information flow from the visual cortex (O2) to the frontal area, but when they reject unfair offers, it displayed a more top-down flow derived from the frontal cortex (Fz) to the parietal and occipital cortices. Furthermore, we performed 2 additional studies to validate the above network models: one was to identify the 2 responses based on the out-degree information of network hub nodes, which results in 70% accuracy, and the other utilized theta burst stimulation (TBS) of transcranial magnetic stimulation (TMS) to modulate the frontal area before the decision-making tasks. We found that the intermittent TBS group demonstrated lower acceptance rates and that the continuous TBS group showed higher acceptance rates compared with the sham group. Similar effects were not observed after TBS of a control site. These results suggest that the revealed decision-making network model can serve as a potential intervention model to alter decision responses.

Brain Network Reconfiguration During Motor Imagery Revealed by a Large-Scale Network Analysis of Scalp EEG.

Mentally imagining rather physically executing the motor behaviors is defined as motor imagery (MI). During MI, the mu rhythmical oscillation of cortical neurons is the event-related desynchronization (ERD) subserving the physiological basis of MI-based brain-computer interface. In our work, we investigated the specific brain network reconfiguration from rest idle to MI task states, and also probed the underlying relationship between the brain network reconfiguration and MI related ERD. Findings revealed that comparing to rest state, the MI showed the enhanced motor area related linkages and the deactivated activity of default mode network. In addition, the reconfigured network index was closely related to the ERDs, i.e., the higher the reconfigured network index was, the more obvious the ERDs were. These findings consistently implied that the reconfiguration from rest to task states underlaid the reallocation of related brain resources, and the efficient brain reconfiguration corresponded to a better MI performance, which provided the new insights into understanding the mechanism of MI as well as the potential biomarker to evaluate the rehabilitation quality for those patients with deficits of motor function.

Characterizing nonlinear relationships in functional imaging data using eigenspace maximal information canonical correlation analysis (emiCCA).

Many important problems in the analysis of neuroimages can be formulated as discovering the relationship between two sets of variables, a task for which linear techniques such as canonical correlation analysis (CCA) have been commonly used. However, to further explore potential nonlinear processes that might co-exist with linear ones in brain function, a more flexible method is required. Here, we propose a new unsupervised and data-driven method, termed the eigenspace maximal information canonical correlation analysis (emiCCA), which is capable of automatically capturing the linear and/or nonlinear relationships between various data sets. A simulation confirmed the superior performance of emiCCA in comparison with linear CCA and kernel CCA (a nonlinear version of CCA). An emiCCA framework for functional magnetic resonance imaging (fMRI) data processing was designed and applied to data from a real motor execution fMRI experiment. This analysis uncovered one linear (in primary motor cortex) and a few nonlinear networks (e.g., in the supplementary motor area, bilateral insula, and cerebellum). This suggests that these various task-related brain areas are part of networks that also contribute to the execution of movements of the hand. These results suggest that emiCCA is a promising technique for exploring various data.

Re-UNet: a novel multi-scale reverse U-shape network architecture for low-dose CT image reconstruction.

In recent years, the growing awareness of public health has brought attention to low-dose computed tomography (LDCT) scans. However, the CT image generated in this way contains a lot of noise or artifacts, which make increasing researchers to investigate methods to enhance image quality. The advancement of deep learning technology has provided researchers with novel approaches to enhance the quality of LDCT images. In the past, numerous studies based on convolutional neural networks (CNN) have yielded remarkable results in LDCT image reconstruction. Nonetheless, they all tend to continue to design new networks based on the fixed network architecture of UNet shape, which also leads to more and more complex networks. In this paper, we proposed a novel network model with a reverse U-shape architecture for the noise reduction in the LDCT image reconstruction task. In the model, we further designed a novel multi-scale feature extractor and edge enhancement module that yields a positive impact on CT images to exhibit strong structural characteristics. Evaluated on a public dataset, the experimental results demonstrate that the proposed model outperforms the compared algorithms based on traditional U-shaped architecture in terms of preserving texture details and reducing noise, as demonstrated by achieving the highest PSNR, SSIM and RMSE value. This study may shed light on the reverse U-shaped network architecture for CT image reconstruction, and could investigate the potential on other medical image processing.

Constantly optimized mean teacher for semi-supervised 3D MRI image segmentation.

The mean teacher model and its variants, as important methods in semi-supervised learning, have demonstrated promising performance in magnetic resonance imaging (MRI) data segmentation. However, the superior performance of teacher model through exponential moving average (EMA) is limited by the unreliability of unlabeled image, resulting in potentially unreliable predictions. In this paper, we propose a framework to optimized the teacher model with reliable expert-annotated data while preserving the advantages of EMA. To avoid the tight coupling that results from EMA, we leverage data augmentations to provide two distinct perspectives for the teacher and student models. The teacher model adopts weak data augmentation to provide supervision for the student model and optimizes itself with real annotations, while the student uses strong data augmentation to avoid overfitting on noise information. In addition, double softmax helps the model resist noise and continue learning meaningful information from the images, which is a key component in the proposed model. Extensive experiments show that the proposed method exhibits competitive performance on the Left Atrium segmentation MRI dataset (LA) and the Brain Tumor Segmentation MRI dataset (BraTS2019). For the LA dataset, we achieved a dice of 91.02% using only 20% labeled data, which is close to the dice of 91.14% obtained by the supervised approach using 100% labeled data. For the BraTs2019 dataset, the proposed method achieved 1.02% and 1.92% improvement on 5% and 10% labeled data, respectively, compared to the best baseline method on this dataset. This study demonstrates that the proposed model can be a potential candidate for medical image segmentation in semi-supervised learning scenario.

Computer-assisted decision support for the usage of preventive antibacterial therapy in children with febrile pyelonephritis: A preliminary study.

Urinary tract infection (UTI) is one of the most common infectious diseases among children, but there is controversy regarding the use of preventive antibiotics for children first diagnosed with febrile pyelonephritis. To the best of our knowledge, no studies have addressed this issue by the deep learning technology. Therefore, in the current study, we conducted a study using Tc99m-DMSA renal static imaging data to investigate the need for preventive antibiotics on children first diagnosed with febrile pyelonephritis under 2 years old. The self-collected dataset comprised 64 children who did not require preventive antibiotic treatments and 112 children who did. Using several classic deep learning models, we verified that it is feasible to screen whether the first diagnosed children with febrile pyelonephritis require preventive antibacterial therapy, achieving a graded diagnosis. With the AlexNet model, we obtained accuracy of 84.05%, sensitivity of 81.71% and specificity of 86.70%, respectively. The experimental results indicate that deep learning technology could provide a new avenue to implement computer-assisted decision support for the diagnosis of the febrile pyelonephritis.

Recognition of autism spectrum disorder in children based on electroencephalogram network topology.

Although our knowledge of autism spectrum disorder (ASD) has been deepened, the accurate diagnosis of ASD from normal individuals is still left behind. In this study, we proposed to apply the spatial pattern of the network topology (SPN) to identify children with ASD from normal ones. Based on two independent batches of electroencephalogram datasets collected separately, the accurate recognition of ASD from normal children was achieved by applying the proposed SPN features. Since decreased long-range connectivity was identified for children with ASD, the SPN features extracted from the distinctive topological architecture between two groups in the first dataset were used to validate the capacity of SPN in classifying ASD, and the SPN features achieved the highest accuracy of 92.31%, which outperformed the other features e.g., power spectrum density (84.62%), network properties (76.92%), and sample entropy (73.08%). Moreover, within the second dataset, by using the model trained in the first dataset, the SPN also acquired the highest sensitivity in recognizing ASD, when compared to the other features. These results consistently illustrated that the functional brain network, especially the intrinsic spatial network topology, might be the potential biomarker for the diagnosis of ASD.

A transformer-based deep neural network model for SSVEP classification.

Steady-state visual evoked potential (SSVEP) is one of the most commonly used control signals in the brain-computer interface (BCI) systems. However, the conventional spatial filtering methods for SSVEP classification highly depend on the subject-specific calibration data. The need for the methods that can alleviate the demand for the calibration data becomes urgent. In recent years, developing the methods that can work in inter-subject scenario has become a promising new direction. As a popular deep learning model nowadays, Transformer has been used in EEG signal classification tasks owing to its excellent performance. Therefore, in this study, we proposed a deep learning model for SSVEP classification based on Transformer architecture in inter-subject scenario, termed as SSVEPformer, which was the first application of Transformer on the SSVEP classification. Inspired by previous studies, we adopted the complex spectrum features of SSVEP data as the model input, which could enable the model to simultaneously explore the spectral and spatial information for classification. Furthermore, to fully utilize the harmonic information, an extended SSVEPformer based on the filter bank technology (FB-SSVEPformer) was proposed to improve the classification performance. Experiments were conducted using two open datasets (Dataset 1: 10 subjects, 12 targets; Dataset 2: 35 subjects, 40 targets). The experimental results show that the proposed models could achieve better results in terms of classification accuracy and information transfer rate than other baseline methods. The proposed models validate the feasibility of deep learning models based on Transformer architecture for SSVEP data classification, and could serve as potential models to alleviate the calibration procedure in the practical application of SSVEP-based BCI systems.

AEAU-Net: an unsupervised end-to-end registration network by combining affine transformation and deformable medical image registration.

Deformable medical image registration plays an essential role in clinical diagnosis and treatment. However, due to the large difference in image deformation, unsupervised convolutional neural network (CNN)-based methods cannot extract global features and local features simultaneously and cannot capture long-distance dependencies to solve the problem of excessive deformation. In this paper, an unsupervised end-to-end registration network is proposed for 3D MRI medical image registration, named AEAU-Net, which includes two-stage operations, i.e., an affine transformation and a deformable registration. These two operations are implemented by an affine transformation subnetwork and a deformable registration subnetwork, respectively. In the deformable registration subnetwork, termed as EAU-Net, we designed an efficient attention mechanism (EAM) module and a recursive residual path (RSP) module. The EAM module is embedded in the bottom layer of the EAU-Net to capture long-distance dependencies. The RSP model is used to obtain effective features by fusing deep and shallow features. Extensive experiments on two datasets, LPBA40 and Mindboggle101, were conducted to verify the effectiveness of the proposed method. Compared with baseline methods, this proposed method could obtain better registration performance. The ablation study further demonstrated the reasonability and validity of the designed architecture of the proposed method.

Improving AR-SSVEP Recognition Accuracy Under High Ambient Brightness Through Iterative Learning.

Augmented reality-based brain-computer interface (AR-BCI) system is one of the important ways to promote BCI technology outside of the laboratory due to its portability and mobility, but its performance in real-world scenarios has not been fully studied. In the current study, we first investigated the effect of ambient brightness on AR-BCI performance. 5 different light intensities were set as experimental conditions to simulate typical brightness in real scenes, while the same steady-state visual evoked potentials (SSVEP) stimulus was displayed in the AR glass. The data analysis results showed that SSVEP can be evoked under all 5 light intensities, but the response intensity became weaker when the brightness increased. The recognition accuracies of AR-SSVEP were negatively correlated to light intensity, the highest accuracies were 89.35% with FBCCA and 83.33% with CCA under 0 lux light intensity, while they decreased to 62.53% and 49.24% under 1200 lux. To solve the accuracy loss problem in high ambient brightness, we further designed a SSVEP recognition algorithm with iterative learning capability, named ensemble online adaptive CCA (eOACCA). The main strategy is to provide initial filters for high-intensity data by iteratively learning low-light-intensity AR-SSVEP data. The experimental results showed that the eOACCA algorithm had significant advantages under higher light intensities ( 600 lux). Compared with FBCCA, the accuracy of eOACCA under 1200 lux was increased by 13.91%. In conclusion, the current study contributed to the in-depth understanding of the performance variations of AR-BCI under different lighting conditions, and was helpful in promoting the AR-BCI application in complex lighting environments.

Effective Emotion Recognition by Learning Discriminative Graph Topologies in EEG Brain Networks.

Multichannel electroencephalogram (EEG) is an array signal that represents brain neural networks and can be applied to characterize information propagation patterns for different emotional states. To reveal these inherent spatial graph features and increase the stability of emotion recognition, we propose an effective emotion recognition model that performs multicategory emotion recognition with multiple emotion-related spatial network topology patterns (MESNPs) by learning discriminative graph topologies in EEG brain networks. To evaluate the performance of our proposed MESNP model, we conducted single-subject and multisubject four-class classification experiments on two public datasets, MAHNOB-HCI and DEAP. Compared with existing feature extraction methods, the MESNP model significantly enhances the multiclass emotional classification performance in the single-subject and multisubject conditions. To evaluate the online version of the proposed MESNP model, we designed an online emotion monitoring system. We recruited 14 participants to conduct the online emotion decoding experiments. The average online experimental accuracy of the 14 participants was 84.56%, indicating that our model can be applied in affective brain-computer interface (aBCI) systems. The offline and online experimental results demonstrate that the proposed MESNP model effectively captures discriminative graph topology patterns and significantly improves emotion classification performance. Moreover, the proposed MESNP model provides a new scheme for extracting features from strongly coupled array signals.

Correction to: Bacomics: a comprehensive cross area originating in the studies of various brain-apparatus conversations.

[This corrects the article DOI: 10.1007/s11571-020-09577-7.].

Discrimination of auditory verbal hallucination in schizophrenia based on EEG brain networks.

Auditory verbal hallucinations (AVH) are a core positive symptom of schizophrenia and are regarded as a consequence of the functional breakdown in the related sensory process. Yet, the potential mechanism of AVH is still lacking. In the present study, we explored the difference between AVHs (n = 23) and non-AVHs (n = 19) in schizophrenia and healthy controls (n = 29) by using multidimensional electroencephalograms data during an auditory oddball task. Compared to healthy controls, both AVH and non-AVH groups showed reduced P300 amplitudes. Additionally, the results from brain networks analysis revealed that AVH patients showed reduced left frontal to posterior parietal/temporal connectivity compared to non-AVH patients. Moreover, using the fused network properties of both delta and theta bands as features for in-depth learning made it possible to identify the AVH from non-AVH patients at an accuracy of 80.95%. The left frontal-parietal/temporal networks seen in the auditory oddball paradigm might be underlying biomarkers of AVH in schizophrenia. This study demonstrated for the first time the functional breakdown of the auditory processing pathway in the AVH patients, leading to a better understanding of the atypical brain network of the AVH patients.

An efficient CNN-LSTM network with spectral normalization and label smoothing technologies for SSVEP frequency recognition.

Objective. Steady-state visual evoked potentials (SSVEPs) based brain-computer interface (BCI) has received great interests owing to the high information transfer rate and available large number of targets. However, the performance of frequency recognition methods heavily depends on the amount of the calibration data for intra-subject classification. Some research adopted the deep learning (DL) algorithm to conduct the inter-subject classification, which could reduce the calculation procedure, but the performance still has large room to improve compared with the intra-subject classification.Approach. To address these issues, we proposed an efficient SSVEP DL NETwork (termed SSVEPNET) based on one-dimensional convolution and long short-term memory (LSTM) module. To enhance the performance of SSVEPNET, we adopted the spectral normalization and label smoothing technologies during implementing the network architecture. We evaluated the SSVEPNET and compared it with other methods for the intra- and inter-subject classification under different conditions, i.e. two datasets, two time-window lengths (1 s and 0.5 s), three sizes of training data.Main results. Under all the experimental settings, the proposed SSVEPNET achieved the highest average accuracy for the intra- and inter-subject classification on the two SSVEP datasets, when compared with other traditional and DL baseline methods.Significance. The extensive experimental results demonstrate that the proposed DL model holds promise to enhance frequency recognition performance in SSVEP-based BCIs. Besides, the mixed network structures with convolutional neural network and LSTM, and the spectral normalization and label smoothing could be useful optimization strategies to design efficient models for electroencephalography data.

Simultaneously exploring multi-scale and asymmetric EEG features for emotion recognition.

In recent years, emotion recognition based on electroencephalography (EEG) has received growing interests in the brain-computer interaction (BCI) field. The neuroscience researches indicate that the left and right brain hemispheres demonstrate activity differences under different emotional activities, which could be an important principle for designing deep learning (DL) model for emotion recognition. Besides, owing to the nonstationarity of EEG signals, using convolution kernels of a single size may not sufficiently extract the abundant features for EEG classification tasks. Based on these two angles, we proposed a model termed Multi-Scales Bi-hemispheric Asymmetric Model (MSBAM) based on convolutional neural network (CNN) structure. Evaluated on the public DEAP and DREAMER datasets, MSBAM achieved over 99% accuracy for the two-class classification of low-level and high-level states in each of four emotional dimensions, i.e., arousal, valence, dominance and liking, respectively. This study further demonstrated the promising potential to design the DL model from the multi-scale characteristics of the EEG data and the neural mechanisms of the emotion cognition.