Spatial-temporal convolutional attention for discovering and characterizing functional brain networks in task fMRI.

Functional brain networks (FBNs) are spatial patterns of brain function that play a critical role in understanding human brain function. There are many proposed methods for mapping the spatial patterns of brain function, however they oversimplify the underlying assumptions of brain function and have various limitations such as linearity and independence. Additionally, current methods fail to account for the dynamic nature of FBNs, which limits their effectiveness in accurately characterizing these networks. To address these limitations, we present a novel deep learning and spatial-wise attention based model called Spatial-Temporal Convolutional Attention (STCA) to accurately model dynamic FBNs. Specifically, we train STCA in a self-supervised manner by utilizing a Convolutional Autoencoder to guide the STCA module in assigning higher attention weights to regions of functional activity. To validate the reliability of the results, we evaluate our approach on the HCP-task motor behavior dataset, the experimental results demonstrate that the STCA derived FBNs have higher spatial similarity with the templates and that the spatial similarity between the templates and the FBNs derived by STCA fluctuates with the task design over time, suggesting that STCA can reflect the dynamic changes of brain function, providing a powerful tool to better understand human brain function. Code is available at https://github.com/SNNUBIAI/STCAE.

Cerebral cortical regions always connect with each other via the shortest paths.

In human society, the choice of transportation mode between two cities is largely influenced by the distance between the regions. Similarly, when neurons communicate with each other within the cerebral cortex, do they establish their connections based on their physical distance? In this study, we employed a data-driven approach to explore the relationships between fiber length and corresponding geodesic distance between the fiber's two endpoints on brain surface. Diffusion-MRI-derived fiber streamlines were used to represent extra-cortical axonal connections between neurons or cortical regions, while geodesic paths between cortical points were employed to simulate intra-cortical connections. The results demonstrated that the geodesic distance between two cortical regions connected by a fiber streamline was greater than the fiber length most of the time, indicating that cortical regions tend to choose the shortest path for connection; whether it be an intra-cortical or extra-cortical route, especially when intra-cortical routes within cortical regions are longer than potential extrinsic fiber routes, there is an increased probability to establish fiber routes to connect the both regions. These findings were validated in a group of human brains and may provide insights into the underlying mechanisms of neuronal growth, connection, and wiring.

Multi-head attention-based masked sequence model for mapping functional brain networks.

The investigation of functional brain networks (FBNs) using task-based functional magnetic resonance imaging (tfMRI) has gained significant attention in the field of neuroimaging. Despite the availability of several methods for constructing FBNs, including traditional methods like GLM and deep learning methods such as spatiotemporal self-attention mechanism (STAAE), these methods have design and training limitations. Specifically, they do not consider the intrinsic characteristics of fMRI data, such as the possibility that the same signal value at different time points could represent different brain states and meanings. Furthermore, they overlook prior knowledge, such as task designs, during training. This study aims to overcome these limitations and develop a more efficient model by drawing inspiration from techniques in the field of natural language processing (NLP). The proposed model, called the Multi-head Attention-based Masked Sequence Model (MAMSM), uses a multi-headed attention mechanism and mask training approach to learn different states corresponding to the same voxel values. Additionally, it combines cosine similarity and task design curves to construct a novel loss function. The MAMSM was applied to seven task state datasets from the Human Connectome Project (HCP) tfMRI dataset. Experimental results showed that the features acquired by the MAMSM model exhibit a Pearson correlation coefficient with the task design curves above 0.95 on average. Moreover, the model can extract more meaningful networks beyond the known task-related brain networks. The experimental results demonstrated that MAMSM has great potential in advancing the understanding of functional brain networks.