Multimodal measures of spontaneous brain activity reveal both common and divergent patterns of cortical functional organization.

Large-scale functional networks have been characterized in both rodent and human brains, typically by analyzing fMRI-BOLD signals. However, the relationship between fMRI-BOLD and underlying neural activity is complex and incompletely understood, which poses challenges to interpreting network organization obtained using this technique. Additionally, most work has assumed a disjoint functional network organization (i.e., brain regions belong to one and only one network). Here, we employ wide-field Ca2+ imaging simultaneously with fMRI-BOLD in mice expressing GCaMP6f in excitatory neurons. We determine cortical networks discovered by each modality using a mixed-membership algorithm to test the hypothesis that functional networks exhibit overlapping organization. We find that there is considerable network overlap (both modalities) in addition to disjoint organization. Our results show that multiple BOLD networks are detected via Ca2+ signals, and networks determined by low-frequency Ca2+ signals are only modestly more similar to BOLD networks. In addition, the principal gradient of functional connectivity is nearly identical for BOLD and Ca2+ signals. Despite similarities, important differences are also detected across modalities, such as in measures of functional connectivity strength and diversity. In conclusion, Ca2+ imaging uncovers overlapping functional cortical organization in the mouse that reflects several, but not all, properties observed with fMRI-BOLD signals.

Hierarchical VAEs provide a normative account of motion processing in the primate brain.

The relationship between perception and inference, as postulated by Helmholtz in the 19th century, is paralleled in modern machine learning by generative models like Variational Autoencoders (VAEs) and their hierarchical variants. Here, we evaluate the role of hierarchical inference and its alignment with brain function in the domain of motion perception. We first introduce a novel synthetic data framework, Retinal Optic Flow Learning (ROFL), which enables control over motion statistics and their causes. We then present a new hierarchical VAE and test it against alternative models on two downstream tasks: (i) predicting ground truth causes of retinal optic flow (e.g., self-motion); and (ii) predicting the responses of neurons in the motion processing pathway of primates. We manipulate the model architectures (hierarchical versus non-hierarchical), loss functions, and the causal structure of the motion stimuli. We find that hierarchical latent structure in the model leads to several improvements. First, it improves the linear decodability of ground truth factors and does so in a sparse and disentangled manner. Second, our hierarchical VAE outperforms previous state-of-the-art models in predicting neuronal responses and exhibits sparse latent-to-neuron relationships. These results depend on the causal structure of the world, indicating that alignment between brains and artificial neural networks depends not only on architecture but also on matching ecologically relevant stimulus statistics. Taken together, our results suggest that hierarchical Bayesian inference underlines the brain's understanding of the world, and hierarchical VAEs can effectively model this understanding.

Multimodal measures of spontaneous brain activity reveal both common and divergent patterns of cortical functional organization.

Large-scale functional networks have been characterized in both rodent and human brains, typically by analyzing fMRI-BOLD signals. However, the relationship between fMRI-BOLD and underlying neural activity is complex and incompletely understood, which poses challenges to interpreting network organization obtained using this technique. Additionally, most work has assumed a disjoint functional network organization (i.e., brain regions belong to one and only one network). Here, we employed wide-field Ca2+ imaging simultaneously with fMRI-BOLD in mice expressing GCaMP6f in excitatory neurons. We determined cortical networks discovered by each modality using a mixed-membership algorithm to test the hypothesis that functional networks are overlapping rather than disjoint. Our results show that multiple BOLD networks are detected via Ca2+ signals; there is considerable network overlap (both modalities); networks determined by low-frequency Ca2+ signals are only modestly more similar to BOLD networks; and, despite similarities, important differences are detected across modalities (e.g., brain region "network diversity"). In conclusion, Ca2+ imaging uncovered overlapping functional cortical organization in the mouse that reflected several, but not all, properties observed with fMRI-BOLD signals.