Brain connectivity meets reservoir computing.

The connectivity of Artificial Neural Networks (ANNs) is different from the one observed in Biological Neural Networks (BNNs). Can the wiring of actual brains help improve ANNs architectures? Can we learn from ANNs about what network features support computation in the brain when solving a task? At a meso/macro-scale level of the connectivity, ANNs' architectures are carefully engineered and such those design decisions have crucial importance in many recent performance improvements. On the other hand, BNNs exhibit complex emergent connectivity patterns at all scales. At the individual level, BNNs connectivity results from brain development and plasticity processes, while at the species level, adaptive reconfigurations during evolution also play a major role shaping connectivity. Ubiquitous features of brain connectivity have been identified in recent years, but their role in the brain's ability to perform concrete computations remains poorly understood. Computational neuroscience studies reveal the influence of specific brain connectivity features only on abstract dynamical properties, although the implications of real brain networks topologies on machine learning or cognitive tasks have been barely explored. Here we present a cross-species study with a hybrid approach integrating real brain connectomes and Bio-Echo State Networks, which we use to solve concrete memory tasks, allowing us to probe the potential computational implications of real brain connectivity patterns on task solving. We find results consistent across species and tasks, showing that biologically inspired networks perform as well as classical echo state networks, provided a minimum level of randomness and diversity of connections is allowed. We also present a framework, bio2art, to map and scale up real connectomes that can be integrated into recurrent ANNs. This approach also allows us to show the crucial importance of the diversity of interareal connectivity patterns, stressing the importance of stochastic processes determining neural networks connectivity in general.

Task-specific subnetworks extend from prefrontal cortex to striatum.

Functional magnetic resonance imaging (fMRI) studies on the dynamic representation of task content focus preferentially on the cerebral cortex. However, neurophysiological studies report coding of task-relevant features also by neurons in the striatum, suggesting basal ganglia involvement in cognitive decision-making. Here we use fMRI data to show that also in humans the striatum is an integrated part of the cognitive brain network. Twelve participants performed 3 cognitive tasks in the scanner, i.e., the Eriksen flanker task, a 2-back matching spatial working memory task, and a response scheme switching task. First, we use region of interest-based multivariate pattern classification to demonstrate that each task reliably induces a unique activity pattern in the striatum and in the lateral prefrontal cortex. We show that the three tasks can also be distinguished in putamen, caudate nucleus and ventral striatum alone. We additionally establish that the contribution of striatum to cognition is not sensitive to habituation or learning. Secondly, we use voxel-to-voxel functional connectivity to establish that voxels in the lateral prefrontal cortex and in the striatum that prefer the same task show significantly stronger functional coupling than voxel pairs in these remote structures that prefer different tasks. These results suggest that striatal neurons form subnetworks with cognition-related regions of the prefrontal cortex. These remote neuron populations are interconnected via functional couplings that exceed the time of execution of the specific tasks.

A natural cortical axis connecting the outside and inside of the human brain.

What structural and connectivity features of the human brain help to explain the extraordinary human cognitive abilities? We recently proposed a set of relevant connectomic fundamentals, some of which arise from the size scaling of the human brain relative to other primate brains, while others of these fundamentals may be uniquely human. In particular, we suggested that the remarkable increase of the size of the human brain due to its prolonged prenatal development has brought with it an increased sparsification, hierarchical modularization, as well as increased depth and cytoarchitectonic differentiation of brain networks. These characteristic features are complemented by a shift of projection origins to the upper layers of many cortical areas as well as the significantly prolonged postnatal development and plasticity of the upper cortical layers. Another fundamental aspect of cortical organization that has emerged in recent research is the alignment of diverse features of evolution, development, cytoarchitectonics, function, and plasticity along a principal, natural cortical axis from sensory ("outside") to association ("inside") areas. Here we highlight how this natural axis is integrated in the characteristic organization of the human brain. In particular, the human brain displays a developmental expansion of outside areas and a stretching of the natural axis such that outside areas are more widely separated from each other and from inside areas than in other species. We outline some functional implications of this characteristic arrangement.

Disentangling cortical functional connectivity strength and topography reveals divergent roles of genes and environment.

The human brain varies across individuals in its morphology, function, and cognitive capacities. Variability is particularly high in phylogenetically modern regions associated with higher order cognitive abilities, but its relationship to the layout and strength of functional networks is poorly understood. In this study we disentangled the variability of two key aspects of functional connectivity: strength and topography. We then compared the genetic and environmental influences on these two features. Genetic contribution is heterogeneously distributed across the cortex and differs for strength and topography. In heteromodal areas genes predominantly affect the topography of networks, while their connectivity strength is shaped primarily by random environmental influence such as learning. We identified peak areas of genetic control of topography overlapping with parts of the processing stream from primary areas to network hubs in the default mode network, suggesting the coordination of spatial configurations across those processing pathways. These findings provide a detailed map of the diverse contribution of heritability and individual experience to the strength and topography of functional brain architecture.

Bio-instantiated recurrent neural networks: Integrating neurobiology-based network topology in artificial networks.

Biological neuronal networks (BNNs) are a source of inspiration and analogy making for researchers that focus on artificial neuronal networks (ANNs). Moreover, neuroscientists increasingly use ANNs as a model for the brain. Despite certain similarities between these two types of networks, important differences can be discerned. First, biological neural networks are sculpted by evolution and the constraints that it entails, whereas artificial neural networks are engineered to solve particular tasks. Second, the network topology of these systems, apart from some analogies that can be drawn, exhibits pronounced differences. Here, we examine strategies to construct recurrent neural networks (RNNs) that instantiate the network topology of brains of different species. We refer to such RNNs as bio-instantiated. We investigate the performance of bio-instantiated RNNs in terms of: (i) the prediction performance itself, that is, the capacity of the network to minimize the cost function at hand in test data, and (ii) speed of training, that is, how fast during training the network reaches its optimal performance. We examine bio-instantiated RNNs in working memory tasks where task-relevant information must be tracked as a sequence of events unfolds in time. We highlight the strategies that can be used to construct RNNs with the network topology found in BNNs, without sacrificing performance. Despite that we observe no enhancement of performance when compared to randomly wired RNNs, our approach demonstrates how empirical neural network data can be used for constructing RNNs, thus, facilitating further experimentation with biologically realistic network topologies, in contexts where such aspect is desired.

An architectonic type principle in the development of laminar patterns of cortico-cortical connections.

Structural connections between cortical areas form an intricate network with a high degree of specificity. Many aspects of this complex network organization in the adult mammalian cortex are captured by an architectonic type principle, which relates structural connections to the architectonic differentiation of brain regions. In particular, the laminar patterns of projection origins are a prominent feature of structural connections that varies in a graded manner with the relative architectonic differentiation of connected areas in the adult brain. Here we show that the architectonic type principle is already apparent for the laminar origins of cortico-cortical projections in the immature cortex of the macaque monkey. We find that prenatal and neonatal laminar patterns correlate with cortical architectonic differentiation, and that the relation of laminar patterns to architectonic differences between connected areas is not substantially altered by the complete loss of visual input. Moreover, we find that the degree of change in laminar patterns that projections undergo during development varies in proportion to the relative architectonic differentiation of the connected areas. Hence, it appears that initial biases in laminar projection patterns become progressively strengthened by later developmental processes. These findings suggest that early neurogenetic processes during the formation of the brain are sufficient to establish the characteristic laminar projection patterns. This conclusion is in line with previously suggested mechanistic explanations underlying the emergence of the architectonic type principle and provides further constraints for exploring the fundamental factors that shape structural connectivity in the mammalian brain.

The natural axis of transmitter receptor distribution in the human cerebral cortex.

Transmitter receptors constitute a key component of the molecular machinery for intercellular communication in the brain. Recent efforts have mapped the density of diverse transmitter receptors across the human cerebral cortex with an unprecedented level of detail. Here, we distill these observations into key organizational principles. We demonstrate that receptor densities form a natural axis in the human cerebral cortex, reflecting decreases in differentiation at the level of laminar organization and a sensory-to-association axis at the functional level. Along this natural axis, key organizational principles are discerned: progressive molecular diversity (increase of the diversity of receptor density); excitation/inhibition (increase of the ratio of excitatory-to-inhibitory receptor density); and mirrored, orderly changes of the density of ionotropic and metabotropic receptors. The uncovered natural axis formed by the distribution of receptors aligns with the axis that is formed by other dimensions of cortical organization, such as the myelo- and cytoarchitectonic levels. Therefore, the uncovered natural axis constitutes a unifying organizational feature linking multiple dimensions of the cerebral cortex, thus bringing order to the heterogeneity of cortical organization.

A Connectomic Hypothesis for the Hominization of the Brain.

Cognitive abilities of the human brain, including language, have expanded dramatically in the course of our recent evolution from nonhuman primates, despite only minor apparent changes at the gene level. The hypothesis we propose for this paradox relies upon fundamental features of human brain connectivity, which contribute to a characteristic anatomical, functional, and computational neural phenotype, offering a parsimonious framework for connectomic changes taking place upon the human-specific evolution of the genome. Many human connectomic features might be accounted for by substantially increased brain size within the global neural architecture of the primate brain, resulting in a larger number of neurons and areas and the sparsification, increased modularity, and laminar differentiation of cortical connections. The combination of these features with the developmental expansion of upper cortical layers, prolonged postnatal brain development, and multiplied nongenetic interactions with the physical, social, and cultural environment gives rise to categorically human-specific cognitive abilities including the recursivity of language. Thus, a small set of genetic regulatory events affecting quantitative gene expression may plausibly account for the origins of human brain connectivity and cognition.

Imaging evolution of the primate brain: the next frontier?

Evolution, as we currently understand it, strikes a delicate balance between animals' ancestral history and adaptations to their current niche. Similarities between species are generally considered inherited from a common ancestor whereas observed differences are considered as more recent evolution. Hence comparing species can provide insights into the evolutionary history. Comparative neuroimaging has recently emerged as a novel subdiscipline, which uses magnetic resonance imaging (MRI) to identify similarities and differences in brain structure and function across species. Whereas invasive histological and molecular techniques are superior in spatial resolution, they are laborious, post-mortem, and oftentimes limited to specific species. Neuroimaging, by comparison, has the advantages of being applicable across species and allows for fast, whole-brain, repeatable, and multi-modal measurements of the structure and function in living brains and post-mortem tissue. In this review, we summarise the current state of the art in comparative anatomy and function of the brain and gather together the main scientific questions to be explored in the future of the fascinating new field of brain evolution derived from comparative neuroimaging.

Shaping brain structure: Genetic and phylogenetic axes of macroscale organization of cortical thickness.

The topology of the cerebral cortex has been proposed to provide an important source of constraint for the organization of cognition. In a sample of twins (n = 1113), we determined structural covariance of thickness to be organized along both a posterior-to-anterior and an inferior-to-superior axis. Both organizational axes were present when investigating the genetic correlation of cortical thickness, suggesting a strong genetic component in humans, and had a comparable organization in macaques, demonstrating they are phylogenetically conserved in primates. In both species, the inferior-superior dimension of cortical organization aligned with the predictions of dual-origin theory, and in humans, we found that the posterior-to-anterior axis related to a functional topography describing a continuum of functions from basic processes involved in perception and action to more abstract features of human cognition. Together, our study provides important insights into how functional and evolutionary patterns converge at the level of macroscale cortical structural organization.

Cross-species functional alignment reveals evolutionary hierarchy within the connectome.

Evolution provides an important window into how cortical organization shapes function and vice versa. The complex mosaic of changes in brain morphology and functional organization that have shaped the mammalian cortex during evolution, complicates attempts to chart cortical differences across species. It limits our ability to fully appreciate how evolution has shaped our brain, especially in systems associated with unique human cognitive capabilities that lack anatomical homologues in other species. Here, we develop a function-based method for cross-species alignment that enables the quantification of homologous regions between humans and rhesus macaques, even when their location is decoupled from anatomical landmarks. Critically, we find cross-species similarity in functional organization reflects a gradient of evolutionary change that decreases from unimodal systems and culminates with the most pronounced changes in posterior regions of the default mode network (angular gyrus, posterior cingulate and middle temporal cortices). Our findings suggest that the establishment of the default mode network, as the apex of a cognitive hierarchy, has changed in a complex manner during human evolution - even within subnetworks.

'Hierarchy' in the organization of brain networks.

Concepts shape the interpretation of facts. One of the most popular concepts in systems neuroscience is that of 'hierarchy'. However, this concept has been interpreted in many different ways, which are not well aligned. This observation suggests that the concept is ill defined. Using the example of the organization of the primate visual cortical system, we explore several contexts in which 'hierarchy' is currently used in the description of brain networks. We distinguish at least four different uses, specifically, 'hierarchy' as a topological sequence of projections, as a gradient of features, as a progression of scales, or as a sorting of laminar projection patterns. We discuss the interpretation and functional implications of the different notions of 'hierarchy' in these contexts and suggest that more specific terms than 'hierarchy' should be used for a deeper understanding of the different dimensions of the organization of brain networks. This article is part of the theme issue 'Unifying the essential concepts of biological networks: biological insights and philosophical foundations'.

An architectonic type principle integrates macroscopic cortico-cortical connections with intrinsic cortical circuits of the primate brain.

The connections linking neurons within and between cerebral cortical areas form a multiscale network for communication. We review recent work relating essential features of cortico-cortical connections, such as their existence and laminar origins and terminations, to fundamental structural parameters of cortical areas, such as their distance, similarity in cytoarchitecture, defined by lamination or neuronal density, and other macroscopic and microscopic structural features. These analyses demonstrate the presence of an architectonic type principle. Across species and cortices, the essential features of cortico-cortical connections vary consistently and strongly with the cytoarchitectonic similarity of cortical areas. By contrast, in multivariate analyses such relations were not found consistently for distance, similarity of cortical thickness, or cellular morphology. Gradients of laminar cortical differentiation, as reflected in overall neuronal density, also correspond to regional variations of cellular features, forming a spatially ordered natural axis of concerted architectonic and connectional changes across the cortical sheet. The robustness of findings across mammalian brains allows cross-species predictions of the existence and laminar patterns of projections, including estimates for the human brain that are not yet available experimentally. The architectonic type principle integrates cortical connectivity and architecture across scales, with implications for computational explorations of cortical physiology and developmental mechanisms.

The architecture of mammalian cortical connectomes in light of the theory of the dual origin of the cerebral cortex.

Uncovering organizational principles of the cerebral cortex is essential for proper understanding of this prominent structure of the mammalian brain. The theory of the dual origin of the cerebral cortex offers such organizational principle. Here, we demonstrate that a duality pertains to the connectional architecture of the cerebral cortex of different mammals. This dual structure also constitutes a major axis of organization of the transcriptional architecture of the cortex and reflects the expression of different morphogens stemming from distinct patterning centers in the developing pallium. The duality of the cortex is also reflected in its spatial dimension, highlighting cortical areas as spatially ordered constellations that are centered around the paleocortex and archicortex, with the later primordial moieties reminiscent of antipodal points in the cortical sheet. The ontogeny of the uncovered dual connectional structure might be rooted in heterochronous neurodevelopmental gradients in the developing pallium, a suggestion corroborated by computational modeling. In all, the current results exemplify the duality of the cerebral cortex as an overarching organizational principle, reflected across the different levels of cortical architecture of different mammalian species, defining a natural axis of mammalian cortical organization.

A blueprint of mammalian cortical connectomes.

The cerebral cortex of mammals exhibits intricate interareal wiring. Moreover, mammalian cortices differ vastly in size, cytological composition, and phylogenetic distance. Given such complexity and pronounced species differences, it is a considerable challenge to decipher organizational principles of mammalian connectomes. Here, we demonstrate species-specific and species-general unifying principles linking the physical, cytological, and connectional dimensions of architecture in the mouse, cat, marmoset, and macaque monkey. The existence of connections is related to the cytology of cortical areas, in addition to the role of physical distance, but this relation is attenuated in mice and marmoset monkeys. The cytoarchitectonic cortical gradients, and not the rostrocaudal axis of the cortex, are closely linked to the laminar origin of connections, a principle that allows the extrapolation of this connectional feature to humans. Lastly, a network core, with a central role under different modes of network communication, characterizes all cortical connectomes. We observe a displacement of the network core in mammals, with a shift of the core of cats and macaque monkeys toward the less neuronally dense areas of the cerebral cortex. This displacement has functional ramifications but also entails a potential increased degree of vulnerability to pathology. In sum, our results sketch out a blueprint of mammalian connectomes consisting of species-specific and species-general links between the connectional, physical, and cytological dimensions of the cerebral cortex, possibly reflecting variations and persistence of evolutionarily conserved mechanisms and cellular phenomena. Our framework elucidates organizational principles that encompass but also extend beyond the wiring economy principle imposed by the physical embedding of the cerebral cortex.

Exploring the limits of network topology estimation using diffusion-based tractography and tracer studies in the macaque cortex.

Reconstructing the anatomical pathways of the brain to study the human connectome has become an important endeavour for understanding brain function and dynamics. Reconstruction of the cortico-cortical connectivity matrix in vivo often relies on noninvasive diffusion-weighted imaging (DWI) techniques but the extent to which they can accurately represent the topological characteristics of structural connectomes remains unknown. We addressed this question by constructing connectomes using DWI data collected from macaque monkeys in vivo and with data from published invasive tracer studies. We found the strength of fiber tracts was well estimated from DWI and topological properties like degree and modularity were captured by tractography-based connectomes. Rich-club/core-periphery type architecture could also be detected but the classification of hubs using betweenness centrality, participation coefficient and core-periphery identification techniques was inaccurate. Our findings indicate that certain aspects of cortical topology can be faithfully represented in noninvasively-obtained connectomes while other network analytic measures warrant cautionary interpretations.

Comprehensive computational modelling of the development of mammalian cortical connectivity underlying an architectonic type principle.

The architectonic type principle relates patterns of cortico-cortical connectivity to the relative architectonic differentiation of cortical regions. One mechanism through which the observed close relation between cortical architecture and connectivity may be established is the joint development of cortical areas and their connections in developmental time windows. Here, we describe a theoretical exploration of the possible mechanistic underpinnings of the architectonic type principle, by performing systematic computational simulations of cortical development. The main component of our in silico model was a developing two-dimensional cortical sheet, which was gradually populated by neurons that formed cortico-cortical connections. To assess different explanatory mechanisms, we varied the spatiotemporal trajectory of the simulated neurogenesis. By keeping the rules governing axon outgrowth and connection formation constant across all variants of simulated development, we were able to create model variants which differed exclusively by the specifics of when and where neurons were generated. Thus, all differences in the resulting connectivity were due to the variations in spatiotemporal growth trajectories. Our results demonstrated that a prescribed targeting of interareal connection sites was not necessary for obtaining a realistic replication of the experimentally observed relation between connection patterns and architectonic differentiation. Instead, we found that spatiotemporal interactions within the forming cortical sheet were sufficient if a small number of empirically well-grounded assumptions were met, namely planar, expansive growth of the cortical sheet around two points of origin as neurogenesis progressed, stronger architectonic differentiation of cortical areas for later neurogenetic time windows, and stochastic connection formation. Thus, our study highlights a potential mechanism of how relative architectonic differentiation and cortical connectivity become linked during development. We successfully predicted connectivity in two species, cat and macaque, from simulated cortico-cortical connection networks, which further underscored the general applicability of mechanisms through which the architectonic type principle can explain cortical connectivity in terms of the relative architectonic differentiation of cortical regions.

Cortical Gradients and Laminar Projections in Mammals.

A key component of current theories of brain structure and function is the layer-specific origin of structural connections of the cerebral cortex. This fundamental connectional feature pertains to different mammalian cortices, and recent neuroimaging advancements have started to pave the way for its function-based mapping in humans. Here, we propose a framework that systematically explains the characteristic layer-specific origin of structural connections and its graded variation across the cortical sheet and across mammalian species. The framework unifies seemingly dispersed observations on multiple levels of cortical organization, including the cellular, connectional, and functional level. Moreover, the framework allows the prediction of the layer-specific origin of connections in a spectrum of mammals, from rodents to humans.

Functional connectivity of task context representations in prefrontal nodes of the multiple demand network.

A subset of regions in the lateral and medial prefrontal cortex and the anterior insula increase their activity level whenever a cognitive task becomes more demanding, regardless of the specific nature of this demand. During execution of a task, these areas and the surrounding cortex temporally encode aspects of the task context in spatially distributed patterns of activity. It is not clear whether these patterns reflect underlying anatomical subnetworks that still exist when task execution has finished. We use fMRI in 12 participants performing alternating blocks of three cognitive tasks to address this question. A first data set is used to define multiple demand regions in each participant. A second dataset from the same participants is used to determine multiple demand voxel assemblies with a preference for one task over the others. We then show that these voxels remain functionally coupled during execution of non-preferred tasks and that they exhibit stronger functional connectivity during rest. This indicates that the assemblies of task preference sharing voxels reflect patterns of underlying anatomical connections. Moreover, we show that voxels preferring the same task have more similar whole brain functional connectivity profiles that are consistent across participants. This suggests that voxel assemblies differ in patterns of input-output connections, most likely reflecting task demand-specific information exchange.

Human orbital and anterior medial prefrontal cortex: Intrinsic connectivity parcellation and functional organization.

The orbital and medial prefrontal cortex (OMPFC) has been implicated in decision-making, reward and emotion processing, and psychopathology, such as depression and obsessive-compulsive disorder. Human and monkey anatomical studies indicate the presence of various cortical subdivisions and suggest that these are organized in two extended networks, a medial and an orbital one. Attempts have been made to replicate these neuroanatomical findings in vivo using MRI techniques for imaging connectivity. These revealed several consistencies, but also many inconsistencies between reported results. Here, we use fMRI resting-state functional connectivity (FC) and data-driven modularity optimization to parcellate the OMPFC to investigate replicability of in vivo parcellation more systematically. By collecting two resting-state data sets per participant, we were able to quantify the reliability of the observed modules and their boundaries. Results show that there was significantly more than chance overlap in modules and their boundaries at the level of individual data sets. Moreover, some of these consistent boundaries significantly co-localized across participants. Hierarchical clustering showed that the whole-brain FC profiles of the OMPFC subregions separate them in two networks, a medial and orbital one, which overlap with the organization proposed by Barbas and Pandya (J Comp Neurol 286:353-375, 1989) and Ongür and Price (Cereb Cortex 10:206-219, 2000). We conclude that in vivo resting-state FC can delineate reliable and neuroanatomically plausible subdivisions that agree with established cytoarchitectonic trends and connectivity patterns, while other subdivisions do not show the same consistency across data sets and studies.