Reconstruction and Simulation of Neocortical Microcircuitry.

We present a first-draft digital reconstruction of the microcircuitry of somatosensory cortex of juvenile rat. The reconstruction uses cellular and synaptic organizing principles to algorithmically reconstruct detailed anatomy and physiology from sparse experimental data. An objective anatomical method defines a neocortical volume of 0.29 ± 0.01 mm(3) containing ~31,000 neurons, and patch-clamp studies identify 55 layer-specific morphological and 207 morpho-electrical neuron subtypes. When digitally reconstructed neurons are positioned in the volume and synapse formation is restricted to biological bouton densities and numbers of synapses per connection, their overlapping arbors form ~8 million connections with ~37 million synapses. Simulations reproduce an array of in vitro and in vivo experiments without parameter tuning. Additionally, we find a spectrum of network states with a sharp transition from synchronous to asynchronous activity, modulated by physiological mechanisms. The spectrum of network states, dynamically reconfigured around this transition, supports diverse information processing strategies. PAPERCLIP: VIDEO ABSTRACT.

HippoUnit: A software tool for the automated testing and systematic comparison of detailed models of hippocampal neurons based on electrophysiological data.

Anatomically and biophysically detailed data-driven neuronal models have become widely used tools for understanding and predicting the behavior and function of neurons. Due to the increasing availability of experimental data from anatomical and electrophysiological measurements as well as the growing number of computational and software tools that enable accurate neuronal modeling, there are now a large number of different models of many cell types available in the literature. These models were usually built to capture a few important or interesting properties of the given neuron type, and it is often unknown how they would behave outside their original context. In addition, there is currently no simple way of quantitatively comparing different models regarding how closely they match specific experimental observations. This limits the evaluation, re-use and further development of the existing models. Further, the development of new models could also be significantly facilitated by the ability to rapidly test the behavior of model candidates against the relevant collection of experimental data. We address these problems for the representative case of the CA1 pyramidal cell of the rat hippocampus by developing an open-source Python test suite, which makes it possible to automatically and systematically test multiple properties of models by making quantitative comparisons between the models and electrophysiological data. The tests cover various aspects of somatic behavior, and signal propagation and integration in apical dendrites. To demonstrate the utility of our approach, we applied our tests to compare the behavior of several different rat hippocampal CA1 pyramidal cell models from the ModelDB database against electrophysiological data available in the literature, and evaluated how well these models match experimental observations in different domains. We also show how we employed the test suite to aid the development of models within the European Human Brain Project (HBP), and describe the integration of the tests into the validation framework developed in the HBP, with the aim of facilitating more reproducible and transparent model building in the neuroscience community.

The SONATA data format for efficient description of large-scale network models.

Increasing availability of comprehensive experimental datasets and of high-performance computing resources are driving rapid growth in scale, complexity, and biological realism of computational models in neuroscience. To support construction and simulation, as well as sharing of such large-scale models, a broadly applicable, flexible, and high-performance data format is necessary. To address this need, we have developed the Scalable Open Network Architecture TemplAte (SONATA) data format. It is designed for memory and computational efficiency and works across multiple platforms. The format represents neuronal circuits and simulation inputs and outputs via standardized files and provides much flexibility for adding new conventions or extensions. SONATA is used in multiple modeling and visualization tools, and we also provide reference Application Programming Interfaces and model examples to catalyze further adoption. SONATA format is free and open for the community to use and build upon with the goal of enabling efficient model building, sharing, and reproducibility.

Data-driven integration of hippocampal CA1 synaptic physiology in silico.

The anatomy and physiology of monosynaptic connections in rodent hippocampal CA1 have been extensively studied in recent decades. Yet, the resulting knowledge remains disparate and difficult to reconcile. Here, we present a data-driven approach to integrate the current state-of-the-art knowledge on the synaptic anatomy and physiology of rodent hippocampal CA1, including axo-dendritic innervation patterns, number of synapses per connection, quantal conductances, neurotransmitter release probability, and short-term plasticity into a single coherent resource. First, we undertook an extensive literature review of paired recordings of hippocampal neurons and compiled experimental data on their synaptic anatomy and physiology. The data collected in this manner is sparse and inhomogeneous due to the diversity of experimental techniques used by different groups, which necessitates the need for an integrative framework to unify these data. To this end, we extended a previously developed workflow for the neocortex to constrain a unifying in silico reconstruction of the synaptic physiology of CA1 connections. Our work identifies gaps in the existing knowledge and provides a complementary resource toward a more complete quantification of synaptic anatomy and physiology in the rodent hippocampal CA1 region.

The physiological variability of channel density in hippocampal CA1 pyramidal cells and interneurons explored using a unified data-driven modeling workflow.

Every neuron is part of a network, exerting its function by transforming multiple spatiotemporal synaptic input patterns into a single spiking output. This function is specified by the particular shape and passive electrical properties of the neuronal membrane, and the composition and spatial distribution of ion channels across its processes. For a variety of physiological or pathological reasons, the intrinsic input/output function may change during a neuron's lifetime. This process results in high variability in the peak specific conductance of ion channels in individual neurons. The mechanisms responsible for this variability are not well understood, although there are clear indications from experiments and modeling that degeneracy and correlation among multiple channels may be involved. Here, we studied this issue in biophysical models of hippocampal CA1 pyramidal neurons and interneurons. Using a unified data-driven simulation workflow and starting from a set of experimental recordings and morphological reconstructions obtained from rats, we built and analyzed several ensembles of morphologically and biophysically accurate single cell models with intrinsic electrophysiological properties consistent with experimental findings. The results suggest that the set of conductances expressed in any given hippocampal neuron may be considered as belonging to two groups: one subset is responsible for the major characteristics of the firing behavior in each population and the other is responsible for a robust degeneracy. Analysis of the model neurons suggests several experimentally testable predictions related to the combination and relative proportion of the different conductances that should be expressed on the membrane of different types of neurons for them to fulfill their role in the hippocampus circuitry.

Morphological Diversity Strongly Constrains Synaptic Connectivity and Plasticity.

Synaptic connectivity between neurons is naturally constrained by the anatomical overlap of neuronal arbors, the space on the axon available for synapses, and by physiological mechanisms that form synapses at a subset of potential synapse locations. What is not known is how these constraints impact emergent connectivity in a circuit with diverse morphologies. We investigated the role of morphological diversity within and across neuronal types on emergent connectivity in a model of neocortical microcircuitry. We found that the average overlap between the dendritic and axonal arbors of different types of neurons determines neuron-type specific patterns of distance-dependent connectivity, severely constraining the space of possible connectomes. However, higher order connectivity motifs depend on the diverse branching patterns of individual arbors of neurons belonging to the same type. Morphological diversity across neuronal types, therefore, imposes a specific structure on first order connectivity, and morphological diversity within neuronal types imposes a higher order structure of connectivity. We estimate that the morphological constraints resulting from diversity within and across neuron types together lead to a 10-fold reduction of the entropy of possible connectivity configurations, revealing an upper bound on the space explored by structural plasticity.

From Neuron Biophysics to Orientation Selectivity in Electrically Coupled Networks of Neocortical L2/3 Large Basket Cells.

In the neocortex, inhibitory interneurons of the same subtype are electrically coupled with each other via dendritic gap junctions (GJs). The impact of multiple GJs on the biophysical properties of interneurons and thus on their input processing is unclear. The present experimentally based theoretical study examined GJs in L2/3 large basket cells (L2/3 LBCs) with 3 goals in mind: (1) To evaluate the errors due to GJs in estimating the cable properties of individual L2/3 LBCs and suggest ways to correct these errors when modeling these cells and the networks they form; (2) to bracket the GJ conductance value (0.05-0.25 nS) and membrane resistivity (10 000-40 000 Ω cm(2)) of L2/3 LBCs; these estimates are tightly constrained by in vitro input resistance (131 ± 18.5 MΩ) and the coupling coefficient (1-3.5%) of these cells; and (3) to explore the functional implications of GJs, and show that GJs: (i) dynamically modulate the effective time window for synaptic integration; (ii) improve the axon's capability to encode rapid changes in synaptic inputs; and (iii) reduce the orientation selectivity, linearity index, and phase difference of L2/3 LBCs. Our study provides new insights into the role of GJs and calls for caution when using in vitro measurements for modeling electrically coupled neuronal networks.

Cellular adaptation facilitates sparse and reliable coding in sensory pathways.

Most neurons in peripheral sensory pathways initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. It is unclear how this phenomenon affects stimulus coding in the later stages of sensory processing. Here, we show that a temporally sparse and reliable stimulus representation develops naturally in sequential stages of a sensory network with adapting neurons. As a modeling framework we employ a mean-field approach together with an adaptive population density treatment, accompanied by numerical simulations of spiking neural networks. We find that cellular adaptation plays a critical role in the dynamic reduction of the trial-by-trial variability of cortical spike responses by transiently suppressing self-generated fast fluctuations in the cortical balanced network. This provides an explanation for a widespread cortical phenomenon by a simple mechanism. We further show that in the insect olfactory system cellular adaptation is sufficient to explain the emergence of the temporally sparse and reliable stimulus representation in the mushroom body. Our results reveal a generic, biophysically plausible mechanism that can explain the emergence of a temporally sparse and reliable stimulus representation within a sequential processing architecture.

Informing deep neural networks by multiscale principles of neuromodulatory systems.

Our brains have evolved the ability to configure and adapt their processing states to match the unique challenges of acting and learning in diverse environments and behavioral contexts. In biological nervous systems, such state specification and adaptation arise in part from neuromodulators, including acetylcholine, noradrenaline, serotonin, and dopamine, whose diffuse release fine-tunes neuronal and synaptic dynamics and plasticity to complement the behavioral context in real-time. Despite the demonstrated effectiveness of deep neural networks for specific tasks, they remain relatively inflexible at generalizing across tasks or adapting to ever-changing behavioral demands. In this article, we provide an overview of neuromodulatory systems and their relationship to emerging pertinent principles in deep neural networks. We further outline opportunities for the integration of neuromodulatory principles into deep neural networks, towards endowing artificial intelligence with a key ingredient underlying the flexibility and learning capability of biological systems.

A calcium-based plasticity model for predicting long-term potentiation and depression in the neocortex.

Pyramidal cells (PCs) form the backbone of the layered structure of the neocortex, and plasticity of their synapses is thought to underlie learning in the brain. However, such long-term synaptic changes have been experimentally characterized between only a few types of PCs, posing a significant barrier for studying neocortical learning mechanisms. Here we introduce a model of synaptic plasticity based on data-constrained postsynaptic calcium dynamics, and show in a neocortical microcircuit model that a single parameter set is sufficient to unify the available experimental findings on long-term potentiation (LTP) and long-term depression (LTD) of PC connections. In particular, we find that the diverse plasticity outcomes across the different PC types can be explained by cell-type-specific synaptic physiology, cell morphology and innervation patterns, without requiring type-specific plasticity. Generalizing the model to in vivo extracellular calcium concentrations, we predict qualitatively different plasticity dynamics from those observed in vitro. This work provides a first comprehensive null model for LTP/LTD between neocortical PC types in vivo, and an open framework for further developing models of cortical synaptic plasticity.

A comprehensive workflow for general-purpose neural modeling with highly configurable neuromorphic hardware systems.

In this article, we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More specifically, we aim at the establishment of this neuromorphic system as a flexible and neuroscientifically valuable modeling tool that can be used by non-hardware experts. We consider various functional aspects to be crucial for this purpose, and we introduce a consistent workflow with detailed descriptions of all involved modules that implement the suggested steps: The integration of the hardware interface into the simulator-independent model description language PyNN; a fully automated translation between the PyNN domain and appropriate hardware configurations; an executable specification of the future neuromorphic system that can be seamlessly integrated into this biology-to-hardware mapping process as a test bench for all software layers and possible hardware design modifications; an evaluation scheme that deploys models from a dedicated benchmark library, compares the results generated by virtual or prototype hardware devices with reference software simulations and analyzes the differences. The integration of these components into one hardware-software workflow provides an ecosystem for ongoing preparative studies that support the hardware design process and represents the basis for the maturity of the model-to-hardware mapping software. The functionality and flexibility of the latter is proven with a variety of experimental results.

In silico voltage-sensitive dye imaging reveals the emergent dynamics of cortical populations.

Voltage-sensitive dye imaging (VSDI) is a powerful technique for interrogating membrane potential dynamics in assemblies of cortical neurons, but with effective resolution limits that confound interpretation. To address this limitation, we developed an in silico model of VSDI in a biologically faithful digital reconstruction of rodent neocortical microcircuitry. Using this model, we extend previous experimental observations regarding the cellular origins of VSDI, finding that the signal is driven primarily by neurons in layers 2/3 and 5, and that VSDI measurements do not capture individual spikes. Furthermore, we test the capacity of VSD image sequences to discriminate between afferent thalamic inputs at various spatial locations to estimate a lower bound on the functional resolution of VSDI. Our approach underscores the power of a bottom-up computational approach for relating scales of cortical processing.

Cortical reliability amid noise and chaos.

Typical responses of cortical neurons to identical sensory stimuli appear highly variable. It has thus been proposed that the cortex primarily uses a rate code. However, other studies have argued for spike-time coding under certain conditions. The potential role of spike-time coding is directly limited by the internally generated variability of cortical circuits, which remains largely unexplored. Here, we quantify this internally generated variability using a biophysical model of rat neocortical microcircuitry with biologically realistic noise sources. We find that stochastic neurotransmitter release is a critical component of internally generated variability, causing rapidly diverging, chaotic recurrent network dynamics. Surprisingly, the same nonlinear recurrent network dynamics can transiently overcome the chaos in response to weak feed-forward thalamocortical inputs, and support reliable spike times with millisecond precision. Our model shows that the noisy and chaotic network dynamics of recurrent cortical microcircuitry are compatible with stimulus-evoked, millisecond spike-time reliability, resolving a long-standing debate.

A null model of the mouse whole-neocortex micro-connectome.

In connectomics, the study of the network structure of connected neurons, great advances are being made on two different scales: that of macro- and meso-scale connectomics, studying the connectivity between populations of neurons, and that of micro-scale connectomics, studying connectivity between individual neurons. We combine these two complementary views of connectomics to build a first draft statistical model of the micro-connectome of a whole mouse neocortex based on available data on region-to-region connectivity and individual whole-brain axon reconstructions. This process reveals a targeting principle that allows us to predict the innervation logic of individual axons from meso-scale data. The resulting connectome recreates biological trends of targeting on all scales and predicts that an established principle of scale invariant topological organization of connectivity can be extended down to the level of individual neurons. It can serve as a powerful null model and as a substrate for whole-brain simulations.

Estimating the Readily-Releasable Vesicle Pool Size at Synaptic Connections in the Neocortex.

Previous studies based on the 'Quantal Model' for synaptic transmission suggest that neurotransmitter release is mediated by a single release site at individual synaptic contacts in the neocortex. However, recent studies seem to contradict this hypothesis and indicate that multi-vesicular release (MVR) could better explain the synaptic response variability observed in vitro. In this study we present a novel method to estimate the number of release sites per synapse, also known as the size of the readily releasable pool (NRRP), from paired whole-cell recordings of connections between layer 5 thick tufted pyramidal cell (L5_TTPC) in the juvenile rat somatosensory cortex. Our approach extends the work of Loebel et al. (2009) by leveraging a recently published data-driven biophysical model of neocortical tissue. Using this approach, we estimated NRRP to be between two to three for synaptic connections between L5_TTPCs. To constrain NRRP values for other connections in the microcircuit, we developed and validated a generalization approach using published data on the coefficient of variation (CV) of the amplitudes of post-synaptic potentials (PSPs) from literature and comparing them against in silico experiments. Our study predicts that transmitter release at synaptic connections in the neocortex could be mediated by MVR and provides a data-driven approach to constrain the MVR model parameters in the microcircuit.

Interoperability of neuroscience modeling software: current status and future directions.

Neuroscience increasingly uses computational models to assist in the exploration and interpretation of complex phenomena. As a result, considerable effort is invested in the development of software tools and technologies for numerical simulations and for the creation and publication of models. The diversity of related tools leads to the duplication of effort and hinders model reuse. Development practices and technologies that support interoperability between software systems therefore play an important role in making the modeling process more efficient and in ensuring that published models can be reliably and easily reused. Various forms of interoperability are possible including the development of portable model description standards, the adoption of common simulation languages or the use of standardized middleware. Each of these approaches finds applications within the broad range of current modeling activity. However more effort is required in many areas to enable new scientific questions to be addressed. Here we present the conclusions of the "Neuro-IT Interoperability of Simulators" workshop, held at the 11th computational neuroscience meeting in Edinburgh ( July 19-20 2006; http://www.cnsorg.org ). We assess the current state of interoperability of neural simulation software and explore the future directions that will enable the field to advance.

Timed Synaptic Inhibition Shapes NMDA Spikes, Influencing Local Dendritic Processing and Global I/O Properties of Cortical Neurons.

The NMDA spike is a long-lasting nonlinear phenomenon initiated locally in the dendritic branches of a variety of cortical neurons. It plays a key role in synaptic plasticity and in single-neuron computations. Combining dynamic system theory and computational approaches, we now explore how the timing of synaptic inhibition affects the NMDA spike and its associated membrane current. When impinging on its early phase, individual inhibitory synapses strongly, but transiently, dampen the NMDA spike; later inhibition prematurely terminates it. A single inhibitory synapse reduces the NMDA-mediated Ca2+ current, a key player in plasticity, by up to 45%. NMDA spikes in distal dendritic branches/spines are longer-lasting and more resilient to inhibition, enhancing synaptic plasticity at these branches. We conclude that NMDA spikes are highly sensitive to dendritic inhibition; sparse weak inhibition can finely tune synaptic plasticity both locally at the dendritic branch level and globally at the level of the neuron's output.

Rich cell-type-specific network topology in neocortical microcircuitry.

Uncovering structural regularities and architectural topologies of cortical circuitry is vital for understanding neural computations. Recently, an experimentally constrained algorithm generated a dense network reconstruction of a ∼0.3-mm3 volume from juvenile rat somatosensory neocortex, comprising ∼31,000 cells and ∼36 million synapses. Using this reconstruction, we found a small-world topology with an average of 2.5 synapses separating any two cells and multiple cell-type-specific wiring features. Amounts of excitatory and inhibitory innervations varied across cells, yet pyramidal neurons maintained relatively constant excitation/inhibition ratios. The circuit contained highly connected hub neurons belonging to a small subset of cell types and forming an interconnected cell-type-specific rich club. Certain three-neuron motifs were overrepresented, matching recent experimental results. Cell-type-specific network properties were even more striking when synaptic strength and sign were considered in generating a functional topology. Our systematic approach enables interpretation of microconnectomics 'big data' and provides several experimentally testable predictions.

BluePyOpt: Leveraging Open Source Software and Cloud Infrastructure to Optimise Model Parameters in Neuroscience.

At many scales in neuroscience, appropriate mathematical models take the form of complex dynamical systems. Parameterizing such models to conform to the multitude of available experimental constraints is a global non-linear optimisation problem with a complex fitness landscape, requiring numerical techniques to find suitable approximate solutions. Stochastic optimisation approaches, such as evolutionary algorithms, have been shown to be effective, but often the setting up of such optimisations and the choice of a specific search algorithm and its parameters is non-trivial, requiring domain-specific expertise. Here we describe BluePyOpt, a Python package targeted at the broad neuroscience community to simplify this task. BluePyOpt is an extensible framework for data-driven model parameter optimisation that wraps and standardizes several existing open-source tools. It simplifies the task of creating and sharing these optimisations, and the associated techniques and knowledge. This is achieved by abstracting the optimisation and evaluation tasks into various reusable and flexible discrete elements according to established best-practices. Further, BluePyOpt provides methods for setting up both small- and large-scale optimisations on a variety of platforms, ranging from laptops to Linux clusters and cloud-based compute infrastructures. The versatility of the BluePyOpt framework is demonstrated by working through three representative neuroscience specific use cases.

Network-timing-dependent plasticity.

Bursts of activity in networks of neurons are thought to convey salient information and drive synaptic plasticity. Here we report that network bursts also exert a profound effect on Spike-Timing-Dependent Plasticity (STDP). In acute slices of juvenile rat somatosensory cortex we paired a network burst, which alone induced long-term depression (LTD), with STDP-induced long-term potentiation (LTP) and LTD. We observed that STDP-induced LTP was either unaffected, blocked or flipped into LTD by the network burst, and that STDP-induced LTD was either saturated or flipped into LTP, depending on the relative timing of the network burst with respect to spike coincidences of the STDP event. We hypothesized that network bursts flip STDP-induced LTP to LTD by depleting resources needed for LTP and therefore developed a resource-dependent STDP learning rule. In a model neural network under the influence of the proposed resource-dependent STDP rule, we found that excitatory synaptic coupling was homeostatically regulated to produce power law distributed burst amplitudes reflecting self-organized criticality, a state that ensures optimal information coding.