Vesicle and reaction-diffusion hybrid modeling with STEPS.

Vesicles carry out many essential functions within cells through the processes of endocytosis, exocytosis, and passive and active transport. This includes transporting and delivering molecules between different parts of the cell, and storing and releasing neurotransmitters in neurons. To date, computational simulation of these key biological players has been rather limited and has not advanced at the same pace as other aspects of cell modeling, restricting the realism of computational models. We describe a general vesicle modeling tool that has been designed for wide application to a variety of cell models, implemented within our software STochastic Engine for Pathway Simulation (STEPS), a stochastic reaction-diffusion simulator that supports realistic reconstructions of cell tissue in tetrahedral meshes. The implementation is validated in an extensive test suite, parallel performance is demonstrated in a realistic synaptic bouton model, and example models are visualized in a Blender extension module.

Recent data on the cerebellum require new models and theories.

The cerebellum has been a popular topic for theoretical studies because its structure was thought to be simple. Since David Marr and James Albus related its function to motor skill learning and proposed the Marr-Albus cerebellar learning model, this theory has guided and inspired cerebellar research. In this review, we summarize the theoretical progress that has been made within this framework of error-based supervised learning. We discuss the experimental progress that demonstrates more complicated molecular and cellular mechanisms in the cerebellum as well as new cell types and recurrent connections. We also cover its involvement in diverse non-motor functions and evidence of other forms of learning. Finally, we highlight the need to explain these new experimental findings into an integrated cerebellar model that can unify its diverse computational functions.

Efficient simulation of neural development using shared memory parallelization.

The Neural Development Simulator, NeuroDevSim, is a Python module that simulates the most important aspects of brain development: morphological growth, migration, and pruning. It uses an agent-based modeling approach inherited from the NeuroMaC software. Each cycle has agents called fronts execute model-specific code. In the case of a growing dendritic or axonal front, this will be a choice between extension, branching, or growth termination. Somatic fronts can migrate to new positions and any front can be retracted to prune parts of neurons. Collision detection prevents new or migrating fronts from overlapping with existing ones. NeuroDevSim is a multi-core program that uses an innovative shared memory approach to achieve parallel processing without messaging. We demonstrate linear strong parallel scaling up to 96 cores for large models and have run these successfully on 128 cores. Most of the shared memory parallelism is achieved without memory locking. Instead, cores have only write privileges to private sections of arrays, while being able to read the entire shared array. Memory conflicts are avoided by a coding rule that allows only active fronts to use methods that need writing access. The exception is collision detection, which is needed to avoid the growth of physically overlapping structures. For collision detection, a memory-locking mechanism was necessary to control access to grid points that register the location of nearby fronts. A custom approach using a serialized lock broker was able to manage both read and write locking. NeuroDevSim allows easy modeling of most aspects of neural development for models simulating a few complex or thousands of simple neurons or a mixture of both. Code available at: https://github.com/CNS-OIST/NeuroDevSim.

Models of Purkinje cell dendritic tree selection during early cerebellar development.

We investigate the relationship between primary dendrite selection of Purkinje cells and migration of their presynaptic partner granule cells during early cerebellar development. During postnatal development, each Purkinje cell grows more than three dendritic trees, from which a primary tree is selected for development, whereas the others completely retract. Experimental studies suggest that this selection process is coordinated by physical and synaptic interactions with granule cells, which undergo a massive migration at the same time. However, technical limitations hinder continuous experimental observation of multiple cell populations. To explore possible mechanisms underlying this selection process, we constructed a computational model using a new computational framework, NeuroDevSim. The study presents the first computational model that simultaneously simulates Purkinje cell growth and the dynamics of granule cell migrations during the first two postnatal weeks, allowing exploration of the role of physical and synaptic interactions upon dendritic selection. The model suggests that interaction with parallel fibers is important to establish the distinct planar morphology of Purkinje cell dendrites. Specific rules to select which dendritic trees to keep or retract result in larger winner trees with more synaptic contacts than using random selection. A rule based on afferent synaptic activity was less effective than rules based on dendritic size or numbers of synapses.

Multidimensional cerebellar computations for flexible kinematic control of movements.

Both the environment and our body keep changing dynamically. Hence, ensuring movement precision requires adaptation to multiple demands occurring simultaneously. Here we show that the cerebellum performs the necessary multi-dimensional computations for the flexible control of different movement parameters depending on the prevailing context. This conclusion is based on the identification of a manifold-like activity in both mossy fibers (MFs, network input) and Purkinje cells (PCs, output), recorded from monkeys performing a saccade task. Unlike MFs, the PC manifolds developed selective representations of individual movement parameters. Error feedback-driven climbing fiber input modulated the PC manifolds to predict specific, error type-dependent changes in subsequent actions. Furthermore, a feed-forward network model that simulated MF-to-PC transformations revealed that amplification and restructuring of the lesser variability in the MF activity is a pivotal circuit mechanism. Therefore, the flexible control of movements by the cerebellum crucially depends on its capacity for multi-dimensional computations.

Self-configuring feedback loops for sensorimotor control.

How dynamic interactions between nervous system regions in mammals performs online motor control remains an unsolved problem. In this paper, we show that feedback control is a simple, yet powerful way to understand the neural dynamics of sensorimotor control. We make our case using a minimal model comprising spinal cord, sensory and motor cortex, coupled by long connections that are plastic. It succeeds in learning how to perform reaching movements of a planar arm with 6 muscles in several directions from scratch. The model satisfies biological plausibility constraints, like neural implementation, transmission delays, local synaptic learning and continuous online learning. Using differential Hebbian plasticity the model can go from motor babbling to reaching arbitrary targets in less than 10 min of in silico time. Moreover, independently of the learning mechanism, properly configured feedback control has many emergent properties: neural populations in motor cortex show directional tuning and oscillatory dynamics, the spinal cord creates convergent force fields that add linearly, and movements are ataxic (as in a motor system without a cerebellum).

STEPS 4.0: Fast and memory-efficient molecular simulations of neurons at the nanoscale.

Recent advances in computational neuroscience have demonstrated the usefulness and importance of stochastic, spatial reaction-diffusion simulations. However, ever increasing model complexity renders traditional serial solvers, as well as naive parallel implementations, inadequate. This paper introduces a new generation of the STochastic Engine for Pathway Simulation (STEPS) project (http://steps.sourceforge.net/), denominated STEPS 4.0, and its core components which have been designed for improved scalability, performance, and memory efficiency. STEPS 4.0 aims to enable novel scientific studies of macroscopic systems such as whole cells while capturing their nanoscale details. This class of models is out of reach for serial solvers due to the vast quantity of computation in such detailed models, and also out of reach for naive parallel solvers due to the large memory footprint. Based on a distributed mesh solution, we introduce a new parallel stochastic reaction-diffusion solver and a deterministic membrane potential solver in STEPS 4.0. The distributed mesh, together with improved data layout and algorithm designs, significantly reduces the memory footprint of parallel simulations in STEPS 4.0. This enables massively parallel simulations on modern HPC clusters and overcomes the limitations of the previous parallel STEPS implementation. Current and future improvements to the solver are not sustainable without following proper software engineering principles. For this reason, we also give an overview of how the STEPS codebase and the development environment have been updated to follow modern software development practices. We benchmark performance improvement and memory footprint on three published models with different complexities, from a simple spatial stochastic reaction-diffusion model, to a more complex one that is coupled to a deterministic membrane potential solver to simulate the calcium burst activity of a Purkinje neuron. Simulation results of these models suggest that the new solution dramatically reduces the per-core memory consumption by more than a factor of 30, while maintaining similar or better performance and scalability.

Control of Ca2+ signals by astrocyte nanoscale morphology at tripartite synapses.

Much of the Ca2+ activity in astrocytes is spatially restricted to microdomains and occurs in fine processes that form a complex anatomical meshwork, the so-called spongiform domain. A growing body of literature indicates that those astrocytic Ca2+ signals can influence the activity of neuronal synapses and thus tune the flow of information through neuronal circuits. Because of technical difficulties in accessing the small spatial scale involved, the role of astrocyte morphology on Ca2+ microdomain activity remains poorly understood. Here, we use computational tools and idealized 3D geometries of fine processes based on recent super-resolution microscopy data to investigate the mechanistic link between astrocytic nanoscale morphology and local Ca2+ activity. Simulations demonstrate that the nano-morphology of astrocytic processes powerfully shapes the spatio-temporal properties of Ca2+ signals and promotes local Ca2+ activity. The model predicts that this effect is attenuated upon astrocytic swelling, hallmark of brain diseases, which we confirm experimentally in hypo-osmotic conditions. Upon repeated neurotransmitter release events, the model predicts that swelling hinders astrocytic signal propagation. Overall, this study highlights the influence of the complex morphology of astrocytes at the nanoscale and its remodeling in pathological conditions on neuron-astrocyte communication at so-called tripartite synapses, where astrocytic processes come into close contact with pre- and postsynaptic structures.

Modeling Neurons in 3D at the Nanoscale.

For decades, neurons have been modeled by methods developed by early pioneers in the field such as Rall, Hodgkin and Huxley, as cable-like morphological structures with voltage changes that are governed by a series of ordinary differential equations describing the conductances of ion channels embedded in the membrane. In recent years, advances in experimental techniques have improved our knowledge of the morphological and molecular makeup of neurons, and this has come alongside ever-increasing computational power and the wider availability of computer hardware to researchers. This has opened up the possibility of more detailed 3D modeling of neuronal morphologies and their molecular makeup, a new, emerging component of the field of computational neuroscience that is expected to play an important role in building our understanding of neurons and their behavior into the future.Many readers may be familiar with 1D models yet unfamiliar with the more detailed 3D description of neurons. As such, this chapter introduces some of the techniques used in detailed 3D, molecular modeling, and shows the steps required for building such models from a foundation of the more familiar 1D description. This broadly falls into two categories; morphology and how to build a 3D computational mesh based on a cable-like description of the neuronal geometry or directly from imaging studies, and biochemically how to define a discrete, stochastic description of the molecular neuronal makeup. We demonstrate this with a full Purkinje cell model, implemented in 3D simulation in software STEPS.

A differential Hebbian framework for biologically-plausible motor control.

In this paper we explore a neural control architecture that is both biologically plausible, and capable of fully autonomous learning. It consists of feedback controllers that learn to achieve a desired state by selecting the errors that should drive them. This selection happens through a family of differential Hebbian learning rules that, through interaction with the environment, can learn to control systems where the error responds monotonically to the control signal. We next show that in a more general case, neural reinforcement learning can be coupled with a feedback controller to reduce errors that arise non-monotonically from the control signal. The use of feedback control can reduce the complexity of the reinforcement learning problem, because only a desired value must be learned, with the controller handling the details of how it is reached. This makes the function to be learned simpler, potentially allowing learning of more complex actions. We use simple examples to illustrate our approach, and discuss how it could be extended to hierarchical architectures.

The Cellular Electrophysiological Properties Underlying Multiplexed Coding in Purkinje Cells.

Neuronal firing patterns are crucial to underpin circuit level behaviors. In cerebellar Purkinje cells (PCs), both spike rates and pauses are used for behavioral coding, but the cellular mechanisms causing code transitions remain unknown. We use a well-validated PC model to explore the coding strategy that individual PCs use to process parallel fiber (PF) inputs. We find increasing input intensity shifts PCs from linear rate-coders to burst-pause timing-coders by triggering localized dendritic spikes. We validate dendritic spike properties with experimental data, elucidate spiking mechanisms, and predict spiking thresholds with and without inhibition. Both linear and burst-pause computations use individual branches as computational units, which challenges the traditional view of PCs as linear point neurons. Dendritic spike thresholds can be regulated by voltage state, compartmentalized channel modulation, between-branch interaction and synaptic inhibition to expand the dynamic range of linear computation or burst-pause computation. In addition, co-activated PF inputs between branches can modify somatic maximum spike rates and pause durations to make them carry analog signals. Our results provide new insights into the strategies used by individual neurons to expand their capacity of information processing.SIGNIFICANCE STATEMENT Understanding how neurons process information is a fundamental question in neuroscience. Purkinje cells (PCs) were traditionally regarded as linear point neurons. We used computational modeling to unveil their electrophysiological properties underlying the multiplexed coding strategy that is observed during behaviors. We demonstrate that increasing input intensity triggers localized dendritic spikes, shifting PCs from linear rate-coders to burst-pause timing-coders. Both coding strategies work at the level of individual dendritic branches. Our work suggests that PCs have the ability to implement branch-specific multiplexed coding at the cellular level, thereby increasing the capacity of cerebellar coding and learning.

Firing rate-dependent phase responses of Purkinje cells support transient oscillations.

Both spike rate and timing can transmit information in the brain. Phase response curves (PRCs) quantify how a neuron transforms input to output by spike timing. PRCs exhibit strong firing-rate adaptation, but its mechanism and relevance for network output are poorly understood. Using our Purkinje cell (PC) model, we demonstrate that the rate adaptation is caused by rate-dependent subthreshold membrane potentials efficiently regulating the activation of Na+ channels. Then, we use a realistic PC network model to examine how rate-dependent responses synchronize spikes in the scenario of reciprocal inhibition-caused high-frequency oscillations. The changes in PRC cause oscillations and spike correlations only at high firing rates. The causal role of the PRC is confirmed using a simpler coupled oscillator network model. This mechanism enables transient oscillations between fast-spiking neurons that thereby form PC assemblies. Our work demonstrates that rate adaptation of PRCs can spatio-temporally organize the PC input to cerebellar nuclei.

Pycabnn: Efficient and Extensible Software to Construct an Anatomical Basis for a Physiologically Realistic Neural Network Model.

Physiologically detailed models of neural networks are an important tool for studying how biophysical mechanisms impact neural information processing. An important, fundamental step in constructing such a model is determining where neurons are placed and how they connect to each other, based on known anatomical properties and constraints given by experimental data. Here we present an open-source software tool, pycabnn, that is dedicated to generating an anatomical model, which serves as the basis of a full network model. In pycabnn, we implemented efficient algorithms for generating physiologically realistic cell positions and for determining connectivity based on extended geometrical structures such as axonal and dendritic morphology. We demonstrate the capabilities and performance of pycabnn by using an example, a network model of the cerebellar granular layer, which requires generating more than half a million cells and computing their mutual connectivity. We show that pycabnn is efficient enough to carry out all the required tasks on a laptop computer within reasonable runtime, although it can also run in a parallel computing environment. Written purely in Python with limited external dependencies, pycabnn is easy to use and extend, and it can be a useful tool for computational neural network studies in the future.

Author Correction: The choroid plexus is an important circadian clock component.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Correction: Spatiotemporal network coding of physiological mossy fiber inputs by the cerebellar granular layer.

[This corrects the article DOI: 10.1371/journal.pcbi.1005754.].

Climbing Fibers Provide Graded Error Signals in Cerebellar Learning.

The cerebellum plays a critical role in coordinating and learning complex movements. Although its importance has been well recognized, the mechanisms of learning remain hotly debated. According to the classical cerebellar learning theory, depression of parallel fiber synapses instructed by error signals from climbing fibers, drives cerebellar learning. The uniqueness of long-term depression (LTD) in cerebellar learning has been challenged by evidence showing multi-site synaptic plasticity. In Purkinje cells, long-term potentiation (LTP) of parallel fiber synapses is now well established and it can be achieved with or without climbing fiber signals, making the role of climbing fiber input more puzzling. The central question is how individual Purkinje cells extract global errors based on climbing fiber input. Previous data seemed to demonstrate that climbing fibers are inefficient instructors, because they were thought to carry "binary" error signals to individual Purkinje cells, which significantly constrains the efficiency of cerebellar learning in several regards. In recent years, new evidence has challenged the traditional view of "binary" climbing fiber responses, suggesting that climbing fibers can provide graded information to efficiently instruct individual Purkinje cells to learn. Here we review recent experimental and theoretical progress regarding modulated climbing fiber responses in Purkinje cells. Analog error signals are generated by the interaction of varying climbing fibers inputs with simultaneous other synaptic input and with firing states of targeted Purkinje cells. Accordingly, the calcium signals which trigger synaptic plasticity can be graded in both amplitude and spatial range to affect the learning rate and even learning direction. We briefly discuss how these new findings complement the learning theory and help to further our understanding of how the cerebellum works.

Variability and directionality of inferior olive neuron dendrites revealed by detailed 3D characterization of an extensive morphological library.

The inferior olive (IO) is an evolutionarily conserved brain stem structure and its output activity plays a major role in the cerebellar computation necessary for controlling the temporal accuracy of motor behavior. The precise timing and synchronization of IO network activity has been attributed to the dendro-dendritic gap junctions mediating electrical coupling within the IO nucleus. Thus, the dendritic morphology and spatial arrangement of IO neurons governs how synchronized activity emerges in this nucleus. To date, IO neuron structural properties have been characterized in few studies and with small numbers of neurons; these investigations have described IO neurons as belonging to two morphologically distinct types, "curly" and "straight". In this work we collect a large number of individual IO neuron morphologies visualized using different labeling techniques and present a thorough examination of their morphological properties and spatial arrangement within the olivary neuropil. Our results show that the extensive heterogeneity in IO neuron dendritic morphologies occupies a continuous range between the classically described "curly" and "straight" types, and that this continuum is well represented by a relatively simple measure of "straightness". Furthermore, we find that IO neuron dendritic trees are often directionally oriented. Combined with an examination of cell body density distributions and dendritic orientation of adjacent IO neurons, our results suggest that the IO network may be organized into groups of densely coupled neurons interspersed with areas of weaker coupling.