Modernizing the NEURON Simulator for Sustainability, Portability, and Performance.

The need for reproducible, credible, multiscale biological modeling has led to the development of standardized simulation platforms, such as the widely-used NEURON environment for computational neuroscience. Developing and maintaining NEURON over several decades has required attention to the competing needs of backwards compatibility, evolving computer architectures, the addition of new scales and physical processes, accessibility to new users, and efficiency and flexibility for specialists. In order to meet these challenges, we have now substantially modernized NEURON, providing continuous integration, an improved build system and release workflow, and better documentation. With the help of a new source-to-source compiler of the NMODL domain-specific language we have enhanced NEURON's ability to run efficiently, via the CoreNEURON simulation engine, on a variety of hardware platforms, including GPUs. Through the implementation of an optimized in-memory transfer mechanism this performance optimized backend is made easily accessible to users, providing training and model-development paths from laptop to workstation to supercomputer and cloud platform. Similarly, we have been able to accelerate NEURON's reaction-diffusion simulation performance through the use of just-in-time compilation. We show that these efforts have led to a growing developer base, a simpler and more robust software distribution, a wider range of supported computer architectures, a better integration of NEURON with other scientific workflows, and substantially improved performance for the simulation of biophysical and biochemical models.

Predicting brain organization with a computational model: 50-year perspective on lateral inhibition and oscillatory gating by dendrodendritic synapses.

The first compartmental computer models of brain neurons using the Rall method predicted novel and unexpected dendrodendritic interactions between mitral and granule cells in the olfactory bulb. We review the models from a 50-year perspective on the work that has challenged, supported, and extended the original proposal that these interactions mediate both lateral inhibition and oscillatory activity, essential steps in the neural basis of olfactory processing and perception. We highlight strategies behind the neurophysiological experiments and the Rall methods that enhance the ability of detailed compartmental modeling to give counterintuitive predictions that lead to deeper insights into neural organization at the synaptic and circuit level. The application of these methods to mechanisms of neurogenesis and plasticity are exciting challenges for the future.

Human Neocortical Neurosolver (HNN), a new software tool for interpreting the cellular and network origin of human MEG/EEG data.

Magneto- and electro-encephalography (MEG/EEG) non-invasively record human brain activity with millisecond resolution providing reliable markers of healthy and disease states. Relating these macroscopic signals to underlying cellular- and circuit-level generators is a limitation that constrains using MEG/EEG to reveal novel principles of information processing or to translate findings into new therapies for neuropathology. To address this problem, we built Human Neocortical Neurosolver (HNN, https://hnn.brown.edu) software. HNN has a graphical user interface designed to help researchers and clinicians interpret the neural origins of MEG/EEG. HNN's core is a neocortical circuit model that accounts for biophysical origins of electrical currents generating MEG/EEG. Data can be directly compared to simulated signals and parameters easily manipulated to develop/test hypotheses on a signal's origin. Tutorials teach users to simulate commonly measured signals, including event related potentials and brain rhythms. HNN's ability to associate signals across scales makes it a unique tool for translational neuroscience research.

Neurons carry information in the form of electrical signals. Each of these signals is too weak to detect on its own. But the combined signals from large groups of neurons can be detected using techniques called EEG and MEG. Sensors on or near the scalp detect changes in the electrical activity of groups of neurons from one millisecond to the next. These recordings can also reveal changes in brain activity due to disease. But how do EEG/MEG signals relate to the activity of neural circuits? While neuroscientists can rarely record electrical activity from inside the human brain, it is much easier to do so in other animals. Computer models can then compare these recordings from animals to the signals in human EEG/MEG to infer how the activity of neural circuits is changing. But building and interpreting these models requires advanced skills in mathematics and programming, which not all researchers possess. Neymotin et al. have therefore developed a user-friendly software platform that can help translate human EEG/MEG recordings into circuit-level activity. Known as the Human Neocortical Neurosolver, or HNN for short, the open-source tool enables users to develop and test hypotheses on the neural origin of EEG/MEG signals. The model simulates the electrical activity of cells in the outer layers of the human brain, the neocortex. By feeding human EEG/MEG data into the model, researchers can predict patterns of circuit-level activity that might have given rise to the EEG/MEG data. The HNN software includes tutorials and example datasets for commonly measured signals, including brain rhythms. It is free to use and can be installed on all major computer platforms or run online. HNN will help researchers and clinicians who wish to identify the neural origins of EEG/MEG signals in the healthy or diseased brain. Likewise, it will be useful to researchers studying brain activity in animals, who want to know how their findings might relate to human EEG/MEG signals. As HNN is suitable for users without training in computational neuroscience, it offers an accessible tool for discoveries in translational neuroscience.

Open Source Brain: A Collaborative Resource for Visualizing, Analyzing, Simulating, and Developing Standardized Models of Neurons and Circuits.

Computational models are powerful tools for exploring the properties of complex biological systems. In neuroscience, data-driven models of neural circuits that span multiple scales are increasingly being used to understand brain function in health and disease. But their adoption and reuse has been limited by the specialist knowledge required to evaluate and use them. To address this, we have developed Open Source Brain, a platform for sharing, viewing, analyzing, and simulating standardized models from different brain regions and species. Model structure and parameters can be automatically visualized and their dynamical properties explored through browser-based simulations. Infrastructure and tools for collaborative interaction, development, and testing are also provided. We demonstrate how existing components can be reused by constructing new models of inhibition-stabilized cortical networks that match recent experimental results. These features of Open Source Brain improve the accessibility, transparency, and reproducibility of models and facilitate their reuse by the wider community.

Neuron Names: A Gene- and Property-Based Name Format, With Special Reference to Cortical Neurons.

Precision in neuron names is increasingly needed. We are entering a new era in which classical anatomical criteria are only the beginning toward defining the identity of a neuron as carried in its name. New criteria include patterns of gene expression, membrane properties of channels and receptors, pharmacology of neurotransmitters and neuropeptides, physiological properties of impulse firing, and state-dependent variations in expression of characteristic genes and proteins. These gene and functional properties are increasingly defining neuron types and subtypes. Clarity will therefore be enhanced by conveying as much as possible the genes and properties in the neuron name. Using a tested format of parent-child relations for the region and subregion for naming a neuron, we show how the format can be extended so that these additional properties can become an explicit part of a neuron's identity and name, or archived in a linked properties database. Based on the mouse, examples are provided for neurons in several brain regions as proof of principle, with extension to the complexities of neuron names in the cerebral cortex. The format has dual advantages, of ensuring order in archiving the hundreds of neuron types across all brain regions, as well as facilitating investigation of a given neuron type or given gene or property in the context of all its properties. In particular, we show how the format is extensible to the variety of neuron types and subtypes being revealed by RNA-seq and optogenetics. As current research reveals increasingly complex properties, the proposed approach can facilitate a consensus that goes beyond traditional neuron types.

Using NEURON for Reaction-Diffusion Modeling of Extracellular Dynamics.

Development of credible clinically-relevant brain simulations has been slowed due to a focus on electrophysiology in computational neuroscience, neglecting the multiscale whole-tissue modeling approach used for simulation in most other organ systems. We have now begun to extend the NEURON simulation platform in this direction by adding extracellular modeling. The extracellular medium of neural tissue is an active medium of neuromodulators, ions, inflammatory cells, oxygen, NO and other gases, with additional physiological, pharmacological and pathological agents. These extracellular agents influence, and are influenced by, cellular electrophysiology, and cellular chemophysiology-the complex internal cellular milieu of second-messenger signaling and cascades. NEURON's extracellular reaction-diffusion is supported by an intuitive Python-based where/who/what command sequence, derived from that used for intracellular reaction diffusion, to support coarse-grained macroscopic extracellular models. This simulation specification separates the expression of the conceptual model and parameters from the underlying numerical methods. In the volume-averaging approach used, the macroscopic model of tissue is characterized by free volume fraction-the proportion of space in which species are able to diffuse, and tortuosity-the average increase in path length due to obstacles. These tissue characteristics can be defined within particular spatial regions, enabling the modeler to account for regional differences, due either to intrinsic organization, particularly gray vs. white matter, or to pathology such as edema. We illustrate simulation development using spreading depression, a pathological phenomenon thought to play roles in migraine, epilepsy and stroke. Simulation results were verified against analytic results and against the extracellular portion of the simulation run under FiPy. The creation of this NEURON interface provides a pathway for interoperability that can be used to automatically export this class of models into complex intracellular/extracellular simulations and future cross-simulator standardization.

Parallel odor processing by mitral and middle tufted cells in the olfactory bulb.

The olfactory bulb (OB) transforms sensory input into spatially and temporally organized patterns of activity in principal mitral (MC) and middle tufted (mTC) cells. Thus far, the mechanisms underlying odor representations in the OB have been mainly investigated in MCs. However, experimental findings suggest that MC and mTC may encode parallel and complementary odor representations. We have analyzed the functional roles of these pathways by using a morphologically and physiologically realistic three-dimensional model to explore the MC and mTC microcircuits in the glomerular layer and deeper plexiform layer. The model makes several predictions. MCs and mTCs are controlled by similar computations in the glomerular layer but are differentially modulated in deeper layers. The intrinsic properties of mTCs promote their synchronization through a common granule cell input. Finally, the MC and mTC pathways can be coordinated through the deep short-axon cells in providing input to the olfactory cortex. The results suggest how these mechanisms can dynamically select the functional network connectivity to create the overall output of the OB and promote the dynamic synchronization of glomerular units for any given odor stimulus.

Load balancing for multi-threaded PDES of stochastic reaction-diffusion in neurons.

Stochastic simulation of chemical reactions and diffusion in a neuron helps to provide a realistic view of the molecular dynamics within a neuron. We developed a multi-threaded PDES simulator, Neuron Time Warp-Multi Thread, suitable for the stochastic simulation of reaction and diffusion in a neuron. In this paper we make use of Q-Learning and Simulated Annealing to determine the parameters for a dynamic load balancing algorithm and for dynamic window control. During the simulation, the runtime statistics of each thread are collected and used to determine the execution time of the simulation. Based upon this assessment, workload is migrated from the most overloaded threads to the most under-load ones. As the results for a calcium wave model show, both approaches can improve the execution time for small simulations by up to 31% (Q-Learning) and 19% (SA). The simulated annealing approach is more suitable for larger populations, decreasing execution time by 41%.

Multithreaded Stochastic PDES for Reactions and Diffusions in Neurons.

Cells exhibit stochastic behavior when the number of molecules is small. Hence a stochastic reaction-diffusion simulator capable of working at scale can provide a more accurate view of molecular dynamics within the cell. This paper describes a parallel discrete event simulator, Neuron Time Warp-Multi Thread (NTW-MT), developed for the simulation of reaction diffusion models of neurons. To the best of our knowledge, this is the first parallel discrete event simulator oriented towards stochastic simulation of chemical reactions in a neuron. The simulator was developed as part of the NEURON project. NTW-MT is optimistic and thread-based, which attempts to capitalize on multi-core architectures used in high performance machines. It makes use of a multi-level queue for the pending event set and a single roll-back message in place of individual anti-messages to disperse contention and decrease the overhead of processing rollbacks. Global Virtual Time is computed asynchronously both within and among processes to get rid of the overhead for synchronizing threads. Memory usage is managed in order to avoid locking and unlocking when allocating and de-allocating memory and to maximize cache locality. We verified our simulator on a calcium buffer model. We examined its performance on a calcium wave model, comparing it to the performance of a process based optimistic simulator and a threaded simulator which uses a single priority queue for each thread. Our multi-threaded simulator is shown to achieve superior performance to these simulators. Finally, we demonstrated the scalability of our simulator on a larger CICR model and a more detailed CICR model.

Twenty years of ModelDB and beyond: building essential modeling tools for the future of neuroscience.

Neuron modeling may be said to have originated with the Hodgkin and Huxley action potential model in 1952 and Rall's models of integrative activity of dendrites in 1964. Over the ensuing decades, these approaches have led to a massive development of increasingly accurate and complex data-based models of neurons and neuronal circuits. ModelDB was founded in 1996 to support this new field and enhance the scientific credibility and utility of computational neuroscience models by providing a convenient venue for sharing them. It has grown to include over 1100 published models covering more than 130 research topics. It is actively curated and developed to help researchers discover and understand models of interest. ModelDB also provides mechanisms to assist running models both locally and remotely, and has a graphical tool that enables users to explore the anatomical and biophysical properties that are represented in a model. Each of its capabilities is undergoing continued refinement and improvement in response to user experience. Large research groups (Allen Brain Institute, EU Human Brain Project, etc.) are emerging that collect data across multiple scales and integrate that data into many complex models, presenting new challenges of scale. We end by predicting a future for neuroscience increasingly fueled by new technology and high performance computation, and increasingly in need of comprehensive user-friendly databases such as ModelDB to provide the means to integrate the data for deeper insights into brain function in health and disease.

Simulation Neurotechnologies for Advancing Brain Research: Parallelizing Large Networks in NEURON.

Large multiscale neuronal network simulations are of increasing value as more big data are gathered about brain wiring and organization under the auspices of a current major research initiative, such as Brain Research through Advancing Innovative Neurotechnologies. The development of these models requires new simulation technologies. We describe here the current use of the NEURON simulator with message passing interface (MPI) for simulation in the domain of moderately large networks on commonly available high-performance computers (HPCs). We discuss the basic layout of such simulations, including the methods of simulation setup, the run-time spike-passing paradigm, and postsimulation data storage and data management approaches. Using the Neuroscience Gateway, a portal for computational neuroscience that provides access to large HPCs, we benchmark simulations of neuronal networks of different sizes (500-100,000 cells), and using different numbers of nodes (1-256). We compare three types of networks, composed of either Izhikevich integrate-and-fire neurons (I&F), single-compartment Hodgkin-Huxley (HH) cells, or a hybrid network with half of each. Results show simulation run time increased approximately linearly with network size and decreased almost linearly with the number of nodes. Networks with I&F neurons were faster than HH networks, although differences were small since all tested cells were point neurons with a single compartment.

Cable energy function of cortical axons.

Accurate estimation of action potential (AP)-related metabolic cost is essential for understanding energetic constraints on brain connections and signaling processes. Most previous energy estimates of the AP were obtained using the Na(+)-counting method, which seriously limits accurate assessment of metabolic cost of ionic currents that underlie AP conduction along the axon. Here, we first derive a full cable energy function for cortical axons based on classic Hodgkin-Huxley (HH) neuronal equations and then apply the cable energy function to precisely estimate the energy consumption of AP conduction along axons with different geometric shapes. Our analytical approach predicts an inhomogeneous distribution of metabolic cost along an axon with either uniformly or nonuniformly distributed ion channels. The results show that the Na(+)-counting method severely underestimates energy cost in the cable model by 20-70%. AP propagation along axons that differ in length may require over 15% more energy per unit of axon area than that required by a point model. However, actual energy cost can vary greatly depending on axonal branching complexity, ion channel density distributions, and AP conduction states. We also infer that the metabolic rate (i.e. energy consumption rate) of cortical axonal branches as a function of spatial volume exhibits a 3/4 power law relationship.

Glomerular and Mitral-Granule Cell Microcircuits Coordinate Temporal and Spatial Information Processing in the Olfactory Bulb.

The olfactory bulb processes inputs from olfactory receptor neurons (ORNs) through two levels: the glomerular layer at the site of input, and the granule cell level at the site of output to the olfactory cortex. The sequence of action of these two levels has not yet been examined. We analyze this issue using a novel computational framework that is scaled up, in three-dimensions (3D), with realistic representations of the interactions between layers, activated by simulated natural odors, and constrained by experimental and theoretical analyses. We suggest that the postulated functions of glomerular circuits have as their primary role transforming a complex and disorganized input into a contrast-enhanced and normalized representation, but cannot provide for synchronization of the distributed glomerular outputs. By contrast, at the granule cell layer, the dendrodendritic interactions mediate temporal decorrelation, which we show is dependent on the preceding contrast enhancement by the glomerular layer. The results provide the first insights into the successive operations in the olfactory bulb, and demonstrate the significance of the modular organization around glomeruli. This layered organization is especially important for natural odor inputs, because they activate many overlapping glomeruli.

Synaptic clusters function as odor operators in the olfactory bulb.

How the olfactory bulb organizes and processes odor inputs through fundamental operations of its microcircuits is largely unknown. To gain new insight we focus on odor-activated synaptic clusters related to individual glomeruli, which we call glomerular units. Using a 3D model of mitral and granule cell interactions supported by experimental findings, combined with a matrix-based representation of glomerular operations, we identify the mechanisms for forming one or more glomerular units in response to a given odor, how and to what extent the glomerular units interfere or interact with each other during learning, their computational role within the olfactory bulb microcircuit, and how their actions can be formalized into a theoretical framework in which the olfactory bulb can be considered to contain "odor operators" unique to each individual. The results provide new and specific theoretical and experimentally testable predictions.

ModelView for ModelDB: Online Presentation of Model Structure.

ModelDB ( modeldb.yale.edu ), a searchable repository of source code of more than 950 published computational neuroscience models, seeks to promote model reuse and reproducibility. Code sharing is a first step; however, model source code is often large and not easily understood. To aid users, we have developed ModelView, a web application for ModelDB that presents a graphical view of model structure augmented with contextual information for NEURON and NEURON-runnable (e.g. NeuroML, PyNN) models. Web presentation provides a rich, simulator-independent environment for interacting with graphs. The necessary data is generated by combining manual curation, text-mining the source code, querying ModelDB, and simulator introspection. Key features of the user interface along with the data analysis, storage, and visualization algorithms are explained. With this tool, researchers can examine and assess the structure of hundreds of models in ModelDB in a standardized presentation without installing any software, downloading the model, or reading model source code.

Neuronal calcium wave propagation varies with changes in endoplasmic reticulum parameters: a computer model.

Calcium (Ca²âº) waves provide a complement to neuronal electrical signaling, forming a key part of a neuron's second messenger system. We developed a reaction-diffusion model of an apical dendrite with diffusible inositol triphosphate (IP3), diffusible Ca²âº, IP3 receptors (IP3Rs), endoplasmic reticulum (ER) Ca²âº leak, and ER pump (SERCA) on ER. Ca²âº is released from ER stores via IP3Rs upon binding of IP3 and Ca²âº. This results in Ca²âº-induced-Ca²âº-release (CICR) and increases Ca²âº spread. At least two modes of Ca²âº wave spread have been suggested: a continuous mode based on presumed relative homogeneity of ER within the cell and a pseudo-saltatory model where Ca²âº regeneration occurs at discrete points with diffusion between them. We compared the effects of three patterns of hypothesized IP3R distribution: (1) continuous homogeneous ER, (2) hotspots with increased IP3R density (IP3R hotspots), and (3) areas of increased ER density (ER stacks). All three modes produced Ca²âº waves with velocities similar to those measured in vitro (approximately 50-90 µm /sec). Continuous ER showed high sensitivity to IP3R density increases, with time to onset reduced and speed increased. Increases in SERCA density resulted in opposite effects. The measures were sensitive to changes in density and spacing of IP3R hotspots and stacks. Increasing the apparent diffusion coefficient of Ca²âº substantially increased wave speed. An extended electrochemical model, including voltage-gated calcium channels and AMPA synapses, demonstrated that membrane priming via AMPA stimulation enhances subsequent Ca²âº wave amplitude and duration. Our modeling suggests that pharmacological targeting of IP3Rs and SERCA could allow modulation of Ca²âº wave propagation in diseases where Ca²âº dysregulation has been implicated.

Sparse coding and lateral inhibition arising from balanced and unbalanced dendrodendritic excitation and inhibition.

The precise mechanism by which synaptic excitation and inhibition interact with each other in odor coding through the unique dendrodendritic synaptic microcircuits present in olfactory bulb is unknown. Here a scaled-up model of the mitral-granule cell network in the rodent olfactory bulb is used to analyze dendrodendritic processing of experimentally determined odor patterns. We found that the interaction between excitation and inhibition is responsible for two fundamental computational mechanisms: (1) a balanced excitation/inhibition in strongly activated mitral cells, leading to a sparse representation of odorant input, and (2) an unbalanced excitation/inhibition (inhibition dominated) in surrounding weakly activated mitral cells, leading to lateral inhibition. These results suggest how both mechanisms can carry information about the input patterns, with optimal level of synaptic excitation and inhibition producing the highest level of sparseness and decorrelation in the network response. The results suggest how the learning process, through the emergent development of these mechanisms, can enhance odor representation of olfactory bulb.

Computational model of erratic arrhythmias in a cardiac cell network: the role of gap junctions.

Cardiac morbidity and mortality increases with the population age. To investigate the underlying pathological mechanisms, and suggest new ways to reduce clinical risks, computational approaches complementing experimental and clinical investigations are becoming more and more important. Here we explore the possible processes leading to the occasional onset and termination of the (usually) non-fatal arrhythmias widely observed in the heart. Using a computational model of a two-dimensional network of cardiac cells, we tested the hypothesis that an ischemia alters the properties of the gap junctions inside the ischemic area. In particular, in agreement with experimental findings, we assumed that an ischemic episode can alter the gap junctions of the affected cells by reducing their average conductance. We extended these changes to include random fluctuations with time, and modifications in the gap junction rectifying conductive properties of cells along the edges of the ischemic area. The results demonstrate how these alterations can qualitatively give an account of all the main types of non-fatal arrhythmia observed experimentally, and suggest how premature beats can be eliminated in three different ways: a) with a relatively small surgical procedure, b) with a pharmacological reduction of the rectifying conductive properties of the gap-junctions, and c) by pharmacologically decreasing the gap junction conductance. In conclusion, our model strongly supports the hypothesis that non-fatal arrhythmias can develop from post-ischemic alteration of the electrical connectivity in a relatively small area of the cardiac cell network, and suggests experimentally testable predictions on their possible treatments.

Distributed organization of a brain microcircuit analyzed by three-dimensional modeling: the olfactory bulb.

The functional consequences of the laminar organization observed in cortical systems cannot be easily studied using standard experimental techniques, abstract theoretical representations, or dimensionally reduced models built from scratch. To solve this problem we have developed a full implementation of an olfactory bulb microcircuit using realistic three-dimensional (3D) inputs, cell morphologies, and network connectivity. The results provide new insights into the relations between the functional properties of individual cells and the networks in which they are embedded. To our knowledge, this is the first model of the mitral-granule cell network to include a realistic representation of the experimentally-recorded complex spatial patterns elicited in the glomerular layer (GL) by natural odor stimulation. Although the olfactory bulb, due to its organization, has unique advantages with respect to other brain systems, the method is completely general, and can be integrated with more general approaches to other systems. The model makes experimentally testable predictions on distributed processing and on the differential backpropagation of somatic action potentials in each lateral dendrite following odor learning, providing a powerful 3D framework for investigating the functions of brain microcircuits.

Reaction-diffusion in the NEURON simulator.

In order to support research on the role of cell biological principles (genomics, proteomics, signaling cascades and reaction dynamics) on the dynamics of neuronal response in health and disease, NEURON's Reaction-Diffusion (rxd) module in Python provides specification and simulation for these dynamics, coupled with the electrophysiological dynamics of the cell membrane. Arithmetic operations on species and parameters are overloaded, allowing arbitrary reaction formulas to be specified using Python syntax. These expressions are then transparently compiled into bytecode that uses NumPy for fast vectorized calculations. At each time step, rxd combines NEURON's integrators with SciPy's sparse linear algebra library.