Grid cell hexagonal patterns formed by fast self-organized learning within entorhinal cortex.

Grid cells in the dorsal segment of the medial entorhinal cortex (dMEC) show remarkable hexagonal activity patterns, at multiple spatial scales, during spatial navigation. It has previously been shown how a self-organizing map can convert firing patterns across entorhinal grid cells into hippocampal place cells that are capable of representing much larger spatial scales. Can grid cell firing fields also arise during navigation through learning within a self-organizing map? This article describes a simple and general mathematical property of the trigonometry of spatial navigation which favors hexagonal patterns. The article also develops a neural model that can learn to exploit this trigonometric relationship. This GRIDSmap self-organizing map model converts path integration signals into hexagonal grid cell patterns of multiple scales. GRIDSmap creates only grid cell firing patterns with the observed hexagonal structure, predicts how these hexagonal patterns can be learned from experience, and can process biologically plausible neural input and output signals during navigation. These results support an emerging unified computational framework based on a hierarchy of self-organizing maps for explaining how entorhinal-hippocampal interactions support spatial navigation.

Learned integration of visual, vestibular, and motor cues in multiple brain regions computes head direction during visually guided navigation.

Effective navigation depends upon reliable estimates of head direction (HD). Visual, vestibular, and outflow motor signals combine for this purpose in a brain system that includes dorsal tegmental nucleus, lateral mammillary nuclei, anterior dorsal thalamic nucleus, and the postsubiculum. Learning is needed to combine such different cues to provide reliable estimates of HD. A neural model is developed to explain how these three types of signals combine adaptively within the above brain regions to generate a consistent and reliable HD estimate, in both light and darkness, which explains the following experimental facts. Each HD cell is tuned to a preferred head direction. The cell's firing rate is maximal at the preferred direction and decreases as the head turns from the preferred direction. The HD estimate is controlled by the vestibular system when visual cues are not available. A well-established visual cue anchors the cell's preferred direction when the cue is in the animal's field of view. Distal visual cues are more effective than proximal cues for anchoring the preferred direction. The introduction of novel cues in either a novel or familiar environment can gain control over a cell's preferred direction within minutes. Turning out the lights or removing all familiar cues does not change the cell's firing activity, but it may accumulate a drift in the cell's preferred direction. The anticipated time interval (ATI) of the HD estimate is greater in early processing stages of the HD system than at later stages. The model contributes to an emerging unified neural model of how multiple processing stages in spatial navigation, including postsubiculum head direction cells, entorhinal grid cells, and hippocampal place cells, are calibrated through learning in response to multiple types of signals as an animal navigates in the world.

Space, time and learning in the hippocampus: how fine spatial and temporal scales are expanded into population codes for behavioral control.

The hippocampus participates in multiple functions, including spatial navigation, adaptive timing and declarative (notably, episodic) memory. How does it carry out these particular functions? The present article proposes that hippocampal spatial and temporal processing are carried out by parallel circuits within entorhinal cortex, dentate gyrus and CA3 that are variations of the same circuit design. In particular, interactions between these brain regions transform fine spatial and temporal scales into population codes that are capable of representing the much larger spatial and temporal scales that are needed to control adaptive behaviors. Previous models of adaptively timed learning propose how a spectrum of cells tuned to brief but different delays are combined and modulated by learning to create a population code for controlling goal-oriented behaviors that span hundreds of milliseconds or even seconds. Here it is proposed how projections from entorhinal grid cells can undergo a similar learning process to create hippocampal place cells that can cover a space of many meters that are needed to control navigational behaviors. The suggested homology between spatial and temporal processing may clarify how spatial and temporal information may be integrated into an episodic memory. The model proposes how a path integration process activates a spatial map of grid cells. Path integration has a limited spatial capacity, and must be reset periodically, leading to the observed grid cell periodicity. Integration-to-map transformations have been proposed to exist in other brain systems. These include cortical mechanisms for numerical representation in the parietal cortex. As in the grid-to-place cell spatial expansion, the analog representation of number is extended by additional mechanisms to represent much larger numbers. The model also suggests how visual landmarks may influence grid cell activities via feedback projections from hippocampal place cells to the entorhinal cortex.

Switching between gamma and theta: Dynamic network control using subthreshold electric fields.

We implemented an experimentally observed orthogonal arrangement of theta and gamma generation circuitry in septotemporal and lamellar dimensions is a two-dimensional model of hippocampus. The model includes three types of cells: pyramidal, basket, and oriens lacunosum-moleculare (OLM) neurons. In this reduced model, application of continuous electric fields allowed us to switch between theta, gamma and mixed theta-gamma regimes without additional pharmacological manipulation. Electric field effects on individual neurons were modeled based on experimental data. Network simulation results predict a flexible experimental technique, which would employ adaptive subthreshold electric fields to continuously modulate neuronal ensemble activity, and can be used for testing cognitive correlates of oscillatory rhythms as well as for suppressing epileptiform activity.

A model of STDP based on spatially and temporally local information: derivation and combination with gated decay.

Temporal relationships between neuronal firing and plasticity have received significant attention in recent decades. Neurophysiological studies have shown the phenomenon of spike-timing-dependent plasticity (STDP). Various models were suggested to implement an STDP-like learning rule in artificial networks based on spiking neuronal representations. The rule presented here was developed under three constraints. First, it only depends on the information that is available at the synapse at the time of synaptic modification. Second, it naturally follows from neurophysiological and psychological research starting with Hebb's postulate [D. Hebb. (1949). The organization of behavior. Wiley, New York]. Third, it is simple, computationally cheap and its parameters are straightforward to determine. This rule is further extended by addition of four different types of gating derived from conventionally used types of gated decay in learning rules for continuous firing rate neural networks. The results show that the advantages of using these gatings are transferred to the new rule without sacrificing its dependency on spike-timing.

Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation.

We investigated the importance of hippocampal theta oscillations and the significance of phase differences of theta modulation in the cortical regions that are involved in goal-directed spatial navigation. Our models used representations of entorhinal cortex layer III (ECIII), hippocampus and prefrontal cortex (PFC) to guide movements of a virtual rat in a virtual environment. The model encoded representations of the environment through long-term potentiation of excitatory recurrent connections between sequentially spiking place cells in ECIII and CA3. This encoding required buffering of place cell activity, which was achieved by a short-term memory (STM) in EC that was regulated by theta modulation and allowed synchronized reactivation with encoding phases in ECIII and CA3. Inhibition at a specific theta phase deactivated the oldest item in the buffer when new input was presented to a full STM buffer. A 180 degrees phase difference separated retrieval and encoding in ECIII and CA3, which enabled us to simulate data on theta phase precession of place cells. Retrieval of known paths was elicited in ECIII by input at the retrieval phase from PFC working memory for goal location, requiring strict theta phase relationships with PFC. Known locations adjacent to the virtual rat were retrieved in CA3. Together, input from ECIII and CA3 activated predictive spiking in cells in CA1 for the next desired place on a shortest path to a goal. Consistent with data, place cell activity in CA1 and CA3 showed smaller place fields than in ECIII.

Neuromodulation, theta rhythm and rat spatial navigation.

Cholinergic and GABAergic innervation of the hippocampus plays an important role in human memory function and rat spatial navigation. Drugs which block acetylcholine receptors or enhance GABA receptor activation cause striking impairments in the encoding of new information. Lesions of the cholinergic innervation of the hippocampus reduce the amplitude of hippocampal theta rhythm and cause impairments in spatial navigation tasks, including the Morris water maze, eight-arm radial maze, spatial reversal and delayed alternation. Here, we review previous work on the role of cholinergic modulation in memory function, and we present a new model of the hippocampus and entorhinal cortex describing the interaction of these regions for goal-directed spatial navigation in behavioral tasks. These mechanisms require separate functional phases for: (1) encoding of pathways without interference from retrieval, and (2) retrieval of pathways for guiding selection of the next movement. We present analysis exploring how phasic changes in physiological variables during hippocampal theta rhythm could provide these different phases and enhance spatial navigation function.

The animat: new frontiers in whole brain modeling.

The researchers at Boston University (BU)'s Neuromorphics Laboratory, part of the National Science Foundation (NSF)-sponsored Center of Excellence for Learning in Education, Science, and Technology (CELEST), are working in collaboration with the engineers and scientists at Hewlett-Packard (HP) to implement neural models of intelligent processes for the next generation of dense, low-power, computer hardware that will use memristive technology to bring data closer to the processor where computation occurs. The HP and BU teams are jointly designing an optimal infrastructure, simulation, and software platform to build an artificial brain. The resulting Cog Ex Machina (Cog) software platform has been successfully used to implement a large-scale, multicomponent brain system that is able to simulate some key rat behavioral results in a virtual environment and has been applied to control robotic platforms as they learn to interact with their environment.

KInNeSS: a modular framework for computational neuroscience.

Making use of very detailed neurophysiological, anatomical, and behavioral data to build biologically-realistic computational models of animal behavior is often a difficult task. Until recently, many software packages have tried to resolve this mismatched granularity with different approaches. This paper presents KInNeSS, the KDE Integrated NeuroSimulation Software environment, as an alternative solution to bridge the gap between data and model behavior. This open source neural simulation software package provides an expandable framework incorporating features such as ease of use, scalability, an XML based schema, and multiple levels of granularity within a modern object oriented programming design. KInNeSS is best suited to simulate networks of hundreds to thousands of branched multi-compartmental neurons with biophysical properties such as membrane potential, voltage-gated and ligand-gated channels, the presence of gap junctions or ionic diffusion, neuromodulation channel gating, the mechanism for habituative or depressive synapses, axonal delays, and synaptic plasticity. KInNeSS outputs include compartment membrane voltage, spikes, local-field potentials, and current source densities, as well as visualization of the behavior of a simulated agent. An explanation of the modeling philosophy and plug-in development is also presented. Further development of KInNeSS is ongoing with the ultimate goal of creating a modular framework that will help researchers across different disciplines to effectively collaborate using a modern neural simulation platform.