Discrete-Attractor-like Tracking in Continuous Attractor Neural Networks.

Continuous attractor neural networks generate a set of smoothly connected attractor states. In memory systems of the brain, these attractor states may represent continuous pieces of information such as spatial locations and head directions of animals. However, during the replay of previous experiences, hippocampal neurons show a discontinuous sequence in which discrete transitions of the neural state are phase locked with the slow-gamma (∼30-50 Hz) oscillation. Here, we explore the underlying mechanisms of the discontinuous sequence generation. We find that a continuous attractor neural network has several phases depending on the interactions between external input and local inhibitory feedback. The discrete-attractor-like behavior naturally emerges in one of these phases without any discreteness assumption. We propose that the dynamics of continuous attractor neural networks is the key to generate discontinuous state changes phase locked to the brain rhythm.

Rethinking the Masking Strategy for Pretraining Molecular Graphs from a Data-Centric View.

Node-level self-supervised learning has been widely applied for pretraining molecular graphs. Attribute Masking (AttrMask) is pioneering work in this field, and its improved methods focus on enhancing the capacity of the backbone models by incorporating additional modules. However, these methods overlook the imbalanced atom distribution due to employing only the random masking strategy to mask atoms for pretraining. According to the properties of molecules, we propose a weighted masking strategy to enhance the capacity of pretrained models by more effective utilization of molecular information while pretraining. Our experimental results demonstrate that AttrMask combined with our proposed weighted masking strategy yields superior performance compared to the random masking strategy, even surpassing the model-centric improvement methods without increasing the parameters. Additionally, our weighted masking strategy can be extended to other pretraining methods to achieve enhanced performance.

Competition on presynaptic resources enhances the discrimination of interfering memories.

Evidence suggests that hippocampal adult neurogenesis is critical for discriminating considerably interfering memories. During adult neurogenesis, synaptic competition modifies the weights of synaptic connections nonlocally across neurons, thus providing a different form of unsupervised learning from Hebb's local plasticity rule. However, how synaptic competition achieves separating similar memories largely remains unknown. Here, we aim to link synaptic competition with such pattern separation. In synaptic competition, adult-born neurons are integrated into the existing neuronal pool by competing with mature neurons for synaptic connections from the entorhinal cortex. We show that synaptic competition and neuronal maturation play distinct roles in separating interfering memory patterns. Furthermore, we demonstrate that a feedforward neural network trained by a competition-based learning rule can outperform a multilayer perceptron trained by the backpropagation algorithm when only a small number of samples are available. Our results unveil the functional implications and potential applications of synaptic competition in neural computation.

Short-term postsynaptic plasticity facilitates predictive tracking in continuous attractors.

Introduction: The N-methyl-D-aspartate receptor (NMDAR) plays a critical role in synaptic transmission and is associated with various neurological and psychiatric disorders. Recently, a novel form of postsynaptic plasticity known as NMDAR-based short-term postsynaptic plasticity (STPP) has been identified. It has been suggested that long-lasting glutamate binding to NMDAR allows for the retention of input information in brain slices up to 500 ms, leading to response facilitation. However, the impact of STPP on the dynamics of neuronal populations remains unexplored. Methods: In this study, we incorporated STPP into a continuous attractor neural network (CANN) model to investigate its effects on neural information encoding in populations of neurons. Unlike short-term facilitation, a form of presynaptic plasticity, the temporally enhanced synaptic efficacy resulting from STPP destabilizes the network state of the CANN by increasing its mobility. Results: Our findings demonstrate that the inclusion of STPP in the CANN model enables the network state to predictively respond to a moving stimulus. This nontrivial dynamical effect facilitates the tracking of the anticipated stimulus, as the enhanced synaptic efficacy induced by STPP enhances the system's mobility. Discussion: The discovered STPP-based mechanism for sensory prediction provides valuable insights into the potential development of brain-inspired computational algorithms for prediction. By elucidating the role of STPP in neural population dynamics, this study expands our understanding of the functional implications of NMDAR-related plasticity in information processing within the brain. Conclusion: The incorporation of STPP into a CANN model highlights its influence on the mobility and predictive capabilities of neural networks. These findings contribute to our knowledge of STPP-based mechanisms and their potential applications in developing computational algorithms for sensory prediction.

Zebrafish capable of generating future state prediction error show improved active avoidance behavior in virtual reality.

Animals make decisions under the principle of reward value maximization and surprise minimization. It is still unclear how these principles are represented in the brain and are reflected in behavior. We addressed this question using a closed-loop virtual reality system to train adult zebrafish for active avoidance. Analysis of the neural activity of the dorsal pallium during training revealed neural ensembles assigning rules to the colors of the surrounding walls. Additionally, one third of fish generated another ensemble that becomes activated only when the real perceived scenery shows discrepancy from the predicted favorable scenery. The fish with the latter ensemble escape more efficiently than the fish with the former ensembles alone, even though both fish have successfully learned to escape, consistent with the hypothesis that the latter ensemble guides zebrafish to take action to minimize this prediction error. Our results suggest that zebrafish can use both principles of goal-directed behavior, but with different behavioral consequences depending on the repertoire of the adopted principles.

Astrocyte GluN2C NMDA receptors control basal synaptic strengths of hippocampal CA1 pyramidal neurons in the stratum radiatum.

Experience-dependent plasticity is a key feature of brain synapses for which neuronal N-Methyl-D-Aspartate receptors (NMDARs) play a major role, from developmental circuit refinement to learning and memory. Astrocytes also express NMDARs, although their exact function has remained controversial. Here, we identify in mouse hippocampus, a circuit function for GluN2C NMDAR, a subtype highly expressed in astrocytes, in layer-specific tuning of synaptic strengths in CA1 pyramidal neurons. Interfering with astrocyte NMDAR or GluN2C NMDAR activity reduces the range of presynaptic strength distribution specifically in the stratum radiatum inputs without an appreciable change in the mean presynaptic strength. Mathematical modeling shows that narrowing of the width of presynaptic release probability distribution compromises the expression of long-term synaptic plasticity. Our findings suggest a novel feedback signaling system that uses astrocyte GluN2C NMDARs to adjust basal synaptic weight distribution of Schaffer collateral inputs, which in turn impacts computations performed by the CA1 pyramidal neuron.

Orchestrated ensemble activities constitute a hippocampal memory engram.

The brain stores and recalls memories through a set of neurons, termed engram cells. However, it is unclear how these cells are organized to constitute a corresponding memory trace. We established a unique imaging system that combines Ca2+ imaging and engram identification to extract the characteristics of engram activity by visualizing and discriminating between engram and non-engram cells. Here, we show that engram cells detected in the hippocampus display higher repetitive activity than non-engram cells during novel context learning. The total activity pattern of the engram cells during learning is stable across post-learning memory processing. Within a single engram population, we detected several sub-ensembles composed of neurons collectively activated during learning. Some sub-ensembles preferentially reappear during post-learning sleep, and these replayed sub-ensembles are more likely to be reactivated during retrieval. These results indicate that sub-ensembles represent distinct pieces of information, which are then orchestrated to constitute an entire memory.

Transient and Persistent UP States during Slow-wave Oscillation and their Implications for Cell-Assembly Dynamics.

The membrane potentials of cortical neurons in vivo exhibit spontaneous fluctuations between a depolarized UP state and a resting DOWN state during the slow-wave sleeps or in the resting states. This oscillatory activity is believed to engage in memory consolidation although the underlying mechanisms remain unknown. Recently, it has been shown that UP-DOWN state transitions exhibit significantly different temporal profiles in different cortical regions, presumably reflecting differences in the underlying network structure. Here, we studied in computational models whether and how the connection configurations of cortical circuits determine the macroscopic network behavior during the slow-wave oscillation. Inspired by cortical neurobiology, we modeled three types of synaptic weight distributions, namely, log-normal, sparse log-normal and sparse Gaussian. Both analytic and numerical results suggest that a larger variance of weight distribution results in a larger chance of having significantly prolonged UP states. However, the different weight distributions only produce similar macroscopic behavior. We further confirmed that prolonged UP states enrich the variety of cell assemblies activated during these states. Our results suggest the role of persistent UP states for the prolonged repetition of a selected set of cell assemblies during memory consolidation.

Hippocampal Neurogenesis Reduces the Dimensionality of Sparsely Coded Representations to Enhance Memory Encoding.

Adult neurogenesis in the hippocampal dentate gyrus (DG) of mammals is known to contribute to memory encoding in many tasks. The DG also exhibits exceptionally sparse activity compared to other systems, however, whether sparseness and neurogenesis interact during memory encoding remains elusive. We implement a novel learning rule consistent with experimental findings of competition among adult-born neurons in a supervised multilayer feedforward network trained to discriminate between contexts. From this rule, the DG population partitions into neuronal ensembles each of which is biased to represent one of the contexts. This corresponds to a low dimensional representation of the contexts, whereby the fastest dimensionality reduction is achieved in sparse models. We then modify the rule, showing that equivalent representations and performance are achieved when neurons compete for synaptic stability rather than neuronal survival. Our results suggest that competition for stability in sparse models is well-suited to developing ensembles of what may be called memory engram cells.