Behavior- and Modality-General Representation of Confidence in Orbitofrontal Cortex.

Every decision we make is accompanied by a sense of confidence about its likely outcome. This sense informs subsequent behavior, such as investing more-whether time, effort, or money-when reward is more certain. A neural representation of confidence should originate from a statistical computation and predict confidence-guided behavior. An additional requirement for confidence representations to support metacognition is abstraction: they should emerge irrespective of the source of information and inform multiple confidence-guided behaviors. It is unknown whether neural confidence signals meet these criteria. Here, we show that single orbitofrontal cortex neurons in rats encode statistical decision confidence irrespective of the sensory modality, olfactory or auditory, used to make a choice. The activity of these neurons also predicts two confidence-guided behaviors: trial-by-trial time investment and cross-trial choice strategy updating. Orbitofrontal cortex thus represents decision confidence consistent with a metacognitive process that is useful for mediating confidence-guided economic decisions.

Constant Sub-second Cycling between Representations of Possible Futures in the Hippocampus.

Cognitive faculties such as imagination, planning, and decision-making entail the ability to represent hypothetical experience. Crucially, animal behavior in natural settings implies that the brain can represent hypothetical future experience not only quickly but also constantly over time, as external events continually unfold. To determine how this is possible, we recorded neural activity in the hippocampus of rats navigating a maze with multiple spatial paths. We found neural activity encoding two possible future scenarios (two upcoming maze paths) in constant alternation at 8 Hz: one scenario per ∼125-ms cycle. Further, we found that the underlying dynamics of cycling (both inter- and intra-cycle dynamics) generalized across qualitatively different representational correlates (location and direction). Notably, cycling occurred across moving behaviors, including during running. These findings identify a general dynamic process capable of quickly and continually representing hypothetical experience, including that of multiple possible futures.

Competing Roles of Slow Oscillations and Delta Waves in Memory Consolidation versus Forgetting.

Sleep has been implicated in both memory consolidation and forgetting of experiences. However, it is unclear what governs the balance between consolidation and forgetting. Here, we tested how activity-dependent processing during sleep might differentially regulate these two processes. We specifically examined how neural reactivations during non-rapid eye movement (NREM) sleep were causally linked to consolidation versus weakening of the neural correlates of neuroprosthetic skill. Strikingly, we found that slow oscillations (SOs) and delta (δ) waves have dissociable and competing roles in consolidation versus forgetting. By modulating cortical spiking linked to SOs or δ waves using closed-loop optogenetic methods, we could, respectively, weaken or strengthen consolidation and thereby bidirectionally modulate sleep-dependent performance gains. We further found that changes in the temporal coupling of spindles to SOs relative to δ waves could account for such effects. Thus, our results indicate that neural activity driven by SOs and δ waves have competing roles in sleep-dependent memory consolidation.

Expanding the Optogenetics Toolkit by Topological Inversion of Rhodopsins.

Targeted manipulation of activity in specific populations of neurons is important for investigating the neural circuit basis of behavior. Optogenetic approaches using light-sensitive microbial rhodopsins have permitted manipulations to reach a level of temporal precision that is enabling functional circuit dissection. As demand for more precise perturbations to serve specific experimental goals increases, a palette of opsins with diverse selectivity, kinetics, and spectral properties will be needed. Here, we introduce a novel approach of "topological engineering"-inversion of opsins in the plasma membrane-and demonstrate that it can produce variants with unique functional properties of interest for circuit neuroscience. In one striking example, inversion of a Channelrhodopsin variant converted it from a potent activator into a fast-acting inhibitor that operates as a cation pump. Our findings argue that membrane topology provides a useful orthogonal dimension of protein engineering that immediately permits as much as a doubling of the available toolkit.

Chronic Stress Alters Striosome-Circuit Dynamics, Leading to Aberrant Decision-Making.

Effective evaluation of costs and benefits is a core survival capacity that in humans is considered as optimal, "rational" decision-making. This capacity is vulnerable in neuropsychiatric disorders and in the aftermath of chronic stress, in which aberrant choices and high-risk behaviors occur. We report that chronic stress exposure in rodents produces abnormal evaluation of costs and benefits resembling non-optimal decision-making in which choices of high-cost/high-reward options are sharply increased. Concomitantly, alterations in the task-related spike activity of medial prefrontal neurons correspond with increased activity of their striosome-predominant striatal projection neuron targets and with decreased and delayed striatal fast-firing interneuron activity. These effects of chronic stress on prefronto-striatal circuit dynamics could be blocked or be mimicked by selective optogenetic manipulation of these circuits. We suggest that altered excitation-inhibition dynamics of striosome-based circuit function could be an underlying mechanism by which chronic stress contributes to disorders characterized by aberrant decision-making under conflict. VIDEO ABSTRACT.

Causal Influence of Visual Cues on Hippocampal Directional Selectivity.

Hippocampal neurons show selectivity with respect to visual cues in primates, including humans, but this has never been found in rodents. To address this long-standing discrepancy, we measured hippocampal activity from rodents during real-world random foraging. Surprisingly, ∼ 25% of neurons exhibited significant directional modulation with respect to visual cues. To dissociate the contributions of visual and vestibular cues, we made similar measurements in virtual reality, in which only visual cues were informative. Here, we found significant directional modulation despite the severe loss of vestibular information, challenging prevailing theories of directionality. Changes in the amount of angular information in visual cues induced corresponding changes in head-directional modulation at the neuronal and population levels. Thus, visual cues are sufficient for-and play a predictable, causal role in-generating directionally selective hippocampal responses. These results dissociate hippocampal directional and spatial selectivity and bridge the gap between primate and rodent studies.

Neuronal Firing Rate Homeostasis Is Inhibited by Sleep and Promoted by Wake.

Homeostatic mechanisms stabilize neural circuit function by keeping firing rates within a set-point range, but whether this process is gated by brain state is unknown. Here, we monitored firing rate homeostasis in individual visual cortical neurons in freely behaving rats as they cycled between sleep and wake states. When neuronal firing rates were perturbed by visual deprivation, they gradually returned to a precise, cell-autonomous set point during periods of active wake, with lengthening of the wake period enhancing firing rate rebound. Unexpectedly, this resetting of neuronal firing was suppressed during sleep. This raises the possibility that memory consolidation or other sleep-dependent processes are vulnerable to interference from homeostatic plasticity mechanisms. PAPERCLIP.

A virtual rodent predicts the structure of neural activity across behaviours.

Animals have exquisite control of their bodies, allowing them to perform a diverse range of behaviours. How such control is implemented by the brain, however, remains unclear. Advancing our understanding requires models that can relate principles of control to the structure of neural activity in behaving animals. Here, to facilitate this, we built a 'virtual rodent', in which an artificial neural network actuates a biomechanically realistic model of the rat1 in a physics simulator2. We used deep reinforcement learning3-5 to train the virtual agent to imitate the behaviour of freely moving rats, thus allowing us to compare neural activity recorded in real rats to the network activity of a virtual rodent mimicking their behaviour. We found that neural activity in the sensorimotor striatum and motor cortex was better predicted by the virtual rodent's network activity than by any features of the real rat's movements, consistent with both regions implementing inverse dynamics6. Furthermore, the network's latent variability predicted the structure of neural variability across behaviours and afforded robustness in a way consistent with the minimal intervention principle of optimal feedback control7. These results demonstrate how physical simulation of biomechanically realistic virtual animals can help interpret the structure of neural activity across behaviour and relate it to theoretical principles of motor control.

Sleep loss diminishes hippocampal reactivation and replay.

Memories benefit from sleep1, and the reactivation and replay of waking experiences during hippocampal sharp-wave ripples (SWRs) are considered to be crucial for this process2. However, little is known about how these patterns are impacted by sleep loss. Here we recorded CA1 neuronal activity over 12 h in rats across maze exploration, sleep and sleep deprivation, followed by recovery sleep. We found that SWRs showed sustained or higher rates during sleep deprivation but with lower power and higher frequency ripples. Pyramidal cells exhibited sustained firing during sleep deprivation and reduced firing during sleep, yet their firing rates were comparable during SWRs regardless of sleep state. Despite the robust firing and abundance of SWRs during sleep deprivation, we found that the reactivation and replay of neuronal firing patterns was diminished during these periods and, in some cases, completely abolished compared to ad libitum sleep. Reactivation partially rebounded after recovery sleep but failed to reach the levels found in natural sleep. These results delineate the adverse consequences of sleep loss on hippocampal function at the network level and reveal a dissociation between the many SWRs elicited during sleep deprivation and the few reactivations and replays that occur during these events.

Toroidal topology of population activity in grid cells.

The medial entorhinal cortex is part of a neural system for mapping the position of an individual within a physical environment1. Grid cells, a key component of this system, fire in a characteristic hexagonal pattern of locations2, and are organized in modules3 that collectively form a population code for the animal's allocentric position1. The invariance of the correlation structure of this population code across environments4,5 and behavioural states6,7, independent of specific sensory inputs, has pointed to intrinsic, recurrently connected continuous attractor networks (CANs) as a possible substrate of the grid pattern1,8-11. However, whether grid cell networks show continuous attractor dynamics, and how they interface with inputs from the environment, has remained unclear owing to the small samples of cells obtained so far. Here, using simultaneous recordings from many hundreds of grid cells and subsequent topological data analysis, we show that the joint activity of grid cells from an individual module resides on a toroidal manifold, as expected in a two-dimensional CAN. Positions on the torus correspond to positions of the moving animal in the environment. Individual cells are preferentially active at singular positions on the torus. Their positions are maintained between environments and from wakefulness to sleep, as predicted by CAN models for grid cells but not by alternative feedforward models12. This demonstration of network dynamics on a toroidal manifold provides a population-level visualization of CAN dynamics in grid cells.

Subpopulations of neurons in the perirhinal cortex enable both modality-specific and modality-invariant recognition of objects.

The perirhinal cortex (PER) supports multimodal object recognition, but how multimodal information of objects is integrated within the PER remains unknown. Here, we recorded single units within the PER while rats performed a PER-dependent multimodal object-recognition task. In this task, audiovisual cues were presented simultaneously (multimodally) or separately (unimodally). We identified 2 types of object-selective neurons in the PER: crossmodal cells, showing constant firing patterns for an object irrespective of its modality, and unimodal cells, showing a preference for a specific modality. Unimodal cells further dissociated unimodal and multimodal versions of the object by modulating their firing rates according to the modality condition. A population-decoding analysis confirmed that the PER could perform both modality-invariant and modality-specific object decoding-the former for recognizing an object as the same in various conditions and the latter for remembering modality-specific experiences of the same object.

Retrieval of contextual memory can be predicted by CA3 remapping and is differentially influenced by NMDAR activity in rat hippocampus subregions.

Episodic memory is essential to navigate in a changing environment by recalling past events, creating new memories, and updating stored information from experience. Although the mechanisms for acquisition and consolidation have been profoundly studied, much less is known about memory retrieval. Hippocampal spatial representations are key for retrieval of contextually guided episodic memories. Indeed, hippocampal place cells exhibit stable location-specific activity which is thought to support contextual memory, but can also undergo remapping in response to environmental changes. It is unclear if remapping is directly related to the expression of different episodic memories. Here, using an incidental memory recognition task in rats, we showed that retrieval of a contextually guided memory is reflected by the levels of CA3 remapping, demonstrating a clear link between external cues, hippocampal remapping, and episodic memory retrieval that guides behavior. Furthermore, we describe NMDARs as key players in regulating the balance between retrieval and memory differentiation processes by controlling the reactivation of specific memory traces. While an increase in CA3 NMDAR activity boosts memory retrieval, dentate gyrus NMDAR activity enhances memory differentiation. Our results contribute to understanding how the hippocampal circuit sustains a flexible balance between memory formation and retrieval depending on the environmental cues and the internal representations of the individual. They also provide new insights into the molecular mechanisms underlying the contributions of hippocampal subregions to generate this balance.

Inter-mosaic coordination of retinal receptive fields.

The output of the retina is organized into many detector grids, called 'mosaics', that signal different features of visual scenes to the brain1-4. Each mosaic comprises a single type of retinal ganglion cell (RGC), whose receptive fields tile visual space. Many mosaics arise as pairs, signalling increments (ON) and decrements (OFF), respectively, of a particular visual feature5. Here we use a model of efficient coding6 to determine how such mosaic pairs should be arranged to optimize the encoding of natural scenes. We find that information is maximized when these mosaic pairs are anti-aligned, meaning that the distances between the receptive field centres across mosaics are greater than expected by chance. We tested this prediction across multiple receptive field mosaics acquired using large-scale measurements of the light responses of rat and primate RGCs. ON and OFF RGC pairs with similar feature selectivity had anti-aligned receptive field mosaics, consistent with this prediction. ON and OFF RGC types that encode distinct features have independent mosaics. These results extend efficient coding theory beyond individual cells to predict how populations of diverse types of RGC are spatially arranged.

Linking hippocampal multiplexed tuning, Hebbian plasticity and navigation.

Three major pillars of hippocampal function are spatial navigation1, Hebbian synaptic plasticity2 and spatial selectivity3. The hippocampus is also implicated in episodic memory4, but the precise link between these four functions is missing. Here we report the multiplexed selectivity of dorsal CA1 neurons while rats performed a virtual navigation task using only distal visual cues5, similar to the standard water maze test of spatial memory1. Neural responses primarily encoded path distance from the start point and the head angle of rats, with a weak allocentric spatial component similar to that in primates but substantially weaker than in rodents in the real world. Often, the same cells multiplexed and encoded path distance, angle and allocentric position in a sequence, thus encoding a journey-specific episode. The strength of neural activity and tuning strongly correlated with performance, with a temporal relationship indicating neural responses influencing behaviour and vice versa. Consistent with computational models of associative and causal Hebbian learning6,7, neural responses showed increasing clustering8 and became better predictors of behaviourally relevant variables, with the average neurometric curves exceeding and converging to psychometric curves. Thus, hippocampal neurons multiplex and exhibit highly plastic, task- and experience-dependent tuning to path-centric and allocentric variables to form episodic sequences supporting navigation.

A metabolic function of the hippocampal sharp wave-ripple.

The hippocampus has previously been implicated in both cognitive and endocrine functions1-15. We simultaneously measured electrophysiological activity from the hippocampus and interstitial glucose concentrations in the body of freely behaving rats to identify an activity pattern that may link these disparate functions of the hippocampus. Here we report that clusters of sharp wave-ripples recorded from the hippocampus reliably predicted a decrease in peripheral glucose concentrations within about 10 min. This correlation was not dependent on circadian, ultradian or meal-triggered fluctuations, could be mimicked with optogenetically induced ripples in the hippocampus (but not in the parietal cortex) and was attenuated to chance levels by pharmacogenetically suppressing activity of the lateral septum, which is the major conduit between the hippocampus and the hypothalamus. Our findings demonstrate that a function of the sharp wave-ripple is to modulate peripheral glucose homeostasis, and offer a mechanism for the link between sleep disruption and blood glucose dysregulation in type 2 diabetes16-18.

The orbitofrontal cortex maps future navigational goals.

Accurate navigation to a desired goal requires consecutive estimates of spatial relationships between the current position and future destination throughout the journey. Although neurons in the hippocampal formation can represent the position of an animal as well as its nearby trajectories1-7, their role in determining the destination of the animal has been questioned8,9. It is, thus, unclear whether the brain can possess a precise estimate of target location during active environmental exploration. Here we describe neurons in the rat orbitofrontal cortex (OFC) that form spatial representations persistently pointing to the subsequent goal destination of an animal throughout navigation. This destination coding emerges before the onset of navigation, without direct sensory access to a distal goal, and even predicts the incorrect destination of an animal at the beginning of an error trial. Goal representations in the OFC are maintained by destination-specific neural ensemble dynamics, and their brief perturbation at the onset of a journey led to a navigational error. These findings suggest that the OFC is part of the internal goal map of the brain, enabling animals to navigate precisely to a chosen destination that is beyond the range of sensory perception.

Evolving schema representations in orbitofrontal ensembles during learning.

How do we learn about what to learn about? Specifically, how do the neural elements in our brain generalize what has been learned in one situation to recognize the common structure of-and speed learning in-other, similar situations? We know this happens because we become better at solving new problems-learning and deploying schemas1-5-through experience. However, we have little insight into this process. Here we show that using prior knowledge to facilitate learning is accompanied by the evolution of a neural schema in the orbitofrontal cortex. Single units were recorded from rats deploying a schema to learn a succession of odour-sequence problems. With learning, orbitofrontal cortex ensembles converged onto a low-dimensional neural code across both problems and subjects; this neural code represented the common structure of the problems and its evolution accelerated across their learning. These results demonstrate the formation and use of a schema in a prefrontal brain region to support a complex cognitive operation. Our results not only reveal a role for the orbitofrontal cortex in learning but also have implications for using ensemble analyses to tap into complex cognitive functions.

Basal forebrain cholinergic activity is necessary for upward firing rate homeostasis in the rodent visual cortex.

Bidirectional homeostatic plasticity allows neurons and circuits to maintain stable firing in the face of developmental or learning-induced perturbations. In the primary visual cortex (V1), upward firing rate homeostasis (FRH) only occurs during active wake (AW) and downward during sleep, but how this behavioral state-dependent gating is accomplished is unknown. Here, we focus on how AW enables upward FRH in V1 of juvenile Long Evans rats. A major difference between quiet wake (QW), when upward FRH is absent, and AW, when it is present, is increased cholinergic (ACh) tone, and the main cholinergic projections to V1 arise from the horizontal diagonal band of the basal forebrain (HDB ACh). We therefore chemogenetically inhibited HDB ACh neurons while inducing upward homeostatic compensation using direct activity-suppression in V1. We found that synaptic scaling up and intrinsic homeostatic plasticity, two important cellular mediators of upward FRH, were both impaired when HDB ACh neurons were inhibited. Most strikingly, HDB ACh inhibition flipped the sign of intrinsic plasticity so that it became anti-homeostatic, and this effect was phenocopied by knockdown of the M1 ACh receptor in V1, indicating that this modulation of intrinsic plasticity is the result of direct actions of ACh within V1. Finally, we found that upward FRH induced by visual deprivation was completely prevented by HDB ACh inhibition. Together, our results show that HDB ACh modulation is a key enabler of upward homeostatic plasticity and FRH, and more broadly suggest that neuromodulatory inputs can segregate upward and downward homeostatic plasticity into distinct behavioral states.

Grid cells in rats deprived of geometric experience during development.

The medial entorhinal cortex (MEC) is part of the brain's network for dynamic representation of location. The most abundant class of neurons in this circuit is the grid cell, characterized by its periodic, hexagonally patterned firing fields. While in developing animals some MEC cell types express adult-like firing patterns already on the first exposure to an open spatial environment, only days after eye opening, grid cells mature more slowly, over a 1-to-2-wk period after the animals leave their nest. Whether the later emergence of a periodic grid pattern reflects a need for experience with spatial environments has not been determined. We here show that grid-like firing patterns continue to appear during exploration of open square environments in rats that are raised for the first months of their life in opaque spherical environments, in the absence of stable reference boundaries to guide spatial orientation. While strictly periodic firing fields were initially absent in these animals, clear grid patterns developed after only a few trials of training. In rats that were tested in the same open environment but raised for the first months of life in opaque cubes, with sharp vertical boundaries, grid-like firing was from the beginning indistinguishable from that of nondeprived control animals growing up in large enriched cages. Thus, although a minimum of experience with peripheral geometric boundaries is required for expression of regular grid patterns in a new environment, the effect of restricted spatial experience is overcome with short training, consistent with a preconfigured experience-independent basis for the grid pattern.

Developmentally Unique Cerebellar Processing Prioritizes Self- over Other-Generated Movements.

Animals must distinguish the sensory consequences of self-generated movements (reafference) from those of other-generated movements (exafference). Only self-generated movements entail the production of motor copies (i.e., corollary discharges), which are compared with reafference in the cerebellum to compute predictive or internal models of movement. Internal models emerge gradually over the first three postnatal weeks in rats through a process that is not yet fully understood. Previously, we demonstrated in postnatal day (P) 8 and P12 rats that precerebellar nuclei convey corollary discharge and reafference to the cerebellum during active (REM) sleep when pups produce limb twitches. Here, recording from a deep cerebellar nucleus (interpositus, IP) in P12 rats of both sexes, we compared reafferent and exafferent responses with twitches and limb stimulations, respectively. As expected, most IP units showed robust responses to twitches. However, in contrast with other sensory structures throughout the brain, relatively few IP units showed exafferent responses. Upon finding that exafferent responses occurred in pups under urethane anesthesia, we hypothesized that urethane inhibits cerebellar cortical cells, thereby disinhibiting exafferent responses in IP. In support of this hypothesis, ablating cortical tissue dorsal to IP mimicked the effects of urethane on exafference. Finally, the results suggest that twitch-related corollary discharge and reafference are conveyed simultaneously and in parallel to cerebellar cortex and IP. Based on these results, we propose that twitches provide opportunities for the nascent cerebellum to integrate somatotopically organized corollary discharge and reafference, thereby enabling the development of closed-loop circuits and, subsequently, internal models.