Fear Extinction Requires Reward.

Learning theorists long hypothesized that appetitive and aversive motivational states influence one another antagonistically. Here, Felsenberg et al. show that the activity of neurons in Drosophila known to be important in appetitive conditioning is necessary for the extinction of aversive conditioning, thereby uncovering biological evidence for this opponent-process.

Memory Allocation: Mechanisms and Function.

Memories for events are thought to be represented in sparse, distributed neuronal ensembles (or engrams). In this article, we review how neurons are chosen to become part of a particular engram, via a process of neuronal allocation. Experiments in rodents indicate that eligible neurons compete for allocation to a given engram, with more excitable neurons winning this competition. Moreover, fluctuations in neuronal excitability determine how engrams interact, promoting either memory integration (via coallocation to overlapping engrams) or separation (via disallocation to nonoverlapping engrams). In parallel with rodent studies, recent findings in humans verify the importance of this memory integration process for linking memories that occur close in time or share related content. A deeper understanding of allocation promises to provide insights into the logic underlying how knowledge is normally organized in the brain and the disorders in which this process has gone awry.

Reflections on the past two decades of neuroscience.

The first issue of Nature Reviews Neuroscience was published 20 years ago, in 2000. To mark this anniversary, in this Viewpoint article we asked a selection of researchers from across the field who have authored pieces published in the journal in recent years for their thoughts on notable and interesting developments in neuroscience, and particularly in their areas of the field, over the past two decades. They also provide some thoughts on current lines of research and questions that excite them.

Neurogenesis-dependent remodeling of hippocampal circuits reduces PTSD-like behaviors in adult mice.

Post-traumatic stress disorder (PTSD) is a hypermnesic condition that develops in a subset of individuals following exposure to severe trauma. PTSD symptoms are debilitating, and include increased anxiety, abnormal threat generalization, and impaired extinction. In developing treatment strategies for PTSD, preclinical studies in rodents have largely focused on interventions that target post-encoding memory processes such as reconsolidation and extinction. Instead, here we focus on forgetting, another post-encoding process that regulates memory expression. Using a double trauma murine model for PTSD, we asked whether promoting neurogenesis-mediated forgetting can weaken trauma memories and associated PTSD-relevant behavioral phenotypes. In the double trauma paradigm, consecutive aversive experiences lead to a constellation of behavioral phenotypes associated with PTSD including increases in anxiety-like behavior, abnormal threat generalization, and deficient extinction. We found that post-training interventions that elevate hippocampal neurogenesis weakened the original trauma memory and decreased these PTSD-relevant phenotypes. These effects were observed using multiple methods to manipulate hippocampal neurogenesis, including interventions restricted to neural progenitor cells that selectively promoted integration of adult-generated granule cells into hippocampal circuits. The same interventions also weakened cocaine place preference memories, suggesting that promoting hippocampal neurogenesis may represent a broadly useful approach in hypermnesic conditions such as PTSD and substance abuse disorders.

Adult neurogenesis acts as a neural regularizer.

New neurons are continuously generated in the subgranular zone of the dentate gyrus throughout adulthood. These new neurons gradually integrate into hippocampal circuits, forming new naive synapses. Viewed from this perspective, these new neurons may represent a significant source of "wiring" noise in hippocampal networks. In machine learning, such noise injection is commonly used as a regularization technique. Regularization techniques help prevent overfitting training data and allow models to generalize learning to new, unseen data. Using a computational modeling approach, here we ask whether a neurogenesis-like process similarly acts as a regularizer, facilitating generalization in a category learning task. In a convolutional neural network (CNN) trained on the CIFAR-10 object recognition dataset, we modeled neurogenesis as a replacement/turnover mechanism, where weights for a randomly chosen small subset of hidden layer neurons were reinitialized to new values as the model learned to categorize 10 different classes of objects. We found that neurogenesis enhanced generalization on unseen test data compared to networks with no neurogenesis. Moreover, neurogenic networks either outperformed or performed similarly to networks with conventional noise injection (i.e., dropout, weight decay, and neural noise). These results suggest that neurogenesis can enhance generalization in hippocampal learning through noise injection, expanding on the roles that neurogenesis may have in cognition.

Upregulation of Anandamide Hydrolysis in the Basolateral Complex of Amygdala Reduces Fear Memory Expression and Indices of Stress and Anxiety.

Increased anandamide (AEA) signaling through inhibition of its catabolic enzyme fatty acid amide hydrolase (FAAH) in the basolateral complex of amygdala (BLA) is thought to buffer against the effects of stress and reduces behavioral signs of anxiety and fear. However, examining the role of AEA signaling in stress, anxiety, and fear through pharmacological depletion has been challenging due to the redundant complexity of its biosynthesis and the lack of a pharmacological synthesis inhibitor. We developed a herpes simplex viral vector to rapidly yet transiently overexpress FAAH specifically within the BLA to assess the impact of suppressing AEA signaling on stress, fear, and anxiety in male rats. Surprisingly, FAAH overexpression in BLA dampened stress-induced corticosterone release, reduced anxiety-like behaviors, and decreased conditioned fear expression. Interestingly, depleting AEA signaling in the BLA did not prevent fear conditioning itself or fear reinstatement. These effects were specific to the overexpression of FAAH because they were reversed by intra-BLA administration of an FAAH inhibitor. Moreover, the fear-suppressive effects of FAAH overexpression were also mitigated by intra-BLA administration of a low dose of a GABAA receptor antagonist, but not an NMDA/AMPA/kainate receptor antagonist, suggesting that they were mediated by an increase in GABAergic neurotransmission. Our data suggest that a permissive AEA tone within the BLA might gate GABA release and that loss of this tone through elevated AEA hydrolysis increases inhibition in the BLA, which in turn reduces stress, anxiety, and fear. These data provide new insights on the mechanisms by which amygdalar endocannabinoid signaling regulates emotional behavior.SIGNIFICANCE STATEMENT Amygdala endocannabinoid signaling is involved in the regulation of stress, anxiety, and fear. Our data indicate that viral-mediated augmentation of anandamide hydrolysis within the basolateral amygdala reduces behavioral indices of stress, anxiety, and conditioned fear expression. These same effects have been previously documented with inhibition of anandamide hydrolysis in the same brain region. Our results indicate that the ability of anandamide signaling to regulate emotional behavior is nonlinear and may involve actions at distinct neuronal populations, which could be influenced by the basal level of anandamide. Modulation of anandamide signaling is a current clinical therapeutic target for stress-related psychiatric illnesses, so these data underscore the importance of fully understanding the mechanisms by which anandamide signaling regulates amygdala-dependent changes in emotionality.

The role of neuronal excitability, allocation to an engram and memory linking in the behavioral generation of a false memory in mice.

Memory is a constructive, not reproductive, process that is prone to errors. Errors in memory, though, may originate from normally adaptive memory processes. At the extreme of memory distortion is falsely "remembering" an event that did not occur. False memories are well-studied in cognitive psychology, but have received relatively less attention in neuroscience. Here, we took advantage of mechanistic insights into how neurons are allocated or recruited into an engram (memory trace) to generate a false memory in mice using only behavioral manipulations. At the time of an event, neurons compete for allocation to an engram supporting the memory for this event; neurons with higher excitability win this competition (Han et al., 2007). Even after the event, these allocated "engram neurons" remain temporarily (~6 h) more excitable than neighboring neurons. Should a similar event occur in this 6 h period of heightened engram neuron excitability, an overlapping population of neurons will be co-allocated to this second engram, which serves to functionally link the two memories (Rashid et al., 2016). Here, we applied this principle of co-allocation and found that mice develop a false fear memory to a neutral stimulus if exposed to this stimulus shortly (3 h), but not a longer time (24 h), after cued fear conditioning. Similar to co-allocation, the generation of this false memory depended on the post-training excitability of engram neurons such that these neurons remained more excitable during exposure to the neutral stimulus at 3 h but not 24 h. Optogenetically silencing engram neurons 3 h after cued fear conditioning impaired formation of a false fear memory to the neutral stimulus, while optogenetically activating engram neurons 24 h after cued fear conditioning created a false fear memory. These results suggest that some false memories may originate from normally adaptive mnemonic processes such as neuronal excitability-dependent allocation and memory linking.

Finding the engram.

Many attempts have been made to localize the physical trace of a memory, or engram, in the brain. However, until recently, engrams have remained largely elusive. In this Review, we develop four defining criteria that enable us to critically assess the recent progress that has been made towards finding the engram. Recent 'capture' studies use novel approaches to tag populations of neurons that are active during memory encoding, thereby allowing these engram-associated neurons to be manipulated at later times. We propose that findings from these capture studies represent considerable progress in allowing us to observe, erase and express the engram.

FoxO6 regulates memory consolidation and synaptic function.

The FoxO family of transcription factors is known to slow aging downstream from the insulin/IGF (insulin-like growth factor) signaling pathway. The most recently discovered FoxO isoform in mammals, FoxO6, is highly enriched in the adult hippocampus. However, the importance of FoxO factors in cognition is largely unknown. Here we generated mice lacking FoxO6 and found that these mice display normal learning but impaired memory consolidation in contextual fear conditioning and novel object recognition. Using stereotactic injection of viruses into the hippocampus of adult wild-type mice, we found that FoxO6 activity in the adult hippocampus is required for memory consolidation. Genome-wide approaches revealed that FoxO6 regulates a program of genes involved in synaptic function upon learning in the hippocampus. Consistently, FoxO6 deficiency results in decreased dendritic spine density in hippocampal neurons in vitro and in vivo. Thus, FoxO6 may promote memory consolidation by regulating a program coordinating neuronal connectivity in the hippocampus, which could have important implications for physiological and pathological age-dependent decline in memory.

Elevation of Hippocampal Neurogenesis Induces a Temporally Graded Pattern of Forgetting of Contextual Fear Memories.

Throughout life neurons are continuously generated in the subgranular zone of the hippocampus. The subsequent integration of newly generated neurons alters patterns of dentate gyrus input and output connectivity, potentially rendering memories already stored in those circuits harder to access. Consistent with this prediction, we previously showed that increasing hippocampal neurogenesis after training induces forgetting of hippocampus-dependent memories, including contextual fear memory. However, the brain regions supporting contextual fear memories change with time, and this time-dependent memory reorganization might regulate the sensitivity of contextual fear memories to fluctuations in hippocampal neurogenesis. By virally expressing the inhibitory designer receptor exclusively activated by designer drugs, hM4Di, we first confirmed that chemogenetic inhibition of dorsal hippocampal neurons impairs retrieval of recent (day-old) but not remote (month-old) contextual fear memories in male mice. We then contrasted the effects of increasing hippocampal neurogenesis at recent versus remote time points after contextual fear conditioning in male and female mice. Increasing hippocampal neurogenesis immediately following training reduced conditioned freezing when mice were replaced in the context 1 month later. In contrast, when hippocampal neurogenesis was increased time points remote to training, conditioned freezing levels were unaltered when mice were subsequently tested. These temporally graded forgetting effects were observed using both environmental and genetic interventions to increase hippocampal neurogenesis. Our experiments identify memory age as a boundary condition for neurogenesis-mediated forgetting and suggest that, as contextual fear memories mature, they become less sensitive to changes in hippocampal neurogenesis levels because they no longer depend on the hippocampus for their expression.SIGNIFICANCE STATEMENT New neurons are generated in the hippocampus throughout life. As they integrate into the hippocampus, they remodel neural circuitry, potentially making information stored in those circuits harder to access. Consistent with this, increasing hippocampal neurogenesis after learning induces forgetting of the learnt information. The current study in mice asks whether these forgetting effects depend on the age of the memory. We found that post-training increases in hippocampal neurogenesis only impacted recently acquired, and not remotely acquired, hippocampal memories. These experiments identify memory age as a boundary condition for neurogenesis-mediated forgetting, and suggest remote memories are less sensitive to changes in hippocampal neurogenesis levels because they no longer depend critically on the hippocampus for their expression.

Impaired Recent, but Preserved Remote, Autobiographical Memory in Pediatric Brain Tumor Patients.

Medulloblastomas, the most common malignant brain tumor in children, are typically treated with radiotherapy. Refinement of this treatment has greatly improved survival rates in this patient population. However, radiotherapy also profoundly affects the developing brain and is associated with reduced hippocampal volume and blunted hippocampal neurogenesis. Such hippocampal (as well as extrahippocampal) abnormalities likely contribute to cognitive impairments in this population. While several aspects of memory have been examined in this population, the impact of radiotherapy on autobiographical memory has not previously been evaluated. Here we evaluated autobiographical memory in male and female patients who received radiotherapy for posterior fossa tumors (PFTs), including medulloblastoma, during childhood. Using the Children's Autobiographical Interview, we retrospectively assessed episodic and nonepisodic details for events that either preceded (i.e., remote) or followed (i.e., recent) treatment. For post-treatment events, PFT patients reported fewer episodic details compared with control subjects. For pretreatment events, PFT patients reported equivalent episodic details compared with control subjects. In a range of conditions associated with reduced hippocampal volume (including medial temporal lobe amnesia, mild cognitive impairment, Alzheimer's disease, temporal lobe epilepsy, transient epileptic amnesia, frontal temporal dementia, traumatic brain injury, encephalitis, and aging), loss of episodic details (even in remote memories) accompanies hippocampal volume loss. It is therefore surprising that pretreatment episodic memories in PFT patients with reduced hippocampal volume are retained. We discuss these findings in light of the anterograde and retrograde impact on memory of experimentally suppressing hippocampal neurogenesis in rodents.SIGNIFICANCE STATEMENT Pediatric medulloblastoma survivors develop cognitive dysfunction following cranial radiotherapy treatment. We report that radiotherapy treatment impairs the ability to form new autobiographical memories, but spares preoperatively acquired autobiographical memories. Reductions in hippocampal volume and cortical volume in regions of the recollection network appear to contribute to this pattern of preserved preoperative, but impaired postoperative, memory. These findings have significant implications for understanding disrupted mnemonic processing in the medial temporal lobe memory system and in the broader recollection network, which are inadvertently affected by standard treatment methods for medulloblastoma tumors in children.

Structural foundations of optogenetics: Determinants of channelrhodopsin ion selectivity.

The structure-guided design of chloride-conducting channelrhodopsins has illuminated mechanisms underlying ion selectivity of this remarkable family of light-activated ion channels. The first generation of chloride-conducting channelrhodopsins, guided in part by development of a structure-informed electrostatic model for pore selectivity, included both the introduction of amino acids with positively charged side chains into the ion conduction pathway and the removal of residues hypothesized to support negatively charged binding sites for cations. Engineered channels indeed became chloride selective, reversing near -65 mV and enabling a new kind of optogenetic inhibition; however, these first-generation chloride-conducting channels displayed small photocurrents and were not tested for optogenetic inhibition of behavior. Here we report the validation and further development of the channelrhodopsin pore model via crystal structure-guided engineering of next-generation light-activated chloride channels (iC++) and a bistable variant (SwiChR++) with net photocurrents increased more than 15-fold under physiological conditions, reversal potential further decreased by another ∼ 15 mV, inhibition of spiking faithfully tracking chloride gradients and intrinsic cell properties, strong expression in vivo, and the initial microbial opsin channel-inhibitor-based control of freely moving behavior. We further show that inhibition by light-gated chloride channels is mediated mainly by shunting effects, which exert optogenetic control much more efficiently than the hyperpolarization induced by light-activated chloride pumps. The design and functional features of these next-generation chloride-conducting channelrhodopsins provide both chronic and acute timescale tools for reversible optogenetic inhibition, confirm fundamental predictions of the ion selectivity model, and further elucidate electrostatic and steric structure-function relationships of the light-gated pore.

Heroes of the Engram.

In 1904, Richard Semon introduced the term "engram" to describe the neural substrate responsible for (or at least important in) storing and recalling memories (i.e., a memory trace). The recent introduction of a vast array of powerful new tools to probe and manipulate memory function at the cell and neuronal circuit level has spurred an explosion of interest in studying the engram. However, the present "engram renaissance" was not borne in isolation but rather builds on a long tradition of memory research. We believe it is important to acknowledge the debts our current generation of scientists owes to those scientists who have offered key ideas, persevered through failed experiments and made important discoveries before us. Examining the past can also offer a fresh perspective on the present state and future promise of the field. Given the large amount of empirical advances made in recent years, it seems particularly timely to look back and review the scientists who introduced the seminal terminology, concepts, methodological approaches, and initial data pertaining to engrams. Rather than simply list their many accomplishments, here we color in some details of the lives and milestone contributions of our seven personal heroes of the engram (Richard Semon, Karl Lashley, Donald Hebb, Wilder Penfield, Brenda Milner, James McConnell, and Richard Thompson). In reviewing their historic role, we also illustrate how their work remains relevant to today's studies.

Contextual fear conditioning in zebrafish.

Zebrafish are a genetically tractable vertebrate that hold considerable promise for elucidating the molecular basis of behavior. Although numerous recent advances have been made in the ability to precisely manipulate the zebrafish genome, much less is known about many aspects of learning and memory in adult fish. Here, we describe the development of a contextual fear conditioning paradigm using an electric shock as the aversive stimulus. We find that contextual fear conditioning is modulated by shock intensity, prevented by an established amnestic agent (MK-801), lasts at least 14 d, and exhibits extinction. Furthermore, fish of various background strains (AB, Tu, and TL) are able to acquire fear conditioning, but differ in fear extinction rates. Taken together, we find that contextual fear conditioning in zebrafish shares many similarities with the widely used contextual fear conditioning paradigm in rodents. Combined with the amenability of genetic manipulation in zebrafish, we anticipate that our paradigm will prove to be a useful complementary system in which to examine the molecular basis of vertebrate learning and memory.

Age-dependent changes in spatial memory retention and flexibility in mice.

In humans, memories for events happening early in life are forgotten more rapidly than those for events later in life. This form of accelerated forgetting in infancy is also observed in non-human species, and has been most extensively characterized in rats. Here we expand the characterization of infantile forgetting to mice, a species where a broader range of genetic tools can be used to understand the neurobiological mechanisms underlying this form of forgetting. Using a hidden platform version of the water maze task, we first assessed retention in mice that ranged in age from 15 to 150days-old at the beginning of training. All groups exhibited spatial memory when tested one day after training. However, only mice that were 20days or older at the time of training could remember one month later. Second, forgetting in younger cohorts of mice was not due to weaker encoding, since when younger mice were over-trained, such that their performance exceeded that of adult mice, they still exhibited forgetting. Third, in young mice, presentation of a reminder one month following training led to memory recovery, indicating that forgetting was due to a retrieval, rather than storage, deficit. Fourth, younger mice exhibited superior reversal learning compared to older mice, raising the possibility that a by-product of infantile forgetting might be greater flexibility.

Development of Adult-Generated Cell Connectivity with Excitatory and Inhibitory Cell Populations in the Hippocampus.

New neurons are generated continuously in the subgranular zone of the hippocampus and integrate into existing hippocampal circuits throughout adulthood. Although the addition of these new neurons may facilitate the formation of new memories, as they integrate, they provide additional excitatory drive to CA3 pyramidal neurons. During development, to maintain homeostasis, new neurons form preferential contacts with local inhibitory circuits. Using retroviral and transgenic approaches to label adult-generated granule cells, we first asked whether a comparable process occurs in the adult hippocampus in mice. Similar to development, we found that, during adulthood, new neurons form connections with inhibitory cells in the dentate gyrus, hilus, and CA3 regions as they integrate into hippocampal circuits. In particular, en passant bouton and filopodia connections with CA3 interneurons peak when adult-generated dentate granule cells (DGCs) are ∼4 weeks of age, a time point when these cells are most excitable. Consistent with this, optical stimulation of 4-week-old (but not 6- or 8-week-old) adult-generated DGCs strongly activated CA3 interneurons. Finally, we found that CA3 interneurons were activated robustly during learning and that their activity was strongly coupled with activity of 4-week-old (but not older) adult-generated DGCs. These data indicate that, as adult-generated neurons integrate into hippocampal circuits, they transiently form strong anatomical, effective, and functional connections with local inhibitory circuits in CA3. Significance statement: New neurons are generated continuously in the subgranular zone of the hippocampus and integrate into existing hippocampal circuits throughout adulthood. Understanding how these cells integrate within well formed circuits will increase our knowledge about the basic principles governing circuit assembly in the adult hippocampus. This study uses a combined connectivity analysis (anatomical, functional, and effective) of the output connections of adult-born hippocampal cells to show that, as these cells integrate into hippocampal circuits, they transiently form strong connections with local inhibitory circuits. This transient increase of connectivity may represent an homeostatic process necessary to accommodate changes in the excitation/inhibition balance induced by the addition of these new excitatory cells to the preexisting excitatory hippocampal circuits.

Parvalbumin interneurons constrain the size of the lateral amygdala engram.

Memories are thought to be represented by discrete physiological changes in the brain, collectively referred to as an engram, that allow patterns of activity present during learning to be reactivated in the future. During the formation of a conditioned fear memory, a subset of principal (excitatory) neurons in the lateral amygdala (LA) are allocated to a neuronal ensemble that encodes an association between an initially neutral stimulus and a threatening aversive stimulus. Previous experimental and computational work suggests that this subset consists of only a small proportion of all LA neurons, and that this proportion remains constant across different memories. Here we examine the mechanisms that contribute to the stability of the size of the LA component of an engram supporting a fear memory. Visualizing expression of the activity-dependent gene Arc following memory retrieval to identify neurons allocated to an engram, we first show that the overall size of the LA engram remains constant across conditions of different memory strength. That is, the strength of a memory was not correlated with the number of LA neurons allocated to the engram supporting that memory. We then examine potential mechanisms constraining the size of the LA engram by expressing inhibitory DREADDS (designer receptors exclusively activated by designer drugs) in parvalbumin-positive (PV+) interneurons of the amygdala. We find that silencing PV+ neurons during conditioning increases the size of the engram, especially in the dorsal subnucleus of the LA. These results confirm predictions from modeling studies regarding the role of inhibition in shaping the size of neuronal memory ensembles and provide additional support for the idea that neurons in the LA are sparsely allocated to the engram based on relative neuronal excitability.

Basal variability in CREB phosphorylation predicts trait-like differences in amygdala-dependent memory.

Much of what is known about the neurobiology of learning and memory comes from studies of the average behavior. In contrast, intersubject differences that emerge within groups are difficult to study systematically and are often excluded from scientific discussion. Nevertheless, population-wide variability is a virtually universal feature of both complex traits, such as intelligence, and hardwired responses, such as defensive behaviors. Here, we use outbred rats to investigate if cAMP response element-binding protein (CREB), a transcription factor that has long been known in experimental settings to be crucial for associative plasticity, participates in natural memory phenotypes. Using a combination of behavioral, biochemical, and viral techniques, we show that a subset of rats with trait-like deficits in aversive memory have basally reduced CREB activity in the lateral amygdala but can be induced to perform at average levels by directly or indirectly enhancing pretraining CREB phosphorylation. These data suggest that endogenous CREB activity in the amygdala may set a critical threshold for plasticity during memory formation.