OFC neurons do not represent the negative value of a conditioned inhibitor.

The orbitofrontal cortex (OFC) is often proposed to function as a value integrator; however, alternative accounts focus on its role in representing associative structures that specify the probability and sensory identity of future outcomes. These two accounts make different predictions about how this area should respond to conditioned inhibitors of reward, since in the former, neural activity should reflect the negative value of the inhibitor, whereas in the latter, it should track the estimated probability of a future reward based on all cues present. Here, we assessed these predictions by recording from small groups of neurons in the lateral OFC of rats during training in a conditioned inhibition design. Rats showed negative summation when the inhibitor was compounded with a novel excitor, suggesting that they learned to respond to the conditioned inhibitor appropriately. Against this backdrop, we found unit and population responses that scaled with expected reward value on excitor + inhibitor compound trials. However, the responses of these neurons did not differentiate between the conditioned inhibitor and a neutral cue when both were presented in isolation. Further, when the ensemble patterns were analyzed, activity to the conditioned inhibitor did not classify according to putative negative value. Instead, it classified with a same-modality neutral cue when presented alone and as a unique item when presented in compound with a novel excitor. This pattern of results supports the notion that OFC encodes a model of the causal structure of the environment rather than either the modality or the value of cues.

Dissociation of Appetitive Overexpectation and Extinction in the Infralimbic Cortex.

Behavioral change is paramount to adaptive behavior. Two ways to achieve alterations in previously established behavior are extinction and overexpectation. The infralimbic (IL) portion of the medial prefrontal cortex controls the inhibition of previously established aversive behavioral responses in extinction. The role of the IL cortex in behavioral modification in appetitive Pavlovian associations remains poorly understood. Here, we seek to determine if the IL cortex modulates overexpectation and extinction of reward learning. Using overexpectation or extinction to achieve a reduction in behavior, the present findings uncover a dissociable role for the IL cortex in these paradigms. Pharmacologically inactivating the IL cortex left overexpectation intact. In contrast, pre-training manipulations in the IL cortex prior to extinction facilitated the reduction in conditioned responding but led to a disrupted extinction retrieval on test drug-free. Additional studies confirmed that this effect is restricted to the IL and not dependent on the dorsally-located prelimbic cortex. Together, these results show that the IL cortex underlies extinction but not overexpectation-driven reduction in behavior, which may be due to regulating the expression of conditioned responses influenced by stimulus-response associations rather than stimulus-stimulus associations.

Thought control with the dopamine transient.

Fine-tuning and coordinating neural activity is essential for an efficient brain. Athalye and colleagues (2018) provide important evidence that neural patterns can be streamlined by inducing dopamine transients.

Associative structures in animal learning: dissociating elemental and configural processes.

The central concern of associative learning theory is to provide an account of behavioral adaptation that is parsimonious in addressing three key questions: (1) under what conditions does learning occur, (2) what are the associative structures involved, and (3) how do these affect behavior? The principle focus here is on the second question, concerning associative structures, but we will have cause to touch on the others in passing. This question is one that has exercised theorists since Pavlov's descriptions of the conditioning process, where he identifies the shared significance of the study of conditioned reflexes for psychologists and neuroscientists alike.

Persistent disruption of overexpectation learning after inactivation of the lateral orbitofrontal cortex in male rats.

RATIONALE AND OBJECTIVE: Learning to inhibit acquired fear responses is fundamental to adaptive behavior. Two procedures that support such learning are extinction and overexpectation. In extinction, an expected outcome is omitted, whereas in overexpectation two individually trained cues are presented in compound to induce an expectation of a greater outcome than that delivered. Previously, we showed that inactivation of the lateral orbitofrontal cortex (lOFC) in experimentally naïve male rats causes a mild impairment in extinction learning but a profound one in overexpectation. The mild extinction impairment was also transient; that is, it was absent in a cohort of rats that had prior history of inhibitory training (overexpectation, extinction) and their associated controls. This raised the question whether lOFC involvement in overexpectation could likewise be attenuated by prior experience. METHODS: Using a muscimol/baclofen cocktail, we inactivated the lOFC during overexpectation training in rats with prior associative learning history (extinction, overexpectation, control) and examined its contribution to reducing learned fear. RESULTS: Inactivating the lOFC during compound training in overexpectation persistently disrupted fear reduction on test in naïve rats and regardless of prior experience. Additionally, we confirm that silencing the lOFC only resulted in a mild impairment in extinction learning in naïve rats. CONCLUSION: We show that prior associative learning experience did not mitigate the deficit in overexpectation caused by lOFC inactivation. Our findings emphasize the importance of this region for this particular form of fear reduction and broaden our understanding of the conditions in which the lOFC modulates behavioral inhibition.

The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression.

BACKGROUND: Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation. METHODS: We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval. RESULTS: CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning. CONCLUSIONS: We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

Parvalbumin interneuron loss mediates repeated anesthesia-induced memory deficits in mice.

Repeated or prolonged, but not short-term, general anesthesia during the early postnatal period causes long-lasting impairments in memory formation in various species. The mechanisms underlying long-lasting impairment in cognitive function are poorly understood. Here, we show that repeated general anesthesia in postnatal mice induces preferential apoptosis and subsequent loss of parvalbumin-positive inhibitory interneurons in the hippocampus. Each parvalbumin interneuron controls the activity of multiple pyramidal excitatory neurons, thereby regulating neuronal circuits and memory consolidation. Preventing the loss of parvalbumin neurons by deleting a proapoptotic protein, mitochondrial anchored protein ligase (MAPL), selectively in parvalbumin neurons rescued anesthesia-induced deficits in pyramidal cell inhibition and hippocampus-dependent long-term memory. Conversely, partial depletion of parvalbumin neurons in neonates was sufficient to engender long-lasting memory impairment. Thus, loss of parvalbumin interneurons in postnatal mice following repeated general anesthesia critically contributes to memory deficits in adulthood.

Retrieval-mediated learning involving episodes requires synaptic plasticity in the hippocampus.

A novel association can form between two memories even when the events to which they correspond are not physically present. For example, once an integrated memory has formed that binds the (when, where, and what) components of an event together, this memory can be triggered by one of its components, and updated with coincident information in the environment. The neural basis of this form of retrieval-mediated learning is unknown. Here, we show, for the first time, that NMDA receptors in the rat hippocampus are required for retrieval-mediated learning involving episodes, but not for the expression of such learning or for retrieval-mediated learning involving simple associations between the components of episodes. These findings provide a novel insight into learning processes that serve the desirable function of integrating stored information with new information, but whose operation might also provide a substrate for some of the cognitive symptoms of schizophrenia and Alzheimer's disease.

Separate but interacting recognition memory systems for different senses: the role of the rat perirhinal cortex.

Two different models (convergent and parallel) potentially describe how recognition memory, the ability to detect the re-occurrence of a stimulus, is organized across different senses. To contrast these two models, rats with or without perirhinal cortex lesions were compared across various conditions that controlled available information from specific sensory modalities. Intact rats not only showed visual, tactile, and olfactory recognition, but also overcame changes in the types of sensory information available between object sampling and subsequent object recognition, e.g., between sampling in the light and recognition in the dark, or vice versa. Perirhinal lesions severely impaired object recognition whenever visual cues were available, but spared olfactory recognition and tactile-based object recognition when tested in the dark. The perirhinal lesions also blocked the ability to recognize an object sampled in the light and then tested for recognition in the dark, or vice versa. The findings reveal parallel recognition systems for different senses reliant on distinct brain areas, e.g., perirhinal cortex for vision, but also show that: (1) recognition memory for multisensory stimuli involves competition between sensory systems and (2) perirhinal cortex lesions produce a bias to rely on vision, despite the presence of intact recognition memory systems serving other senses.

Understanding Associative Learning Through Higher-Order Conditioning.

Associative learning is often considered to require the physical presence of stimuli in the environment in order for them to be linked. This, however, is not a necessary condition for learning. Indeed, associative relationships can form between events that are never directly paired. That is, associative learning can occur by integrating information across different phases of training. Higher-order conditioning provides evidence for such learning through two deceptively similar designs - sensory preconditioning and second-order conditioning. In this review, we detail the procedures and factors that influence learning in these designs, describe the associative relationships that can be acquired, and argue for the importance of this knowledge in studying brain function.

Peer review without gatekeeping.

eLife is changing its editorial process to emphasize public reviews and assessments of preprints by eliminating accept/reject decisions after peer review.

Perirhinal cortex lesions uncover subsidiary systems in the rat for the detection of novel and familiar objects.

The present study compared the impact of perirhinal cortex lesions on tests of object recognition. Object recognition was tested directly by looking at the preferential exploration of novel objects over simultaneously presented familiar objects. Object recognition was also tested indirectly by presenting just novel objects or just familiar objects, and recording exploration levels. Rats with perirhinal cortex lesions were severely impaired at discriminating a novel object from a simultaneously presented familiar object (direct test), yet displayed normal levels of exploration to novel objects presented on their own and showed normal declines in exploration times for familiar objects that were repeatedly presented (indirect tests). This effective reduction in the exploration of familiar objects after perirhinal cortex lesions points to the sparing of some recognition mechanisms. This possibility led us to determine whether rats with perirhinal cortex lesions can overcome their preferential exploration deficits when given multiple object familiarisation trials prior to that same (familiar) object being paired with a novel object. It was found that after multiple familiarisation trials, objects could now successfully be recognised as familiar by rats with perirhinal cortex lesions, both following a 90-min delay (the longest delay tested) and when object recognition was tested in the dark after familiarisation trials in the light. These latter findings reveal: (i) the presumed recruitment of other regions to solve recognition memory problems in the absence of perirhinal cortex tissue; and (ii) that these additional recognition mechanisms require more familiarisation trials than perirhinal-based recognition mechanisms.

New behavioral protocols to extend our knowledge of rodent object recognition memory.

Animals often show an innate preference for novelty. This preference facilitates spontaneous exploration tasks of novelty discrimination (recognition memory). In response to limitations with standard spontaneous object recognition procedures for rodents, a new task ("bow-tie maze") was devised. This task combines features of delayed nonmatching-to-sample with spontaneous exploration. The present study explored aspects of object recognition in the bow-tie maze not amenable to standard procedures. Two rat strains (Lister Hooded, Dark Agouti) displayed very reliable object recognition in both the light and dark, with the Lister Hooded strain showing superior performance (Experiment 1). These findings reveal the potential contribution of tactile and odor cues in object recognition. As the bow-tie maze task permits multiple trials within a session, it was possible to derive forgetting curves both within-session and between-sessions (Experiment 1). In Experiment 2, rats with hippocampal or fornix lesions performed at normal levels on the basic version of the recognition task, contrasting with the marked deficits previously seen after perirhinal cortex lesions. Next, the training protocol was adapted (Experiment 3), and this modified version was used successfully with mice (Experiment 4). The overall findings demonstrate the efficacy of this new behavioral task and advance our understanding of object recognition.

Threat perception: Fear and the retrorubal field.

A new study has found that neurons within a structure of the rat midbrain known as the retrorubral field show diverse responses to stimuli that signal different levels of threat, as well as a separate pattern of diverse responses to differentially predicted aversive outcomes.

Mechanisms of higher-order learning in the amygdala.

Adaptive behaviour is under the potent control of environmental cues. Such cues can acquire value by virtue of their associations with outcomes of motivational significance, be they appetitive or aversive. There are at least two ways through which an environmental cue can acquire value, through first-order and higher-order conditioning. In first-order conditioning, a neutral cue is directly paired with an outcome of motivational significance. In higher-order conditioning, a cue is indirectly associated with motivational events via a directly conditioned first-order stimulus. The present article reviews some of the associations that support learning in first- and higher-order conditioning, as well as the role of the BLA and the molecular mechanisms involved in these two types of learning.

Adaptive behaviour under conflict: Deconstructing extinction, reversal, and active avoidance learning.

In complex environments, organisms must respond adaptively to situations despite conflicting information. Under natural (i.e. non-laboratory) circumstances, it is rare that cues or responses are consistently paired with a single outcome. Inconsistent pairings are more common, as are situations where cues and responses are associated with multiple outcomes. Such inconsistency creates conflict, and a response that is adaptive in one scenario may not be adaptive in another. Learning to adjust responses accordingly is important for species to survive and prosper. Here we review the behavioural and brain mechanisms of responding under conflict by focusing on three popular behavioural procedures: extinction, reversal learning, and active avoidance. Extinction involves adapting from reinforcement to non-reinforcement, reversal learning involves swapping the reinforcement of cues or responses, and active avoidance involves performing a response to avoid an aversive outcome, which may conflict with other defensive strategies. We note that each of these phenomena relies on somewhat overlapping neural circuits, suggesting that such circuits may be critical for the general ability to respond appropriately under conflict.

Neural substrates of appetitive and aversive prediction error.

Prediction error, defined by the discrepancy between real and expected outcomes, lies at the core of associative learning. Behavioural investigations have provided evidence that prediction error up- and down-regulates associative relationships, and allocates attention to stimuli to enable learning. These behavioural advances have recently been followed by investigations into the neurobiological substrates of prediction error. In the present paper, we review neuroscience data obtained using causal and recording neural methods from a variety of key behavioural designs. We explore the neurobiology of both appetitive (reward) and aversive (fear) prediction error with a focus on the mesolimbic dopamine system, the amygdala, ventrolateral periaqueductal gray, hippocampus, cortex and locus coeruleus noradrenaline. New questions and avenues for research are considered.

Agency rescues competition for credit assignment among predictive cues from adverse learning conditions.

A fundamental assumption of learning theories is that the credit assigned to predictive cues is not simply determined by their probability of reinforcement, but by their ability to compete with other cues present during learning. This assumption has guided behavioral and neural science research for decades, and tremendous empirical and theoretical advances have been made identifying the mechanisms of cue competition. However, when learning conditions are not optimal (e.g., when training is massed), cue competition is attenuated. This failure of the learning system exposes the individual's vulnerability to form spurious associations in the real world. Here, we uncover that cue competition in rats can be rescued when conditions are suboptimal provided that the individual has agency over the learning experience. Our findings reveal a new effect of agency over learning on credit assignment among predictive cues, and open new avenues of investigation into the underlying mechanisms.

Female rats take longer than male rats to update reward expectancies when outcomes are worse than expected.

The ability to update predictive relationships and adjust behavior accordingly is critical for survival. Females take longer to update expectancies under conditions of outcome omission. It remains unknown whether that is also the case under conditions when outcomes are delivered such as in overexpectation. Here we examined whether male and female rats are able to learn from overexpectation using the same learning parameters. Our data show that males but not females learn from overexpectation when given just a single day of compound training, whereas both sexes learn when given extended 2 days of overexpectation training. These data provide important insight into sex differences that link with prior work and thus open an avenue for the study of how conflicting memories interact in the male and female brain. (PsycInfo Database Record (c) 2020 APA, all rights reserved).