A hippocampo-cortical pathway detects changes in the validity of an action as a predictor of reward.

Much research has been dedicated to understanding the psychological and neural bases of goal-directed action, yet the relationship between context and goal-directed action is not well understood. Here, we used excitotoxic lesions, chemogenetics, and circuit-specific manipulations to demonstrate the role of the ventral hippocampus (vHPC) in contextual learning that supports sensitivity to action-outcome contingencies, a hallmark of goal-directed action. We found that chemogenetic inhibition of the ventral, but not dorsal, hippocampus attenuated sensitivity to instrumental contingency degradation. We then tested the hypothesis that this deficit was due to an inability to discern the relative validity of the action compared with the context as a predictor of reward. Using latent inhibition and Pavlovian context conditioning, we confirm that degradation of action-outcome contingencies relies on intact context-outcome learning and show that this learning is dependent on vHPC. Finally, we show that chemogenetic inhibition of vHPC terminals in the medial prefrontal cortex also impairs both instrumental contingency degradation and context-outcome learning. These results implicate a hippocampo-cortical pathway in adapting to changes in instrumental contingencies and indicate that the psychological basis of this deficit is an inability to learn the predictive value of the context. Our findings contribute to a broader understanding of the neural bases of goal-directed action and its contextual regulation.

Contribution of dorsal versus ventral hippocampus to the hierarchical modulation of goal-directed actions in rats.

Adaptive behaviour often necessitates that animals learn about events in a manner that is specific to a particular context or environment. These hierarchical organisations allow the animal to decide which action is the most appropriate when faced with ambiguous or conflicting possibilities. This study examined the role of hippocampus in enabling animals to use the context to guide action selection. We used a hierarchical instrumental outcome devaluation task in which male rats learn that the context provides information about the unique action-outcome relations that are in effect. We first confirmed that rats encode and use hierarchical context-(action-outcome) relations. We then show that chemogenetic inhibition of ventral hippocampus impairs both the encoding and retrieval of these associations, while inhibition of dorsal hippocampus impairs only the retrieval. Importantly, neither dorsal nor ventral hippocampus was required for goal-directed behaviour per se as these impairments only emerged when rats were forced to use the context to identify the current action-outcome relationships. These findings are discussed with respect to the role of the hippocampus and its broader circuitry in the contextual modulation of goal-directed behaviour and the importance of hierarchical associations in flexible behaviour.

Male and female rats show opiate withdrawal-induced place aversion and extinction in a Y-maze paradigm.

Gender differences have been observed in the vulnerability to drug abuse and in the different stages of the addictive process. In opiate dependence, differences between sexes have been shown in humans and laboratory animals in various phases of opiate addiction, especially in withdrawal-associated negative affective states. Using a Y-maze conditioned place aversion paradigm, we investigated potential sex differences in the expression and extinction of the aversive memory of precipitated opiate withdrawal state in morphine-dependent rats. No significant difference between sexes was observed in the occurrence of withdrawal signs following naloxone injection during conditioning. Moreover, opiate withdrawal memory expression and extinction following repeated testing was demonstrated in both male and female rats, with no significant differences between sexes. Finally, we report spontaneous recovery following extinction of opiate withdrawal memory. Altogether these data provide further evidence that persistent withdrawal-related memories may be strong drivers of opiate dependence, and demonstrate that both males and females can be used in experimental rodent cohorts to better understand opiate-related effects, reward, aversive state of withdrawal, abstinence and relapse.

The mediodorsal thalamus supports adaptive responding based on stimulus-outcome associations.

The ability to engage into flexible behaviors is crucial in dynamic environments. We recently showed that in addition to the well described role of the orbitofrontal cortex (OFC), its thalamic input from the submedius thalamic nucleus (Sub) also contributes to adaptive responding during Pavlovian degradation. In the present study, we examined the role of the mediodorsal thalamus (MD) which is the other main thalamic input to the OFC. To this end, we assessed the effect of both pre- and post-training MD lesions in rats performing a Pavlovian contingency degradation task. Pre-training lesions mildly impeded the establishment of stimulus-outcome associations during the initial training of Pavlovian conditioning without interfering with Pavlovian degradation training when the sensory feedback provided by the outcome rewards were available to animals. However, we found that both pre- and post-training MD lesions produced a selective impairment during a test conducted under extinction conditions, during which only current mental representation could guide behavior. Altogether, these data suggest a role for the MD in the successful encoding and representation of Pavlovian associations.

A thalamocortical circuit for updating action-outcome associations.

The ability to flexibly use knowledge is one cardinal feature of goal-directed behaviors. We recently showed that thalamocortical and corticothalamic pathways connecting the medial prefrontal cortex and the mediodorsal thalamus (MD) contribute to adaptive decision-making (Alcaraz et al., 2018). In this study, we examined the impact of disconnecting the MD from its other main cortical target, the orbitofrontal cortex (OFC) in a task assessing outcome devaluation after initial instrumental training and after reversal of action-outcome contingencies. Crossed MD and OFC lesions did not impair instrumental performance. Using the same approach, we found however that disconnecting the OFC from its other main thalamic afferent, the submedius nucleus, produced a specific impairment in adaptive responding following action-outcome reversal. Altogether, this suggests that multiple thalamocortical circuits may act synergistically to achieve behaviorally relevant functions.

Flexible Use of Predictive Cues beyond the Orbitofrontal Cortex: Role of the Submedius Thalamic Nucleus.

The orbitofrontal cortex (OFC) is known to play a crucial role in learning the consequences of specific events. However, the contribution of OFC thalamic inputs to these processes is largely unknown. Using a tract-tracing approach, we first demonstrated that the submedius nucleus (Sub) shares extensive reciprocal connections with the OFC. We then compared the effects of excitotoxic lesions of the Sub or the OFC on the ability of rats to use outcome identity to direct responding. We found that neither OFC nor Sub lesions interfered with the basic differential outcomes effect. However, more specific tests revealed that OFC rats, but not Sub rats, were disproportionally relying on the outcome, rather than on the discriminative stimulus, to guide behavior, which is consistent with the view that the OFC integrates information about predictive cues. In subsequent experiments using a Pavlovian contingency degradation procedure, we found that both OFC and Sub lesions produced a severe deficit in the ability to update Pavlovian associations. Altogether, the submedius therefore appears as a functionally relevant thalamic component in a circuit dedicated to the integration of predictive cues to guide behavior, previously conceived as essentially dependent on orbitofrontal functions. Significance statement: In the present study, we identify a largely unknown thalamic region, the submedius nucleus, as a new functionally relevant component in a circuit supporting the flexible use of predictive cues. Such abilities were previously conceived as largely dependent on the orbitofrontal cortex. Interestingly, this echoes recent findings in the field showing, in research involving an instrumental setup, an additional involvement of another thalamic nuclei, the parafascicular nucleus, when correct responding requires an element of flexibility (Bradfield et al., 2013a). Therefore, the present contribution supports the emerging view that limbic thalamic nuclei may contribute critically to adaptive responding when an element of flexibility is required after the establishment of initial learning.

Mediodorsal but not anterior thalamic nuclei lesions impair acquisition of a conditional discrimination task.

The limbic thalamus is a heterogeneous structure with distinctive cortical connectivity. A recent review suggests that the mediodorsal thalamic nucleus (MD), unlike the anterior thalamic nuclei (ATN), may be involved in selecting relevant information in tasks relying on executive functions. We compared the effects of excitotoxic lesions of the MD or the ATN on the acquisition of a simple conditional discrimination in rats. When required to choose from two levers according to auditory or visual cues, ATN rats and sham-lesioned rats performed to the same levels and displayed similar acquisition curves. Under the same conditions, MD rats' acquisition of the task was markedly delayed. This group nevertheless attained nearly normal performances after more extensive training. Furthermore, all rats learned reversal of the original discrimination at the same rate. These results highlight functional specialization within the limbic thalamus and support the notion that MD contributes to the identification of relevant dimensions in conditional tasks during the initial stages of acquisition.

Disrupting effect of drug-induced reward on spatial but not cue-guided learning: implication of the striatal protein kinase A/cAMP response element-binding protein pathway.

The multiple memory systems hypothesis posits that different neural circuits function in parallel and may compete for information processing and storage. For example, instrumental conditioning would depend on the striatum, whereas spatial memory may be mediated by a circuit centered on the hippocampus. However, the nature of the task itself is not sufficient to select durably one system over the other. In this study, we investigated the effects of natural and pharmacological rewards on the selection of a particular memory system during learning. We compared the effects of food- or drug-induced activation of the reward system on cue-guided versus spatial learning using a Y-maze discrimination task. Drug-induced reward severely impaired the acquisition of a spatial discrimination task but spared the cued version of the task. Immunohistochemical analysis of the phosphorylated form of the cAMP response element binding (CREB) protein and c-Fos expression induced by behavioral testing revealed that the spatial deficit was associated with a decrease of both markers within the hippocampus and the prefrontal cortex. In contrast, drug reward potentiated the cued learning-induced CREB phosphorylation within the dorsal striatum. Administration of the protein kinase A inhibitor 8-Bromo-adenosine-3',5'-cyclic monophosphorothioate Rp isomer (Rp-cAMPS) into the dorsal striatum before training completely reversed the drug-induced spatial deficit and restored CREB phosphorylation levels within the hippocampus and the prefrontal cortex. Therefore, drug-induced striatal hyperactivity may underlie the declarative memory deficit reported here. This mechanism could represent an important early step toward the development of addictive behaviors by promoting conditioning to the detriment of more flexible forms of memory.