Cerebellar Neurodynamics Predict Decision Timing and Outcome on the Single-Trial Level.

Goal-directed behavior requires the interaction of multiple brain regions. How these regions and their interactions with brain-wide activity drive action selection is less understood. We have investigated this question by combining whole-brain volumetric calcium imaging using light-field microscopy and an operant-conditioning task in larval zebrafish. We find global, recurring dynamics of brain states to exhibit pre-motor bifurcations toward mutually exclusive decision outcomes. These dynamics arise from a distributed network displaying trial-by-trial functional connectivity changes, especially between cerebellum and habenula, which correlate with decision outcome. Within this network the cerebellum shows particularly strong and predictive pre-motor activity (>10 s before movement initiation), mainly within the granule cells. Turn directions are determined by the difference neuroactivity between the ipsilateral and contralateral hemispheres, while the rate of bi-hemispheric population ramping quantitatively predicts decision time on the trial-by-trial level. Our results highlight a cognitive role of the cerebellum and its importance in motor planning.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING.

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Fast odour dynamics are encoded in the olfactory system and guide behaviour.

Odours are transported in turbulent plumes, which result in rapid concentration fluctuations1,2 that contain rich information about the olfactory scenery, such as the composition and location of an odour source2-4. However, it is unclear whether the mammalian olfactory system can use the underlying temporal structure to extract information about the environment. Here we show that ten-millisecond odour pulse patterns produce distinct responses in olfactory receptor neurons. In operant conditioning experiments, mice discriminated temporal correlations of rapidly fluctuating odours at frequencies of up to 40 Hz. In imaging and electrophysiological recordings, such correlation information could be readily extracted from the activity of mitral and tufted cells-the output neurons of the olfactory bulb. Furthermore, temporal correlation of odour concentrations5 reliably predicted whether odorants emerged from the same or different sources in naturalistic environments with complex airflow. Experiments in which mice were trained on such tasks and probed using synthetic correlated stimuli at different frequencies suggest that mice can use the temporal structure of odours to extract information about space. Thus, the mammalian olfactory system has access to unexpectedly fast temporal features in odour stimuli. This endows animals with the capacity to overcome key behavioural challenges such as odour source separation5, figure-ground segregation6 and odour localization7 by extracting information about space from temporal odour dynamics.

Cognitive control persistently enhances hippocampal information processing.

Could learning that uses cognitive control to judiciously use relevant information while ignoring distractions generally improve brain function, beyond forming explicit memories? According to a neuroplasticity hypothesis for how some cognitive behavioural therapies are effective, cognitive control training (CCT) changes neural circuit information processing1-3. Here we investigated whether CCT persistently alters hippocampal neural circuit function. We show that mice learned and remembered a conditioned place avoidance during CCT that required ignoring irrelevant locations of shock. CCT facilitated learning new tasks in novel environments for several weeks, relative to unconditioned controls and control mice that avoided the same place during reduced distraction. CCT rapidly changes entorhinal cortex-to-dentate gyrus synaptic circuit function, resulting in an excitatory-inhibitory subcircuit change that persists for months. CCT increases inhibition that attenuates the dentate response to medial entorhinal cortical input, and through disinhibition, potentiates the response to strong inputs, pointing to overall signal-to-noise enhancement. These neurobiological findings support the neuroplasticity hypothesis that, as well as storing item-event associations, CCT persistently optimizes neural circuit information processing.

Different Effects of Peer Sex on Operant Responding for Social Interaction and Striatal Dopamine Activity.

When rats are given discrete choices between social interactions with a peer and opioid or psychostimulant drugs, they choose social interaction, even after extensive drug self-administration experience. Studies show that like drug and nondrug food reinforcers, social interaction is an operant reinforcer and induces dopamine release. However, these studies were conducted with same-sex peers. We examined if peer sex influences operant social interaction and the role of estrous cycle and striatal dopamine in same- versus opposite-sex social interaction. We trained male and female rats (n = 13 responders/12 peers) to lever-press (fixed-ratio 1 [FR1] schedule) for 15 s access to a same- or opposite-sex peer for 16 d (8 d/sex) while tracking females' estrous cycle. Next, we transfected GRAB-DA2m and implanted optic fibers into nucleus accumbens (NAc) core and dorsomedial striatum (DMS). We then retrained the rats for 15 s social interaction (FR1 schedule) for 16 d (8 d/sex) and recorded striatal dopamine during operant responding for a peer for 8 d (4 d/sex). Finally, we assessed economic demand by manipulating FR requirements for a peer (10 d/sex). In male, but not female rats, operant responding was higher for the opposite-sex peer. Female's estrous cycle fluctuations had no effect on operant social interaction. Striatal dopamine signals for operant social interaction were dependent on the peer's sex and striatal region (NAc core vs DMS). Results indicate that estrous cycle fluctuations did not influence operant social interaction and that NAc core and DMS dopamine activity reflect sex-dependent features of volitional social interaction.

Distinct Action Signals by Subregions in the Nucleus Accumbens during STOP-Change Performance.

The nucleus accumbens (NAc) is thought to contribute to motivated behavior by signaling the value of reward-predicting cues and the delivery of anticipated reward. The NAc is subdivided into core and shell, with each region containing different populations of neurons that increase or decrease firing to rewarding events. While there are numerous theories of functions pertaining to these subregions and cell types, most are in the context of reward processing, with fewer considering that the NAc might serve functions related to action selection more generally. We recorded from single neurons in the NAc as rats of both sexes performed a STOP-change task that is commonly used to study motor control and impulsivity. In this task, rats respond quickly to a spatial cue on 80% of trials (GO) and must stop and redirect planned movement on 20% of trials (STOP). We found that the activity of reward-excited neurons signaled accurate response direction on GO, but not STOP, trials and that these neurons exhibited higher precue firing after correct trials. In contrast, reward-inhibited neurons significantly represented response direction on STOP trials at the time of the instrumental response. Finally, the proportion of reward-excited to reward-inhibited neurons and the strength of precue firing decreased as the electrode traversed the NAc. We conclude that reward-excited cells (more common in core) promote proactive action selection, while reward-inhibited cells (more common in shell) contribute to accurate responding on STOP trials that require reactive suppression and redirection of behavior.

Value Estimation versus Effort Mobilization: A General Dissociation between Ventromedial and Dorsomedial Prefrontal Cortex.

Deciding on a course of action requires both an accurate estimation of option values and the right amount of effort invested in deliberation to reach sufficient confidence in the final choice. In a previous study, we have provided evidence, across a series of judgment and choice tasks, for a dissociation between the ventromedial prefrontal cortex (vmPFC), which would represent option values, and the dorsomedial prefrontal cortex (dmPFC), which would represent the duration of deliberation. Here, we first replicate this dissociation and extend it to the case of an instrumental learning task, in which 24 human volunteers (13 women) choose between options associated with probabilistic gains and losses. According to fMRI data recorded during decision-making, vmPFC activity reflects the sum of option values generated by a reinforcement learning model and dmPFC activity the deliberation time. To further generalize the role of the dmPFC in mobilizing effort, we then analyze fMRI data recorded in the same participants while they prepare to perform motor and cognitive tasks (squeezing a handgrip or making numerical comparisons) to maximize gains or minimize losses. In both cases, dmPFC activity is associated with the output of an effort regulation model, and not with response time. Taken together, these results strengthen a general theory of behavioral control that implicates the vmPFC in the estimation of option values and the dmPFC in the energization of relevant motor and cognitive processes.

Interacting neural ensembles in orbitofrontal cortex for social and feeding behaviour.

Categorically distinct basic drives (for example, for social versus feeding behaviour1-3) can exert potent influences on each other; such interactions are likely to have important adaptive consequences (such as appropriate regulation of feeding in the context of social hierarchies) and can become maladaptive (such as in clinical settings involving anorexia). It is known that neural systems regulating natural and adaptive caloric intake, and those regulating social behaviours, involve related circuitry4-7, but the causal circuit mechanisms of these drive adjudications are not clear. Here we investigate the causal role in behaviour of cellular-resolution experience-specific neuronal populations in the orbitofrontal cortex, a major reward-processing hub that contains diverse activity-specific neuronal populations that respond differentially to various aspects of caloric intake8-13 and social stimuli14,15. We coupled genetically encoded activity imaging with the development and application of methods for optogenetic control of multiple individually defined cells, to both optically monitor and manipulate the activity of many orbitofrontal cortex neurons at the single-cell level in real time during rewarding experiences (caloric consumption and social interaction). We identified distinct populations within the orbitofrontal cortex that selectively responded to either caloric rewards or social stimuli, and found that activity of individually specified naturally feeding-responsive neurons was causally linked to increased feeding behaviour; this effect was selective as, by contrast, single-cell resolution activation of naturally social-responsive neurons inhibited feeding, and activation of neurons responsive to neither feeding nor social stimuli did not alter feeding behaviour. These results reveal the presence of potent cellular-level subnetworks within the orbitofrontal cortex that can be precisely engaged to bidirectionally control feeding behaviours subject to, for example, social influences.

Goal-directed learning is multidimensional and accompanied by diverse and widespread changes in neocortical signaling.

New tasks are often learned in stages with each stage reflecting a different learning challenge. Accordingly, each learning stage is likely mediated by distinct neuronal processes. And yet, most rodent studies of the neuronal correlates of goal-directed learning focus on individual outcome measures and individual brain regions. Here, we longitudinally studied mice from naïve to expert performance in a head-fixed, operant conditioning whisker discrimination task. In addition to tracking the primary behavioral outcome of stimulus discrimination, we tracked and compared an array of object-based and temporal-based behavioral measures. These behavioral analyses identify multiple, partially overlapping learning stages in this task, consistent with initial response implementation, early stimulus-response generalization, and late response inhibition. To begin to understand the neuronal foundations of these learning processes, we performed widefield Ca2+ imaging of dorsal neocortex throughout learning and correlated behavioral measures with neuronal activity. We found distinct and widespread correlations between neocortical activation patterns and various behavioral measures. For example, improvements in sensory discrimination correlated with target stimulus evoked activations of response-related cortices along with distractor stimulus evoked global cortical suppression. Our study reveals multidimensional learning for a simple goal-directed learning task and generates hypotheses for the neuronal modulations underlying these various learning processes.

Intolerance of uncertainty affects the behavioral and neural mechanisms of higher generalization.

Intolerance of uncertainty (IU) is associated with several anxiety disorders. In this study, we employed rewards and losses as unconditioned positive and negative stimuli, respectively, to explore the effects of an individual's IU level on positive and negative generalizations using magnetic resonance imaging technology. Following instrumental learning, 48 participants (24 high IU; 24 low IU) were invited to complete positive and negative generalization tasks; their behavioral responses and neural activities were recorded by functional magnetic resonance imaging. The behavior results demonstrated that participants with high IUs exhibited higher generalizations to both positive and negative cues as compared with participants having low IUs. Neuroimaging results demonstrated that they exhibited higher activation levels in the right anterior insula and the default mode network (i.e. precuneus and posterior cingulate gyrus), as well as related reward circuits (i.e. caudate and right putamen). Therefore, higher generalization scores and the related abnormal brain activation may be key markers of IU as a vulnerability factor for anxiety disorders.

Connecting self-report and instrumental behavior during incubation of food craving in humans.

Incubation of craving is a phenomenon describing the intensification of craving for a reward over extended periods of abstinence from reinforcement. Animal models use instrumental markers of craving to reward cues to examine incubation, while human paradigms rely on subjective self-reports. Here, we characterize an animal-inspired, novel human paradigm that showed strong positive relationships between self-reports and instrumental markers of craving for favored palatable foods. Further, we found consistent nonlinear relationships with time since last consumption and self-reports, and preliminary patterns between time and instrumental responses. These findings provide a novel approach to establishing an animal-inspired human model of incubation.

Adolescents flexibly adapt action selection based on controllability inferences.

From early in life, we encounter both controllable environments, in which our actions can causally influence the reward outcomes we experience, and uncontrollable environments, in which they cannot. Environmental controllability is theoretically proposed to organize our behavior. In controllable contexts, we can learn to proactively select instrumental actions that bring about desired outcomes. In uncontrollable environments, Pavlovian learning enables hard-wired, reflexive reactions to anticipated, motivationally salient events, providing "default" behavioral responses. Previous studies characterizing the balance between Pavlovian and instrumental learning systems across development have yielded divergent findings, with some studies observing heightened expression of Pavlovian learning during adolescence and others observing a reduced influence of Pavlovian learning during this developmental stage. In this study, we aimed to investigate whether a theoretical model of controllability-dependent arbitration between learning systems might explain these seemingly divergent findings in the developmental literature, with the specific hypothesis that adolescents' action selection might be particularly sensitive to environmental controllability. To test this hypothesis, 90 participants, aged 8-27, performed a probabilistic-learning task that enables estimation of Pavlovian influence on instrumental learning, across both controllable and uncontrollable conditions. We fit participants' data with a reinforcement-learning model in which controllability inferences adaptively modulate the dominance of Pavlovian versus instrumental control. Relative to children and adults, adolescents exhibited greater flexibility in calibrating the expression of Pavlovian bias to the degree of environmental controllability. These findings suggest that sensitivity to environmental reward statistics that organize motivated behavior may be heightened during adolescence.

Reward-Mediated, Model-Free Reinforcement-Learning Mechanisms in Pavlovian and Instrumental Tasks Are Related.

Model-free and model-based computations are argued to distinctly update action values that guide decision-making processes. It is not known, however, if these model-free and model-based reinforcement learning mechanisms recruited in operationally based instrumental tasks parallel those engaged by pavlovian-based behavioral procedures. Recently, computational work has suggested that individual differences in the attribution of incentive salience to reward predictive cues, that is, sign- and goal-tracking behaviors, are also governed by variations in model-free and model-based value representations that guide behavior. Moreover, it is not appreciated if these systems that are characterized computationally using model-free and model-based algorithms are conserved across tasks for individual animals. In the current study, we used a within-subject design to assess sign-tracking and goal-tracking behaviors using a pavlovian conditioned approach task and then characterized behavior using an instrumental multistage decision-making (MSDM) task in male rats. We hypothesized that both pavlovian and instrumental learning processes may be driven by common reinforcement-learning mechanisms. Our data confirm that sign-tracking behavior was associated with greater reward-mediated, model-free reinforcement learning and that it was also linked to model-free reinforcement learning in the MSDM task. Computational analyses revealed that pavlovian model-free updating was correlated with model-free reinforcement learning in the MSDM task. These data provide key insights into the computational mechanisms mediating associative learning that could have important implications for normal and abnormal states.SIGNIFICANCE STATEMENT Model-free and model-based computations that guide instrumental decision-making processes may also be recruited in pavlovian-based behavioral procedures. Here, we used a within-subject design to test the hypothesis that both pavlovian and instrumental learning processes were driven by common reinforcement-learning mechanisms. Sign-tracking and goal-tracking behaviors were assessed in rats using a pavlovian conditioned approach task, and then instrumental behavior was characterized using an MSDM task. We report that sign-tracking behavior was associated with greater model-free, but not model-based, learning in the MSDM task. These data suggest that pavlovian and instrumental behaviors may be driven by conserved reinforcement-learning mechanisms.

The Orienting Reflex Reveals Behavioral States Set by Demanding Contexts: Role of the Superior Colliculus.

Sensory stimuli can trigger an orienting reflex (response) by which animals move the head to position their sensors (e.g., eyes, pinna, whiskers). Orienting responses may be important to evaluate stimuli that call for action (e.g., approach, escape, ignore), but little is known about the dynamics of orienting responses in the context of goal-directed actions. Using mice of either sex, we found that, during a signaled avoidance action, the orienting response evoked by the conditioned stimulus (CS) consisted of a fast head movement containing rotational and translational components that varied substantially as a function of the behavioral and underlying brain states of the animal set by different task contingencies. Larger CS-evoked orienting responses were associated with high-intensity auditory stimuli, failures to produce the appropriate signaled action, and behavioral states resulting from uncertain or demanding situations and the animal's ability to cope with them. As a prototypical orienting neural circuit, we confirmed that the superior colliculus controls and codes the direction of spontaneous exploratory orienting movements. In addition, superior colliculus activity correlated with CS-evoked orienting responses, and either its optogenetic inhibition or excitation potentiated CS-evoked orienting responses, which are likely generated downstream in the medulla. CS-evoked orienting responses may be a useful probe to assess behavioral and related brain states, and state-dependent modulation of orienting responses may involve the superior colliculus.SIGNIFICANCE STATEMENT Humans and other animals produce an orienting reflex (also known as orienting response) by which they rapidly orient their head and sensors to evaluate novel or salient stimuli. Spontaneous orienting movements also occur during exploration of the environment in the absence of explicit, salient stimuli. We monitored stimulus-evoked orienting responses in mice performing signaled avoidance behaviors and found that these responses reflect the behavioral state of the animal set by contextual demands and the animal's ability to cope with them. Various experiments involving the superior colliculus revealed a well-established role in spontaneous orienting but only an influencing effect over orienting responses. Stimulus-evoked orienting responses may be a useful probe of behavioral and related brain states.

Anticipation of Appetitive Operant Action Induces Sustained Dopamine Release in the Nucleus Accumbens.

The mesolimbic dopamine system is implicated in signaling reward-related information as well as in actions that generate rewarding outcomes. These implications are commonly investigated in either pavlovian or operant reinforcement paradigms, where only the latter requires instrumental action. To parse contributions of reward- and action-related information to dopamine signals, we directly compared the two paradigms: male rats underwent either pavlovian or operant conditioning while dopamine release was measured in the nucleus accumbens, a brain region central for processing this information. Task conditions were identical with the exception of the operant-lever response requirement. Rats in both groups released the same quantity of dopamine at the onset of the reward-predictive cue. However, only the operant-conditioning group showed a subsequent, sustained plateau in dopamine concentration throughout the entire 5 s cue presentation (preceding the required action). This dopamine ramp was unaffected by probabilistic reward delivery, occurred exclusively before operant actions, and was not related to task performance or task acquisition as it persisted throughout the 2 week daily behavioral training. Instead, the ramp flexibly increased in duration with longer cue presentation, seemingly modulating the initial cue-onset-triggered dopamine release, that is, the reward prediction error (RPE) signal, as both signal amplitude and sustainment diminished when reward timing was made more predictable. Thus, our findings suggest that RPE and action components of dopamine release can be differentiated temporally into phasic and ramping/sustained signals, respectively, where the latter depends on the former and presumably reflects the anticipation or incentivization of appetitive action, conceptually akin to motivation.SIGNIFICANCE STATEMENT It is unclear whether the components of dopamine signals that are related to reward-associated information and reward-driven approach behavior can be separated. Most studies investigating the dopamine system use either pavlovian or operant conditioning, which both involve the delivery of reward and necessitate appetitive approach behavior. Thus, used exclusively, neither paradigm can disentangle the contributions of these components to dopamine release. However, by combining both paradigms in the same study, we find that anticipation of a reward-driven operant action induces a modulation of reward-prediction-associated dopamine release, producing so-called dopamine ramps. Therefore, our findings provide new insight into dopamine ramps and suggest that dopamine signals integrate reward and appetitive action in a temporally distinguishable, yet dependent, manner.

Effects of Experiencing CS-US Pairings on Instructed Fear Reversal.

Fear learning allows us to identify and anticipate aversive events and adapt our behavior accordingly. This is often thought to rely on associative learning mechanisms where an initially neutral conditioned stimulus (CS) is repeatedly paired with an aversive unconditioned stimulus (US), eventually leading to the CS also being perceived as aversive and threatening. Importantly, however, humans also show verbal fear learning. Namely, they have the ability to change their responses to stimuli rapidly through verbal instructions about CS-US pairings. Past research on the link between experience-based and verbal fear learning indicated that verbal instructions about a reversal of CS-US pairings can fully override the effects of previously experienced CS-US pairings, as measured through fear ratings, skin conductance, and fear-potentiated startle. However, it remains an open question whether such instructions can also annul learned CS representations in the brain. Here, we used a fear reversal paradigm (female and male participants) in conjunction with representational similarity analysis of fMRI data to test whether verbal instructions fully override the effects of experienced CS-US pairings in fear-related brain regions or not. Previous research suggests that only the right amygdala should show lingering representations of previously experienced threat ("pavlovian trace"). Unexpectedly, we found evidence for the residual effect of prior CS-US experience to be much more widespread than anticipated, in the amygdala but also cortical regions like the dorsal anterior cingulate or dorsolateral prefrontal cortex. This finding shines a new light on the interaction of different fear learning mechanisms, at times with unexpected consequences.SIGNIFICANCE STATEMENT Humans are able to learn about aversive stimuli both from experience (i.e., repeated pairings of conditioned stimulus (CS) and unconditioned stimulus (US; pavlovian conditioning), and from verbal instructions about stimulus pairings. Understanding how experience-based and verbal learning processes interact is key for understanding the cognitive and neural underpinnings of fear learning. We tested whether prior aversive experiences (CS-US pairings) affected subsequent verbal learning, searching for lingering threat signals after verbal instructions reversed a CS from being threatening to being safe. While past research suggested such threat signals can only be found in the amygdala, we found evidence to be much more widespread, including the medial and lateral PFC. This highlights how experience-based and verbal learning processes interact to support adaptive behavior.

Motor learning changes the axon initial segment of the spinal motoneuron.

We are studying the mechanisms of H-reflex operant conditioning, a simple form of learning. Modelling studies in the literature and our previous data suggested that changes in the axon initial segment (AIS) might contribute. To explore this, we used blinded quantitative histological and immunohistochemical methods to study in adult rats the impact of H-reflex conditioning on the AIS of the spinal motoneuron that produces the reflex. Successful, but not unsuccessful, H-reflex up-conditioning was associated with greater AIS length and distance from soma; greater length correlated with greater H-reflex increase. Modelling studies in the literature suggest that these increases may increase motoneuron excitability, supporting the hypothesis that they may contribute to H-reflex increase. Up-conditioning did not affect AIS ankyrin G (AnkG) immunoreactivity (IR), p-p38 protein kinase IR, or GABAergic terminals. Successful, but not unsuccessful, H-reflex down-conditioning was associated with more GABAergic terminals on the AIS, weaker AnkG-IR, and stronger p-p38-IR. More GABAergic terminals and weaker AnkG-IR correlated with greater H-reflex decrease. These changes might potentially contribute to the positive shift in motoneuron firing threshold underlying H-reflex decrease; they are consistent with modelling suggesting that sodium channel change may be responsible. H-reflex down-conditioning did not affect AIS dimensions. This evidence that AIS plasticity is associated with and might contribute to H-reflex conditioning adds to evidence that motor learning involves both spinal and brain plasticity, and both neuronal and synaptic plasticity. AIS properties of spinal motoneurons are likely to reflect the combined influence of all the motor skills that share these motoneurons. KEY POINTS: Neuronal action potentials normally begin in the axon initial segment (AIS). AIS plasticity affects neuronal excitability in development and disease. Whether it does so in learning is unknown. Operant conditioning of a spinal reflex, a simple learning model, changes the rat spinal motoneuron AIS. Successful, but not unsuccessful, H-reflex up-conditioning is associated with greater AIS length and distance from soma. Successful, but not unsuccessful, down-conditioning is associated with more AIS GABAergic terminals, less ankyrin G, and more p-p38 protein kinase. The associations between AIS plasticity and successful H-reflex conditioning are consistent with those between AIS plasticity and functional changes in development and disease, and with those predicted by modelling studies in the literature. Motor learning changes neurons and synapses in spinal cord and brain. Because spinal motoneurons are the final common pathway for behaviour, their AIS properties probably reflect the combined impact of all the behaviours that use these motoneurons.

AMPA and NMDA receptors in dentate gyrus mediate memory for sucrose in two port discrimination task.

Although the phenomenon of memory formation and recall associated with the use of psychotropic drugs has been extensively studied, mechanisms underlying memories for natural reward have not been clarified. Herein, we test the hypothesis that glutamatergic receptors in the dentate gyrus play a role in memories associated with sucrose. We used pellet self-administration protocol to generate memories in two-port nose-poke discrimination task using male Wistar rats. During non-rewarded probe trial, the conditioned animals readily discriminated the active port versus inactive port and showed massive increase in mRNA expression of AMPA receptor subunit genes (gria2, gria3) as well as c-Fos protein in the DG. Access to sweet pellet further enhanced c-Fos expression in the DG. However, animals pre-treated with AMPA receptor antagonist CNQX (intra-DG), on exposure to operant chamber (no pellet), showed decreased discrimination as well as c-Fos expression. We suggest that AMPA receptors in DG mediate recall and consolidation of memories associated with sucrose consumption. CNQX pre-treated animals, if presented with sweet pellet on nose poke, exhibited high discrimination index coupled with increased c-Fos expression. In these CNQX treated rats, the DI was again decreased following administration of NMDA receptor antagonist AP5. We suggest that, although AMPA receptors are blocked, the access to sweet pellet may induce surge of glutamate in the DG, which in turn may reinstate memories via activation of erstwhile silent synapses in NMDA dependant manner.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance.

Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.

Augmenting glutamatergic, but not dopaminergic, activity in the nucleus accumbens shell disrupts responding to a discrete alcohol cue in an alcohol context.

Discrete alcohol cues and contexts are relapse triggers for people with alcohol use disorder exerting particularly powerful control over behaviour when they co-occur. Here, we investigated the neural substrates subserving the capacity for alcohol-associated contexts to elevate responding to an alcohol-predictive conditioned stimulus (CS). Specifically, rats were trained in a distinct 'alcohol context' to respond by entering a fluid port during a discrete auditory CS that predicted the delivery of alcohol and were familiarized with a 'neutral context' wherein alcohol was never available. When conditioned CS responding was tested by presenting the CS without alcohol, we found that augmenting glutamatergic activity in the nucleus accumbens (NAc) shell by microinfusing α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) reduced responding to an alcohol CS in an alcohol, but not neutral, context. Further, AMPA microinfusion robustly affected behaviour, attenuating the number, duration and latency of CS responses selectively in the alcohol context. Although dopaminergic inputs to the NAc shell were previously shown to be necessary for CS responding in an alcohol context, here, chemogenetic excitation of ventral tegmental area (VTA) dopamine neurons and their inputs to the NAc shell did not affect CS responding. Critically, chemogenetic excitation of VTA dopamine neurons affected feeding behaviour and elevated c-fos immunoreactivity in the VTA and NAc shell, validating the chemogenetic approach. These findings enrich our understanding of the substrates underlying Pavlovian responding for alcohol and reveal that the capacity for contexts to modulate responding to discrete alcohol cues is delicately underpinned by the NAc shell.