Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking.

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Improved visual discrimination learning in mice with partial 5-HT2B gene deletion.

The neurotransmitter serotonin (5-hydroxytryptamine, 5-HT) has been linked to multiple aspects of cognition. For example, in rodents, discrimination and reversal learning are altered by experimentally induced changes in brain serotonin levels, and reduced expression of the 5-HT2B receptor subtype in mice and humans is associated with decreased serotonergic tone and increased behavioral impulsivity. Serotonin modulates cognitive flexibility as well as fear and anxiety, but the specific contributions of 5-HT2B receptors to these behaviors is unknown. The current study assessed mice with partial Htr2b deletion for performance on a touchscreen-based pairwise visual discrimination and reversal learning task followed by a test of cued fear learning. Male Htr2b heterozygous mice (+/-) and littermate controls (+/+) were trained to discriminate between two visual stimuli presented on a touch-sensitive screen, one which predicted delivery of a 14-mg food pellet and the other which was not rewarded. Once discrimination performance criterion was attained, the stimulus-reward contingencies were reversed. Htr2b +/- mice were faster to reach discrimination criterion than +/+ controls, and made fewer errors. Htr2b +/- mice were also slower to make responses and collect rewards. Conversely, measures of reversal learning were not different between genotypes. Pavlovian cued fear conditioning was also normal in Htr2b +/-mice. These data demonstrate a selective improvement in touchscreen-based discrimination learning in mice with partial deletion of the 5-HT2B receptor, and provide further insight into the role of the 5-HT2B receptor in cognition.

Prefrontal cortical and nucleus accumbens contributions to discriminative conditioned suppression of reward-seeking.

Fear can potently inhibit ongoing behavior, including reward-seeking, yet the neural circuits that underlie such suppression remain to be clarified. Prior studies have demonstrated that distinct subregions of the rodent medial prefrontal cortex (mPFC) differentially affect fear behavior, whereby fear expression is promoted by the more dorsal prelimbic cortex (PL) and inhibited by the more ventral infralimbic cortex (IL). These mPFC regions project to subregions of the nucleus accumbens, the core (NAcC) and shell (NAcS), that differentially contribute to reward-seeking as well as affective processes that may be relevant to fear expression. Here, we investigated how these mPFC and NAc subregions contribute to discriminative fear conditioning, assessed by conditioned suppression of reward-seeking. Bilateral inactivation of the NAcS or PL reduced the expression of conditioned suppression to a shock-associated CS+, whereas NAcC inactivation reduced reward-seeking without affecting suppression. IL inactivation caused a general reduction in conditioned suppression following discriminative conditioning, but not when using a single-stimulus design. Pharmacological disconnection of the PL → NAcS pathway revealed that this projection mediates conditioned suppression. These data add to a growing literature implicating discrete cortico-striatal pathways in the suppression of reward-seeking in response to aversive stimuli. Dysfunction within related structures may contribute to aberrant patterns of behavior in psychiatric illnesses including substance use disorders.

Prefrontal Regulation of Punished Ethanol Self-administration.

BACKGROUND: A clinical hallmark of alcohol use disorder is persistent drinking despite potential adverse consequences. The ventromedial prefrontal cortex (vmPFC) and dorsomedial prefrontal cortex (dmPFC) are positioned to exert top-down control over subcortical regions, such as the nucleus accumbens shell (NAcS) and basolateral amygdala, which encode positive and negative valence of ethanol (EtOH)-related stimuli. Prior rodent studies have implicated these regions in regulation of punished EtOH self-administration (EtOH-SA). METHODS: We conducted in vivo electrophysiological recordings in mouse vmPFC and dmPFC to obtain neuronal correlates of footshock-punished EtOH-SA. Ex vivo recordings were performed in NAcS D1 receptor-expressing medium spiny neurons receiving vmPFC input to examine punishment-related plasticity in this pathway. Optogenetic photosilencing was employed to assess the functional contribution of the vmPFC, dmPFC, vmPFC projections to NAcS, or vmPFC projections to basolateral amygdala, to punished EtOH-SA. RESULTS: Punishment reduced EtOH lever pressing and elicited aborted presses (lever approach followed by rapid retraction). Neurons in the vmPFC and dmPFC exhibited phasic firing to EtOH lever presses and aborts, but only in the vmPFC was there a population-level shift in coding from lever presses to aborts with punishment. Closed-loop vmPFC, but not dmPFC, photosilencing on a postpunishment probe test negated the reduction in EtOH lever presses but not in aborts. Punishment was associated with altered plasticity at vmPFC inputs to D1 receptor-expressing medium spiny neurons in the NAcS. Photosilencing vmPFC projections to the NAcS, but not to the basolateral amygdala, partially reversed suppression of EtOH lever presses on probe testing. CONCLUSIONS: These findings demonstrate a key role for the vmPFC in regulating EtOH-SA after punishment, with implications for understanding the neural basis of compulsive drinking in alcohol use disorder.

A novel multichoice touchscreen paradigm for assessing cognitive flexibility in mice.

Cognitive flexibility refers to various processes which enable behaviors to be modified on the basis of a change in the contingencies between stimuli or responses and their associated outcomes. Reversal learning is a form of cognitive flexibility which measures the ability to adjust responding based on a switch in the stimulus-outcome contingencies of, typically two, perceptually distinct stimuli. Reversal tasks have provided valuable insight into the neural basis of cognitive flexibility, implicating brain regions including the lateral orbitofrontal cortex (lOFC) and dorsomedial prefrontal cortex (dmPFC). However, with two-stimulus reversal, it is difficult to determine whether response errors are due excessive perseveration, deficient learning, or other problems with updating. To address this limitation, we developed a mouse three-choice touchscreen-based visual reversal task, in which the contingencies of two stimuli were switched on reversal but a third, simultaneously presented, stimulus was never reinforced. We found that, in male C57BL/6J mice, responding at the previously rewarded stimulus predominated over the newly and never-reinforced stimuli during early reversal. Next, we showed that acute pharmacological inhibition of lOFC, but not dmPFC, impaired early reversal performance, relative to noninactivated controls. Interestingly, however, lOFC inactivation deficits were characterized by increased choice of the never-reinforced stimulus and a decrease in (perseverative-like) responding at the previously rewarded stimulus. These effects are inconsistent with the historical notion of lOFC mediating response inhibition and closer to recent views of the lOFC's role in response/outcome tracking. Overall, these findings provide initial support the utility of this novel paradigm for studying cognitive flexibility and its underlying neural substrates.

Cooperative and dissociable involvement of the nucleus accumbens core and shell in the promotion and inhibition of actions during active and inhibitory avoidance.

The flexible implementation of active and passive strategies to avoid danger is critical to survival. Conversely, the inappropriate allocation of these behaviors may underlie pathological avoidance in neuropsychiatric illnesses. The present study investigated whether these two poles of avoidance may be differentially regulated by subdivsions of the nucleus accumbens, the core (NAcC) and shell (NAcS), which are known to bi-directionally control flexible action selection during reward-seeking. In so doing, we developed a novel cued active/inhibitory avoidance task conducted in operant chambers that entailed presentations of two distinct, 15 s auditory cues. One cue indicated that impending foot-shocks could be avoided by pressing a lever (active avoidance), whereas another cue signaled that shocks could be avoided by withholding presses (inhibitory avoidance). In well-trained rats, pharmacological inactivation of either the NAcC or NAcS impaired active avoidance. In contrast, inhibitory avoidance was disrupted by inactivation of the NAcS, but not NAcC, reflecting a deficit in response-inhibition that manifested as more inhibitory avoidance failures and lever-presses, as well as increased locomotion. Foot-shock sensitivity was unaffected by inactivation of either subregion. In a subsequent experiment, treatment with the monoamine releaser d-amphetamine (1 mg/kg) did not affect active avoidance, but disinhibited lever pressing during inhibitory avoidance trials. These results provide novel insight into the ventral striatal and monoaminergic regulation of flexible response allocation and inhibition that facilitates avoidance behavior and highlight the importance of different subregions of the NAc in action selection during aversively-motivated behaviors.

Contributions of basolateral amygdala and nucleus accumbens subregions to mediating motivational conflict during punished reward-seeking.

The involvement of different nodes within meso-cortico-limbic-striatal circuitry in mediating reward-seeking has been well described, yet comparatively less is known about how such circuitry may regulate appetitively-motivated behaviors that may be punished. The basolateral amygdala (BLA) is one nucleus that has been implicated in suppressing punished reward-seeking, and this structure can modulate goal-directed behavior via projections to subregions of the nucleus accumbens (NAc). Here, we examined the effects of reversible inactivations of the BLA, NAc Shell (NAcS), and core (NAcC) on performance of a "Conflict" task where rats pressed a lever for sucrose reinforcement during three distinct 5min phases. During the first and last phases of a session, rats lever-pressed for food reward delivered on a VI-15/FR5 schedule. In between these phases was a signaled "Conflict" period, where each lever-press yielded food, but 50% of presses were also punished with foot-shock. Under control conditions, well-trained rats responded vigorously during the two "safe" VI-15/FR5 periods, but reduced responding during the punished Conflict period. Inactivation of either the BLA or the NAcS via infusions of baclofen/muscimol disinhibited punished seeking, increasing lever-pressing during the conflict period, while attenuating pressing during VI-15/FR5 phases. In contrast, NAcC inactivation markedly decreased responding across all three phases. Similar inactivation of the BLA or NAcS did not alter responding in a separate control experiment where rats pressed for food on schedules identical to the Conflict task in the absence of any punishment, while NAcC inactivation again suppressed responding. These results imply that BLA and NAcS are part of a circuit that suppresses reward-seeking in the face of danger, which in turn may have implications for disorders characterized by punishment resistance, including substance abuse and obsessive-compulsive disorder.

Perturbations in reward-related decision-making induced by reduced prefrontal cortical GABA transmission: Relevance for psychiatric disorders.

The prefrontal cortex (PFC) is critical for higher-order cognitive functions, including decision-making. In psychiatric conditions such as schizophrenia, prefrontal dysfunction co-occurs with pronounced alterations in decision-making ability. These alterations include a diminished ability to utilize probabilistic reinforcement in guiding future choice, and a reduced willingness to expend effort to receive reward. Among the neurochemical abnormalities observed in the PFC of individuals with schizophrenia are alterations in the production and function of the inhibitory neurotransmitter gamma-aminobutyric acid (GABA). To probe how PFC GABA hypofunction may contribute to alterations in cost/benefit decision-making, we assessed the effects GABAA-receptor antagonist bicuculline (BIC; 50 ng in 0.5 µl saline/hemisphere) infusion in the medial PFC of rats during performance on a series of well-validated cost/benefit decision-making tasks. Intra-PFC BIC reduced risky choice and reward sensitivity during probabilistic discounting and decreased the preference for larger rewards associated with a greater effort cost, similar to the behavioral sequelae observed in schizophrenia. Additional experiments revealed that these treatments did not alter instrumental responding on a progressive ratio schedule, nor did they impair the ability to discriminate between reward and no reward. However, BIC induced a subtle but consistent impairment in preference for larger vs. smaller rewards of equal cost. BIC infusion also increased decision latencies and impaired the ability to "stay on task" as indexed by reduced rates of instrumental responding. Collectively, these results implicate prefrontal GABAergic dysfunction as a key contributing factor to abnormal decision-making observed in schizophrenia and other neuropsychiatric conditions with similar neurobiological and behavioral alterations.

Prefrontal cortical gamma-aminobutyric acid transmission and cognitive function: drawing links to schizophrenia from preclinical research.

Cognitive dysfunction in schizophrenia is one of the most pervasive and debilitating aspects of the disorder. Among the numerous neural abnormalities that may contribute to schizophrenia symptoms, perturbations in markers for the inhibitory neurotransmitter gamma-aminobutyric acid (GABA), particularly within the frontal lobes, are some of the most reliable alterations observed at postmortem examination. However, how prefrontal GABA dysfunction contributes to cognitive impairment in schizophrenia remains unclear. We provide an overview of postmortem GABAergic perturbations in the brain affected by schizophrenia and describe circumstantial evidence linking these alterations to cognitive dysfunction. In addition, we conduct a survey of studies using neurodevelopmental, genetic, and pharmacologic rodent models that induce schizophrenia-like cognitive impairments, highlighting the convergence of these mechanistically distinct approaches to prefrontal GABAergic disruption. We review preclinical studies that have directly targeted prefrontal cortical GABAergic transmission using local application of GABAA receptor antagonists. These studies have provided an important link between GABA transmission and cognitive dysfunction in schizophrenia because they show that reducing prefrontal inhibitory transmission induces various cognitive, emotional, and dopaminergic abnormalities that resemble aspects of the disorder. These converging clinical and preclinical findings provide strong support for the idea that perturbations in GABA signaling drive certain forms of cognitive dysfunction in schizophrenia. Future studies using this approach will yield information to refine further a putative "GABA hypothesis" of schizophrenia.

Orexin receptor activity in the basal forebrain alters performance on an olfactory discrimination task.

Cholinergic innervation of the prefrontal cortex is critical for various forms of cognition, although the efferent modulators contributing to acetylcholine (ACh) release are not well understood. The main source of cortical ACh, the basal forebrain, receives projections from lateral and perifornical hypothalamic neurons releasing the peptides orexin (orexin A; OxA, and orexin B; OxB), of which OxA is hypothesized to play a role in various cognitive functions. We sought to assess one such function known to be susceptible to basal forebrain cholinergic manipulation, olfactory discrimination acquisition, and reversal learning, in rats following intra-basal forebrain infusion of OxA or the orexin 1 receptor (OxR1) antagonist SB-334867. OxA administration facilitated, while OxR1 antagonism impaired performance on both the acquisition and reversal portions of the task. These data suggest that orexin acting in the basal forebrain may be important for cortical-dependant executive functions, possibly through the stimulation of cortical ACh release.

Prefrontal cortical GABA transmission modulates discrimination and latent inhibition of conditioned fear: relevance for schizophrenia.

Inhibitory gamma-aminobutyric acid (GABA) transmission within the prefrontal cortex (PFC) regulates numerous functions, and perturbations in GABAergic transmission within this region have been proposed to contribute to some of the cognitive and behavioral abnormalities associated with disorders such as schizophrenia. These abnormalities include deficits in emotional regulation and aberrant attributions of affective salience. Yet, how PFC GABA regulates these types of emotional processes are unclear. To address this issue, we investigated the contribution of PFC GABA transmission to different aspects of Pavlovian emotional learning in rats using translational discriminative fear conditioning and latent inhibition (LI) assays. Reducing prelimbic PFC GABAA transmission via infusions of the antagonist bicuculline before the acquisition or expression of fear conditioning eliminated the ability to discriminate between an aversive conditioned stimulus (CS+) paired with footshock vs a neutral CS-, resembling similar deficits observed in schizophrenic patients. In a separate experiment, blockade of PFC GABAA receptors before CS preexposure (PE) and conditioning did not affect subsequent expression of LI, but did enhance fear in rats that were not preexposed to the CS. In contrast, PFC GABA-blockade before a fear expression test disrupted the recall of learned irrelevance and abolished LI. These data suggest that normal PFC GABA transmission is critical for regulating and mitigating multiple aspects of aversive learning, including discrimination between fear vs safety signals and recall of information about the irrelevance of stimuli. Furthermore, they suggest that similar deficits in emotional regulation observed in schizophrenia may be driven in part by deficient PFC GABA activity.

Impaired reality testing in an animal model of schizophrenia.

BACKGROUND: Schizophrenia is a chronic and devastating brain disorder characterized by hallucinations and delusions, symptoms reflecting impaired reality testing. Although animal models have captured negative symptoms and cognitive deficits associated with schizophrenia, none have addressed these defining, positive symptoms. METHODS: Here we tested the performance of adults given neonatal ventral hippocampal lesions (NVHL), a neurodevelopmental model of schizophrenia, in two taste aversion procedures. RESULTS: Normal and NVHL rats formed aversions to a palatable food when the food was directly paired with nausea, but only NVHL rats formed a food aversion when the cue predicting that food was paired with nausea. The failure of NVHL rats to discriminate fully real from imagined food parallels the failure of people with schizophrenia to differentiate internal thoughts and beliefs from reality. CONCLUSIONS: These results further validate the NVHL model of schizophrenia and provide a means to assess impaired reality testing in variety of animal models.