Delay discounting for sucrose in alcohol-preferring and nonpreferring rats using a sipper tube within-sessions task.

BACKGROUND: Delay discounting (DD) is a measure of impulsivity that quantifies preference for a small reward delivered immediately over a large reward delivered after a delay. It has been hypothesized that impulsivity is an endophenotype associated with increased risk for development of alcohol use disorders (AUDs); however, a causal role of impulsivity is difficult to determine with human studies. We tested this hypothesis by assessing the degree of DD present in alcohol-naïve rats selectively bred for either high- or low-alcohol preference. METHODS: A novel adaptation of a within-sessions DD procedure was used to compare impulsivity differences between male alcohol-preferring (P) and nonpreferring (NP) rat lines (n = 6 per line) using a 5% sucrose reward. Animals chose between 2 options: 2-second sipper tube access delivered immediately (small reward) or 8-second access after a variable delay (large reward). Each 50-minute session consisted of 5 blocks of ten 60-second trials. Within each session, the delay to the large reward increased in each block of trials. Delays were gradually increased over 3 sets to attain a final delay set of 3, 8, 15, 18, and 25 seconds. RESULTS: Prior to starting delays, there were no significant differences between lines in sucrose consumption or percent choice for the large reward, and both lines exhibited a clear preference for the large reward. After delays were initiated, choice for the large reward decreased as the delay to its presentation increased. Although discounting of the large, delayed reward was observed for both lines, the degree of discounting, or "impulsivity," was greater for P rats compared with NP rats. CONCLUSIONS: P rats are more impulsive for sucrose rewards before exposure to alcohol compared with NP rats. Thus, individuals genetically predisposed toward developing AUDs may be more likely to engage in impulsive decision making prior to alcohol exposure.

Is extinction the hallmark of operant discrimination? Reinforcement and S(Delta) effects.

Using a successive discrimination procedure with rats, three experiments investigated the contribution of reinforcement rate and amount of S(Delta) exposure on the acquisition of an operant discrimination. S(D) components and were always 2 min in length, while S(Delta) (extinction) components were either 1 min or 4 min in length; responses in S(D) were reinforced on one of four schedules. In Experiment 1, each of eight groups were exposed to one possible combination of rate of reinforcement and S(Delta) component length. At every level of reinforcement, the 4 min S(Delta) groups acquired the discrimination more quickly. However, within each level of reinforcement, the proportions of responding in S(D) as a function cumulative S(Delta) exposure were equivalent, regardless of the number of reinforcers earned in S(D), suggesting that extinction is the "hallmark" of discrimination. Experiment 2 sought to replicate these results in a within-subjects design, and although the 4 min S(Delta) conditions always produced superior discriminations, the lack of discriminated responding in some conditions suggested that stimulus disparity was reduced. Experiment 3 clarified those results and extended the finding that the acquisition of operant discrimination closely parallels extinction of responding in S(Delta). In sum, it appears that higher reinforcement rates and longer S(Delta) exposure facilitate the acquisition of discriminated operant responding.

Methylphenidate preferentially increases catecholamine neurotransmission within the prefrontal cortex at low doses that enhance cognitive function.

BACKGROUND: Low doses of psychostimulants, such as methylphenidate (MPH), are widely used in the treatment of attention-deficit/hyperactivity disorder (ADHD). Surprisingly little is known about the neural mechanisms that underlie the behavioral/cognitive actions of these drugs. The prefrontal cortex (PFC) is implicated in ADHD. Moreover, dopamine (DA) and norepinephrine (NE) are important modulators of PFC-dependent cognition. To date, the actions of low-dose psychostimulants on PFC DA and NE neurotransmission are unknown. METHODS: In vivo microdialysis was used to compare the effects of low-dose MPH on NE and DA efflux within the PFC and select subcortical fields in male rats. Doses used (oral, 2.0 mg/kg; intraperitoneal, .25-1.0 mg/kg) were first determined to produce clinically relevant plasma concentrations and to facilitate both PFC-dependent attention and working memory. RESULTS: At low doses that improve PFC-dependent cognitive function and that are devoid of locomotor-activating effects, MPH substantially increases NE and DA efflux within the PFC. In contrast, outside the PFC these doses of MPH have minimal impact on NE and DA efflux. CONCLUSIONS: The current observations suggest that the therapeutic actions of low-dose psychostimulants involve the preferential activation of catecholamine neurotransmission within the PFC.

Dissociable hippocampal and amygdalar D1-like receptor contribution to discriminated Pavlovian conditioned approach learning.

Pavlovian conditioning is an elementary form of reward-related behavioral adaptation. The mesolimbic dopamine system is widely considered to mediate critical aspects of reward-related learning. For example, initial acquisition of positively-reinforced operant behavior requires dopamine (DA) D1 receptor (D1R) activation in the basolateral amygdala (BLA), central nucleus of the amygdala (CeA), and the ventral subiculum (vSUB). However, the role of D1R activation in these areas on appetitive, non-drug-related, Pavlovian learning is not currently known. In separate experiments, microinfusions of the D1-like receptor antagonist SCH-23390 (3.0 nmol/0.5 µL per side) into the amygdala and subiculum preceded discriminated Pavlovian conditioned approach (dPCA) training sessions. D1-like antagonism in all three structures impaired the acquisition of discriminated approach, but had no effect on performance after conditioning was asymptotic. Moreover, dissociable effects of D1-like antagonism in the three structures on components of discriminated responding were obtained. Lastly, the lack of latent inhibition in drug-treated groups may elucidate the role of D1-like in reward-related Pavlovian conditioning. The present data suggest a role for the D1 receptors in the amygdala and hippocampus in learning the significance of conditional stimuli, but not in the expression of conditional responses.

The effect of REM sleep deprivation on motivation for food reward.

Prolonged sleep deprivation in rats produces a characteristic syndrome consisting of an increase in food intake yet a decrease in weight. Moreover, the increase in food intake generally precedes the weight loss, suggesting that sleep deprivation may affect appetitive behaviors. Using the multiple platform method to produce rapid eye movement (REM) sleep deprivation, we investigated the effect of REM sleep deprivation (REMSD) on motivation for food reward utilizing food-reinforced operant tasks. In acquisition or maintenance of an operant task, REM sleep-deprived rats, with or without simultaneous food restriction, decreased responding for sucrose pellet reward in comparison to controls, despite the fact that all REM sleep-deprived rats lost weight. Furthermore, the overall response deficit of the REM sleep-deprived rats was due to a within-session decline in responding. REM sleep-deprived rats showed evidence of understanding the contingency of the task comparable to controls throughout deprivation period, suggesting that the decrements in responding were not primarily related to deficits in learning or memory. Rather, REM sleep deprivation appears to alter systems involved in motivational processes, reward, and/or attention.

Pigeons' choices between fixed-interval and random-interval schedules: utility of variability?

Pigeons' choosing between fixed-interval and random-interval schedules of reinforcement was investigated in three experiments using a discrete-trial procedure. In all three experiments, the random-interval schedule was generated by sampling a probability distribution at an interval (and in multiples of the interval) equal to that of the fixed-interval schedule. Thus the programmed delays to reinforcement on the random alternative were never shorter and were often longer than the fixed interval. Despite this feature, the fixed schedule was not strongly preferred. Increases in the probability used to generate the random interval resulted in decreased preferences for the fixed schedule. In addition, the number of consecutive choices on the preferred alternative varied directly with preference, whereas the consecutive number of choices on the nonpreferred alternative was fairly constant. The probability of choosing the random alternative was unaffected by the immediately prior interval encountered on that schedule, even when it was very long relative to the average value. The results loosely support conceptions of a "preference for variability" from foraging theory and the "utility of behavioral variability" from human decision-making literatures.

Central amygdalar and dorsal striatal NMDA receptor involvement in instrumental learning and spontaneous behavior.

Glutamate-coded signaling in corticostriatal circuits has been shown to be important in various forms of learning and memory. In the present study, the authors found that N-methyl-D-aspartate (NMDA) receptor antagonism in the central nucleus of the amygdala (CeA) and the posterior lateral striatum (PLS) impaired instrumental conditioning but had no effect in the anterior dorsal striatum. NMDA receptor antagonism in the CeA and PLS also affected spontaneous motor behavior and certain aspects of feeding. The present findings extend knowledge of the dynamic neurophysiological processes, instantiated in a complex neural network, required for instrumental learning in the mammalian brain.

Glutamate-mediated plasticity in corticostriatal networks: role in adaptive motor learning.

Little is known about how memories of new voluntary motor actions, also known as procedural memory, are formed at the molecular level. Our work examining acquisition of lever-pressing for food in rats has shown that activation of glutamate NMDA receptors, within broadly distributed but interconnected regions (e.g., nucleus accumbens core, prefrontal cortex, basolateral amygdala), is critical for such learning to occur. This receptor stimulation triggers intracellular cascades that involve protein phosphorylation and new protein synthesis. In support of this idea, we have found that posttrial inhibition of protein synthesis in the ventral striatum impairs learning, whereas posttrial NMDA receptor blockade does not. More recent data show extension of this network to the central amygdala, where infusions of NMDA antagonists also impair learning. We hypothesize that activity in this distributed network (including dopaminergic activity and perhaps muscarinic cholinergic activity) computes coincident events and thus enhances the probability that temporally related actions and events (e.g., lever pressing and delivery of reward) become associated. Such basic mechanisms of plasticity within this reinforcement learning network also appear to be profoundly affected in addiction.

Interactions between the CB1 receptor agonist Delta 9-THC and the CB1 receptor antagonist SR-141716 in rats: open-field revisited.

This study examined the effects of Delta(9)-tetrahydrocannabinol (Delta(9)-THC) and the CB1 antagonist SR-141716 on open-field behaviors in male Sprague-Dawley rats. Animals were examined after administration of Delta(9)-THC alone (dose range: 0.3-5.6 mg/kg), SR-141716 alone (dose range: 1-5.6 mg/kg) and the two drugs in combination; injections were given intraperitoneally 30 min prior to testing. There was a dose-related suppression of ambulation (horizontal activity) and rearing (vertical activity) after Delta(9)-THC administration. Co-administration of SR-141716 counteracted this suppression; however, antagonism was only partial for rearing. Interestingly, 1 mg/kg SR-141716 was as effective as 3 and 5.6 mg/kg SR-141716 in this antagonist action. Increasing doses of Delta(9)-THC produced an increase in circling behavior; latency to leave the starting area in the center of the field was significantly elevated by 5.6 mg/kg Delta(9)-THC. Those effects were completely blocked by SR-141716. Grooming and scratching showed a dose-related increase following administration of SR-141716 (1-5.6 mg/kg), which were only partially blocked by co-administration of Delta(9)-THC (3 and 5.6 mg/kg). When given alone, only the highest dose of SR-141716 (5.6 mg/kg) depressed ambulation; rearing and latency were not significantly changed, and circling was absent. Differences in the number of vocalizations, urination and defecation generally did not differ clearly among the treatment conditions. These results may show that SR-141716 is acting as (i) an inverse agonist and/or (ii) that the endogenous cannabinoid system is tonically active under certain conditions.

The effects of clinically relevant doses of amphetamine and methylphenidate on signal detection and DRL in rats.

Low dose amphetamine (AMPH) and methylphenidate (MPH, Ritalin(®)) are the most widely prescribed and most effective pharmacotherapy for attention-deficit/hyperactivity disorder (ADHD). Certain low, clinically relevant doses of MPH improve sustained attention and working memory in normal rats, in contrast to higher doses that impair cognitive ability and induce locomotor activity. However, the effects of AMPH of MPH on sustained attention and behavioral inhibition remain poorly characterized. The present experiments examined the actions of AMPH (0.1 and 0.25 mg/kg) and MPH (0.5 and 1.0 mg/kg) in a rat model of 1) sustained attention, where signal and blank trials were interspersed randomly and occurred at unpredictable times, and 2) behavioral inhibition, using a differential reinforcement of low rate (DRL) schedule. In a signal detection paradigm, both 0.5 mg/kg and 1.0 mg/kg MPH and 0.25 mg/kg AMPH improve sustained attention, however neither AMPH nor MPH improve behavioral inhibition on DRL. Taken together with other recent studies, it appears that clinically-relevant doses of AMPH and MPH may preferentially improve attention-related behavior while having little effect on behavioral inhibition. These observations provide additional insight into the basic behavioral actions of low-dose psychostimulants and further suggest that the use of sustained attention tasks may be important in the development of novel pharmacological treatments for ADHD.

The clinical relevance of neuroplasticity in corticostriatal networks during operant learning.

Dopamine and glutamate serve crucial functions in neural plasticity, learning and memory, and addiction. Contemporary theories contend that these two, widely-distributed neurotransmitter systems play an integrative role in motivational and associative information processing. Combined signaling of these systems, particularly through the dopamine (DA) D1 and glutamate (Glu) N-methyl-d-aspartate receptors (NMDAR), triggers critical intracellular signaling cascades that lead to changes in chromatin structure, gene expression, synaptic plasticity, and ultimately behavior. Addictive drugs also induce long-term neuroadaptations at the molecular and genomic levels causing structural changes that alter basic connectivity. Indeed, evidence that drugs of abuse engage D1- and NMDA-mediated neuronal cascades shared with normal reward learning provides one of the most important insights from contemporary studies on the neurobiology of addiction. Such drug-induced neuroadaptations likely contribute to abnormal information processing and behavior, resulting in the poor decision-making, loss of control, and compulsivity that characterize addiction. Such features are also common to many other neuropsychiatric disorders. Behavior problems, construed as difficulties associated with operant learning and behavior, present compelling challenges and unique opportunities for their treatment that require further study. The present review highlights the integrative work of Ann E. Kelley and colleagues, demonstrating a critical role not only for NMDAR, D1 receptors (D1R), and their associated signaling cascades, but also for other Glu receptors and protein synthesis in operant learning throughout a cortico-striatal-limbic network. Recent work has extended the impact of appetitive learning to epigenetic processes. A better understanding of these processes will likely assist in discovering therapeutics to engage neural plasticity-related processes and promote functional behavioral adaptations.

Adequacy of maternal iron status protects against behavioral, neuroanatomical, and growth deficits in fetal alcohol spectrum disorders.

Fetal alcohol spectrum disorders (FASD) are the leading non-genetic cause of neurodevelopmental disability in children. Although alcohol is clearly teratogenic, environmental factors such as gravidity and socioeconomic status significantly modify individual FASD risk despite equivalent alcohol intake. An explanation for this variability could inform FASD prevention. Here we show that the most common nutritional deficiency of pregnancy, iron deficiency without anemia (ID), is a potent and synergistic modifier of FASD risk. Using an established rat model of third trimester-equivalent binge drinking, we show that ID significantly interacts with alcohol to impair postnatal somatic growth, associative learning, and white matter formation, as compared with either insult separately. For the associative learning and myelination deficits, the ID-alcohol interaction was synergistic and the deficits persisted even after the offsprings' iron status had normalized. Importantly, the observed deficits in the ID-alcohol animals comprise key diagnostic criteria of FASD. Other neurobehaviors were normal, showing the ID-alcohol interaction was selective and did not reflect a generalized malnutrition. Importantly ID worsened FASD outcome even though the mothers lacked overt anemia; thus diagnostics that emphasize hematological markers will not identify pregnancies at-risk. This is the first direct demonstration that, as suggested by clinical studies, maternal iron status has a unique influence upon FASD outcome. While alcohol is unquestionably teratogenic, this ID-alcohol interaction likely represents a significant portion of FASD diagnoses because ID is more common in alcohol-abusing pregnancies than generally appreciated. Iron status may also underlie the associations between FASD and parity or socioeconomic status. We propose that increased attention to normalizing maternal iron status will substantially improve FASD outcome, even if maternal alcohol abuse continues. These findings offer novel insights into how alcohol damages the developing brain.

A comparison of adult and adolescent rat behavior in operant learning, extinction, and behavioral inhibition paradigms.

Poor self-control, lack of inhibition, and impulsivity contribute to the propensity of adolescents to engage in risky or dangerous behaviors. Brain regions (e.g., prefrontal cortex) involved in impulse-control, reward-processing, and decision-making continue to develop during adolescence, raising the possibility that an immature brain contributes to dangerous behavior during adolescence. However, very few validated animal behavioral models are available for behavioral neuroscientists to explore the relationship between brain development and behavior. To that end, a valid model must be conducted in the relatively brief window of adolescence and not use manipulations that potentially compromise development. The present experiments used three operant arrangements to assess whether adolescent rats differ from adults in measures of learning, behavioral inhibition, and impulsivity, within the aforementioned time frame without substantial food restriction. In Experiment 1, separate squads of rats were trained to lever-press and then transitioned to two types of extinction. Relative to their baselines, adolescent rats responded more during extinction than adults, suggesting that they were less sensitive to the abolishment of the reinforcement contingency. Experiment 2 demonstrated similar age-related differences during exposure to a differential reinforcement of low rates schedule, a test of behavioral inhibition. Lastly, in Experiment 3, adolescent's responding decreased more slowly than adults during exposure to a resetting delay of reinforcement schedule, suggesting impaired self-control. Results from these experiments suggest that adolescents exhibit impaired learning, behavioral inhibition and self-control, and in concert with recent reports, provide researchers with three behavioral models to more fully explore neurobiology of risk-taking behavior in adolescence.

Operant learning requires NMDA-receptor activation in the anterior cingulate cortex and dorsomedial striatum, but not in the orbitofrontal cortex.

Previous research has shown that corticostriatal N-methyl-D-aspartate receptor (NMDAR) activation is necessary for operant learning. NMDAR activation induces plasticity-related intracellular signaling processes leading to gene expression, which are hypothesized to be important steps in codifying the content of learning. Operant learning induces immediate early gene (IEG) expression in key corticostriatal structures, namely the dorsomedial striatum (DMS), the orbitofrontal (OFC), and anterior cingulate cortices (ACC). Both the ACC and OFC send glutamatergic projections to the DMS, which is a crucial site for operant behavior. However, the role of NMDAR activation in these corticostriatal regions in operant learning is unknown. To test this hypothesis, the NMDA antagonist AP-5 (1 microg/0.5 microl) or saline was bilaterally microinjected into the ACC, OFC, and DMS of food-deprived rats just prior to operant learning sessions. NMDAR antagonism in the ACC and DMS impaired the acquisition of lever pressing for sucrose pellets but had no effect on lever pressing once learned. NMDAR blockade in OFC did not significantly impair operant learning, suggesting that NMDAR activation in operant learning is site-specific. These data extend our understanding of the role of NMDA receptors in operant learning and behavior throughout an extended corticostriatal network.

Intra-accumbens infusion of a muscarinic antagonist reduces food intake without altering the incentive properties of food-associated cues.

Previous work has implicated the cholinergic system in modulating feeding behavior; however, its specific function remains unclear. This work aims to characterize potential dissociations between the central cholinergic modulation of the incentive properties of food and food-associated cues, and consummatory behaviors. Three separate experiments demonstrated that intra-accumbens infusion of the muscarinic antagonist scopolamine 3 hr before the testing session significantly decreased food intake. General motor activity in anticipation of food was not diminished. Experiments also showed that scopolamine did not impair operant responding for a food-associated conditioned reinforcer (CR), nor was d-amphetamine potentiation of CR responding altered by scopolamine pretreatment. This study contributes to the growing evidence that goal-seeking behaviors are mediated by a set of neural processes distinct from those governing food reward.

Altered longevity-assurance activity of p53:p44 in the mouse causes memory loss, neurodegeneration and premature death.

The longevity-assurance activity of the tumor suppressor p53 depends on the levels of Delta40p53 (p44), a short and naturally occurring isoform of the p53 gene. As such, increased dosage of p44 in the mouse leads to accelerated aging and short lifespan. Here we show that mice homozygous for a transgene encoding p44 (p44(+/+)) display cognitive decline and synaptic impairment early in life. The synaptic deficits are attributed to hyperactivation of insulin-like growth factor 1 receptor (IGF-1R) signaling and altered metabolism of the microtubule-binding protein tau. In fact, they were rescued by either Igf1r or Mapt haploinsufficiency. When expressing a human or a 'humanized' form of the amyloid precursor protein (APP), p44(+/+) animals developed a selective degeneration of memory-forming and -retrieving areas of the brain, and died prematurely. Mechanistically, the neurodegeneration was caused by both paraptosis- and autophagy-like cell deaths. These results indicate that altered longevity-assurance activity of p53:p44 causes memory loss and neurodegeneration by affecting IGF-1R signaling. Importantly, Igf1r haploinsufficiency was also able to correct the synaptic deficits of APP(695/swe) mice, a model of Alzheimer's disease.

Muscarinic receptor antagonism causes a functional alteration in nucleus accumbens mu-opiate-mediated feeding behavior.

Intra-nucleus accumbens (Acb) infusion of cholinergic muscarinic antagonist, scopolamine (10 microg/0.5 microl), markedly reduced fat intake elicited by intra-Acb treatment of the mu-opioid receptor agonist, DAMGO, with 30 min and 4h pretreatment intervals. Intra-Acb scopolamine infusions also reduced food intake in food-deprived rats, but not water intake in water-deprived rats. Hence, Acb muscarinic manipulations exhibit some specificity for feeding, perhaps via interactions with the striatal opioid system.

Dissociating ventral and dorsal subicular dopamine D1 receptor involvement in instrumental learning, spontaneous motor behavior, and motivation.

A series of experiments investigating the role of dopamine D1 receptors in the ventral subiculum (vSUB) and dorsal subiculum (dSUB), 2 subregions of the hippocampal formation, found that D1 receptor antagonism (3.0 nmol/0.5 microl SCH-23390 bilaterally) in the vSUB impaired instrumental learning and performance, reduced break point in progressive ratio (PR) tests, and produced an intrasession decline in responding during test sessions, but had no effect on spontaneous motor or food-directed behavior. In contrast, D1 receptor blockade in the dSUB had no effect on instrumental learning, performance, PR break point, or food-directed behavior, but reduced spontaneous motor behavior. These results suggest a dissociation between the vSUB and dSUB with respect to the role of dopamine in various aspects of motivated and motor behavior. Further, D1 activation in the vSUB may be a critical component of motivational arousal associated with learned contextual cues.

AMPA/kainate, NMDA, and dopamine D1 receptor function in the nucleus accumbens core: a context-limited role in the encoding and consolidation of instrumental memory.

Neural integration of glutamate- and dopamine-coded signals within the nucleus accumbens (NAc) is a fundamental process governing cellular plasticity underlying reward-related learning. Intra-NAc core blockade of NMDA or D1 receptors in rats impairs instrumental learning (lever-pressing for sugar pellets), but it is not known during which phase of learning (acquisition or consolidation) these receptors are recruited, nor is it known what role AMPA/kainate receptors have in these processes. Here we show that pre-trial intra-NAc core administration of the NMDA, AMPA/KA, and D1 receptor antagonists AP-5 (1 microg/0.5 microL), LY293558 (0.01 or 0.1 microg/0.5 microL), and SCH23390 (1 microg/0.5 microL), respectively, impaired acquisition of a lever-pressing response, whereas post-trial administration left memory consolidation unaffected. An analysis of the microstructure of behavior while rats were under the influence of these drugs revealed that glutamatergic and dopaminergic signals contribute differentially to critical aspects of the initial, randomly emitted behaviors that enable reinforcement learning. Thus, glutamate and dopamine receptors are activated in a time-limited fashion-only being required while the animals are actively engaged in the learning context.