The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards.

Cues that reliably predict rewards trigger the thoughts and emotions normally evoked by those rewards. Humans and other animals will work, often quite hard, for these cues. This is termed conditioned reinforcement. The ability to use conditioned reinforcers to guide our behaviour is normally beneficial; however, it can go awry. For example, corporate icons, such as McDonald's Golden Arches, influence consumer behaviour in powerful and sometimes surprising ways, and drug-associated cues trigger relapse to drug seeking in addicts and animals exposed to addictive drugs, even after abstinence or extinction. Yet, despite their prevalence, it is not known how conditioned reinforcers control human or other animal behaviour. One possibility is that they act through the use of the specific rewards they predict; alternatively, they could control behaviour directly by activating emotions that are independent of any specific reward. In other words, the Golden Arches may drive business because they evoke thoughts of hamburgers and fries, or instead, may be effective because they also evoke feelings of hunger or happiness. Moreover, different brain circuits could support conditioned reinforcement mediated by thoughts of specific outcomes versus more general affective information. Here we have attempted to address these questions in rats. Rats were trained to learn that different cues predicted different rewards using specialized conditioning procedures that controlled whether the cues evoked thoughts of specific outcomes or general affective representations common to different outcomes. Subsequently, these rats were given the opportunity to press levers to obtain short and otherwise unrewarded presentations of these cues. We found that rats were willing to work for cues that evoked either outcome-specific or general affective representations. Furthermore the orbitofrontal cortex, a prefrontal region important for adaptive decision-making, was critical for the former but not for the latter form of conditioned reinforcement.

Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments.

Damage to orbitofrontal cortex (OFC) has long been associated with deficits in reversal learning. OFC damage also causes inflexible associative encoding in basolateral amygdala (ABL) during reversal learning. Here we provide a critical test of the hypothesis that the reversal deficit in OFC-lesioned rats is caused by this inflexible encoding in ABL. Rats with bilateral neurotoxic lesions of OFC, ABL, or both areas were tested on a series of two-odor go/no-go discrimination problems, followed by two serial reversals of the final problem. As expected, all groups acquired the initial problems at the same rate, and rats with OFC lesions were slower to acquire the reversals than sham controls. This impairment was abolished by accompanying ABL lesions, while ABL lesions alone had no effect on reversal learning. These results are consistent with the hypothesis that OFC facilitates cognitive flexibility by promoting updating of associative encoding in downstream brain areas.

Cocaine-induced decision-making deficits are mediated by miscoding in basolateral amygdala.

Addicts and drug-experienced animals have decision-making deficits in reversal-learning tasks and more complex 'gambling' variants. Here we show evidence that these deficits are mediated by persistent encoding of outdated associative information in the basolateral amygdala. Cue-selective neurons in the basolateral amygdala, recorded in cocaine-treated rats, failed to change cue preference during reversal learning. Further, the presence of these neurons was critical to the expression of the reversal-learning deficit in the cocaine-treated rats.

Double dissociation of the effects of medial and orbital prefrontal cortical lesions on attentional and affective shifts in mice.

Many neuropsychiatric diseases are associated with cognitive rigidity linked to prefrontal dysfunction. For example, schizophrenia and Parkinson's disease are associated with performance deficits on the Wisconsin Card Sorting Test, which evaluates attentional set shifting. Although the genetic underpinnings of these disorders can be reproduced in mice, there are few models for testing the functional consequences. Here, we demonstrate that an analog of the Wisconsin Card Sorting Test, developed in marmosets and recently adapted to rats, is a behavioral model of prefrontal function in mice. Systematic analysis demonstrated that formation of the attentional set in mice is dependent on the number of problem sets. We found that mice, like rats and primates, exhibit both affective and attentional sets, and these functions are disrupted by neurotoxic damage to orbitofrontal and medial prefrontal cortical areas, respectively. These data are identical to studies in rats and similar to the deficits reported after prefrontal damage in a comparable task in marmosets. These results provide a behavioral model to assess prefrontal function in mice.

Withdrawal from cocaine self-administration produces long-lasting deficits in orbitofrontal-dependent reversal learning in rats.

Drug addicts make poor decisions. These decision-making deficits have been modeled in addicts and laboratory animals using reversal-learning tasks. However, persistent reversal-learning impairments have been shown in rats and monkeys only after noncontingent cocaine injections. Current thinking holds that to represent the human condition effectively, animal models of addiction must utilize self-administration procedures in which drug is earned contingently; thus, it remains unclear whether reversal-learning deficits caused by noncontingent cocaine exposure are relevant to addiction. To test whether reversal learning deficits are caused by contingent cocaine exposure, we trained rats to self-administer cocaine, assessed cue-induced cocaine seeking in extinction tests after 1 and 30 d of withdrawal, and then tested for reversal learning more than a month later. We found robust time-dependent increases in cue-induced cocaine seeking in the two extinction tests (incubation of craving) and severe reversal-learning impairments.

Conditioned reinforcement can be mediated by either outcome-specific or general affective representations.

Conditioned reinforcers are Pavlovian cues that support the acquisition and maintenance of new instrumental responses. Responding on the basis of conditioned rather than primary reinforcers is a pervasive part of modern life, yet we have a remarkably limited understanding of what underlying associative information is triggered by these cues to guide responding. Specifically, it is not certain whether conditioned reinforcers are effective because they evoke representations of specific outcomes or because they trigger general affective states that are independent of any specific outcome. This question has important implications for how different brain circuits might be involved in conditioned reinforcement. Here, we use specialized Pavlovian training procedures, reinforcer devaluation and transreinforcer blocking, to create cues that were biased to preferentially evoke either devaluation-insensitive, general affect representations or, devaluation-sensitive, outcome-specific representations. Subsequently, these cues, along with normally conditioned control cues, were presented contingent on lever pressing. We found that intact rats learned to lever press for either the outcome or the affect cues to the same extent as for a normally conditioned cue. These results demonstrate that conditioned reinforcers can guide responding through either type of associative information. Interestingly, conditioned reinforcement was abolished in rats with basolateral amygdala lesions. Consistent with the extant literature, this result suggests a general role for basolateral amygdala in conditioned reinforcement. The implications of these data, combined with recent reports from our laboratory of a more specialized role of orbitofrontal cortex in conditioned reinforcement, will be discussed.

Prior cocaine exposure disrupts extinction of fear conditioning.

Psychostimulant exposure has been shown to cause molecular and cellular changes in prefrontal cortex. It has been hypothesized that these drug-induced changes might affect the operation of prefrontal-limbic circuits, disrupting their normal role in controlling behavior and thereby leading to compulsive drug-seeking. To test this hypothesis, we tested cocaine-treated rats in a fear conditioning, inflation, and extinction task, known to depend on medial prefrontal cortex and amygdala. Cocaine-treated rats conditioned and inflated similar to saline controls but displayed slower extinction learning. These results support the hypothesis that control processes in the medial prefrontal cortex are impaired by cocaine exposure.

Cutting corners: the dynamics of turning behaviors in two primate species.

In an attempt to characterize more fully the variation in substrate reaction forces in the locomotor repertoire of primates, we recorded the forces involved in directional changes for two species. These are the first records of turning forces for vertebrate quadrupeds, much less primates. Three ring-tailed lemurs and two patas monkeys performed turns of approximately 30 degrees as they crossed a force platform. The ring-tailed lemurs also turned on a horizontal branch-like support with a segment attached to the force transducer. Mediolateral forces of up to 40% body weight were recorded. These are considerably higher than during linear locomotion. Pivot limbs in ground turns and turns on the branch differed in the lemurs, suggesting that substrate influences turning strategies. Limbs encountered both medial and lateral reaction forces, and as a result, they may be exposed to variable bending regimes in the frontal plane. The stereotypy in bending regimes suggested by in vivo bone strain studies, therefore, may characterize linear locomotion only. The lemurs showed hindlimb dominance in turns, both in terms of frequency used as well as force magnitude (hindlimb steering). Hindlimb dominance in weight support characterizes both species (and primates in general), but it is more pronounced in the lemurs. In the patas monkeys, forces were more evenly distributed among the two pairs of limbs. The mediolateral turning forces therefore seem to track the amount of weight to be shifted sideways. Overall variance in mediolateral forces was greater in the arboreal and versatile lemurs than in the terrestrial and cursorial patas monkeys.

Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making.

Recent evidence has linked exposure to addictive drugs to an inability to employ information about adverse consequences, or outcomes, to control behavior. For instance, addicts and drug-experienced animals fail to adapt their behavior to avoid adverse outcomes in gambling and reversal tasks or after changes in the value of expected rewards. These deficits are similar to those caused by damage to the orbitofrontal cortex, suggesting that addictive drugs may cause long-lasting changes in the representation of outcome associations in a circuit that includes the orbitofrontal cortex. Here we test this hypothesis by recording from orbitofrontal neurons in a discrimination task in rats previously exposed to cocaine (30 mg/kg i.p. for 14 days). We found that orbitofrontal neurons recorded in cocaine-experienced rats failed to signal the adverse outcome at the time a decision was made in the task. The loss of this signal was associated with abnormal changes in response latencies on aversive trials. Furthermore, upon reversal of the cue-outcome associations, orbitofrontal neurons in cocaine-treated rats with enduring reversal impairments failed to reverse their cue-selectivity, while orbitofrontal neurons in cocaine-treated rats with normal performance showed an increase in the plasticity of cue-selective firing after reversal. These results provide direct neurophysiological evidence that exposure to cocaine can cause behaviorally relevant changes in the processing of associative information in a circuit that includes the orbitofrontal cortex.

External forces on the limbs of jumping lemurs at takeoff and landing.

Ground reaction forces were recorded for jumps of three individuals each of Lemur catta and Eulemur fulvus. Animals jumped back and forth between a ground-mounted force plate and a 0.5-m elevated platform, covering horizontal distances of 0.5-2 m. In total, 190 takeoffs and 263 landings were collected. Animals typically jumped from a run up and into a run out, during which they gained or into which they carried horizontal impulse. Correspondingly, vertical impulses dominated takeoffs and landings. Peak forces were moderate in magnitude and not much higher than forces reported for quadrupedal gaits. This is in contrast to the forces for standing jumps of specialized leapers that considerably exceed forces associated with quadrupedal gaits. Force magnitudes for the lemur jumps are more comparable to peak forces reported for other quadrupeds performing running jumps. Takeoffs are characterized by higher hindlimb than forelimb peak forces and impulses. L. catta typically landed with the hindlimbs making first contact, and the hindlimb forces and impulses were higher than the forelimb forces and impulses at landing. E. fulvus typically landed with the forelimbs striking first and also bearing the higher forces. This pattern does not fully conform to the paradigm of primate limb force distribution, with higher hindlimb than forelimb forces. However, the absolute highest forces in E. fulvus also occur at the hindlimbs, during acceleration for takeoff.

Gait mechanics of lemurid primates on terrestrial and arboreal substrates.

Aspects of gait mechanics of two lemurid species were explored experimentally. Substrate reaction forces were recorded for three animals each of L. catta and E. fulvus walking and running at voluntary speeds either on a wooden runway with an integrated force platform or on elevated pole supports with a section attached to the force platform. The average height of the back over these substrates and fluctuations in this height were evaluated using video-analysis. Animals preferred walking gaits and lower speeds on the poles, and gallops and higher speeds on the ground. At overlapping speeds, few adjustments to substrate types were identified. Hind limb peak forces are usually lower on the poles than on the ground, and the caudal back is closer to the substrate. This suggests that greater hind limb flexion and reduced limb stiffness occurred on the poles. The support phases for both limbs at higher speeds are slightly elongated on the poles. Forelimb peak forces are not lower, and the trajectory of the caudal back does not follow a smoother path, i.e., not all elements of a compliant gait are present on the simulated arboreal substrates. The horizontal, rigid poles, offered as substitutes for branchlike supports in the natural habitat, may not pose enough of a challenge to require more substantial gait adjustments. Across substrates, forelimb peak forces are generally lower than hind limb peak forces. The interlimb force distribution is similar to that of most other primates with more even limb lengths. Walking gaits present a greater divergence in fore- and hind limb forces than galloping gaits, which are associated with higher forces. The more arboreal E. fulvus has higher forelimb forces than the more terrestrial L. catta, unlike some anthropoid species in which the arborealists have lower forelimb forces than the terrestrialists. As in other primate and nonprimate quadrupeds, the major propulsive thrust comes from the hind limbs in both lemurs. While our data confirm certain aspects of primate gait mechanics (e.g., generally higher hind limb forces), they do not fully support the notion of greater limb compliance. Neither a compliant forelimb on branchlike supports, nor a negative correlation of forelimb force magnitudes with degree of arboreality were observed. Increasing forelimb-to-hind-limb-force-ratios with increasing speed and force magnitudes are also not expected under this paradigm.