The Neurobiology of Activational Aspects of Motivation: Exertion of Effort, Effort-Based Decision Making, and the Role of Dopamine.

Motivational processes are complex and multifaceted, with both directional and activational aspects. Behavioral activation and exertion of effort are functions that enable organisms to overcome obstacles separating them from significant outcomes. In a complex environment, organisms make cost/benefit decisions, assessing work-related response costs and reinforcer preference. Animal studies have challenged the general idea that dopamine (DA) is best viewed as the reward transmitter and instead have illustrated the involvement of DA in activational and effort-related processes. Mesocorticolimbic DA is a key component of the effort-related motivational circuitry that includes multiple neurotransmitters and brain areas. Human studies have identified brain areas and transmitter systems involved in effort-based decision making and characterized the reduced selection of high-effort activities associated with motivational symptoms of depression and schizophrenia. Animal and human research on the neurochemistry of behavioral activation and effort-related processes makes an important conceptual contribution by illustrating the dissociable nature of distinct aspects of motivation.

Impact of Caffeine on Ethanol-Induced Stimulation and Sensitization: Changes in ERK and DARPP-32 Phosphorylation in Nucleus Accumbens.

BACKGROUND: Caffeine is frequently consumed with ethanol to reduce the impairing effects induced by ethanol, including psychomotor slowing or incoordination. Both drugs modulate dopamine (DA)-related markers in accumbens (Acb), and Acb DA is involved in voluntary locomotion and locomotor sensitization. The present study determined whether caffeine can affect locomotion induced by acute and repeated ethanol administration in adult male CD-1 mice. METHODS: Acute administration of caffeine (7.5 to 30.0 mg/kg) was evaluated for its effects on acute ethanol-induced (1.5 to 3.5 g/kg) changes in open-field horizontal locomotion, supported rearing, and rearing not supported by the wall. DA receptor-dependent phosphorylation markers were assessed: extracellular signal-regulated kinase (pERK), and dopamine-and cAMP-regulated phosphoprotein Mr32kDa phosphorylated at threonine 75 site (pDARPP-32-Thr75) in Acb core and shell. Acutely administered caffeine was also evaluated in ethanol-sensitized (1.5 g/kg) mice. RESULTS: Acute ethanol decreased both types of rearing. Caffeine increased supported rearing but did not block ethanol -induced decreases in rearing. Both substances increased horizontal locomotion in a biphasic manner, and caffeine potentiated ethanol-induced locomotion. Although ethanol administered repeatedly induced sensitization of locomotion and unsupported rearing, acute administration of caffeine to ethanol-sensitized mice in an ethanol-free state resulted in blunted stimulant effects compared with those seen in ethanol-naïve mice. Ethanol increased pERK immunoreactivity in both subregions of the Acb, but coadministration with caffeine blunted this increase. There were no effects on pDARPP-32(Thr75) immunoreactivity. CONCLUSIONS: The present results demonstrated that, after the first administration, caffeine potentiated the stimulating actions of ethanol, but did not counteract its suppressant or ataxic effects. Moreover, our results show that caffeine has less activating effects in ethanol-sensitized animals.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation.

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Preference for vigorous exercise versus sedentary sucrose drinking: an animal model of anergia induced by dopamine receptor antagonism.

Motivation has activational and directional components. Mesolimbic dopamine is critical for the regulation of behavioral activation and effort-related processes in motivated behaviors. Impairing mesolimbic dopamine function leads to fatigue and anergia, but leaves intact other aspects of reinforce seeking behaviors, such as the consummatory or hedonic component. In male Swiss mice, we characterized the impact of dopamine antagonism on the selection of concurrently presented stimuli that have different vigor requirements. We analyzed running wheel activity versus sucrose solution intake, typically used as a measure of anhedonia. Results are compared with data from nonconcurrent presentation to those stimuli. In the concurrent presentation experiment, control mice preferred to spend time running compared to sucrose intake. Dopamine antagonism shifted relative reinforcer preference, reducing time spent on the running wheel, but actually increasing time-consuming sucrose. Mice increased frequency of bouts for both reinforcers, suggesting that there was fatigue in the running wheel rather than aversion. Moreover, satiation or habituation by preexposing animals to both reinforcers did not shift preferences. In the nonconcurrent experiments, haloperidol reduced running wheel but had no impact on sucrose consumption. Dopamine antagonism did not change preference for sucrose or total volume consumed. Additional correlational analyses indicated that baseline differences in sucrose consumption were independent of baseline running or novelty exploration. Thus, dopamine antagonism seems to have anergic rather than anhedonic effects, and the concurrent presentation in this setting could be useful for assessing preferences based on effort requirements.

Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology.

Motivation has been defined as the process that allows organisms to regulate their internal and external environment, and control the probability, proximity and availability of stimuli. As such, motivation is a complex process that is critical for survival, which involves multiple behavioural functions mediated by a number of interacting neural circuits. Classical theories of motivation suggest that there are both directional and activational aspects of motivation, and activational aspects (i.e. speed and vigour of both the instigation and persistence of behaviour) are critical for enabling organisms to overcome work-related obstacles or constraints that separate them from significant stimuli. The present review discusses the role of brain dopamine and related circuits in behavioural activation, exertion of effort in instrumental behaviour, and effort-related decision-making, based upon both animal and human studies. Impairments in behavioural activation and effort-related aspects of motivation are associated with psychiatric symptoms such as anergia, fatigue, lassitude and psychomotor retardation, which cross multiple pathologies, including depression, schizophrenia, and Parkinson's disease. Therefore, this review also attempts to provide an interdisciplinary approach that integrates findings from basic behavioural neuroscience, behavioural economics, clinical neuropsychology, psychiatry, and neurology, to provide a coherent framework for future research and theory in this critical field. Although dopamine systems are a critical part of the brain circuitry regulating behavioural activation, exertion of effort, and effort-related decision-making, mesolimbic dopamine is only one part of a distributed circuitry that includes multiple neurotransmitters and brain areas. Overall, there is a striking similarity between the brain areas involved in behavioural activation and effort-related processes in rodents and in humans. Animal models of effort-related decision-making are highly translatable to humans, and an emerging body of evidence indicates that alterations in effort-based decision-making are evident in several psychiatric and neurological disorders. People with major depression, schizophrenia, and Parkinson's disease show evidence of decision-making biases towards a lower exertion of effort. Translational studies linking research with animal models, human volunteers, and clinical populations are greatly expanding our knowledge about the neural basis of effort-related motivational dysfunction, and it is hoped that this research will ultimately lead to improved treatment for motivational and psychomotor symptoms in psychiatry and neurology.

Oral Ingestion and Intraventricular Injection of Curcumin Attenuates the Effort-Related Effects of the VMAT-2 Inhibitor Tetrabenazine: Implications for Motivational Symptoms of Depression.

Effort-related choice tasks are used for studying depressive motivational symptoms such as anergia/fatigue. These studies investigated the ability of the dietary supplement curcumin to reverse the low-effort bias induced by the monoamine storage blocker tetrabenazine. Tetrabenazine shifted effort-related choice in rats, decreasing high-effort lever pressing but increasing chow intake. The effects of tetrabenazine were reversed by oral ingestion of curcumin (80.0-160.0 mg/kg) and infusions of curcumin into the cerebral ventricles (2.0-8.0 µg). Curcumin attenuates the effort-related effects of tetrabenazine in this model via actions on the brain, suggesting that curcumin may be useful for treating human motivational symptoms.

Effort-related motivational effects of the VMAT-2 inhibitor tetrabenazine: implications for animal models of the motivational symptoms of depression.

Motivated behaviors are often characterized by a high degree of behavioral activation, and work output and organisms frequently make effort-related decisions based upon cost/benefit analyses. Moreover, people with major depression and other disorders often show effort-related motivational symptoms such as anergia, psychomotor retardation, and fatigue. It has been suggested that tasks measuring effort-related choice behavior could be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT) inhibitor tetrabenazine. Tetrabenazine produces depressive symptoms in humans and, because of its selective inhibition of VMAT-2, it preferentially depletes dopamine (DA). Rats were assessed using a concurrent fixed-ratio 5/chow feeding choice task that is known to be sensitive to dopaminergic manipulations. Tetrabenazine shifted response choice in rats, producing a dose-related decrease in lever pressing and a concomitant increase in chow intake. However, it did not alter food intake or preference in parallel free-feeding choice studies. The effects of tetrabenazine on effort-related choice were reversed by the adenosine A2A antagonist MSX-3 and the antidepressant bupropion. A behaviorally active dose of tetrabenazine decreased extracellular DA in nucleus accumbens and increased expression of DARPP-32 in accumbens medium spiny neurons in a pattern indicative of reduced transmission at both D1 and D2 DA receptors. These experiments demonstrate that tetrabenazine, which is used in animal models to produce depression-like effects, can alter effort-related choice behavior. These studies have implications for the development of animal models of the motivational symptoms of depression and related disorders.

Bupropion increases selection of high effort activity in rats tested on a progressive ratio/chow feeding choice procedure: implications for treatment of effort-related motivational symptoms.

BACKGROUND: Depression and related disorders are characterized by deficits in behavioral activation, exertion of effort, and other psychomotor/motivational dysfunctions. Depressed patients show alterations in effort-related decision making and a bias towards selection of low effort activities. It has been suggested that animal tests of effort-related decision making could be useful as models of motivational dysfunctions seen in psychopathology. METHODS: Because clinical studies have suggested that inhibition of catecholamine uptake may be a useful strategy for treatment of effort-related motivational symptoms, the present research assessed the ability of bupropion to increase work output in rats responding on a test of effort-related decision-making (ie, a progressive ratio/chow feeding choice task). With this task, rats can choose between working for a preferred food (high-carbohydrate pellets) by lever pressing on a progressive ratio schedule vs obtaining a less preferred laboratory chow that is freely available in the chamber. RESULTS: Bupropion (10.0-40.0 mg/kg intraperitoneal) significantly increased all measures of progressive ratio lever pressing, but decreased chow intake. These effects were greatest in animals with low baseline levels of work output on the progressive ratio schedule. Because accumbens dopamine is implicated in effort-related processes, the effects of bupropion on markers of accumbens dopamine transmission were examined. Bupropion elevated extracellular dopamine levels in accumbens core as measured by microdialysis and increased phosphorylated dopamine and cyclic-AMP related phosphoprotein 32 kDaltons (pDARPP-32) immunoreactivity in a manner consistent with D1 and D2 receptor stimulation. CONCLUSION: The ability of bupropion to increase exertion of effort in instrumental behavior may have implications for the pathophysiology and treatment of effort-related motivational symptoms in humans.

Pharmacological characterization of sex differences in the effects of dopaminergic drugs on effort-based decision making in rats.

RATIONALE: Motivational dysfunctions related to effort exertion are common in psychiatric disorders. Dopamine systems regulate exertion of effort and effort-based choice in humans and rodents. OBJECTIVES: Previous rodent studies mainly employed male rats, and it is imperative to conduct studies in male and female rats. METHODS: The present studies compared the effort-related effects of IP injections of the dopamine antagonists ecopipam and haloperidol, and the vesicular monoamine transport-2 inhibitor tetrabenazine (TBZ), in male and female rats using the fixed ratio 5/chow feeding choice task. RESULTS: Ecopipam (0.05-0.2 mg/kg) and haloperidol (0.05-0.15 mg/kg) induced a low-effort bias, decreasing lever pressing and increasing chow intake in males and females in the same dose range. With lever pressing, there was a modest but significant dose x sex interaction after ecopipam injection, but there was no significant interaction after administration of haloperidol. In the first study with TBZ (0.25-1.0 mg/kg), there was a robust sex difference. TBZ shifted choice from lever pressing to chow intake in male rats, but was ineffective in females. In a second experiment, 2.0 mg/kg affected choice behavior in both males and females. TBZ increased accumbens c-Fos immunoreactivity in a sex-dependent manner, with males significantly increasing at 1.0 mg/kg, while females showed augmented immunoreactivity at 2.0 mg/kg. CONCLUSIONS: The neural and behavioral effects of TBZ differed across sexes, emphasizing the importance of conducting studies in male and female rats. This research has implications for understanding the effort-related motivational dysfunctions seen in psychopathology.

Potential therapeutics for effort-related motivational dysfunction: assessing novel atypical dopamine transport inhibitors.

People with depression and other neuropsychiatric disorders can experience motivational dysfunctions such as fatigue and anergia, which involve reduced exertion of effort in goal-directed activity. To model effort-related motivational dysfunction, effort-based choice tasks can be used, in which rats can select between obtaining a preferred reinforcer by high exertion of effort vs. a low effort/less preferred option. Preclinical data indicate that dopamine transport (DAT) inhibitors can reverse pharmacologically-induced low-effort biases and increase selection of high-effort options in effort-based choice tasks. Although classical DAT blockers like cocaine can produce undesirable effects such as liability for misuse and psychotic reactions, not all DAT inhibitors have the same neurochemical profile. The current study characterized the effort-related effects of novel DAT inhibitors that are modafinil analogs and have a range of binding profiles and neurochemical actions (JJC8-088, JJC8-089, RDS3-094, and JJC8-091) by using two different effort-related choice behavior tasks in male Sprague-Dawley rats. JJC8-088, JJC8-089, and RDS3-094 significantly reversed the low-effort bias induced by the VMAT-2 inhibitor tetrabenazine, increasing selection of high-effort fixed ratio 5 lever pressing vs. chow intake. In addition, JJC8-089 reversed the effects of tetrabenazine in female rats. JJC8-088 and JJC8-089 also increased selection of high-effort progressive ratio responding in a choice task. However, JJC8-091 failed to produce these outcomes, potentially due to its unique pharmacological profile (i.e., binding to an occluded conformation of DAT). Assessment of a broad range of DAT inhibitors with different neurochemical characteristics may lead to the identification of compounds that are useful for treating motivational dysfunction in humans.

Deep brain stimulation of the subthalamic nucleus reverses oral tremor in pharmacological models of parkinsonism: interaction with the effects of adenosine A2A antagonism.

Deep brain stimulation (DBS) of the subthalamic nucleus is increasingly being employed as a treatment for parkinsonian symptoms, including tremor. The present studies used tremulous jaw movements, a pharmacological model of tremor in rodents, to investigate the tremorolytic effects of subthalamic DBS in rats. Subthalamic DBS reduced the tremulous jaw movements induced by the dopamine D2 family antagonist pimozide and the D1 family antagonist ecopipam, as well as the cholinomimetics pilocarpine and galantamine. The ability of DBS to suppress tremulous jaw movements was dependent on the neuroanatomical locus being stimulated (subthalamic nucleus vs. a striatal control site), as well as the frequency and intensity of stimulation used. Importantly, administration of the adenosine A2A receptor antagonist MSX-3 reduced the frequency and intensity parameters needed to attenuate tremulous jaw movements. These results have implications for the clinical use of DBS, and future studies should determine whether adenosine A2A antagonism could be used to enhance the tremorolytic efficacy of subthalamic DBS at low frequencies and intensities in human patients.

Lipopolysaccharide-induced changes in effort-related motivational function: Interactions with 2-deoxyglucose.

Inflammation is linked to motivational deficits seen in depression and other disorders. Lipopolysaccharide (LPS) induces an inflammatory response and impairs motivated behavior in humans and rodents. It has been suggested that inflammation can shift metabolic needs to functions that warrant more response to the perceived threat (e.g., fighting infection), therefore altering aspects of motivation. Animal models have been developed to assess alterations in motivated behavior by giving the animal the option to work (i.e., lever press) for a highly palatable food reward vs. approaching and consuming a freely available, albeit less preferred, food. This model was used to determine if administration of 2-deoxy-D-glucose (2DG), a substance that inhibits glucose uptake and glycolysis, could reverse the motivational deficits induced by LPS in rats. A food preference/intake task was also conducted to see if LPS affected intake of the highly palatable vs. less palatable foods when both are freely available. It was hypothesized that 2-DG would reverse the motivational deficits caused by LPS and there would be no effect on food preference/intake of the highly palatable food. Results showed that 2-DG significantly reversed LPS effects at the lowest dose, while methylphenidate did not. The food intake/preference tests showed that LPS significantly decreased food intake of both foods but did not alter preference for the highly palatable food compared to vehicle. These results suggest that in addition to having effects on exertion of effort during instrumental behavior, LPS also has direct effects on primary food motivation.

Effects of the dopamine depleting agent tetrabenazine in tests evaluating different components of depressive-like behavior in mice: sex-dependent response to antidepressant drugs with SERT and DAT blocker profiles.

BACKGROUND: Depression is a disorder twice as common in women than in men. There are sex differences in the symptomatology and treatment response to this disorder. Impairments in behavioral activation (i.e. anergia, fatigue) are often seen in people with depression and are highly resistant to treatment. The role of mesolimbic dopamine (DA) in regulating behavioral activation has been extensively studied in male rodents, but little is known in female rodents. OBJECTIVE: The present studies assessed potential sex differences in rodent paradigms used to study different components of depressive-like behavior, and in the treatment response to antidepressants with different mechanisms of action. METHODS: Male and female CD1 mice received Tetrabenazine (TBZ), a VMAT-2 blocker that depletes DA and induces depressive symptoms in humans. Mice were tested on the Forced Swim Test, (FST), the Dark-Light box (DL), the elevated plus maze (EPM), Social Interaction (SI) test, and sucrose preference and consumption using the two bottles test. In addition, bupropion (a DA reuptake inhibitor) or fluoxetine (a serotonin reuptake inhibitor) were used to reverse TBZ-induced anergia. RESULTS: In the FST, bupropion reversed TBZ effects in both sexes but fluoxetine was only effective in female mice. DA depletion did not affect other aspects of depression such as anxiety, sociability or sucrose consumption, and there was no interaction with bupropion on these parameters. In TBZ treated-females SERT-blockers may be effective at reversing anergia in aversive contexts (FST), and potentiating avoidance of anxiogenic stimuli. CONCLUSIONS: Pro-dopaminergic antidepressants seem more efficacious at improving anergia in both sexes than SERT-blockers.

Effort-related effects of chronic administration of the DA D2 receptor antagonist haloperidol via subcutaneous programmable minipumps: Reversal by co-administration of the adenosine A2A antagonist istradefylline.

RATIONALE: Long-acting antipsychotics such as haloperidol decanoate are becoming more commonly used. Long-acting depot formulations have several advantages, but secondary negative effects of prolonged delivery, including motivational dysfunctions, could have debilitating effects. Assessing the behavioral changes that emerge during chronic antipsychotic administration in rats could provide insight regarding the development of motivational dysfunctions and drug tolerance. OBJECTIVES: Acute administration of dopamine D2 antagonists such as haloperidol induce motivational deficits in rats, as marked by a shift towards a low-effort bias during effort-based choice tasks. In the present studies, programmable subcutaneous infusion pumps provided continuous and controlled drug delivery of haloperidol. Animals were assessed using a fixed ratio (FR) 5 lever pressing schedule and the FR5/chow feeding test of effort-based choice. The adenosine A2A antagonist istradefylline was studied for its ability to reverse the effects of chronic haloperidol. RESULTS: Continuous chronic infusions of haloperidol produced significant reductions in FR5 performance and a shift from lever pressing to chow intake in rats tested on FR5/chow feeding choice, with no evidence of tolerance over the 4-week infusion period. Behavior returned to baseline during the vehicle-infusion washout period. Istradefylline significantly reversed the effects of haloperidol, increasing lever pressing and decreasing chow intake in haloperidol-treated rats. CONCLUSIONS: These studies provide an important behavioral characterization of the effects of chronically infused haloperidol, and demonstrate that A2A antagonism reverses the effects of chronic haloperidol. This research could contribute to the understanding and treatment of motivational dysfunctions seen in schizophrenia, Parkinson's disease, and other disorders involving dopamine.

Sex and age differences in mice models of effort-based decision-making and anergia in depression: the role of dopamine, and cerebral-dopamine-neurotrophic-factor.

Mesolimbic dopamine (DA) regulates vigor in motivated behavior. While previous results have mainly been performed in male rodents, the present studies compared CD1 male and female mice in effort-based decision-making tests of motivation. These tests offered choices between several reinforcers that require different levels of effort (progressive ratio/choice task and 3-choice-T-maze task). Sweet reinforcers were used in both tasks. In the operant tasks, females worked harder as the task required more effort to access a 10% sucrose solution. Although males and females did not differ in preference for 10% vs 3% solutions under free concurrent presentation, females consumed more of the 10% solution when tested alone. The operant task requires a long period of training and changes in the DA system due to age can be mediating long-term changes in effort. Thus, age and sex factors were evaluated in the T-maze task, which requires only a short training period. Both sexes and ages were equally active when habituated to the running wheel (RW), but females consumed more sweet pellets than males, especially at an older age. Both sexes had a strong preference for the RW compared to more sedentary reinforcers in the 3-choice-T-maze test, but older animals spent less time running and ate more than the young ones. The DA-depleting agent tetrabenazine reduced time running in older mice but not in adolescents. Cerebral-dopamine-neurotrophic-factor was reduced in older mice of both sexes compared to adolescent mice. These results emphasize the importance of taking into account differences in sex and age when evaluating willingness to exert effort for specific reinforcers.

Effects of the atypical antipsychotic and D3/D2 dopamine partial agonist cariprazine on effort-based choice behavior: implications for modeling avolition.

RATIONALE: Cariprazine is an atypical antipsychotic that acts as a D3/D2 receptor partial agonist. In addition to treating positive symptoms of schizophrenia, cariprazine may have utility for treating negative symptoms. Rodent studies have focused on the effects of cariprazine on cognitive functions and behaviors thought to be related to anhedonia. Avolition, which is characterized by reduced initiation and persistence of goal-directed behavior, is another important negative symptom. OBJECTIVES: Effort-related choice tasks have been used as animal models of avolition. In these studies, cariprazine was assessed for its effects on effort-based choice in both rats and mice. Previous work has shown that D2 antagonists such as haloperidol and eticlopride produce a low-effort bias in rodents tested on effort-based choice tasks. RESULTS: Low doses of cariprazine produced a low-effort bias in rats tested on the fixed ratio 5/chow feeding choice task, decreasing lever pressing for high carbohydrate pellets but increasing chow intake. Cariprazine did not alter preference or intake of these foods in free-feeding tests. The effort-related effects of cariprazine were reversed by co-administration of the adenosine A2A antagonist istradefylline, and cariprazine failed to reverse the effort-related effects of the dopamine-depleting agent tetrabenazine. In mouse touchscreen choice tests, low doses of cariprazine also produced a low-effort bias, shifting behavior away from panel pressing. CONCLUSIONS: These results demonstrate that with these rodent models of avolition, cariprazine appears to act like a D2-family antagonist even at very low doses. Furthermore, the pharmacological regulation of avolition may differ from that of other negative symptoms.

Beyond the symptom: the biology of fatigue.

A workshop titled "Beyond the Symptom: The Biology of Fatigue" was held virtually September 27-28, 2021. It was jointly organized by the Sleep Research Society and the Neurobiology of Fatigue Working Group of the NIH Blueprint Neuroscience Research Program. For access to the presentations and video recordings, see: https://neuroscienceblueprint.nih.gov/about/event/beyond-symptom-biology-fatigue. The goals of this workshop were to bring together clinicians and scientists who use a variety of research approaches to understand fatigue in multiple conditions and to identify key gaps in our understanding of the biology of fatigue. This workshop summary distills key issues discussed in this workshop and provides a list of promising directions for future research on this topic. We do not attempt to provide a comprehensive review of the state of our understanding of fatigue, nor to provide a comprehensive reprise of the many excellent presentations. Rather, our goal is to highlight key advances and to focus on questions and future approaches to answering them.

Midbrain dopamine neurons associated with reward processing innervate the neurogenic subventricular zone.

Coordinated regulation of the adult neurogenic subventricular zone (SVZ) is accomplished by a myriad of intrinsic and extrinsic factors. The neurotransmitter dopamine is one regulatory molecule implicated in SVZ function. Nigrostriatal and ventral tegmental area (VTA) midbrain dopamine neurons innervate regions adjacent to the SVZ, and dopamine synapses are found on SVZ cells. Cell division within the SVZ is decreased in humans with Parkinson's disease and in animal models of Parkinson's disease following exposure to toxins that selectively remove nigrostriatal neurons, suggesting that dopamine is critical for SVZ function and nigrostriatal neurons are the main suppliers of SVZ dopamine. However, when we examined the aphakia mouse, which is deficient in nigrostriatal neurons, we found no detrimental effect to SVZ proliferation or organization. Instead, dopamine innervation of the SVZ tracked to neurons at the ventrolateral boundary of the VTA. This same dopaminergic neuron population also innervated the SVZ of control mice. Characterization of these neurons revealed expression of proteins indicative of VTA neurons. Furthermore, exposure to the neurotoxin MPTP depleted neurons in the ventrolateral VTA and resulted in decreased SVZ proliferation. Together, these results reveal that dopamine signaling in the SVZ originates from a population of midbrain neurons more typically associated with motivational and reward processing.

Changes in nucleus accumbens and neostriatal c-Fos and DARPP-32 immunoreactivity during different stages of food-reinforced instrumental training.

Nucleus accumbens is involved in several aspects of instrumental behavior, motivation and learning. Recent studies showed that dopamine (DA) release in the accumbens shell was significantly increased on the first day of training on a fixed ratio (FR) 5 schedule (i.e. the transition from FR1 to FR5) compared with those rats that continued FR1 training, even though the rats on their first day of FR5 training received less food reinforcement than rats continuing on the FR1 schedule. Additionally, the second day of FR5 responding was marked by a significant increase in DA release in accumbens core. The present studies employed immunohistochemical methods to characterize the changes in cellular markers of accumbens and neostriatal neural activity that occur during various stages of food-reinforced FR5 training. c-Fos and DARPP-32 immunoreactivity in accumbens shell was significantly increased on the first day of FR5 training, while core c-Fos and DARPP-32 expression showed large increases on the second day of FR5 training. Additional studies showed that c-Fos and DARPP-32 expression in neostriatum increased after more extensive training. Double-labeling studies with immunofluorescence methods indicated that increases in accumbens c-Fos and DARPP-32 expression were primarily seen in substance-P-positive neurons. These increases in accumbens c-Fos and DARPP-32 immunoreactivity seen during the initial phases of FR training may reflect several factors, including novelty, learning, stress or the presentation of a work-related challenge to the organism. Moreover, it appears that the separate subregions of the striatal complex are differentially activated at distinct phases of instrumental training.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work.

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.