Temporal Dynamics Underlying Prelimbic Prefrontal Cortical Regulation of Action Selection and Outcome Evaluation during Risk/Reward Decision-Making.

Risk/reward decision-making is a dynamic process that includes periods of deliberation before action selection and evaluation of the action outcomes that bias subsequent choices. Inactivation of the prelimbic (PL) cortex has revealed its integral role in updating decision biases in the face of changes in probabilistic reward contingencies, yet how phasic PL signals during different phases of the decision process influence choice remains unclear. We used temporally specific optogenetic inhibition to selectively disrupt PL activity coinciding with action selection and outcome phases to examine how these signals influence choice. Male rats expressing the inhibitory opsin eArchT within PL excitatory neurons were well trained on a probabilistic discounting task, entailing choice between small/certain versus large/risky rewards, the probability of which varied over a session (50-12.5%). During testing, brief light pulses suppressed PL activity before choice or after different outcomes. Prechoice suppression reduced bias toward more preferred/higher utility options and disrupted how recent outcomes influenced subsequent choice. Inhibition during risky losses induced a similar profile, but here, the impact of reward omissions were either amplified or diminished, relative to the context of the estimated profitability of the risky option. Inhibition during large or small reward receipt reduced risky choice when this option was more profitable, suggesting these signals can both reinforce rewarded risky choices and also act as a relative value comparator signal that augments incentive for larger rewards. These findings reveal multifaceted contributions by the PL in implementing decisions and integrating action-outcome feedback to assign context to the decision space.SIGNIFICANCE STATEMENT The PL prefrontal cortex plays an integral role in guiding risk/reward decisions, but how activity in this region during different phases of the decision process influences choice is unclear. By using temporally specific optogenetic manipulations of this activity, the present study unveiled previously uncharacterized and differential contributions by PL in implementing decision policies and how evaluation of decision outcomes shape subsequent choice. These findings provide novel insight into the dynamic processes engaged by the PL that underlie action selection in situations involving reward uncertainty that may aid in understanding the mechanism underlying normal and aberrant decision-making processes.

Hippocampal neurogenesis promotes effortful responding but does not regulate effort-based choice.

A fundamental trait of depression is low motivation. Hippocampal neurogenesis has been associated with motivational deficits but detailed evidence on how it regulates human-relevant behavioral traits is still missing. We used the hGFAP-TK rat model to deplete actively dividing neural stem cells in the rat hippocampus. Use of the effort-discounting operant task allowed us to identify specific and detailed deficits in motivation behavior. In this task, rats are given a choice between small and large food rewards, where 2-20 lever presses are required to obtain the large reward (four sugar pellets) versus one press to receive the smaller reward (two sugar pellets). We found that depleting adult neurogenesis did not affect effort-based choice or general motivation to complete the task. However, lack of adult neurogenesis reduced the pressing rate and thus increased time to complete the required presses to obtain a reward. In summary, the present study finds that adult hippocampal neurogenesis specifically reduces response vigor to obtain rewards and thus deepens our understanding in how neurogenesis shapes depression.

Hippocampal neurogenesis promotes preference for future rewards.

Adult hippocampal neurogenesis has been implicated in a number of disorders where reward processing is disrupted but whether new neurons regulate specific aspects of reward-related decision making remains unclear. Given the role of the hippocampus in future-oriented cognition, here we tested whether adult neurogenesis regulates preference for future, advantageous rewards in a delay discounting paradigm for rats. Indeed, blocking neurogenesis caused a profound aversion for delayed rewards, and biased choice behavior toward immediately available, but smaller, rewards. Consistent with a role for the ventral hippocampus in impulsive decision making and future-thinking, neurogenesis-deficient animals displayed reduced activity in the ventral hippocampus. In intact animals, delay-based decision making restructured dendrites and spines in adult-born neurons and specifically activated adult-born neurons in the ventral dentate gyrus, relative to dorsal activation in rats that chose between immediately-available rewards. Putative developmentally-born cells, located in the superficial granule cell layer, did not display task-specific activity. These findings identify a novel and specific role for neurogenesis in decisions about future rewards, thereby implicating newborn neurons in disorders where short-sighted gains are preferred at the expense of long-term health.

Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues.

The ability to learn Pavlovian associations from environmental cues predicting positive outcomes is critical for survival, motivating adaptive behaviours. This cued-motivated behaviour depends on the nucleus accumbens (NAc). NAc output activity mediated by spiny projecting neurons (SPNs) is regulated by dopamine, but also by cholinergic interneurons (CINs), which can release acetylcholine and glutamate via the activity of the vesicular acetylcholine transporter (VAChT) or the vesicular glutamate transporter (VGLUT3), respectively. Here we investigated behavioural and neurochemical changes in mice performing a touchscreen Pavlovian approach task by recording dopamine, acetylcholine, and calcium dynamics from D1- and D2-SPNs using fibre photometry in control, VAChT or VGLUT3 mutant mice to understand how these signals cooperate in the service of approach behaviours toward reward-predicting cues. We reveal that NAc acetylcholine-dopaminergic signalling is continuously updated to regulate striatal output underlying the acquisition of Pavlovian approach learning toward reward-predicting cues.

Age-dependent and region-specific alteration of parvalbumin neurons, perineuronal nets and microglia in the mouse prefrontal cortex and hippocampus following obesogenic diet consumption.

Emergent evidence demonstrates that excessive consumption of high fat and high sugar (HFHS) diets has negative consequences on hippocampal and prefrontal cortex (PFC) function. Moreover, the delayed maturation of the PFC including the late development of parvalbumin-expressing (PV) interneurons and perineuronal nets (PNNs) may promote vulnerability to HFHS diet-induced nutritional stress. However, the young brain may have some resistance to diet-induced neuroinflammation. Thus, we examined the impact of a HFHS diet commencing either in adolescence or adulthood in male mice. PV interneurons, PNNs and microglia were assessed using immunohistochemistry. We observed greater numbers of PV neurons and PNNs in the hippocampus and the prelimbic and infralimbic PFC in adult mice in comparison to our younger cohort. Mice that consumed HFHS diet as adults had reduced numbers of hippocampal PV neurons and PNNs, which correlated with adiposity. However, we saw no effects of diet on PV and PNNs in the PFC. HFHS diet increased microgliosis in the adult cohort, and morphological changes to microglia were observed in the PFC and hippocampus of the adolescent cohort, with a shift to activated microglia phenotypes. Taken together, these findings demonstrate different regional and age-specific effects of obesogenic diets on PV neurons, PNNs and microglia.

Correction: Intact memory for local and distal cues in male and female rats that lack adult neurogenesis.

[This corrects the article DOI: 10.1371/journal.pone.0197869.].

Intact memory for local and distal cues in male and female rats that lack adult neurogenesis.

The dentate gyrus is essential for remembering the fine details of experiences that comprise episodic memory. Dentate gyrus granule cells receive highly-processed sensory information and are hypothesized to perform a pattern separation function, whereby similar sensory inputs are transformed into orthogonal neural representations. Behaviorally, this is believed to enable distinct memory for highly interfering stimuli. Since the dentate gyrus is comprised of a large number of adult-born neurons, which have unique synaptic wiring and neurophysiological firing patterns, it has been proposed that neurogenesis may contribute to this process in unique ways. Some behavioral evidence exists to support this role, whereby neurogenesis-deficient rodents are impaired at discriminating the fine visuospatial details of experiences. However, the extent to which newborn neurons contribute to dentate gyrus-dependent learning tasks is unclear. Furthermore, since most studies of dentate gyrus function are conducted in male rats, little is known about how females perform in similar situations, and whether there might be sex differences in the function of adult neurogenesis. To address these issues, we examined spatial discrimination memory in transgenic male and female rats that lacked adult neurogenesis. The first task probed memory for the position of local objects in an open field, assessed by behavioral responses to novel object locations. The second task examined memory for distal environmental cues. All rats were able to successfully discriminate local and distal cue changes. Males and females also performed comparably, although females displayed higher levels of rearing and locomotion. Collectively, our results indicate that rats are capable of learning about local and distal cues in the absence of adult neurogenesis.

Optogenetic Dissection of Temporal Dynamics of Amygdala-Striatal Interplay during Risk/Reward Decision Making.

Decision making often requires weighing costs and benefits of different options that vary in terms of reward magnitude and uncertainty. Previous studies using pharmacological inactivations have shown that the basolateral amygdala (BLA) to nucleus accumbens (NAc) pathway promotes choice towards larger/riskier rewards. Neural activity in BLA and NAc shows distinct, phasic changes in firing prior to choice and following action outcomes, yet, how these temporally-discrete patterns of activity within BLA→NAc circuitry influence choice is unclear. We assessed how optogenetic silencing of BLA terminals in the NAc altered action selection during probabilistic decision making. Rats received intra-BLA infusions of viruses encoding the inhibitory opsin eArchT and were well trained on a probabilistic discounting task, where they chose between smaller/certain rewards and larger rewards delivered in a probabilistic manner, with the odds of obtaining the larger reward changing over a session (50-12.5%). During testing, activity of BLA→NAc inputs were suppressed with 4- to 7-s pulses of light delivered via optic fibers into the NAc during discrete task events: prior to choice or after choice outcomes. Inhibition prior to choice reduced selection of the preferred option, suggesting that during deliberation, BLA→NAc activity biases choice towards preferred rewards. Inhibition during reward omissions increased risky choice during the low-probability block, indicating that activity after non-rewarded actions serves to modify subsequent choice. In contrast, silencing during rewarded outcomes did not reliably affect choice. These data demonstrate how patterns of activity in BLA→NAc circuitry convey different types of information that guide action selection in situations involving reward uncertainty.