Cerebellar Neurodynamics Predict Decision Timing and Outcome on the Single-Trial Level.

Goal-directed behavior requires the interaction of multiple brain regions. How these regions and their interactions with brain-wide activity drive action selection is less understood. We have investigated this question by combining whole-brain volumetric calcium imaging using light-field microscopy and an operant-conditioning task in larval zebrafish. We find global, recurring dynamics of brain states to exhibit pre-motor bifurcations toward mutually exclusive decision outcomes. These dynamics arise from a distributed network displaying trial-by-trial functional connectivity changes, especially between cerebellum and habenula, which correlate with decision outcome. Within this network the cerebellum shows particularly strong and predictive pre-motor activity (>10 s before movement initiation), mainly within the granule cells. Turn directions are determined by the difference neuroactivity between the ipsilateral and contralateral hemispheres, while the rate of bi-hemispheric population ramping quantitatively predicts decision time on the trial-by-trial level. Our results highlight a cognitive role of the cerebellum and its importance in motor planning.

Time-scale invariant contingency yields one-shot reinforcement learning despite extremely long delays to reinforcement.

Reinforcement learning inspires much theorizing in neuroscience, cognitive science, machine learning, and AI. A central question concerns the conditions that produce the perception of a contingency between an action and reinforcement-the assignment-of-credit problem. Contemporary models of associative and reinforcement learning do not leverage the temporal metrics (measured intervals). Our information-theoretic approach formalizes contingency by time-scale invariant temporal mutual information. It predicts that learning may proceed rapidly even with extremely long action-reinforcer delays. We show that rats can learn an action after a single reinforcement, even with a 16-min delay between the action and reinforcement (15-fold longer than any delay previously shown to support such learning). By leveraging metric temporal information, our solution obviates the need for windows of associability, exponentially decaying eligibility traces, microstimuli, or distributions over Bayesian belief states. Its three equations have no free parameters; they predict one-shot learning without iterative simulation.

Different Effects of Peer Sex on Operant Responding for Social Interaction and Striatal Dopamine Activity.

When rats are given discrete choices between social interactions with a peer and opioid or psychostimulant drugs, they choose social interaction, even after extensive drug self-administration experience. Studies show that like drug and nondrug food reinforcers, social interaction is an operant reinforcer and induces dopamine release. However, these studies were conducted with same-sex peers. We examined if peer sex influences operant social interaction and the role of estrous cycle and striatal dopamine in same- versus opposite-sex social interaction. We trained male and female rats (n = 13 responders/12 peers) to lever-press (fixed-ratio 1 [FR1] schedule) for 15 s access to a same- or opposite-sex peer for 16 d (8 d/sex) while tracking females' estrous cycle. Next, we transfected GRAB-DA2m and implanted optic fibers into nucleus accumbens (NAc) core and dorsomedial striatum (DMS). We then retrained the rats for 15 s social interaction (FR1 schedule) for 16 d (8 d/sex) and recorded striatal dopamine during operant responding for a peer for 8 d (4 d/sex). Finally, we assessed economic demand by manipulating FR requirements for a peer (10 d/sex). In male, but not female rats, operant responding was higher for the opposite-sex peer. Female's estrous cycle fluctuations had no effect on operant social interaction. Striatal dopamine signals for operant social interaction were dependent on the peer's sex and striatal region (NAc core vs DMS). Results indicate that estrous cycle fluctuations did not influence operant social interaction and that NAc core and DMS dopamine activity reflect sex-dependent features of volitional social interaction.

Neuronal Ensembles in the Amygdala Allow Social Information to Motivate Later Decisions.

Social experiences carry tremendous weight in our decision-making, even when social partners are not present. To determine mechanisms, we trained female mice to respond for two food reinforcers. Then, one food was paired with a novel conspecific. Mice later favored the conspecific-associated food, even in the absence of the conspecific. Chemogenetically silencing projections from the prelimbic subregion (PL) of the medial prefrontal cortex to the basolateral amygdala (BLA) obstructed this preference while leaving social discrimination intact, indicating that these projections are necessary for socially driven choice. Further, mice that performed the task had greater densities of dendritic spines on excitatory BLA neurons relative to mice that did not. We next induced chemogenetic receptors in cells active during social interactions-when mice were encoding information that impacted later behavior. BLA neurons stimulated by social experience were necessary for mice to later favor rewards associated with social conspecifics but not make other choices. This profile contrasted with that of PL neurons stimulated by social experience, which were necessary for choice behavior in social and nonsocial contexts alike. The PL may convey a generalized signal allowing mice to favor particular rewards, while units in the BLA process more specialized information, together supporting choice motivated by social information.

From Prediction to Action: Dissociable Roles of Ventral Tegmental Area and Substantia Nigra Dopamine Neurons in Instrumental Reinforcement.

Reward seeking requires the coordination of motor programs to achieve goals. Midbrain dopamine neurons are critical for reinforcement, and their activation is sufficient for learning about cues, actions, and outcomes. Here we examine in detail the mechanisms underlying the ability of ventral tegmental area (VTA) and substantia nigra (SNc) dopamine neurons to support instrumental learning. By exploiting numerous behavioral tasks in combination with time-limited optogenetic manipulations in male and female rats, we reveal that VTA and SNc dopamine neurons generate reinforcement through separable psychological processes. VTA dopamine neurons imbue actions and their associated cues with motivational value that allows flexible and persistent pursuit, whereas SNc dopamine neurons support time-limited, precise, action-specific learning that is nonscalable and inflexible. This architecture is reminiscent of actor-critic reinforcement learning models with VTA and SNc instructing the critic and actor, respectively. Our findings indicate that heterogeneous dopamine systems support unique forms of instrumental learning that ultimately result in disparate reward-seeking strategies.SIGNIFICANCE STATEMENT Dopamine neurons in the midbrain are essential for learning, motivation, and movement. Here we describe in detail the ability of VTA and SNc dopamine neurons to generate instrumental reinforcement, a process where an agent learns about actions they can emit to earn reward. While rats will avidly work and learn to respond for activation of VTA and SNc dopamine neurons, we find that only VTA dopamine neurons imbue actions and their associated cues with motivational value that spur continued pursuit of reward. Our data support a hypothesis that VTA and SNc dopamine neurons engage distinct psychological processes that have consequences for our understanding of these neurons in health and disease.

Anticipation of Appetitive Operant Action Induces Sustained Dopamine Release in the Nucleus Accumbens.

The mesolimbic dopamine system is implicated in signaling reward-related information as well as in actions that generate rewarding outcomes. These implications are commonly investigated in either pavlovian or operant reinforcement paradigms, where only the latter requires instrumental action. To parse contributions of reward- and action-related information to dopamine signals, we directly compared the two paradigms: male rats underwent either pavlovian or operant conditioning while dopamine release was measured in the nucleus accumbens, a brain region central for processing this information. Task conditions were identical with the exception of the operant-lever response requirement. Rats in both groups released the same quantity of dopamine at the onset of the reward-predictive cue. However, only the operant-conditioning group showed a subsequent, sustained plateau in dopamine concentration throughout the entire 5 s cue presentation (preceding the required action). This dopamine ramp was unaffected by probabilistic reward delivery, occurred exclusively before operant actions, and was not related to task performance or task acquisition as it persisted throughout the 2 week daily behavioral training. Instead, the ramp flexibly increased in duration with longer cue presentation, seemingly modulating the initial cue-onset-triggered dopamine release, that is, the reward prediction error (RPE) signal, as both signal amplitude and sustainment diminished when reward timing was made more predictable. Thus, our findings suggest that RPE and action components of dopamine release can be differentiated temporally into phasic and ramping/sustained signals, respectively, where the latter depends on the former and presumably reflects the anticipation or incentivization of appetitive action, conceptually akin to motivation.SIGNIFICANCE STATEMENT It is unclear whether the components of dopamine signals that are related to reward-associated information and reward-driven approach behavior can be separated. Most studies investigating the dopamine system use either pavlovian or operant conditioning, which both involve the delivery of reward and necessitate appetitive approach behavior. Thus, used exclusively, neither paradigm can disentangle the contributions of these components to dopamine release. However, by combining both paradigms in the same study, we find that anticipation of a reward-driven operant action induces a modulation of reward-prediction-associated dopamine release, producing so-called dopamine ramps. Therefore, our findings provide new insight into dopamine ramps and suggest that dopamine signals integrate reward and appetitive action in a temporally distinguishable, yet dependent, manner.

Motor learning changes the axon initial segment of the spinal motoneuron.

We are studying the mechanisms of H-reflex operant conditioning, a simple form of learning. Modelling studies in the literature and our previous data suggested that changes in the axon initial segment (AIS) might contribute. To explore this, we used blinded quantitative histological and immunohistochemical methods to study in adult rats the impact of H-reflex conditioning on the AIS of the spinal motoneuron that produces the reflex. Successful, but not unsuccessful, H-reflex up-conditioning was associated with greater AIS length and distance from soma; greater length correlated with greater H-reflex increase. Modelling studies in the literature suggest that these increases may increase motoneuron excitability, supporting the hypothesis that they may contribute to H-reflex increase. Up-conditioning did not affect AIS ankyrin G (AnkG) immunoreactivity (IR), p-p38 protein kinase IR, or GABAergic terminals. Successful, but not unsuccessful, H-reflex down-conditioning was associated with more GABAergic terminals on the AIS, weaker AnkG-IR, and stronger p-p38-IR. More GABAergic terminals and weaker AnkG-IR correlated with greater H-reflex decrease. These changes might potentially contribute to the positive shift in motoneuron firing threshold underlying H-reflex decrease; they are consistent with modelling suggesting that sodium channel change may be responsible. H-reflex down-conditioning did not affect AIS dimensions. This evidence that AIS plasticity is associated with and might contribute to H-reflex conditioning adds to evidence that motor learning involves both spinal and brain plasticity, and both neuronal and synaptic plasticity. AIS properties of spinal motoneurons are likely to reflect the combined influence of all the motor skills that share these motoneurons. KEY POINTS: Neuronal action potentials normally begin in the axon initial segment (AIS). AIS plasticity affects neuronal excitability in development and disease. Whether it does so in learning is unknown. Operant conditioning of a spinal reflex, a simple learning model, changes the rat spinal motoneuron AIS. Successful, but not unsuccessful, H-reflex up-conditioning is associated with greater AIS length and distance from soma. Successful, but not unsuccessful, down-conditioning is associated with more AIS GABAergic terminals, less ankyrin G, and more p-p38 protein kinase. The associations between AIS plasticity and successful H-reflex conditioning are consistent with those between AIS plasticity and functional changes in development and disease, and with those predicted by modelling studies in the literature. Motor learning changes neurons and synapses in spinal cord and brain. Because spinal motoneurons are the final common pathway for behaviour, their AIS properties probably reflect the combined impact of all the behaviours that use these motoneurons.

A whole-brain analysis of functional connectivity and immediate early gene expression reveals functional network shifts after operant learning.

Previous studies of operant learning have addressed neuronal activities and network changes in specific brain areas, such as the striatum, sensorimotor cortex, prefrontal/orbitofrontal cortices, and hippocampus. However, how changes in the whole-brain network are caused by cellular-level changes remains unclear. We, therefore, combined resting-state functional magnetic resonance imaging (rsfMRI) and whole-brain immunohistochemical analysis of early growth response 1 (EGR1), a marker of neural plasticity, to elucidate the temporal and spatial changes in functional networks and underlying cellular processes during operant learning. We used an 11.7-Tesla MRI scanner and whole-brain immunohistochemical analysis of EGR1 in mice during the early and late stages of operant learning. In the operant training, mice received a reward when they pressed left and right buttons alternately, and were punished with a bright light when they made a mistake. A group of mice (n = 22) underwent the first rsfMRI acquisition before behavioral sessions, the second acquisition after 3 training-session-days (early stage), and the third after 21 training-session-days (late stage). Another group of mice (n = 40) was subjected to histological analysis 15 min after the early or late stages of behavioral sessions. Functional connectivity increased between the limbic areas and thalamus or auditory cortex after the early stage of training, and between the motor cortex, sensory cortex, and striatum after the late stage of training. The density of EGR1-immunopositive cells in the motor and sensory cortices increased in both the early and late stages of training, whereas the density in the amygdala increased only in the early stage of training. The subcortical networks centered around the limbic areas that emerged in the early stage have been implicated in rewards, pleasures, and fears. The connectivities between the motor cortex, somatosensory cortex, and striatum that consolidated in the late stage have been implicated in motor learning. Our multimodal longitudinal study successfully revealed temporal shifts in brain regions involved in behavioral learning together with the underlying cellular-level plasticity between these regions. Our study represents a first step towards establishing a new experimental paradigm that combines rsfMRI and immunohistochemistry to link macroscopic and microscopic mechanisms involved in learning.

The longitudinal behavioral effects of acute exposure to galactic cosmic radiation in female C57BL/6J mice: Implications for deep space missions, female crews, and potential antioxidant countermeasures.

Galactic cosmic radiation (GCR) is an unavoidable risk to astronauts that may affect mission success. Male rodents exposed to 33-beam-GCR (33-GCR) show short-term cognitive deficits but reports on female rodents and long-term assessment are lacking. We asked: What are the longitudinal behavioral effects of 33-GCR on female mice? Also, can an antioxidant/anti-inflammatory compound (CDDO-EA) mitigate the impact of 33-GCR? Mature (6-month-old) C57BL/6J female mice received CDDO-EA (400 µg/g of food) or a control diet (vehicle, Veh) for 5 days and Sham-irradiation (IRR) or whole-body 33-GCR (0.75Gy) on the 4th day. Three-months post-IRR, mice underwent two touchscreen-platform tests: (1) location discrimination reversal (tests behavior pattern separation and cognitive flexibility, abilities reliant on the dentate gyrus) and (2) stimulus-response learning/extinction. Mice then underwent arena-based behavior tests (e.g. open field, 3-chamber social interaction). At the experiment's end (14.25-month post-IRR), an index relevant to neurogenesis was quantified (doublecortin-immunoreactive [DCX+] dentate gyrus immature neurons). Female mice exposed to Veh/Sham vs. Veh/33-GCR had similar pattern separation (% correct to 1st reversal). There were two effects of diet: CDDO-EA/Sham and CDDO-EA/33-GCR mice had better pattern separation vs. their respective control groups (Veh/Sham, Veh/33-GCR), and CDDO-EA/33-GCR mice had better cognitive flexibility (reversal number) vs. Veh/33-GCR mice. One radiation effect/CDDO-EA countereffect also emerged: Veh/33-GCR mice had slower stimulus-response learning (days to completion) vs. all other groups, including CDDO-EA/33-GCR mice. In general, all mice showed normal anxiety-like behavior, exploration, and habituation to novel environments. There was also a change relevant to neurogenesis: Veh/33-GCR mice had fewer DCX+ dentate gyrus immature neurons vs. Veh/Sham mice. Our study implies space radiation is a risk to a female crew's longitudinal mission-relevant cognitive processes and CDDO-EA is a potential dietary countermeasure for space-radiation CNS risks.

Does phasic dopamine release cause policy updates?

Phasic dopamine activity is believed to both encode reward-prediction errors (RPEs) and to cause the adaptations that these errors engender. If so, a rat working for optogenetic stimulation of dopamine neurons will repeatedly update its policy and/or action values, thus iteratively increasing its work rate. Here, we challenge this view by demonstrating stable, non-maximal work rates in the face of repeated optogenetic stimulation of midbrain dopamine neurons. Furthermore, we show that rats learn to discriminate between world states distinguished only by their history of dopamine activation. Comparison of these results to reinforcement learning simulations suggests that the induced dopamine transients acted more as rewards than RPEs. However, pursuit of dopaminergic stimulation drifted upwards over a time scale of days and weeks, despite its stability within trials. To reconcile the results with prior findings, we consider multiple roles for dopamine signalling.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance.

Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.

Attentional processing in the rat dorsal posterior parietal cortex.

The human posterior parietal cortex (PPC) is known to support sustained attention. Specifically, top-down attention is generally processed in dorsal regions while bottom-up regulation occurs more ventrally. In rodent models, however, it is still unclear whether the PPC is required for sustained attention, or whether there is a similar functional dissociation between anatomical regions. Consequently, the aim of this study was to investigate the contribution of the rodent dorsal PPC (dPPC) in sustained attention. We used the five-choice serial reaction time task (5CSRTT) and compared rats with neurotoxic dPPC lesions to sham operated rats. We found that rats with dPPC lesions were less accurate and took longer to make correct choices, indicating impaired attention and reduced processing speed. This effect, however, was limited to the first few days of post-operative testing. After an apparent recovery, omissions became elevated in the lesion group, which, in the absence of reduced motivation and mobility, can also be interpreted as impaired attention. In subsequent challenge probes, the lesion group displayed globally elevated latency to make a correct response, indicating reduced processing speed. No differences in premature responses or perseverative responses were observed at any time, demonstrating that dPPC lesions did not affect impulsivity and compulsivity. This pattern of behavior suggests that while intact dPPC supports goal-driven (top-down) modulation of attention, it likely does not play a central role in processing stimulus-driven (bottom-up) attention. Furthermore, compensatory mechanisms can support sustained attention in the absence of a fully functioning dPPC, although this occurs at the expense of processing speed. Our results inform the literature by confirming that rodent PPC is involved in regulating sustained attention and providing preliminary evidence for a functional dissociation between top-down and bottom-up attentional processing.

Investigating the interactions between multiple memory stores in the pond snail Lymnaea stagnalis.

The pond snail Lymnaea stagnalis exhibits various forms of associative learning including (1) operant conditioning of aerial respiration where snails are trained not to open their pneumostome in a hypoxic pond water environment using a weak tactile stimulus to their pneumostome as they attempt to open it; and (2) a 24 h-lasting taste-specific learned avoidance known as the Garcia effect utilizing a lipopolysaccharide (LPS) injection just after snails eat a novel food substance (carrot). Typically, lab-inbred snails require two 0.5 h training sessions to form long-term memory (LTM) for operant conditioning of aerial respiration. However, some stressors (e.g., heat shock or predator scent) act as memory enhancers and thus a single 0.5 h training session is sufficient to enhance LTM formation lasting at least 24 h. Here, we found that snails forming a food-aversion LTM following Garcia-effect training exhibited enhanced LTM following operant condition of aerial respiration if trained in the presence of the food substance (carrot) they became averse to. Control experiments led us to conclude that carrot becomes a 'sickness' risk signal and acts as a stressor, sufficient to enhance LTM formation for another conditioning procedure.

Hearing in helmeted guineafowl (Numida meleagris): audiogram from 2 Hz to 10 kHz and localization acuity for brief noise bursts.

Behavioral hearing thresholds and noise localization acuity were determined using a conditioned avoidance/suppression procedure for three Helmeted guineafowl (Numida meleagris). The guineafowl responded to frequencies as low as 2 Hz at 82.5 dB SPL, and as high as 8 kHz at 84.5 dB SPL. At a level of 60 dB SPL, their hearing range spanned 8.12 octaves (24.6 Hz-6.86 kHz). Like most birds, they do not hear sounds above 8 kHz. However, the guineafowl demonstrated good low-frequency hearing (frequencies below 32 Hz), showing thresholds that are more sensitive than both the peafowl and pigeon, both of which hear infrasound. It thus appears that infrasound perception may be more common than previously thought and may have implications for species that inhabit areas with wind energy facilities. The guineafowls' minimum audible angle for a 100-ms broadband noise burst was 13.8 °, at the median for birds and near the mean for mammals. Unlike in mammals, the small sample of bird species and limited representation of lifestyles do not yet allow for meaningful interpretations of the selective pressures or mechanisms that underlie their abilities to locate sound sources.

Levonorgestrel maintains goal-directed behavior in habit-trained intact female rats.

Hormonal contraceptives are utilized by millions of women worldwide. However, it remains unclear if these powerful endocrine modulators may alter cognitive function. Habit formation involves the progression of instrumental learning as it goes from being a conscious goal-directed process to a cue-driven automatic habitual motor response. Dysregulated goal and/or habit is implicated in numerous psychopathologies, underscoring the relevance of examining the effect of hormonal contraceptives on goal-directed and habitual behavior. This study examined the effect of levonorgestrel (LNG), a widely used progestin-type contraceptive, on the development of habit in intact female rats. Rats were implanted with subcutaneous capsules that slowly released LNG over the course of the experiment or cholesterol-filled capsules. All female rats underwent operant training followed by reward devaluation to test for habit. One group of females was trained at a level that is sub-threshold to habit, while another group of females was trained to a level well over the habit threshold observed in intact females. The results reveal that all sub-threshold trained rats remained goal-directed irrespective of LGN treatment, suggesting LNG is not advancing habit formation in female rats at this level of reinforcement. However, in rats that were overtrained well above the threshold, cholesterol females showed habitual behavior, thus replicating a portion of our original studies. In contrast, LNG-treated habit-trained rats remained goal-directed, indicating that LNG impedes the development and/or expression of habit following this level of supra-threshold to habit training. Thus, LNG may offset habit formation by sustaining attentional or motivational processes during learning in intact female rats. These results may be clinically relevant to women using this type of hormonal contraceptive as well as in other progestin-based hormone therapies.

Prairie voles seek social contact with peer companions during immune challenge.

Selection for group living has occurred across taxa, despite inherent risk of disease transmission. Behavioral and immune responses to sickness affect social interactions and can be altered by social contexts. However, the majority of research on sickness behavior has focused on species that do not form selective social relationships. Prairie voles (Microtus ochrogaster) form selective social relationships with mates and peers and provide a useful study system to examine effects of sickness on social seeking in established relationships. We used peripheral injections of lipopolysaccharide (LPS) of E. coli to stimulate the innate immune system and verified effects on activity, core temperature, and corticosterone concentrations for 6 h following treatment. We demonstrated that male and female same-sex pairs of prairie voles increase social contact when sick and that this increase persists when contact is initiated by the sick vole. Finally, we assessed social motivation following immune challenge using operant choice chambers equipped with two levers and side chambers. Voles worked to gain access to chambers with social and non-social rewards. While overall effort decreased following LPS injection, only immune-challenged voles worked significantly harder for their companion than for a non-social chamber. LPS treatment also increased proportion of rewards earned for the partner versus a stranger and again led to increased huddling behavior. Prior studies in other rodent species have shown decreased social interaction when sick; the present results demonstrate an alternative outcome of sickness in the context of dyadic bonds and lay the foundation for future work in peer companions.

Repeated exposure to physiologically effective doses of contraceptive hormones ethinyl estradiol or levonorgestrel do not alter the reinforcing effects of a brief visual stimulus in ovary-intact rats.

Estradiol and progesterone potentiate and attenuate reward processes, respectively. Despite these well-characterized effects, there is minimal research on the effects of synthetic estrogens (e.g., ethinyl estradiol, or EE) and progestins (e.g., levonorgestrel, or LEVO) contained in clinically-utilized hormonal contraceptives. The present study characterized the separate effects of repeated exposure to EE or LEVO on responding maintained by a reinforcing visual stimulus. Forty ovary-intact female Sprague-Dawley rats received either sesame oil vehicle (n = 16), 0.18 µg/day EE (n = 16), or 0.6 µg/day LEVO (n = 8) subcutaneous injections 30-min before daily one-hour sessions. Rats' responding was maintained by a 30-sec visual stimulus on a Variable Ratio-3 schedule of reinforcement. The day after rats' last session, we determined rats estrous cycle phase via vaginal cytology before sacrifice and subsequently weighing each rat's uterus to further verify the contraceptive hormone manipulation. The visual stimulus functioned as a reinforcer, but neither EE nor LEVO enhanced visual stimulus maintained responding. Estrous cytology was consistent with normal cycling in vehicle rats and halting of normal cycling in EE and LEVO rats. EE increased uterine weights consistent with typical uterotrophic effects observed with estrogens, further confirming the physiological impacts of our EE and LEVO doses. In conclusion, a physiologically effective dose of neither EE nor LEVO did not alter the reinforcing efficacy of a visual stimulus reinforcer. Future research should characterize the effects of hormonal contraceptives on responding maintained by other reinforcer types to determine the generality of the present findings.

To know or not to know? Curiosity and the value of prospective information in animals.

Humans and other animals often seek instrumental information to strategically improve their decisions in the present. Our curiosity also leads us to acquire non-instrumental information that is not immediately useful but can be encoded in memory and stored for use in the future by means of episodic recall. Despite its adaptive benefits and central role in human cognition, questions remain about the cognitive mechanisms and evolutionary origins that underpin curiosity. Here, we comparatively review recent empirical studies that some authors have suggested reflects curiosity in nonhuman animals. We focus on findings from laboratory tasks in which individuals can choose to gain advanced information about uncertain future outcomes, even though the information cannot be used to increase future rewards and is often costly. We explore the prevalence of preferences in these tasks across animals, discuss the theoretical advances that they have promoted, and outline some limitations in contemporary research. We also discuss several features of human curiosity that can guide future empirical research aimed at characterising and understanding curiosity in animals. Though the prevalence of curiosity in animals is actively debated, we surmise that investigating behavioural candidates for curiosity-motivated behaviour in a broader range of species and contexts, should help promote theoretical advances in our understanding of cognitive principles and evolutionary pressures that support curiosity-driven behaviour.

Ventral pallidum regulates the default mode network, controlling transitions between internally and externally guided behavior.

Daily life requires transitions between performance of well-practiced, automatized behaviors reliant upon internalized representations and behaviors requiring external focus. Such transitions involve differential activation of the default mode network (DMN), a group of brain areas associated with inward focus. We asked how optogenetic modulation of the ventral pallidum (VP), a subcortical DMN node, impacts task switching between internally to externally guided lever-pressing behavior in the rat. Excitation of the VP dramatically compromised acquisition of an auditory discrimination task, trapping animals in a DMN state of automatized internally focused behavior and impairing their ability to direct attention to external sensory stimuli. VP inhibition, on the other hand, facilitated task acquisition, expediting escape from the DMN brain state, thereby allowing rats to incorporate the contingency changes associated with the auditory stimuli. We suggest that VP, instant by instant, regulates the DMN and plays a deterministic role in transitions between internally and externally guided behaviors.

Developmental trajectory of social reward motivation from early adolescence into adulthood in female and male Long-Evans rats.

Most studies of adolescent and adult behavior involved one age group of each, whereas the dynamic changes in brain development suggest that there may be behavioral flux in adolescence. In two studies, we investigated developmental changes in social reward motivation in female and male Long-Evans rats from prepuberty to early adulthood in a social operant conditioning task. Given the earlier onset of puberty in females than in males, we predicted the course of social reward development would differ between the sexes. Overall, the pattern of results from both studies suggests that the trajectory of social motivation across adolescence is characterized by upward and downward shifts that do not depend on the sex of the rats. During training, in both studies, the mean number of social gate openings and percentage of social gate openings was higher at P30 (prepubertal, early adolescence) and P50 (late adolescence) than at P40 (mid adolescence) and P70 (adulthood) irrespective of sex. Nevertheless, the specific age comparisons that were significant depended on the study. In both studies, P30 rats had greater levels of social motivation than did adults in accessing a social reward when increased effort was required (progressive ratio tests). In an extinction test, only P30 and P50 rats continued to show more nose-pokes at the previously social gate than at the nonsocial gate, suggesting resistance to extinction. The results highlight the importance of characterizing behavior at several timepoints in adolescence to understand the neural mechanisms, many of which show similar discontinuities as they develop across adolescence.