Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice.

The ability to persist toward a desired objective is a fundamental aspect of behavioral control whose impairment is implicated in several behavioral disorders. One of the prominent features of behavioral persistence is that its maturation occurs relatively late in development. This is presumed to echo the developmental time course of a corresponding circuit within late-maturing parts of the brain, such as the prefrontal cortex, but the specific identity of the responsible circuits is unknown. Here, we used a genetic approach to describe the maturation of the projection from layer 5 neurons of the neocortex to the dorsal raphe nucleus in mice. Using optogenetic-assisted circuit mapping, we show that this projection undergoes a dramatic increase in synaptic potency between postnatal weeks 3 and 8, corresponding to the transition from juvenile to adult. We then show that this period corresponds to an increase in the behavioral persistence that mice exhibit in a foraging task. Finally, we used a genetic targeting strategy that primarily affected neurons in the medial prefrontal cortex, to selectively ablate this pathway in adulthood and show that mice revert to a behavioral phenotype similar to juveniles. These results suggest that frontal cortical to dorsal raphe input is a critical anatomical and functional substrate of the development and manifestation of behavioral persistence.

Serotonin.

Serotonin, also known as 5-hydroxytryptamine or 5-HT, is a neuromodulator widely recognized for its role in various psychoactive drugs. These drugs can exhibit antidepressant, antipsychotic, anxiolytic, empathogenic, or psychedelic effects, depending on their specific interactions with the serotonin system as well as other neuromodulators such as noradrenaline, dopamine, and oxytocin. This has led to a widespread belief that the neurochemical processes taking place deep inside our brains affect our subjective experiences and mental health. However, a scientific understanding of how neuromodulators' functions relate to drug effects remains elusive.

A reservoir of foraging decision variables in the mouse brain.

In any given situation, the environment can be parsed in different ways to yield decision variables (DVs) defining strategies useful for different tasks. It is generally presumed that the brain only computes a single DV defining the current behavioral strategy. Here to test this assumption, we recorded neural ensembles in the frontal cortex of mice performing a foraging task admitting multiple DVs. Methods developed to uncover the currently employed DV revealed the use of multiple strategies and occasional switches in strategy within sessions. Optogenetic manipulations showed that the secondary motor cortex (M2) is needed for mice to use the different DVs in the task. Surprisingly, we found that regardless of which DV best explained the current behavior, M2 activity concurrently encoded a full basis set of computations defining a reservoir of DVs appropriate for alternative tasks. This form of neural multiplexing may confer considerable advantages for learning and adaptive behavior.

Next-generation brain observatories.

We propose centralized brain observatories for large-scale recordings of neural activity in mice and non-human primates coupled with cloud-based data analysis and sharing. Such observatories will advance reproducible systems neuroscience and democratize access to the most advanced tools and data.

Stress-sensitive inference of task controllability.

Estimating the controllability of the environment enables agents to better predict upcoming events and decide when to engage controlled action selection. How does the human brain estimate controllability? Trial-by-trial analysis of choices, decision times and neural activity in an explore-and-predict task demonstrate that humans solve this problem by comparing the predictions of an 'actor' model with those of a reduced 'spectator' model of their environment. Neural blood oxygen level-dependent responses within striatal and medial prefrontal areas tracked the instantaneous difference in the prediction errors generated by these two statistical learning models. Blood oxygen level-dependent activity in the posterior cingulate, temporoparietal and prefrontal cortices covaried with changes in estimated controllability. Exposure to inescapable stressors biased controllability estimates downward and increased reliance on the spectator model in an anxiety-dependent fashion. Taken together, these findings provide a mechanistic account of controllability inference and its distortion by stress exposure.

Spatial maps in piriform cortex during olfactory navigation.

Odours are a fundamental part of the sensory environment used by animals to guide behaviours such as foraging and navigation1,2. Primary olfactory (piriform) cortex is thought to be the main cortical region for encoding odour identity3-8. Here, using neural ensemble recordings in freely moving rats performing an odour-cued spatial choice task, we show that posterior piriform cortex neurons carry a robust spatial representation of the environment. Piriform spatial representations have features of a learned cognitive map, being most prominent near odour ports, stable across behavioural contexts and independent of olfactory drive or reward availability. The accuracy of spatial information carried by individual piriform neurons was predicted by the strength of their functional coupling to the hippocampal theta rhythm. Ensembles of piriform neurons concurrently represented odour identity as well as spatial locations of animals, forming an odour-place map. Our results reveal a function for piriform cortex in spatial cognition and suggest that it is well-suited to form odour-place associations and guide olfactory-cued spatial navigation.

Standardized and reproducible measurement of decision-making in mice.

Progress in science requires standardized assays whose results can be readily shared, compared, and reproduced across laboratories. Reproducibility, however, has been a concern in neuroscience, particularly for measurements of mouse behavior. Here, we show that a standardized task to probe decision-making in mice produces reproducible results across multiple laboratories. We adopted a task for head-fixed mice that assays perceptual and value-based decision making, and we standardized training protocol and experimental hardware, software, and procedures. We trained 140 mice across seven laboratories in three countries, and we collected 5 million mouse choices into a publicly available database. Learning speed was variable across mice and laboratories, but once training was complete there were no significant differences in behavior across laboratories. Mice in different laboratories adopted similar reliance on visual stimuli, on past successes and failures, and on estimates of stimulus prior probability to guide their choices. These results reveal that a complex mouse behavior can be reproduced across multiple laboratories. They establish a standard for reproducible rodent behavior, and provide an unprecedented dataset and open-access tools to study decision-making in mice. More generally, they indicate a path toward achieving reproducibility in neuroscience through collaborative open-science approaches.

In science, it is of vital importance that multiple studies corroborate the same result. Researchers therefore need to know all the details of previous experiments in order to implement the procedures as exactly as possible. However, this is becoming a major problem in neuroscience, as animal studies of behavior have proven to be hard to reproduce, and most experiments are never replicated by other laboratories. Mice are increasingly being used to study the neural mechanisms of decision making, taking advantage of the genetic, imaging and physiological tools that are available for mouse brains. Yet, the lack of standardized behavioral assays is leading to inconsistent results between laboratories. This makes it challenging to carry out large-scale collaborations which have led to massive breakthroughs in other fields such as physics and genetics. To help make these studies more reproducible, the International Brain Laboratory (a collaborative research group) et al. developed a standardized approach for investigating decision making in mice that incorporates every step of the process; from the training protocol to the software used to analyze the data. In the experiment, mice were shown images with different contrast and had to indicate, using a steering wheel, whether it appeared on their right or left. The mice then received a drop of sugar water for every correction decision. When the image contrast was high, mice could rely on their vision. However, when the image contrast was very low or zero, they needed to consider the information of previous trials and choose the side that had recently appeared more frequently. This method was used to train 140 mice in seven laboratories from three different countries. The results showed that learning speed was different across mice and laboratories, but once training was complete the mice behaved consistently, relying on visual stimuli or experiences to guide their choices in a similar way. These results show that complex behaviors in mice can be reproduced across multiple laboratories, providing an unprecedented dataset and open-access tools for studying decision making. This work could serve as a foundation for other groups, paving the way to a more collaborative approach in the field of neuroscience that could help to tackle complex research challenges.

Citric Acid Water as an Alternative to Water Restriction for High-Yield Mouse Behavior.

Powerful neural measurement and perturbation tools have positioned mice as an ideal species for probing the neural circuit mechanisms of cognition. Crucial to this success is the ability to motivate animals to perform specific behaviors. One successful strategy is to restrict their water intake, rewarding them with water during a behavioral task. However, water restriction requires rigorous monitoring of animals' health and hydration status and can be challenging for some mice. We present an alternative that allows mice more control over their water intake: free home-cage access to water, made slightly sour by a small amount of citric acid (CA). In a previous study, rats with free access to CA water readily performed a behavioral task for water rewards, although completing fewer trials than under water restriction (Reinagel, 2018). We here extend this approach to mice and confirm its robustness across multiple laboratories. Mice reduced their intake of CA water while maintaining healthy weights. Continuous home-cage access to CA water only subtly impacted their willingness to perform a decision-making task, in which they were rewarded with sweetened water. When free CA water was used instead of water restriction only on weekends, learning and decision-making behavior were unaffected. CA water is thus a promising alternative to water restriction, allowing animals more control over their water intake without interfering with behavioral performance.

Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size.

Transient variations in pupil size (PS) under constant luminance are coupled to rapid changes in arousal state,1-3 which have been interpreted as vigilance,4 salience,5 or a surprise signal.6-8 Neural control of such fluctuations presumably involves multiple brain regions5,9-11 and neuromodulatory systems,3,12,13 but it is often associated with phasic activity of the noradrenergic system.9,12,14,15 Serotonin (5-HT), a neuromodulator also implicated in aspects of arousal16 such as sleep-wake transitions,17 motivational state regulation,18 and signaling of unexpected events,19 seems to affect PS,20-24 but these effects have not been investigated in detail. Here we show that phasic 5-HT neuron stimulation causes transient PS changes. We used optogenetic activation of 5-HT neurons in the dorsal raphe nucleus (DRN) of head-fixed mice performing a foraging task. 5-HT-driven modulations of PS were maintained throughout the photostimulation period and sustained for a few seconds after the end of stimulation. We found no evidence that the increase in PS with activation of 5-HT neurons resulted from interactions of photostimulation with behavioral variables, such as locomotion or licking. Furthermore, we observed that the effect of 5-HT on PS depended on the level of environmental uncertainty, consistent with the idea that 5-HT could report a surprise signal.19 These results advance our understanding of the neuromodulatory control of PS, revealing a tight relationship between phasic activation of 5-HT neurons and changes in PS.

The impact of learning on perceptual decisions and its implication for speed-accuracy tradeoffs.

In standard models of perceptual decision-making, noisy sensory evidence is considered to be the primary source of choice errors and the accumulation of evidence needed to overcome this noise gives rise to speed-accuracy tradeoffs. Here, we investigated how the history of recent choices and their outcomes interact with these processes using a combination of theory and experiment. We found that the speed and accuracy of performance of rats on olfactory decision tasks could be best explained by a Bayesian model that combines reinforcement-based learning with accumulation of uncertain sensory evidence. This model predicted the specific pattern of trial history effects that were found in the data. The results suggest that learning is a critical factor contributing to speed-accuracy tradeoffs in decision-making, and that task history effects are not simply biases but rather the signatures of an optimal learning strategy.

Inference-Based Decisions in a Hidden State Foraging Task: Differential Contributions of Prefrontal Cortical Areas.

Essential features of the world are often hidden and must be inferred by constructing internal models based on indirect evidence. Here, to study the mechanisms of inference, we establish a foraging task that is naturalistic and easily learned yet can distinguish inference from simpler strategies such as the direct integration of sensory data. We show that both mice and humans learn a strategy consistent with optimal inference of a hidden state. However, humans acquire this strategy more than an order of magnitude faster than mice. Using optogenetics in mice, we show that orbitofrontal and anterior cingulate cortex inactivation impacts task performance, but only orbitofrontal inactivation reverts mice from an inference-based to a stimulus-bound decision strategy. These results establish a cross-species paradigm for studying the problem of inference-based decision making and begins to dissect the network of brain regions crucial for its performance.

Learning optimal decisions with confidence.

Diffusion decision models (DDMs) are immensely successful models for decision making under uncertainty and time pressure. In the context of perceptual decision making, these models typically start with two input units, organized in a neuron-antineuron pair. In contrast, in the brain, sensory inputs are encoded through the activity of large neuronal populations. Moreover, while DDMs are wired by hand, the nervous system must learn the weights of the network through trial and error. There is currently no normative theory of learning in DDMs and therefore no theory of how decision makers could learn to make optimal decisions in this context. Here, we derive such a rule for learning a near-optimal linear combination of DDM inputs based on trial-by-trial feedback. The rule is Bayesian in the sense that it learns not only the mean of the weights but also the uncertainty around this mean in the form of a covariance matrix. In this rule, the rate of learning is proportional (respectively, inversely proportional) to confidence for incorrect (respectively, correct) decisions. Furthermore, we show that, in volatile environments, the rule predicts a bias toward repeating the same choice after correct decisions, with a bias strength that is modulated by the previous choice's difficulty. Finally, we extend our learning rule to cases for which one of the choices is more likely a priori, which provides insights into how such biases modulate the mechanisms leading to optimal decisions in diffusion models.

The mechanistic foundation of Weber's law.

Although Weber's law is the most firmly established regularity in sensation, no principled way has been identified to choose between its many proposed explanations. We investigated Weber's law by training rats to discriminate the relative intensity of sounds at the two ears at various absolute levels. These experiments revealed the existence of a psychophysical regularity, which we term time-intensity equivalence in discrimination (TIED), describing how reaction times change as a function of absolute level. The TIED enables the mathematical specification of the computational basis of Weber's law, placing strict requirements on how stimulus intensity is encoded in the stochastic activity of sensory neurons and revealing that discriminative choices must be based on bounded exact accumulation of evidence. We further demonstrate that this mechanism is not only necessary for the TIED to hold but is also sufficient to provide a virtually complete quantitative description of the behavior of the rats.

An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals.

Serotonin has widespread, but computationally obscure, modulatory effects on learning and cognition. Here, we studied the impact of optogenetic stimulation of dorsal raphe serotonin neurons in mice performing a non-stationary, reward-driven decision-making task. Animals showed two distinct choice strategies. Choices after short inter-trial-intervals (ITIs) depended only on the last trial outcome and followed a win-stay-lose-switch pattern. In contrast, choices after long ITIs reflected outcome history over multiple trials, as described by reinforcement learning models. We found that optogenetic stimulation during a trial significantly boosted the rate of learning that occurred due to the outcome of that trial, but these effects were only exhibited on choices after long ITIs. This suggests that serotonin neurons modulate reinforcement learning rates, and that this influence is masked by alternate, unaffected, decision mechanisms. These results provide insight into the role of serotonin in treating psychiatric disorders, particularly its modulation of neural plasticity and learning.

Activation of serotonin neurons promotes active persistence in a probabilistic foraging task.

The neuromodulator serotonin (5-HT) has been implicated in a variety of functions that involve patience or impulse control. Many of these effects are consistent with a long-standing theory that 5-HT promotes behavioral inhibition, a motivational bias favoring passive over active behaviors. To further test this idea, we studied the impact of 5-HT in a probabilistic foraging task, in which mice must learn the statistics of the environment and infer when to leave a depleted foraging site for the next. Critically, mice were required to actively nose-poke in order to exploit a given site. We show that optogenetic activation of 5-HT neurons in the dorsal raphe nucleus increases the willingness of mice to actively attempt to exploit a reward site before giving up. These results indicate that behavioral inhibition is not an adequate description of 5-HT function and suggest that a unified account must be based on a higher-order function.

Stereotaxic Adeno-associated Virus Injection and Cannula Implantation in the Dorsal Raphe Nucleus of Mice.

Optogenetic methods are now widespread in neuroscience research. Here we present a detailed surgical procedure to inject adeno-associated viruses and implant optic fiber cannulas in the dorsal raphe nucleus (DRN) of living mice. Combined with transgenic mouse lines, this protocol allows specific targeting of serotonin-producing neurons in the brain. It includes fixing a mouse in a stereotaxic frame, performing a craniotomy, virus injection and fiber implantation. Animals can be later used in behavioral experiments, combined with optogenetic manipulations (Dugué et al., 2014; Correia et al., 2017) or monitoring of neuronal activity (Matias et al., 2017). The described procedure is a fundamental step in both optogenetic and fiber photometry experiments of deep brain areas. It is optimized for serotonin neurons in the DRN, but it can be applied to any other cell type and brain region. When using transgenic mouse lines that express functionally relevant levels of optogenetic tools or reporter lines, the virus injection step can be skipped and the protocol is reduced to the cannula implantation procedure.

Distinct Sources of Deterministic and Stochastic Components of Action Timing Decisions in Rodent Frontal Cortex.

The selection and timing of actions are subject to determinate influences such as sensory cues and internal state as well as to effectively stochastic variability. Although stochastic choice mechanisms are assumed by many theoretical models, their origin and mechanisms remain poorly understood. Here we investigated this issue by studying how neural circuits in the frontal cortex determine action timing in rats performing a waiting task. Electrophysiological recordings from two regions necessary for this behavior, medial prefrontal cortex (mPFC) and secondary motor cortex (M2), revealed an unexpected functional dissociation. Both areas encoded deterministic biases in action timing, but only M2 neurons reflected stochastic trial-by-trial fluctuations. This differential coding was reflected in distinct timescales of neural dynamics in the two frontal cortical areas. These results suggest a two-stage model in which stochastic components of action timing decisions are injected by circuits downstream of those carrying deterministic bias signals.

Activity patterns of serotonin neurons underlying cognitive flexibility.

Serotonin is implicated in mood and affective disorders. However, growing evidence suggests that a core endogenous role is to promote flexible adaptation to changes in the causal structure of the environment, through behavioral inhibition and enhanced plasticity. We used long-term photometric recordings in mice to study a population of dorsal raphe serotonin neurons, whose activity we could link to normal reversal learning using pharmacogenetics. We found that these neurons are activated by both positive and negative prediction errors, and thus report signals similar to those proposed to promote learning in conditions of uncertainty. Furthermore, by comparing the cue responses of serotonin and dopamine neurons, we found differences in learning rates that could explain the importance of serotonin in inhibiting perseverative responding. Our findings show how the activity patterns of serotonin neurons support a role in cognitive flexibility, and suggest a revised model of dopamine-serotonin opponency with potential clinical implications.