Spatial maps in piriform cortex during olfactory navigation.

Odours are a fundamental part of the sensory environment used by animals to guide behaviours such as foraging and navigation1,2. Primary olfactory (piriform) cortex is thought to be the main cortical region for encoding odour identity3-8. Here, using neural ensemble recordings in freely moving rats performing an odour-cued spatial choice task, we show that posterior piriform cortex neurons carry a robust spatial representation of the environment. Piriform spatial representations have features of a learned cognitive map, being most prominent near odour ports, stable across behavioural contexts and independent of olfactory drive or reward availability. The accuracy of spatial information carried by individual piriform neurons was predicted by the strength of their functional coupling to the hippocampal theta rhythm. Ensembles of piriform neurons concurrently represented odour identity as well as spatial locations of animals, forming an odour-place map. Our results reveal a function for piriform cortex in spatial cognition and suggest that it is well-suited to form odour-place associations and guide olfactory-cued spatial navigation.

Learning optimal decisions with confidence.

Diffusion decision models (DDMs) are immensely successful models for decision making under uncertainty and time pressure. In the context of perceptual decision making, these models typically start with two input units, organized in a neuron-antineuron pair. In contrast, in the brain, sensory inputs are encoded through the activity of large neuronal populations. Moreover, while DDMs are wired by hand, the nervous system must learn the weights of the network through trial and error. There is currently no normative theory of learning in DDMs and therefore no theory of how decision makers could learn to make optimal decisions in this context. Here, we derive such a rule for learning a near-optimal linear combination of DDM inputs based on trial-by-trial feedback. The rule is Bayesian in the sense that it learns not only the mean of the weights but also the uncertainty around this mean in the form of a covariance matrix. In this rule, the rate of learning is proportional (respectively, inversely proportional) to confidence for incorrect (respectively, correct) decisions. Furthermore, we show that, in volatile environments, the rule predicts a bias toward repeating the same choice after correct decisions, with a bias strength that is modulated by the previous choice's difficulty. Finally, we extend our learning rule to cases for which one of the choices is more likely a priori, which provides insights into how such biases modulate the mechanisms leading to optimal decisions in diffusion models.

Optogenetic Activation of Dorsal Raphe Serotonin Neurons Rapidly Inhibits Spontaneous But Not Odor-Evoked Activity in Olfactory Cortex.

Serotonin (5-hydroxytriptamine; 5-HT) is implicated in a variety of brain functions including not only the regulation of mood and control of behavior but also the modulation of perception. 5-HT neurons in the dorsal raphe nucleus (DRN) often fire locked to sensory stimuli, but little is known about how 5-HT affects sensory processing, especially on this timescale. Here, we used an optogenetic approach to study the effect of 5-HT on single-unit activity in the mouse primary olfactory (anterior piriform) cortex. We show that activation of DRN 5-HT neurons rapidly inhibits the spontaneous firing of olfactory cortical neurons, acting in a divisive manner, but entirely spares sensory-driven firing. These results identify a new role for serotonergic modulation in dynamically regulating the balance between different sources of neural activity in sensory systems, suggesting a possible role for 5-HT in perceptual inference. SIGNIFICANCE STATEMENT: Serotonin is implicated in a wide variety of (pato)physiological functions including perception, but its precise role has remained elusive. Here, using optogenetic tools in vivo, we show that serotonergic neuromodulation prominently inhibits the spontaneous electrical activity of neurons in the primary olfactory cortex on a rapid (<1 s) timescale but leaves sensory responses unaffected. These results identify a new role for serotonergic modulation in rapidly changing the balance between different sources of neural activity in sensory systems.

Neural correlates, computation and behavioural impact of decision confidence.

Humans and other animals must often make decisions on the basis of imperfect evidence. Statisticians use measures such as P values to assign degrees of confidence to propositions, but little is known about how the brain computes confidence estimates about decisions. We explored this issue using behavioural analysis and neural recordings in rats in combination with computational modelling. Subjects were trained to perform an odour categorization task that allowed decision confidence to be manipulated by varying the distance of the test stimulus to the category boundary. To understand how confidence could be computed along with the choice itself, using standard models of decision-making, we defined a simple measure that quantified the quality of the evidence contributing to a particular decision. Here we show that the firing rates of many single neurons in the orbitofrontal cortex match closely to the predictions of confidence models and cannot be readily explained by alternative mechanisms, such as learning stimulus-outcome associations. Moreover, when tested using a delayed reward version of the task, we found that rats' willingness to wait for rewards increased with confidence, as predicted by the theoretical model. These results indicate that confidence estimates, previously suggested to require 'metacognition' and conscious awareness are available even in the rodent brain, can be computed with relatively simple operations, and can drive adaptive behaviour. We suggest that confidence estimation may be a fundamental and ubiquitous component of decision-making.

Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice.

The ability to persist toward a desired objective is a fundamental aspect of behavioral control whose impairment is implicated in several behavioral disorders. One of the prominent features of behavioral persistence is that its maturation occurs relatively late in development. This is presumed to echo the developmental time course of a corresponding circuit within late-maturing parts of the brain, such as the prefrontal cortex, but the specific identity of the responsible circuits is unknown. Here, we used a genetic approach to describe the maturation of the projection from layer 5 neurons of the neocortex to the dorsal raphe nucleus in mice. Using optogenetic-assisted circuit mapping, we show that this projection undergoes a dramatic increase in synaptic potency between postnatal weeks 3 and 8, corresponding to the transition from juvenile to adult. We then show that this period corresponds to an increase in the behavioral persistence that mice exhibit in a foraging task. Finally, we used a genetic targeting strategy that primarily affected neurons in the medial prefrontal cortex, to selectively ablate this pathway in adulthood and show that mice revert to a behavioral phenotype similar to juveniles. These results suggest that frontal cortical to dorsal raphe input is a critical anatomical and functional substrate of the development and manifestation of behavioral persistence.

Serotonin.

Serotonin, also known as 5-hydroxytryptamine or 5-HT, is a neuromodulator widely recognized for its role in various psychoactive drugs. These drugs can exhibit antidepressant, antipsychotic, anxiolytic, empathogenic, or psychedelic effects, depending on their specific interactions with the serotonin system as well as other neuromodulators such as noradrenaline, dopamine, and oxytocin. This has led to a widespread belief that the neurochemical processes taking place deep inside our brains affect our subjective experiences and mental health. However, a scientific understanding of how neuromodulators' functions relate to drug effects remains elusive.

A reservoir of foraging decision variables in the mouse brain.

In any given situation, the environment can be parsed in different ways to yield decision variables (DVs) defining strategies useful for different tasks. It is generally presumed that the brain only computes a single DV defining the current behavioral strategy. Here to test this assumption, we recorded neural ensembles in the frontal cortex of mice performing a foraging task admitting multiple DVs. Methods developed to uncover the currently employed DV revealed the use of multiple strategies and occasional switches in strategy within sessions. Optogenetic manipulations showed that the secondary motor cortex (M2) is needed for mice to use the different DVs in the task. Surprisingly, we found that regardless of which DV best explained the current behavior, M2 activity concurrently encoded a full basis set of computations defining a reservoir of DVs appropriate for alternative tasks. This form of neural multiplexing may confer considerable advantages for learning and adaptive behavior.

Midbrain contributions to sensorimotor decision making.

Making decisions about future actions is a fundamental function of the nervous system. Classical theories hold that separate sets of brain regions are responsible for selecting and implementing an action. Traditionally, action selection has been considered the domain of high-level regions, such as the prefrontal cortex, whereas action generation is thought to be carried out by dedicated cortical and subcortical motor regions. However, increasing evidence suggests that the activity of individual neurons in cortical motor structures reflects abstract properties of "decision variables" rather than conveying simple motor commands. Less is known, though, about the role of subcortical structures in decision making. In particular, the superior colliculus (SC) is critical for planning and initiating visually guided, gaze-displacing movements and selecting visual targets, but whether and how it contributes more generally to sensorimotor decisions are unclear. Here, we show that the SC is intimately involved in orienting decisions based on odor cues, even though the SC does not explicitly process olfactory stimuli. Neurons were recorded from the intermediate and deep SC layers in rats trained to perform a delayed-response, odor-cued spatial choice task. SC neurons commonly fired well in advance of movement initiation, predicting the chosen direction nearly 1 s before movement. Moreover, under conditions of sensory uncertainty, SC activity varied with task difficulty and reward outcome, reflecting the influence of decision variables on the intercollicular competition thought to underlie orienting movements. These results indicate that the SC plays a more general role in decisions than previously appreciated, extending beyond visuomotor functions.

Stress-sensitive inference of task controllability.

Estimating the controllability of the environment enables agents to better predict upcoming events and decide when to engage controlled action selection. How does the human brain estimate controllability? Trial-by-trial analysis of choices, decision times and neural activity in an explore-and-predict task demonstrate that humans solve this problem by comparing the predictions of an 'actor' model with those of a reduced 'spectator' model of their environment. Neural blood oxygen level-dependent responses within striatal and medial prefrontal areas tracked the instantaneous difference in the prediction errors generated by these two statistical learning models. Blood oxygen level-dependent activity in the posterior cingulate, temporoparietal and prefrontal cortices covaried with changes in estimated controllability. Exposure to inescapable stressors biased controllability estimates downward and increased reliance on the spectator model in an anxiety-dependent fashion. Taken together, these findings provide a mechanistic account of controllability inference and its distortion by stress exposure.

Next-generation brain observatories.

We propose centralized brain observatories for large-scale recordings of neural activity in mice and non-human primates coupled with cloud-based data analysis and sharing. Such observatories will advance reproducible systems neuroscience and democratize access to the most advanced tools and data.

Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size.

Transient variations in pupil size (PS) under constant luminance are coupled to rapid changes in arousal state,1-3 which have been interpreted as vigilance,4 salience,5 or a surprise signal.6-8 Neural control of such fluctuations presumably involves multiple brain regions5,9-11 and neuromodulatory systems,3,12,13 but it is often associated with phasic activity of the noradrenergic system.9,12,14,15 Serotonin (5-HT), a neuromodulator also implicated in aspects of arousal16 such as sleep-wake transitions,17 motivational state regulation,18 and signaling of unexpected events,19 seems to affect PS,20-24 but these effects have not been investigated in detail. Here we show that phasic 5-HT neuron stimulation causes transient PS changes. We used optogenetic activation of 5-HT neurons in the dorsal raphe nucleus (DRN) of head-fixed mice performing a foraging task. 5-HT-driven modulations of PS were maintained throughout the photostimulation period and sustained for a few seconds after the end of stimulation. We found no evidence that the increase in PS with activation of 5-HT neurons resulted from interactions of photostimulation with behavioral variables, such as locomotion or licking. Furthermore, we observed that the effect of 5-HT on PS depended on the level of environmental uncertainty, consistent with the idea that 5-HT could report a surprise signal.19 These results advance our understanding of the neuromodulatory control of PS, revealing a tight relationship between phasic activation of 5-HT neurons and changes in PS.

Citric Acid Water as an Alternative to Water Restriction for High-Yield Mouse Behavior.

Powerful neural measurement and perturbation tools have positioned mice as an ideal species for probing the neural circuit mechanisms of cognition. Crucial to this success is the ability to motivate animals to perform specific behaviors. One successful strategy is to restrict their water intake, rewarding them with water during a behavioral task. However, water restriction requires rigorous monitoring of animals' health and hydration status and can be challenging for some mice. We present an alternative that allows mice more control over their water intake: free home-cage access to water, made slightly sour by a small amount of citric acid (CA). In a previous study, rats with free access to CA water readily performed a behavioral task for water rewards, although completing fewer trials than under water restriction (Reinagel, 2018). We here extend this approach to mice and confirm its robustness across multiple laboratories. Mice reduced their intake of CA water while maintaining healthy weights. Continuous home-cage access to CA water only subtly impacted their willingness to perform a decision-making task, in which they were rewarded with sweetened water. When free CA water was used instead of water restriction only on weekends, learning and decision-making behavior were unaffected. CA water is thus a promising alternative to water restriction, allowing animals more control over their water intake without interfering with behavioral performance.

Standardized and reproducible measurement of decision-making in mice.

Progress in science requires standardized assays whose results can be readily shared, compared, and reproduced across laboratories. Reproducibility, however, has been a concern in neuroscience, particularly for measurements of mouse behavior. Here, we show that a standardized task to probe decision-making in mice produces reproducible results across multiple laboratories. We adopted a task for head-fixed mice that assays perceptual and value-based decision making, and we standardized training protocol and experimental hardware, software, and procedures. We trained 140 mice across seven laboratories in three countries, and we collected 5 million mouse choices into a publicly available database. Learning speed was variable across mice and laboratories, but once training was complete there were no significant differences in behavior across laboratories. Mice in different laboratories adopted similar reliance on visual stimuli, on past successes and failures, and on estimates of stimulus prior probability to guide their choices. These results reveal that a complex mouse behavior can be reproduced across multiple laboratories. They establish a standard for reproducible rodent behavior, and provide an unprecedented dataset and open-access tools to study decision-making in mice. More generally, they indicate a path toward achieving reproducibility in neuroscience through collaborative open-science approaches.

In science, it is of vital importance that multiple studies corroborate the same result. Researchers therefore need to know all the details of previous experiments in order to implement the procedures as exactly as possible. However, this is becoming a major problem in neuroscience, as animal studies of behavior have proven to be hard to reproduce, and most experiments are never replicated by other laboratories. Mice are increasingly being used to study the neural mechanisms of decision making, taking advantage of the genetic, imaging and physiological tools that are available for mouse brains. Yet, the lack of standardized behavioral assays is leading to inconsistent results between laboratories. This makes it challenging to carry out large-scale collaborations which have led to massive breakthroughs in other fields such as physics and genetics. To help make these studies more reproducible, the International Brain Laboratory (a collaborative research group) et al. developed a standardized approach for investigating decision making in mice that incorporates every step of the process; from the training protocol to the software used to analyze the data. In the experiment, mice were shown images with different contrast and had to indicate, using a steering wheel, whether it appeared on their right or left. The mice then received a drop of sugar water for every correction decision. When the image contrast was high, mice could rely on their vision. However, when the image contrast was very low or zero, they needed to consider the information of previous trials and choose the side that had recently appeared more frequently. This method was used to train 140 mice in seven laboratories from three different countries. The results showed that learning speed was different across mice and laboratories, but once training was complete the mice behaved consistently, relying on visual stimuli or experiences to guide their choices in a similar way. These results show that complex behaviors in mice can be reproduced across multiple laboratories, providing an unprecedented dataset and open-access tools for studying decision making. This work could serve as a foundation for other groups, paving the way to a more collaborative approach in the field of neuroscience that could help to tackle complex research challenges.

Sensory-evoked intrinsic optical signals in the olfactory bulb are coupled to glutamate release and uptake.

Functional imaging signals arise from metabolic and hemodynamic activity, but how these processes are related to the synaptic and electrical activity of neurons is not well understood. To provide insight into this issue, we used in vivo imaging and simultaneous local pharmacology to study how sensory-evoked neural activity leads to intrinsic optical signals (IOS) in the well-defined circuitry of the olfactory glomerulus. Odor-evoked IOS were tightly coupled to release of glutamate and were strongly modulated by activation of presynaptic dopamine and GABA-B receptors. Surprisingly, IOS were independent of postsynaptic transmission through ionotropic or metabotropic glutamate receptors, but instead were inhibited when uptake by astrocytic glutamate transporters was blocked. These data suggest that presynaptic glutamate release and uptake by astrocytes form a critical pathway through which neural activity is linked to metabolic processing and hence to functional imaging signals.

Representation of spatial goals in rat orbitofrontal cortex.

The orbitofrontal cortex (OFC) is thought to participate in making and evaluating goal-directed decisions. In rodents, spatial navigation is a major mode of goal-directed behavior, and anatomical and lesion studies implicate the OFC in spatial processing, but there is little direct evidence for coding of spatial or motor variables. Here, we recorded from ventrolateral and lateral OFC in an odor-cued two-alternative choice task requiring orientation and approach to spatial goal ports. In this context, over half of OFC neurons encoded choice direction or goal port location. A subset of neurons was jointly selective for the trial outcome and port location, information useful for the selection or evaluation of spatial goals. These observations show that the rodent OFC not only encodes information relating to general motivational significance, as shown previously, but also encodes spatiomotor variables needed to define specific behavioral goals and the locomotor actions required to attain them.

The functional microarchitecture of the mouse barrel cortex.

Cortical maps, consisting of orderly arrangements of functional columns, are a hallmark of the organization of the cerebral cortex. However, the microorganization of cortical maps at the level of single neurons is not known, mainly because of the limitations of available mapping techniques. Here, we used bulk loading of Ca(2+) indicators combined with two-photon microscopy to image the activity of multiple single neurons in layer (L) 2/3 of the mouse barrel cortex in vivo. We developed methods that reliably detect single action potentials in approximately half of the imaged neurons in L2/3. This allowed us to measure the spiking probability following whisker deflection and thus map the whisker selectivity for multiple neurons with known spatial relationships. At the level of neuronal populations, the whisker map varied smoothly across the surface of the cortex, within and between the barrels. However, the whisker selectivity of individual neurons recorded simultaneously differed greatly, even for nearest neighbors. Trial-to-trial correlations between pairs of neurons were high over distances spanning multiple cortical columns. Our data suggest that the response properties of individual neurons are shaped by highly specific subcolumnar circuits and the momentary intrinsic state of the neocortex.

The impact of learning on perceptual decisions and its implication for speed-accuracy tradeoffs.

In standard models of perceptual decision-making, noisy sensory evidence is considered to be the primary source of choice errors and the accumulation of evidence needed to overcome this noise gives rise to speed-accuracy tradeoffs. Here, we investigated how the history of recent choices and their outcomes interact with these processes using a combination of theory and experiment. We found that the speed and accuracy of performance of rats on olfactory decision tasks could be best explained by a Bayesian model that combines reinforcement-based learning with accumulation of uncertain sensory evidence. This model predicted the specific pattern of trial history effects that were found in the data. The results suggest that learning is a critical factor contributing to speed-accuracy tradeoffs in decision-making, and that task history effects are not simply biases but rather the signatures of an optimal learning strategy.

Inference-Based Decisions in a Hidden State Foraging Task: Differential Contributions of Prefrontal Cortical Areas.

Essential features of the world are often hidden and must be inferred by constructing internal models based on indirect evidence. Here, to study the mechanisms of inference, we establish a foraging task that is naturalistic and easily learned yet can distinguish inference from simpler strategies such as the direct integration of sensory data. We show that both mice and humans learn a strategy consistent with optimal inference of a hidden state. However, humans acquire this strategy more than an order of magnitude faster than mice. Using optogenetics in mice, we show that orbitofrontal and anterior cingulate cortex inactivation impacts task performance, but only orbitofrontal inactivation reverts mice from an inference-based to a stimulus-bound decision strategy. These results establish a cross-species paradigm for studying the problem of inference-based decision making and begins to dissect the network of brain regions crucial for its performance.