Behavior- and Modality-General Representation of Confidence in Orbitofrontal Cortex.

Every decision we make is accompanied by a sense of confidence about its likely outcome. This sense informs subsequent behavior, such as investing more-whether time, effort, or money-when reward is more certain. A neural representation of confidence should originate from a statistical computation and predict confidence-guided behavior. An additional requirement for confidence representations to support metacognition is abstraction: they should emerge irrespective of the source of information and inform multiple confidence-guided behaviors. It is unknown whether neural confidence signals meet these criteria. Here, we show that single orbitofrontal cortex neurons in rats encode statistical decision confidence irrespective of the sensory modality, olfactory or auditory, used to make a choice. The activity of these neurons also predicts two confidence-guided behaviors: trial-by-trial time investment and cross-trial choice strategy updating. Orbitofrontal cortex thus represents decision confidence consistent with a metacognitive process that is useful for mediating confidence-guided economic decisions.

Roadmap for the Emerging Field of Cancer Neuroscience.

Mounting evidence indicates that the nervous system plays a central role in cancer pathogenesis. In turn, cancers and cancer therapies can alter nervous system form and function. This Commentary seeks to describe the burgeoning field of "cancer neuroscience" and encourage multidisciplinary collaboration for the study of cancer-nervous system interactions.

Central Cholinergic Neurons Are Rapidly Recruited by Reinforcement Feedback.

Basal forebrain cholinergic neurons constitute a major neuromodulatory system implicated in normal cognition and neurodegenerative dementias. Cholinergic projections densely innervate neocortex, releasing acetylcholine to regulate arousal, attention, and learning. However, their precise behavioral function is poorly understood because identified cholinergic neurons have never been recorded during behavior. To determine which aspects of cognition their activity might support, we recorded cholinergic neurons using optogenetic identification in mice performing an auditory detection task requiring sustained attention. We found that a non-cholinergic basal forebrain population-but not cholinergic neurons-were correlated with trial-to-trial measures of attention. Surprisingly, cholinergic neurons responded to reward and punishment with unusual speed and precision (18 ± 3 ms). Cholinergic responses were scaled by the unexpectedness of reinforcement and were highly similar across neurons and two nuclei innervating distinct cortical areas. These results reveal that the cholinergic system broadcasts a rapid and precisely timed reinforcement signal, supporting fast cortical activation and plasticity.

Interneuron Types as Attractors and Controllers.

Cortical interneurons display striking differences in shape, physiology, and other attributes, challenging us to appropriately classify them. We previously suggested that interneuron types should be defined by their role in cortical processing. Here, we revisit the question of how to codify their diversity based upon their division of labor and function as controllers of cortical information flow. We suggest that developmental trajectories provide a guide for appreciating interneuron diversity and argue that subtype identity is generated using a configurational (rather than combinatorial) code of transcription factors that produce attractor states in the underlying gene regulatory network. We present our updated three-stage model for interneuron specification: an initial cardinal step, allocating interneurons into a few major classes, followed by definitive refinement, creating subclasses upon settling within the cortex, and lastly, state determination, reflecting the incorporation of interneurons into functional circuit ensembles. We close by discussing findings indicating that major interneuron classes are both evolutionarily ancient and conserved. We propose that the complexity of cortical circuits is generated by phylogenetically old interneuron types, complemented by an evolutionary increase in principal neuron diversity. This suggests that a natural neurobiological definition of interneuron types might be derived from a match between their developmental origin and computational function.

The pheromone darcin drives a circuit for innate and reinforced behaviours.

Organisms have evolved diverse behavioural strategies that enhance the likelihood of encountering and assessing mates1. Many species use pheromones to communicate information about the location, sexual and social status of potential partners2. In mice, the major urinary protein darcin-which is present in the urine of males-provides a component of a scent mark that elicits approach by females and drives learning3,4. Here we show that darcin elicits a complex and variable behavioural repertoire that consists of attraction, ultrasonic vocalization and urinary scent marking, and also serves as a reinforcer in learning paradigms. We identify a genetically determined circuit-extending from the accessory olfactory bulb to the posterior medial amygdala-that is necessary for all behavioural responses to darcin. Moreover, optical activation of darcin-responsive neurons in the medial amygdala induces both the innate and the conditioned behaviours elicited by the pheromone. These neurons define a topographically segregated population that expresses neuronal nitric oxide synthase. We suggest that this darcin-activated neural circuit integrates pheromonal information with internal state to elicit both variable innate behaviours and reinforced behaviours that may promote mate encounters and mate selection.

Frontal cortex neuron types categorically encode single decision variables.

Individual neurons in many cortical regions have been found to encode specific, identifiable features of the environment or body that pertain to the function of the region1-3. However, in frontal cortex, which is involved in cognition, neural responses display baffling complexity, carrying seemingly disordered mixtures of sensory, motor and other task-related variables4-13. This complexity has led to the suggestion that representations in individual frontal neurons are randomly mixed and can only be understood at the neural population level14,15. Here we show that neural activity in rat orbitofrontal cortex (OFC) is instead highly structured: single neuron activity co-varies with individual variables in computational models that explain choice behaviour. To characterize neural responses across a large behavioural space, we trained rats on a behavioural task that combines perceptual and value-guided decisions. An unbiased, model-free clustering analysis identified distinct groups of OFC neurons, each with a particular response profile in task-variable space. Applying a simple model of choice behaviour to these categorical response profiles revealed that each profile quantitatively corresponds to a specific decision variable, such as decision confidence. Additionally, we demonstrate that a connectivity-defined cell type, orbitofrontal neurons projecting to the striatum, carries a selective and temporally sustained representation of a single decision variable: integrated value. We propose that neurons in frontal cortex, as in other cortical regions, form a sparse and overcomplete representation of features relevant to the region's function, and that they distribute this information selectively to downstream regions to support behaviour.

Interneuron cell types are fit to function.

Understanding brain circuits begins with an appreciation of their component parts - the cells. Although GABAergic interneurons are a minority population within the brain, they are crucial for the control of inhibition. Determining the diversity of these interneurons has been a central goal of neurobiologists, but this amazing cell type has so far defied a generalized classification system. Interneuron complexity within the telencephalon could be simplified by viewing them as elaborations of a much more finite group of developmentally specified cardinal classes that become further specialized as they mature. Our perspective emphasizes that the ultimate goal is to dispense with classification criteria and directly define interneuron types by function.

Cortical interneurons that specialize in disinhibitory control.

In the mammalian cerebral cortex the diversity of interneuronal subtypes underlies a division of labour subserving distinct modes of inhibitory control. A unique mode of inhibitory control may be provided by inhibitory neurons that specifically suppress the firing of other inhibitory neurons. Such disinhibition could lead to the selective amplification of local processing and serve the important computational functions of gating and gain modulation. Although several interneuron populations are known to target other interneurons to varying degrees, little is known about interneurons specializing in disinhibition and their in vivo function. Here we show that a class of interneurons that express vasoactive intestinal polypeptide (VIP) mediates disinhibitory control in multiple areas of neocortex and is recruited by reinforcement signals. By combining optogenetic activation with single-cell recordings, we examined the functional role of VIP interneurons in awake mice, and investigated the underlying circuit mechanisms in vitro in auditory and medial prefrontal cortices. We identified a basic disinhibitory circuit module in which activation of VIP interneurons transiently suppresses primarily somatostatin- and a fraction of parvalbumin-expressing inhibitory interneurons that specialize in the control of the input and output of principal cells, respectively. During the performance of an auditory discrimination task, reinforcement signals (reward and punishment) strongly and uniformly activated VIP neurons in auditory cortex, and in turn VIP recruitment increased the gain of a functional subpopulation of principal neurons. These results reveal a specific cell type and microcircuit underlying disinhibitory control in cortex and demonstrate that it is activated under specific behavioural conditions.

Optogenetic Dissection of the Basal Forebrain Neuromodulatory Control of Cortical Activation, Plasticity, and Cognition.

The basal forebrain (BF) houses major ascending projections to the entire neocortex that have long been implicated in arousal, learning, and attention. The disruption of the BF has been linked with major neurological disorders, such as coma and Alzheimer's disease, as well as in normal cognitive aging. Although it is best known for its cholinergic neurons, the BF is in fact an anatomically and neurochemically complex structure. Recent studies using transgenic mouse lines to target specific BF cell types have led to a renaissance in the study of the BF and are beginning to yield new insights about cell-type-specific circuit mechanisms during behavior. These approaches enable us to determine the behavioral conditions under which cholinergic and noncholinergic BF neurons are activated and how they control cortical processing to influence behavior. Here we discuss recent advances that have expanded our knowledge about this poorly understood brain region and laid the foundation for future cell-type-specific manipulations to modulate arousal, attention, and cortical plasticity in neurological disorders. SIGNIFICANCE STATEMENT: Although the basal forebrain is best known for, and often equated with, acetylcholine-containing neurons that provide most of the cholinergic innervation of the neocortex, it is in fact an anatomically and neurochemically complex structure. Recent studies using transgenic mouse lines to target specific cell types in the basal forebrain have led to a renaissance in this field and are beginning to dissect circuit mechanisms in the basal forebrain during behavior. This review discusses recent advances in the roles of basal forebrain cholinergic and noncholinergic neurons in cognition via their dynamic modulation of cortical activity.

A Mathematical Framework for Statistical Decision Confidence.

Decision confidence is a forecast about the probability that a decision will be correct. From a statistical perspective, decision confidence can be defined as the Bayesian posterior probability that the chosen option is correct based on the evidence contributing to it. Here, we used this formal definition as a starting point to develop a normative statistical framework for decision confidence. Our goal was to make general predictions that do not depend on the structure of the noise or a specific algorithm for estimating confidence. We analytically proved several interrelations between statistical decision confidence and observable decision measures, such as evidence discriminability, choice, and accuracy. These interrelationships specify necessary signatures of decision confidence in terms of externally quantifiable variables that can be empirically tested. Our results lay the foundations for a mathematically rigorous treatment of decision confidence that can lead to a common framework for understanding confidence across different research domains, from human and animal behavior to neural representations.

Multiple modes of phase locking between sniffing and whisking during active exploration.

Sense organs are often actively controlled by motor processes and such active sensing profoundly shapes the timing of sensory information flow. The temporal coordination between different active sensing processes is less well understood but is essential for multisensory integration, coordination between brain regions, and energetically optimal sampling strategies. Here we studied the coordination between sniffing and whisking, the motor processes in rodents that control the acquisition of smell and touch information, respectively. Sniffing, high-frequency respiratory bouts, and whisking, rapid back and forth movements of mystacial whiskers, occur in the same theta frequency range (4-12 Hz) leading to a hypothesis that these sensorimotor rhythms are phase locked. To test this, we monitored sniffing using a thermocouple in the nasal cavity and whisking with an electromyogram of the mystacial pad in rats engaged in an open field reward foraging behavior. During bouts of exploration, sniffing and whisking showed strong one-to-one phase locking within the theta frequency range (4-12 Hz). Interestingly, we also observed multimode phase locking with multiple whisks within a sniff cycle or multiple sniffs within a whisk cycle-always at the same preferred phase. This specific phase relationship coupled the acquisition phases of the two sensorimotor rhythms, inhalation and whisker protraction. Our results suggest that sniffing and whisking may be under the control of interdependent rhythm generators that dynamically coordinate active acquisition of olfactory and somatosensory information.

Neural correlates, computation and behavioural impact of decision confidence.

Humans and other animals must often make decisions on the basis of imperfect evidence. Statisticians use measures such as P values to assign degrees of confidence to propositions, but little is known about how the brain computes confidence estimates about decisions. We explored this issue using behavioural analysis and neural recordings in rats in combination with computational modelling. Subjects were trained to perform an odour categorization task that allowed decision confidence to be manipulated by varying the distance of the test stimulus to the category boundary. To understand how confidence could be computed along with the choice itself, using standard models of decision-making, we defined a simple measure that quantified the quality of the evidence contributing to a particular decision. Here we show that the firing rates of many single neurons in the orbitofrontal cortex match closely to the predictions of confidence models and cannot be readily explained by alternative mechanisms, such as learning stimulus-outcome associations. Moreover, when tested using a delayed reward version of the task, we found that rats' willingness to wait for rewards increased with confidence, as predicted by the theoretical model. These results indicate that confidence estimates, previously suggested to require 'metacognition' and conscious awareness are available even in the rodent brain, can be computed with relatively simple operations, and can drive adaptive behaviour. We suggest that confidence estimation may be a fundamental and ubiquitous component of decision-making.

Structured behavioral data format: An NWB extension standard for task-based behavioral neuroscience experiments.

Understanding brain function necessitates linking neural activity with corresponding behavior. Structured behavioral experiments are crucial for probing the neural computations and dynamics underlying behavior; however, adequately representing their complex data is a significant challenge. Currently, a comprehensive data standard that fully encapsulates task-based experiments, integrating neural activity with the richness of behavioral context, is lacking. We designed a data model, as an extension to the NWB neurophysiology data standard, to represent structured behavioral neuroscience experiments, spanning stimulus delivery, timestamped events and responses, and simultaneous neural recordings. This data format is validated through its application to a variety of experimental designs, showcasing its potential to advance integrative analyses of neural circuits and complex behaviors. This work introduces a comprehensive data standard designed to capture and store a spectrum of behavioral data, encapsulating the multifaceted nature of modern neuroscience experiments.

Monosynaptic restriction of the anterograde herpes simplex virus strain H129 for neural circuit tracing.

Identification of synaptic partners is a fundamental task for systems neuroscience. To date, few reliable techniques exist for whole brain labeling of downstream synaptic partners in a cell-type-dependent and monosynaptic manner. Herein, we describe a novel monosynaptic anterograde tracing system based on the deletion of the gene UL6 from the genome of a cre-dependent version of the anterograde Herpes Simplex Virus 1 strain H129. Given that this knockout blocks viral genome packaging and thus viral spread, we reasoned that co-infection of a HSV H129 ΔUL6 virus with a recombinant adeno-associated virus expressing UL6 in a cre-dependent manner would result in monosynaptic spread from target cre-expressing neuronal populations. Application of this system to five nonreciprocal neural circuits resulted in labeling of neurons in expected projection areas. While some caveats may preclude certain applications, this system provides a reliable method to label postsynaptic partners in a brain-wide fashion.

Choice ball: a response interface for two-choice psychometric discrimination in head-fixed mice.

The mouse is an important model system for investigating the neural circuits mediating behavior. Because of advances in imaging and optogenetic methods, head-fixed mouse preparations provide an unparalleled opportunity to observe and control neural circuits. To investigate how neural circuits produce behavior, these methods need to be paired with equally well-controlled and monitored behavioral paradigms. Here, we introduce the choice ball, a response device that enables two-alternative forced-choice (2AFC) tasks in head-fixed mice based on the readout of lateral paw movements. We demonstrate the advantages of the choice ball by training mice in the random-click task, a two-choice auditory discrimination behavior. For each trial, mice listened to binaural streams of Poisson-distributed clicks and were required to roll the choice ball laterally toward the side with the greater click rate. In this assay, mice performed hundreds of trials per session with accuracy ranging from 95% for easy stimuli (large interaural click-rate contrast) to near chance level for low-contrast stimuli. We also show, using the record of individual paw strokes, that mice often reverse decisions they have already initiated and that decision reversals correlate with improved performance. The choice ball enables head-fixed 2AFC paradigms, facilitating the circuit-level analysis of sensory processing, decision making, and motor control in mice.

Cognition and the single neuron: How cell types construct the dynamic computations of frontal cortex.

Frontal cortex is thought to underlie many advanced cognitive capacities, from self-control to long term planning. Reflecting these diverse demands, frontal neural activity is notoriously idiosyncratic, with tuning properties that are correlated with endless numbers of behavioral and task features. This menagerie of tuning has made it difficult to extract organizing principles that govern frontal neural activity. Here, we contrast two successful yet seemingly incompatible approaches that have begun to address this challenge. Inspired by the indecipherability of single-neuron tuning, the first approach casts frontal computations as dynamical trajectories traversed by arbitrary mixtures of neurons. The second approach, by contrast, attempts to explain the functional diversity of frontal activity with the biological diversity of cortical cell-types. Motivated by the recent discovery of functional clusters in frontal neurons, we propose a consilience between these population and cell-type-specific approaches to neural computations, advancing the conjecture that evolutionarily inherited cell-type constraints create the scaffold within which frontal population dynamics must operate.

Apparent sunk cost effect in rational agents.

Rational decision makers aim to maximize their gains, but humans and other animals often fail to do so, exhibiting biases and distortions in their choice behavior. In a recent study of economic decisions, humans, mice, and rats were reported to succumb to the sunk cost fallacy, making decisions based on irrecoverable past investments to the detriment of expected future returns. We challenge this interpretation because it is subject to a statistical fallacy, a form of attrition bias, and the observed behavior can be explained without invoking a sunk cost-dependent mechanism. Using a computational model, we illustrate how a rational decision maker with a reward-maximizing decision strategy reproduces the reported behavioral pattern and propose an improved task design to dissociate sunk costs from fluctuations in decision valuation. Similar statistical confounds may be common in analyses of cognitive behaviors, highlighting the need to use causal statistical inference and generative models for interpretation.

Cortex-wide response mode of VIP-expressing inhibitory neurons by reward and punishment.

Neocortex is classically divided into distinct areas, each specializing in different function, but all could benefit from reinforcement feedback to inform and update local processing. Yet it remains elusive how global signals like reward and punishment are represented in local cortical computations. Previously, we identified a cortical neuron type, vasoactive intestinal polypeptide (VIP)-expressing interneurons, in auditory cortex that is recruited by behavioral reinforcers and mediates disinhibitory control by inhibiting other inhibitory neurons. As the same disinhibitory cortical circuit is present virtually throughout cortex, we wondered whether VIP neurons are likewise recruited by reinforcers throughout cortex. We monitored VIP neural activity in dozens of cortical regions using three-dimensional random access two-photon microscopy and fiber photometry while mice learned an auditory discrimination task. We found that reward and punishment during initial learning produce rapid, cortex-wide activation of most VIP interneurons. This global recruitment mode showed variations in temporal dynamics in individual neurons and across areas. Neither the weak sensory tuning of VIP interneurons in visual cortex nor their arousal state modulation was fully predictive of reinforcer responses. We suggest that the global response mode of cortical VIP interneurons supports a cell-type-specific circuit mechanism by which organism-level information about reinforcers regulates local circuit processing and plasticity.

Computational validity: using computation to translate behaviours across species.

We propose a new conceptual framework (computational validity) for translation across species and populations based on the computational similarity between the information processing underlying parallel tasks. Translating between species depends not on the superficial similarity of the tasks presented, but rather on the computational similarity of the strategies and mechanisms that underlie those behaviours. Computational validity goes beyond construct validity by directly addressing questions of information processing. Computational validity interacts with circuit validity as computation depends on circuits, but similar computations could be accomplished by different circuits. Because different individuals may use different computations to accomplish a given task, computational validity suggests that behaviour should be understood through the subject's point of view; thus, behaviour should be characterized on an individual level rather than a task level. Tasks can constrain the computational algorithms available to a subject and the observed subtleties of that behaviour can provide information about the computations used by each individual. Computational validity has especially high relevance for the study of psychiatric disorders, given the new views of psychiatry as identifying and mediating information processing dysfunctions that may show high inter-individual variability, as well as for animal models investigating aspects of human psychiatric disorders. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.

Rats use memory confidence to guide decisions.

Memory enables access to past experiences to guide future behavior. Humans can determine which memories to trust (high confidence) and which to doubt (low confidence). How memory retrieval, memory confidence, and memory-guided decisions are related, however, is not understood. In particular, how confidence in memories is used in decision making is unknown. We developed a spatial memory task in which rats were incentivized to gamble their time: betting more following a correct choice yielded greater reward. Rat behavior reflected memory confidence, with higher temporal bets following correct choices. We applied machine learning to identify a memory decision variable and built a generative model of memories evolving over time that accurately predicted both choices and confidence reports. Our results reveal in rats an ability thought to exist exclusively in primates and introduce a unified model of memory dynamics, retrieval, choice, and confidence.