Striosomes Mediate Value-Based Learning Vulnerable in Age and a Huntington's Disease Model.

Learning valence-based responses to favorable and unfavorable options requires judgments of the relative value of the options, a process necessary for species survival. We found, using engineered mice, that circuit connectivity and function of the striosome compartment of the striatum are critical for this type of learning. Calcium imaging during valence-based learning exhibited a selective correlation between learning and striosomal but not matrix signals. This striosomal activity encoded discrimination learning and was correlated with task engagement, which, in turn, could be regulated by chemogenetic excitation and inhibition. Striosomal function during discrimination learning was disturbed with aging and severely so in a mouse model of Huntington's disease. Anatomical and functional connectivity of parvalbumin-positive, putative fast-spiking interneurons (FSIs) to striatal projection neurons was enhanced in striosomes compared with matrix in mice that learned. Computational modeling of these findings suggests that FSIs can modulate the striosomal signal-to-noise ratio, crucial for discrimination and learning.

A measure of smell enables the creation of olfactory metamers.

Wavelength is a physical measure of light, and the intricate understanding of its link to perceived colour enables the creation of perceptual entities such as metamers-non-overlapping spectral compositions that generate identical colour percepts1. By contrast, scientists have been unable to develop a physical measure linked to perceived smell, even one that merely reflects the extent of perceptual similarity between odorants2. Here, to generate such a measure, we collected perceptual similarity estimates of 49,788 pairwise odorants from 199 participants who smelled 242 different multicomponent odorants and used these data to refine a predictive model that links odorant structure to odorant perception3. The resulting measure combines 21 physicochemical features of the odorants into a single number-expressed in radians-that accurately predicts the extent of perceptual similarity between multicomponent odorant pairs. To assess the usefulness of this measure, we investigated whether we could use it to create olfactory metamers. To this end, we first identified a cut-off in the measure: pairs of multicomponent odorants that were within 0.05 radians of each other or less were very difficult to discriminate. Using this cut-off, we were able to design olfactory metamers-pairs of non-overlapping molecular compositions that generated identical odour percepts. The accurate predictions of perceptual similarity, and the ensuing creation of olfactory metamers, suggest that we have obtained a valid olfactory measure, one that may enable the digitization of smell.

Dopamine D2 receptors in discrimination learning and spine enlargement.

Dopamine D2 receptors (D2Rs) are densely expressed in the striatum and have been linked to neuropsychiatric disorders such as schizophrenia1,2. High-affinity binding of dopamine suggests that D2Rs detect transient reductions in dopamine concentration (the dopamine dip) during punishment learning3-5. However, the nature and cellular basis of D2R-dependent behaviour are unclear. Here we show that tone reward conditioning induces marked stimulus generalization in a manner that depends on dopamine D1 receptors (D1Rs) in the nucleus accumbens (NAc) of mice, and that discrimination learning refines the conditioning using a dopamine dip. In NAc slices, a narrow dopamine dip (as short as 0.4 s) was detected by D2Rs to disinhibit adenosine A2A receptor (A2AR)-mediated enlargement of dendritic spines in D2R-expressing spiny projection neurons (D2-SPNs). Plasticity-related signalling by Ca2+/calmodulin-dependent protein kinase II and A2ARs in the NAc was required for discrimination learning. By contrast, extinction learning did not involve dopamine dips or D2-SPNs. Treatment with methamphetamine, which dysregulates dopamine signalling, impaired discrimination learning and spine enlargement, and these impairments were reversed by a D2R antagonist. Our data show that D2Rs refine the generalized reward learning mediated by D1Rs.

Perceptual learning across saccades: Feature but not location specific.

Perceptual learning is the ability to enhance perception through practice. The hallmark of perceptual learning is its specificity for the trained location and stimulus features, such as orientation. For example, training in discriminating a grating's orientation improves performance only at the trained location but not in other untrained locations. Perceptual learning has mostly been studied using stimuli presented briefly while observers maintained gaze at one location. However, in everyday life, stimuli are actively explored through eye movements, which results in successive projections of the same stimulus at different retinal locations. Here, we studied perceptual learning of orientation discrimination across saccades. Observers were trained to saccade to a peripheral grating and to discriminate its orientation change that occurred during the saccade. The results showed that training led to transsaccadic perceptual learning (TPL) and performance improvements which did not generalize to an untrained orientation. Remarkably, however, for the trained orientation, we found a complete transfer of TPL to the untrained location in the opposite hemifield suggesting high flexibility of reference frame encoding in TPL. Three control experiments in which participants were trained without saccades did not show such transfer, confirming that the location transfer was contingent upon eye movements. Moreover, performance at the trained location, but not at the untrained location, was also improved in an untrained fixation task. Our results suggest that TPL has both, a location-specific component that occurs before the eye movement and a saccade-related component that involves location generalization.

Dentate gyrus circuits for encoding, retrieval and discrimination of episodic memories.

The dentate gyrus (DG) has a key role in hippocampal memory formation. Intriguingly, DG lesions impair many, but not all, hippocampus-dependent mnemonic functions, indicating that the rest of the hippocampus (CA1-CA3) can operate autonomously under certain conditions. An extensive body of theoretical work has proposed how the architectural elements and various cell types of the DG may underlie its function in cognition. Recent studies recorded and manipulated the activity of different neuron types in the DG during memory tasks and have provided exciting new insights into the mechanisms of DG computational processes, particularly for the encoding, retrieval and discrimination of similar memories. Here, we review these DG-dependent mnemonic functions in light of the new findings and explore mechanistic links between the cellular and network properties of, and the computations performed by, the DG.

Frontal cortex neuron types categorically encode single decision variables.

Individual neurons in many cortical regions have been found to encode specific, identifiable features of the environment or body that pertain to the function of the region1-3. However, in frontal cortex, which is involved in cognition, neural responses display baffling complexity, carrying seemingly disordered mixtures of sensory, motor and other task-related variables4-13. This complexity has led to the suggestion that representations in individual frontal neurons are randomly mixed and can only be understood at the neural population level14,15. Here we show that neural activity in rat orbitofrontal cortex (OFC) is instead highly structured: single neuron activity co-varies with individual variables in computational models that explain choice behaviour. To characterize neural responses across a large behavioural space, we trained rats on a behavioural task that combines perceptual and value-guided decisions. An unbiased, model-free clustering analysis identified distinct groups of OFC neurons, each with a particular response profile in task-variable space. Applying a simple model of choice behaviour to these categorical response profiles revealed that each profile quantitatively corresponds to a specific decision variable, such as decision confidence. Additionally, we demonstrate that a connectivity-defined cell type, orbitofrontal neurons projecting to the striatum, carries a selective and temporally sustained representation of a single decision variable: integrated value. We propose that neurons in frontal cortex, as in other cortical regions, form a sparse and overcomplete representation of features relevant to the region's function, and that they distribute this information selectively to downstream regions to support behaviour.

Goal-directed learning is multidimensional and accompanied by diverse and widespread changes in neocortical signaling.

New tasks are often learned in stages with each stage reflecting a different learning challenge. Accordingly, each learning stage is likely mediated by distinct neuronal processes. And yet, most rodent studies of the neuronal correlates of goal-directed learning focus on individual outcome measures and individual brain regions. Here, we longitudinally studied mice from naïve to expert performance in a head-fixed, operant conditioning whisker discrimination task. In addition to tracking the primary behavioral outcome of stimulus discrimination, we tracked and compared an array of object-based and temporal-based behavioral measures. These behavioral analyses identify multiple, partially overlapping learning stages in this task, consistent with initial response implementation, early stimulus-response generalization, and late response inhibition. To begin to understand the neuronal foundations of these learning processes, we performed widefield Ca2+ imaging of dorsal neocortex throughout learning and correlated behavioral measures with neuronal activity. We found distinct and widespread correlations between neocortical activation patterns and various behavioral measures. For example, improvements in sensory discrimination correlated with target stimulus evoked activations of response-related cortices along with distractor stimulus evoked global cortical suppression. Our study reveals multidimensional learning for a simple goal-directed learning task and generates hypotheses for the neuronal modulations underlying these various learning processes.

Goal discrimination in hippocampal nonplace cells when place information is ambiguous.

SignificanceGoal-directed spatial navigation has been found to rely on hippocampal neurons that are spatially modulated. We show that "nonplace" cells without significant spatial modulation play a role in discriminating goals when environmental cues for goals are ambiguous. This nonplace cell activity is performance-dependent and is modulated by gamma oscillations. Finally, nonplace cell goal discrimination coding fails in a mouse model of Alzheimer's disease (AD). Together, these results show that nonplace cell firing can signal unique task-relevant information when spatial information is ambiguous; these signals depend on performance and are absent in a mouse model of AD.

Auditory discrimination learning and acoustic cue weighing in female zebra finches with localized FoxP1 knockdowns.

Rare disruptions of the transcription factor FOXP1 are implicated in a human neurodevelopmental disorder characterized by autism and/or intellectual disability with prominent problems in speech and language abilities. Avian orthologues of this transcription factor are evolutionarily conserved and highly expressed in specific regions of songbird brains, including areas associated with vocal production learning and auditory perception. Here, we investigated possible contributions of FoxP1 to song discrimination and auditory perception in juvenile and adult female zebra finches. They received lentiviral knockdowns of FoxP1 in one of two brain areas involved in auditory stimulus processing, HVC (proper name) or CMM (caudomedial mesopallium). Ninety-six females, distributed over different experimental and control groups were trained to discriminate between two stimulus songs in an operant Go/Nogo paradigm and subsequently tested with an array of stimuli. This made it possible to assess how well they recognized and categorized altered versions of training stimuli and whether localized FoxP1 knockdowns affected the role of different features during discrimination and categorization of song. Although FoxP1 expression was significantly reduced by the knockdowns, neither discrimination of the stimulus songs nor categorization of songs modified in pitch, sequential order of syllables or by reversed playback were affected. Subsequently, we analyzed the full dataset to assess the impact of the different stimulus manipulations for cue weighing in song discrimination. Our findings show that zebra finches rely on multiple parameters for song discrimination, but with relatively more prominent roles for spectral parameters and syllable sequencing as cues for song discrimination.NEW & NOTEWORTHY In humans, mutations of the transcription factor FoxP1 are implicated in speech and language problems. In songbirds, FoxP1 has been linked to male song learning and female preference strength. We found that FoxP1 knockdowns in female HVC and caudomedial mesopallium (CMM) did not alter song discrimination or categorization based on spectral and temporal information. However, this large dataset allowed to validate different cue weights for spectral over temporal information for song recognition.

The medial prefrontal cortex during flexible decisions: Evidence for its role in distinct working memory processes.

During decisions that involve working memory, task-related information must be encoded, maintained across delays, and retrieved. Few studies have attempted to causally disambiguate how different brain structures contribute to each of these components of working memory. In the present study, we used transient optogenetic disruptions of rat medial prefrontal cortex (mPFC) during a serial spatial reversal learning (SSRL) task to test its role in these specific working memory processes. By analyzing numerous performance metrics, we found: (1) mPFC disruption impaired performance during only the choice epoch of initial discrimination learning of the SSRL task; (2) mPFC disruption impaired performance in dissociable ways across all task epochs (delay, choice, return) during flexible decision-making; (3) mPFC disruption resulted in a reduction of the typical vicarious-trial-and-error rate modulation that was related to changes in task demands. Taken together, these findings suggest that the mPFC plays an outsized role in working memory retrieval, becomes involved in encoding and maintenance when recent memories conflict with task demands, and enables animals to flexibly utilize working memory to update behavior as environments change.

AMPA and NMDA receptors in dentate gyrus mediate memory for sucrose in two port discrimination task.

Although the phenomenon of memory formation and recall associated with the use of psychotropic drugs has been extensively studied, mechanisms underlying memories for natural reward have not been clarified. Herein, we test the hypothesis that glutamatergic receptors in the dentate gyrus play a role in memories associated with sucrose. We used pellet self-administration protocol to generate memories in two-port nose-poke discrimination task using male Wistar rats. During non-rewarded probe trial, the conditioned animals readily discriminated the active port versus inactive port and showed massive increase in mRNA expression of AMPA receptor subunit genes (gria2, gria3) as well as c-Fos protein in the DG. Access to sweet pellet further enhanced c-Fos expression in the DG. However, animals pre-treated with AMPA receptor antagonist CNQX (intra-DG), on exposure to operant chamber (no pellet), showed decreased discrimination as well as c-Fos expression. We suggest that AMPA receptors in DG mediate recall and consolidation of memories associated with sucrose consumption. CNQX pre-treated animals, if presented with sweet pellet on nose poke, exhibited high discrimination index coupled with increased c-Fos expression. In these CNQX treated rats, the DI was again decreased following administration of NMDA receptor antagonist AP5. We suggest that, although AMPA receptors are blocked, the access to sweet pellet may induce surge of glutamate in the DG, which in turn may reinstate memories via activation of erstwhile silent synapses in NMDA dependant manner.

Disrupting dorsal hippocampus impairs category learning in rats.

Categorization requires a balance of mechanisms that can generalize across common features and discriminate against specific details. A growing literature suggests that the hippocampus may accomplish these mechanisms by using fundamental mechanisms like pattern separation, pattern completion, and memory integration. Here, we assessed the role of the rodent dorsal hippocampus (HPC) in category learning by combining inhibitory DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) and simulations using a neural network model. Using touchscreens, we trained rats to categorize distributions of visual stimuli containing black and white gratings that varied along two continuous dimensions. Inactivating the dorsal HPC impaired category learning and generalization, suggesting that the rodent HPC plays an important role during categorization. Hippocampal inactivation had no effect on a control discrimination task that used identical trial procedures as the categorization tasks, suggesting that the impairments were specific to categorization. Model simulations were conducted with variants of a neural network to assess the impact of selective deficits on category learning. The hippocampal inactivation groups were best explained by a model that injected random noise into the computation that compared the similarity between category stimuli and existing memory representations. This model is akin to a deficit in mechanisms of pattern completion, which retrieves similar memory representations using partial information.

Dynamic regulation of corticostriatal glutamatergic synaptic expression during reversal learning in male mice.

Behavioral flexibility, one of the core executive functions of the brain, has been shown to be an essential skill for survival across species. Corticostriatal circuits play a critical role in mediating behavioral flexibility. The molecular mechanisms underlying these processes are still unclear. Here, we measured how synaptic glutamatergic α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor (AMPAR) and N-methyl-D-aspartic acid receptor (NMDAR) expression dynamically changed during specific stages of learning and reversal. Following training to well-established stages of discrimination and reversal learning on a touchscreen visual task, lateral orbitofrontal cortex (OFC), dorsal striatum (dS) as well as medial prefrontal cortex (mPFC), basolateral amygdala (BLA) and piriform cortex (Pir) were micro dissected from male mouse brain and the expression of glutamatergic receptor subunits in the synaptic fraction were measured via immunoblotting. We found that the GluN2B subunit of NMDAR in the OFC remained stable during initial discrimination learning but significantly increased in the synaptic fraction during mid-reversal stages, the period during which the OFC has been shown to play a critical role in updating outcome expectancies. In contrast, both GluA1 and GluA2 subunits of the AMPAR significantly increased in the dS synaptic fraction as new associations were learned late in reversal. Expression of NMDAR and AMPAR subunits did not significantly differ across learning stages in any other brain region. Together, these findings further support the involvement of OFC-dS circuits in moderating well-learned associations and flexible behavior and suggest that dynamic synaptic expression of NMDAR and AMPAR in these circuits may play a role in mediating efficient learning during discrimination and the ability to update previously learned associations as environmental contingencies change.

Generalization of a positive-feature interoceptive morphine occasion setter across the rat estrous cycle.

INTRODUCTION: Interoceptive stimuli elicited by drug administration acquire conditioned modulatory properties of the induction of conditioned appetitive behaviours by exteroceptive cues. This effect may be modeled using a drug discrimination task in which the drug stimulus is trained as a positive-feature (FP) occasion setter (OS) that disambiguates the relation between an exteroceptive light conditioned stimulus (CS) and a sucrose unconditioned stimulus (US). We previously reported that females are less sensitive to generalization of a FP morphine OS than males, so we investigated the role of endogenous ovarian hormones in this difference. METHODS: Male and female rats received intermixed injections of 3.2 mg/kg morphine or saline before each daily training session. Training consisted of 8 presentations of the CS, each followed by access to sucrose on morphine, but not saline sessions. Following acquisiton, rats were tested for generalization of the morphine stimulus to 0, 1.0, 3.2, and 5.4 mg/kg morphine. Female rats were monitored for estrous cyclicity using vaginal cytology throughout the study. RESULTS: Both sexes acquired stable drug discrimination. A gradient of generalization was measured across morphine doses and this behaviour did not differ by sex, nor did it differ across the estrous cycle in females. CONCLUSIONS: Morphine generalization is independent of fluctuations in levels of sex and endogenous gonadal hormones in females under these experimental conditions.

Social demonstration of colour preference improves the learning of associated demonstrated actions.

We studied how different types of social demonstration improve house sparrows' (Passer domesticus) success in solving a foraging task that requires both operant learning (opening covers) and discrimination learning (preferring covers of the rewarding colour). We provided learners with either paired demonstration (of both cover opening and colour preference), action-only demonstration (of opening white covers only), or no demonstration (a companion bird eating without covers). We found that sparrows failed to learn the two tasks with no demonstration, and learned them best with a paired demonstration. Interestingly, the action of cover opening was learned faster with paired rather than action-only demonstration despite being equally demonstrated in both. We also found that only with paired demonstration, the speed of operant (action) learning was related to the demonstrator's level of activity. Colour preference (i.e. discrimination learning) was eventually acquired by all sparrows that learned to open covers, even without social demonstration of colour preference. Thus, adding a demonstration of colour preference was actually more important for operant learning, possibly as a result of increasing the similarity between the demonstrated and the learned tasks, thereby increasing the learner's attention to the actions of the demonstrator. Giving more attention to individuals in similar settings may be an adaptive strategy directing social learners to focus on ecologically relevant behaviours and on tasks that are likely to be learned successfully.

This or not that: select and reject control of relational responding in rats using a blank comparison procedure with odor stimuli.

The blank comparison (BLC) task was developed to assess stimulus relations in discrimination learning; that is, are subjects learning to "select" the correct stimulus (S+) or "reject" the incorrect stimulus (S-) or both? This task has been used to study exclusion learning, mostly in humans and monkeys, and the present study extends the procedure to rats. The BLC task uses an ambiguous stimulus (BLC+/-) that replaces S+ (in the presence of S-) and replaces S- (in the presence of S+). In the current experiment, four rats were trained to remove session-novel scented lids from sand-filled cups in a two-choice, simultaneous presentation procedure called the Odor Span Task (OST) before being trained on the BLC procedure using odors as the discriminative stimuli. The BLC training procedure utilized simple discrimination training (S+ and S-) and added select (S+ and BLC-) and reject (BLC+ and S-) trial types. All rats demonstrated accurate performance in sessions with both select and reject type trials. Next, BLC probe trials were interspersed in standard OST sessions to assess the form of stimulus control in the OST. Rats performed accurately on select type probe trials (similar to baseline OST performance) and also showed above chance accuracy on reject type trials. Thus, we demonstrated that rats could acquire an odor-based version of the BLC task and that both select and exclusion-based (reject) relations were active in the OST. The finding of exclusion in rats under the rigorous BLC task conditions confirms that exclusion-based responding is not limited to humans and non-human primates.

Discriminative-stimulus effects of cannabidiol oil in Sprague-Dawley rats.

Cannabidiol (CBD) is one of the major centrally active phytocannabinoid components of cannabis, and has been approved by the FDA only for the treatment of seizures associated with three rare disorders. It has also been touted as a potential treatment for anxiety in place of more traditional treatments like benzodiazepines. Although there is some evidence of anxiolytic effects of CBD, its suitability as a substitute for benzodiazepines is unknown. This experiment was designed to assess the extent to which CBD shares interoceptive discriminative-stimulus properties with the anxiolytic drug chlordiazepoxide (CDP), a benzodiazepine. In the present experiment, a range of doses (0-1569 mg/kg) of over-the-counter CBD oil was administered (i.g.) in male Sprague-Dawley rats trained to discriminate 5.6 mg/kg CDP from saline. Due to the long time-course effects of CBD, generalization tests were conducted at 90 and 120 min post-CBD administration. The two highest doses of CBD tested (1064 and 1569 mg/kg) were found to partially substitute for 5.6 mg/kg CDP, with mean percent responding on the CDP-associated lever reaching above 20% at time 2 (120 min post-CBD administration), suggesting that high doses of the over-the-counter CBD oils used in this experiment share interoceptive discriminative-stimulus properties to some degree with CDP. These results are novel in comparison to existing research into stimulus effects of CBD, in which substitution for benzodiazepines has not previously been observed.

Examination of the mechanisms underlying the discriminative stimulus properties of the atypical antipsychotic amisulpride.

Amisulpride is an atypical benzamide antipsychotic/antidepressant, whose mechanism of action is thought to depend mainly on dopamine D2/3 receptor activity, but also with some serotonin 5-HT2B/7 effects. The present study examined the role of D2/3 receptors and 5-HT2B/7 receptors in amisulpride's discriminative stimulus. Selective agonists and antagonists of the above receptors were tested in adult, male C57BL/6 mice trained to discriminate 10 mg/kg amisulpride from vehicle in a two-lever drug discrimination assay. After acquisition of the two-lever discrimination, the amisulpride generalization curve yielded an ED50 = 0.56 mg/kg (95% CI = 0.42-0.76 mg/kg). Substitution tests found that the D2/3 antagonist raclopride (62.7% Drug Lever Responding), D2/3 agonist quinpirole (56.6% DLR), 5-HT7 agonist LP-44 (50.1% DLR) and 5-HT7 antagonist SB-269970 (36.7% DLR) produced various degrees of partial substitution for the amisulpride stimulus, whereas the 5-HT2B agonist BW 723C86 (17.9% DLR) and 5-HT2B antagonist SB-204741 (21.1% DLR) yielded negligible amisulpride-like effects. In combination tests with amisulpride, quinpirole decreased percent responding from 98.3% to 57.0% DLR, LP-44 decreased percent responding from 97.6% to 76.7% DLR, and BW 723C86 reduced percent responding from 95.66% to 74.11% DLR. Taken together, the results from stimulus generalization and antagonism studies suggest that amisulpride has a complex discriminative cue that involves mainly mixed D2/3 receptor antagonist/agonist effects and, to a lesser degree, mixed 5-HT7 receptor agonist/antagonist and perhaps 5-HT2B receptor antagonist effects.

Discriminative stimulus properties of Cannabis sativa terpenes in rats.

Cannabis is a pharmacologically complex plant consisting of hundreds of potentially active compounds. One class of compounds present in cannabis that has received little attention are terpenes. Traditionally thought to impart aroma and flavor to cannabis, it has become increasingly recognized that terpenes might exert therapeutic effects themselves. Several recent reports have also indicated terpenes might behave as cannabinoid type 1 (CB1) receptor agonists. This study aimed to investigate whether several terpenes present in cannabis produce discriminative stimulus effects similar to or enhance the effects of Δ 9 -tetrahydrocannabinol (THC). Subsequent experiments explored other potential cannabimimetic effects of these terpenes. Rats were trained to discriminate THC from vehicle while responding under a fixed-ratio 10 schedule of food presentation. Substitution testing was performed with the CB receptor agonist JWH-018 and the terpenes linalool, limonene, γ-terpinene and α-humulene alone. Terpenes were also studied in combination with THC. Finally, THC and terpenes were tested in the tetrad assay to screen for CB1-receptor agonist-like effects. THC and JWH-018 dose-dependently produced responding on the THC-paired lever. When administered alone, none of the terpenes produced responding predominantly on the THC-paired lever. When administered in combination with THC, none of the terpenes enhanced the potency of THC, and in the case of α-humulene, decreased the potency of THC to produce responding on the THC-paired lever. While THC produced effects in all four tetrad components, none of the terpenes produced effects in all four components. Therefore, the terpenes examined in this report do not have effects consistent with CB1 receptor agonist properties in the brain.

Limits of flexibility and associative learning in pigeons.

In a recent study, Wasserman, Kain, and O'Donoghue (Current Biology, 33(6), 1112-1116, 2023) set out to resolve the associative learning paradox by showing that pigeons can solve a complex category learning task through associative learning. The present Outlook paper presents their findings, expands on this paradox, and discusses implications of their results.