Distinct Dopamine Receptor Pathways Underlie the Temporal Sensitivity of Associative Learning.

Animals rely on the relative timing of events in their environment to form and update predictive associations, but the molecular and circuit mechanisms for this temporal sensitivity remain incompletely understood. Here, we show that olfactory associations in Drosophila can be written and reversed on a trial-by-trial basis depending on the temporal relationship between an odor cue and dopaminergic reinforcement. Through the synchronous recording of neural activity and behavior, we show that reversals in learned odor attraction correlate with bidirectional neural plasticity in the mushroom body, the associative olfactory center of the fly. Two dopamine receptors, DopR1 and DopR2, contribute to this temporal sensitivity by coupling to distinct second messengers and directing either synaptic depression or potentiation. Our results reveal how dopamine-receptor signaling pathways can detect the order of events to instruct opposing forms of synaptic and behavioral plasticity, allowing animals to flexibly update their associations in a dynamic environment.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING.

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Differential mechanisms underlie trace and delay conditioning in Drosophila.

Two forms of associative learning-delay conditioning and trace conditioning-have been widely investigated in humans and higher-order mammals1. In delay conditioning, an unconditioned stimulus (for example, an electric shock) is introduced in the final moments of a conditioned stimulus (for example, a tone), with both ending at the same time. In trace conditioning, a 'trace' interval separates the conditioned stimulus and the unconditioned stimulus. Trace conditioning therefore relies on maintaining a neural representation of the conditioned stimulus after its termination (hence making distraction possible2), to learn the conditioned stimulus-unconditioned stimulus contingency3; this makes it more cognitively demanding than delay conditioning4. Here, by combining virtual-reality behaviour with neurogenetic manipulations and in vivo two-photon brain imaging, we show that visual trace conditioning and delay conditioning in Drosophila mobilize R2 and R4m ring neurons in the ellipsoid body. In trace conditioning, calcium transients during the trace interval show increased oscillations and slower declines over repeated training, and both of these effects are sensitive to distractions. Dopaminergic activity accompanies signal persistence in ring neurons, and this is decreased by distractions solely during trace conditioning. Finally, dopamine D1-like and D2-like receptor signalling in ring neurons have different roles in delay and trace conditioning; dopamine D1-like receptor 1 mediates both forms of conditioning, whereas the dopamine D2-like receptor is involved exclusively in sustaining ring neuron activity during the trace interval of trace conditioning. These observations are similar to those previously reported in mammals during arousal5, prefrontal activation6 and high-level cognitive learning7,8.

Dominant activities of fear engram cells in the dorsal dentate gyrus underlie fear generalization in mice.

Over-generalized fear is a maladaptive response to harmless stimuli or situations characteristic of posttraumatic stress disorder (PTSD) and other anxiety disorders. The dorsal dentate gyrus (dDG) contains engram cells that play a crucial role in accurate memory retrieval. However, the coordination mechanism of neuronal subpopulations within the dDG network during fear generalization is not well understood. Here, with the Tet-off system combined with immunostaining and two-photon calcium imaging, we report that dDG fear engram cells labeled in the conditioned context constitutes a significantly higher proportion of dDG neurons activated in a similar context where mice show generalized fear. The activation of these dDG fear engram cells encoding the conditioned context is both sufficient and necessary for inducing fear generalization in the similar context. Activities of mossy cells in the ventral dentate gyrus (vMCs) are significantly suppressed in mice showing fear generalization in a similar context, and activating the vMCs-dDG pathway suppresses generalized but not conditioned fear. Finally, modifying fear memory engrams in the dDG with "safety" signals effectively rescues fear generalization. These findings reveal that the competitive advantage of dDG engram cells underlies fear generalization, which can be rescued by activating the vMCs-dDG pathway or modifying fear memory engrams, and provide novel insights into the dDG network as the neuronal basis of fear generalization.

Fear circuit-based neurobehavioral signatures mirror resilience to chronic social stress in mouse.

Consistent evidence from human data points to successful threat-safety discrimination and responsiveness to extinction of fear memories as key characteristics of resilient individuals. To promote valid cross-species approaches for the identification of resilience mechanisms, we establish a translationally informed mouse model enabling the stratification of mice into three phenotypic subgroups following chronic social defeat stress, based on their individual ability for threat-safety discrimination and conditioned learning: the Discriminating-avoiders, characterized by successful social threat-safety discrimination and extinction of social aversive memories; the Indiscriminate-avoiders, showing aversive response generalization and resistance to extinction, in line with findings on susceptible individuals; and the Non-avoiders displaying impaired aversive conditioned learning. To explore the neurobiological mechanisms underlying the stratification, we perform transcriptome analysis within three key target regions of the fear circuitry. We identify subgroup-specific differentially expressed genes and gene networks underlying the behavioral phenotypes, i.e., the individual ability to show threat-safety discrimination and respond to extinction training. Our approach provides a translationally informed template with which to characterize the behavioral, molecular, and circuit bases of resilience in mice.

Pupillary Responses Reflect Dynamic Changes in Multiple Cognitive Factors During Associative Learning in Primates.

Associative learning involves complex interactions of multiple cognitive factors. While adult subjects can articulate these factors verbally, for model animals such as macaques, we rely on behavioral outputs. In our study, we used pupillary responses as an alternative measure to capture these underlying cognitive changes. We recorded the dynamic changes in the pupils of three male macaques when they learned the associations between visual stimuli and reward sizes under the classical Pavlovian experimental paradigm. We found that during the long-term learning process, the gradual changes in the pupillary response reflect the changes in the cognitive state of the animals. The pupillary response can be explained by a linear combination of components corresponding to multiple cognitive factors. These components reflect the impact of visual stimuli on the pupils, the prediction of reward values associated with the visual stimuli, and the macaques' understanding of the current experimental reward rules. The changing patterns of these factors during interday and intraday learning clearly demonstrate the enhancement of current reward-stimulus association and the weakening of previous reward-stimulus association. Our study shows that the dynamic response of pupils can serve as an objective indicator to characterize the psychological changes of animals, understand their learning process, and provide important tools for exploring animal behavior during the learning process.

What is Learned Determines How Pavlovian Conditioned Fear is Consolidated in the Brain.

Activity in the basolateral amygdala complex (BLA) is needed to encode fears acquired through contact with both innate sources of danger (i.e., things that are painful) and learned sources of danger (e.g., being threatened with a gun). However, within the BLA, the molecular processes required to consolidate the two types of fear are not the same: protein synthesis is needed to consolidate the first type of fear (so-called first-order fear) but not the latter (so-called second-order fear). The present study examined why first- and second-order fears differ in this respect. Specifically, it used a range of conditioning protocols in male and female rats, and assessed the effects of a BLA infusion of the protein synthesis inhibitor, cycloheximide, on first- and second-order conditioned fear. The results revealed that the differential protein synthesis requirements for consolidation of first- and second-order fears reflect differences in what is learned in each case. Protein synthesis in the BLA is needed to consolidate fears that result from encoding of relations between stimuli in the environment (stimulus-stimulus associations, typical for first-order fear) but is not needed to consolidate fears that form when environmental stimuli associate directly with fear responses emitted by the animal (stimulus-response associations, typical for second-order fear). Thus, the substrates of Pavlovian fear conditioning in the BLA depend on the way that the environment impinges upon the animal. This is discussed with respect to theories of amygdala function in Pavlovian fear conditioning, and ways in which stimulus-response associations might be consolidated in the brain.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning.

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Adaptive Responding to Stimulus-Outcome Associations Requires Noradrenergic Transmission in the Medial Prefrontal Cortex.

A dynamic environment, such as the one we inhabit, requires organisms to continuously update their knowledge of the setting. While the prefrontal cortex is recognized for its pivotal role in regulating such adaptive behavior, the specific contribution of each prefrontal area remains elusive. In the current work, we investigated the direct involvement of two major prefrontal subregions, the medial prefrontal cortex (mPFC, A32D + A32V) and the orbitofrontal cortex (OFC, VO + LO), in updating pavlovian stimulus-outcome (S-O) associations following contingency degradation in male rats. Specifically, animals had to learn that a particular cue, previously fully predicting the delivery of a specific reward, was no longer a reliable predictor. First, we found that chemogenetic inhibition of mPFC, but not of OFC, neurons altered the rats' ability to adaptively respond to degraded and non-degraded cues. Next, given the growing evidence pointing at noradrenaline (NA) as a main neuromodulator of adaptive behavior, we decided to investigate the possible involvement of NA projections to the two subregions in this higher-order cognitive process. Employing a pair of novel retrograde vectors, we traced NA projections from the locus ceruleus (LC) to both structures and observed an equivalent yet relatively segregated amount of inputs. Then, we showed that chemogenetic inhibition of NA projections to the mPFC, but not to the OFC, also impaired the rats' ability to adaptively respond to the degradation procedure. Altogether, our findings provide important evidence of functional parcellation within the prefrontal cortex and point at mPFC NA as key for updating pavlovian S-O associations.

The amygdala NT3-TrkC pathway underlies inter-individual differences in fear extinction and related synaptic plasticity.

Fear-related pathologies are among the most prevalent psychiatric conditions, having inappropriate learned fear and resistance to extinction as cardinal features. Exposure therapy represents a promising therapeutic approach, the efficiency of which depends on inter-individual variation in fear extinction learning, which neurobiological basis is unknown. We characterized a model of extinction learning, whereby fear-conditioned mice were categorized as extinction (EXT)-success or EXT-failure, according to their inherent ability to extinguish fear. In the lateral amygdala, GluN2A-containing NMDAR are required for LTP and stabilization of fear memories, while GluN2B-containing NMDAR are required for LTD and fear extinction. EXT-success mice showed attenuated LTP, strong LTD and higher levels of synaptic GluN2B, while EXT-failure mice showed strong LTP, no LTD and higher levels of synaptic GluN2A. Neurotrophin 3 (NT3) infusion in the lateral amygdala was sufficient to rescue extinction deficits in EXT-failure mice. Mechanistically, activation of tropomyosin receptor kinase C (TrkC) with NT3 in EXT-failure slices attenuated lateral amygdala LTP, in a GluN2B-dependent manner. Conversely, blocking endogenous NT3-TrkC signaling with TrkC-Fc chimera in EXT-success slices strengthened lateral amygdala LTP. Our data support a key role for the NT3-TrkC system in inter-individual differences in fear extinction in rodents, through modulation of amygdalar NMDAR composition and synaptic plasticity.

The human insula processes both modality-independent and pain-selective learning signals.

Prediction errors (PEs) are generated when there are differences between an expected and an actual event or sensory input. The insula is a key brain region involved in pain processing, and studies have shown that the insula encodes the magnitude of an unexpected outcome (unsigned PEs). In addition to signaling this general magnitude information, PEs can give specific information on the direction of this deviation-i.e., whether an event is better or worse than expected. It is unclear whether the unsigned PE responses in the insula are selective for pain or reflective of a more general processing of aversive events irrespective of modality. It is also unknown whether the insula can process signed PEs at all. Understanding these specific mechanisms has implications for understanding how pain is processed in the brain in both health and in chronic pain conditions. In this study, 47 participants learned associations between 2 conditioned stimuli (CS) with 4 unconditioned stimuli (US; painful heat or loud sound, of one low and one high intensity each) while undergoing functional magnetic resonance imaging (fMRI) and skin conductance response (SCR) measurements. We demonstrate that activation in the anterior insula correlated with unsigned intensity PEs, irrespective of modality, indicating an unspecific aversive surprise signal. Conversely, signed intensity PE signals were modality specific, with signed PEs following pain but not sound located in the dorsal posterior insula, an area implicated in pain intensity processing. Previous studies have identified abnormal insula function and abnormal learning as potential causes of pain chronification. Our findings link these results and suggest that a misrepresentation of learning relevant PEs in the insular cortex may serve as an underlying factor in chronic pain.

Mesoscale simulations predict the role of synergistic cerebellar plasticity during classical eyeblink conditioning.

According to the motor learning theory by Albus and Ito, synaptic depression at the parallel fibre to Purkinje cells synapse (pf-PC) is the main substrate responsible for learning sensorimotor contingencies under climbing fibre control. However, recent experimental evidence challenges this relatively monopolistic view of cerebellar learning. Bidirectional plasticity appears crucial for learning, in which different microzones can undergo opposite changes of synaptic strength (e.g. downbound microzones-more likely depression, upbound microzones-more likely potentiation), and multiple forms of plasticity have been identified, distributed over different cerebellar circuit synapses. Here, we have simulated classical eyeblink conditioning (CEBC) using an advanced spiking cerebellar model embedding downbound and upbound modules that are subject to multiple plasticity rules. Simulations indicate that synaptic plasticity regulates the cascade of precise spiking patterns spreading throughout the cerebellar cortex and cerebellar nuclei. CEBC was supported by plasticity at the pf-PC synapses as well as at the synapses of the molecular layer interneurons (MLIs), but only the combined switch-off of both sites of plasticity compromised learning significantly. By differentially engaging climbing fibre information and related forms of synaptic plasticity, both microzones contributed to generate a well-timed conditioned response, but it was the downbound module that played the major role in this process. The outcomes of our simulations closely align with the behavioural and electrophysiological phenotypes of mutant mice suffering from cell-specific mutations that affect processing of their PC and/or MLI synapses. Our data highlight that a synergy of bidirectional plasticity rules distributed across the cerebellum can facilitate finetuning of adaptive associative behaviours at a high spatiotemporal resolution.

Neural circuits underlying a psychotherapeutic regimen for fear disorders.

A psychotherapeutic regimen that uses alternating bilateral sensory stimulation (ABS) has been used to treat post-traumatic stress disorder. However, the neural basis that underlies the long-lasting effect of this treatment-described as eye movement desensitization and reprocessing-has not been identified. Here we describe a neuronal pathway driven by the superior colliculus (SC) that mediates persistent attenuation of fear. We successfully induced a lasting reduction in fear in mice by pairing visual ABS with conditioned stimuli during fear extinction. Among the types of visual stimulation tested, ABS provided the strongest fear-reducing effect and yielded sustained increases in the activities of the SC and mediodorsal thalamus (MD). Optogenetic manipulation revealed that the SC-MD circuit was necessary and sufficient to prevent the return of fear. ABS suppressed the activity of fear-encoding cells and stabilized inhibitory neurotransmission in the basolateral amygdala through a feedforward inhibitory circuit from the MD. Together, these results reveal the neural circuit that underlies an effective strategy for sustainably attenuating traumatic memories.

Oxytocin-dependent reopening of a social reward learning critical period with MDMA.

A critical period is a developmental epoch during which the nervous system is expressly sensitive to specific environmental stimuli that are required for proper circuit organization and learning. Mechanistic characterization of critical periods has revealed an important role for exuberant brain plasticity during early development, and for constraints that are imposed on these mechanisms as the brain matures1. In disease states, closure of critical periods limits the ability of the brain to adapt even when optimal conditions are restored. Thus, identification of manipulations that reopen critical periods has been a priority for translational neuroscience2. Here we provide evidence that developmental regulation of oxytocin-mediated synaptic plasticity (long-term depression) in the nucleus accumbens establishes a critical period for social reward learning. Furthermore, we show that a single dose of (+/-)-3,4-methylendioxymethamphetamine (MDMA) reopens the critical period for social reward learning and leads to a metaplastic upregulation of oxytocin-dependent long-term depression. MDMA-induced reopening of this critical period requires activation of oxytocin receptors in the nucleus accumbens, and is recapitulated by stimulation of oxytocin terminals in the nucleus accumbens. These findings have important implications for understanding the pathogenesis of neurodevelopmental diseases that are characterized by social impairments and of disorders that respond to social influence or are the result of social injury3.

Auditory aversive generalization learning prompts threat-specific changes in alpha-band activity.

Pairing a neutral stimulus with aversive outcomes prompts neurophysiological and autonomic changes in response to the conditioned stimulus (CS+), compared to cues that signal safety (CS-). One of these changes-selective amplitude reduction of parietal alpha-band oscillations-has been reliably linked to processing of visual CS+. It is, however, unclear to what extent auditory conditioned cues prompt similar changes, how these changes evolve as learning progresses, and how alpha reduction in the auditory domain generalizes to similar stimuli. To address these questions, 55 participants listened to three sine wave tones, with either the highest or lowest pitch (CS+) being associated with a noxious white noise burst. A threat-specific (CS+) reduction in occipital-parietal alpha-band power was observed similar to changes expected for visual stimuli. No evidence for aversive generalization to the tone most similar to the CS+ was observed in terms of alpha-band power changes, aversiveness ratings, or pupil dilation. By-trial analyses found that selective alpha-band changes continued to increase as aversive conditioning continued, beyond when participants reported awareness of the contingencies. The results support a theoretical model in which selective alpha power represents a cross-modal index of continuous aversive learning, accompanied by sustained sensory discrimination of conditioned threat from safety cues.

Conditioning and pseudoconditioning differently change intrinsic excitability of inhibitory interneurons in the neocortex.

Many studies indicate a broad role of various classes of GABAergic interneurons in the processes related to learning. However, little is known about how the learning process affects intrinsic excitability of specific classes of interneurons in the neocortex. To determine this, we employed a simple model of conditional learning in mice where vibrissae stimulation was used as a conditioned stimulus and a tail shock as an unconditioned one. In vitro whole-cell patch-clamp recordings showed an increase in intrinsic excitability of low-threshold spiking somatostatin-expressing interneurons (SST-INs) in layer 4 (L4) of the somatosensory (barrel) cortex after the conditioning paradigm. In contrast, pseudoconditioning reduced intrinsic excitability of SST-LTS, parvalbumin-expressing interneurons (PV-INs), and vasoactive intestinal polypeptide-expressing interneurons (VIP-INs) with accommodating pattern in L4 of the barrel cortex. In general, increased intrinsic excitability was accompanied by narrowing of action potentials (APs), whereas decreased intrinsic excitability coincided with AP broadening. Altogether, these results show that both conditioning and pseudoconditioning lead to plastic changes in intrinsic excitability of GABAergic interneurons in a cell-specific manner. In this way, changes in intrinsic excitability can be perceived as a common mechanism of learning-induced plasticity in the GABAergic system.

Temporally and anatomically specific contributions of the human amygdala to threat and safety learning.

Neural plasticity in subareas of the rodent amygdala is widely known to be essential for Pavlovian threat conditioning and safety learning. However, less consistent results have been observed in human neuroimaging studies. Here, we identify and test three important factors that may contribute to these discrepancies: the temporal profile of amygdala response in threat conditioning, the anatomical specificity of amygdala responses during threat conditioning and safety learning, and insufficient power to identify these responses. We combined data across multiple studies using a well-validated human threat conditioning paradigm to examine amygdala involvement during threat conditioning and safety learning. In 601 humans, we show that two amygdala subregions tracked the conditioned stimulus with aversive shock during early conditioning while only one demonstrated delayed responding to a stimulus not paired with shock. Our findings identify cross-species similarities in temporal- and anatomical-specific amygdala contributions to threat and safety learning, affirm human amygdala involvement in associative learning and highlight important factors for future associative learning research in humans.

Regional synapse gain and loss accompany memory formation in larval zebrafish.

Defining the structural and functional changes in the nervous system underlying learning and memory represents a major challenge for modern neuroscience. Although changes in neuronal activity following memory formation have been studied [B. F. Grewe et al., Nature 543, 670-675 (2017); M. T. Rogan, U. V. Stäubli, J. E. LeDoux, Nature 390, 604-607 (1997)], the underlying structural changes at the synapse level remain poorly understood. Here, we capture synaptic changes in the midlarval zebrafish brain that occur during associative memory formation by imaging excitatory synapses labeled with recombinant probes using selective plane illumination microscopy. Imaging the same subjects before and after classical conditioning at single-synapse resolution provides an unbiased mapping of synaptic changes accompanying memory formation. In control animals and animals that failed to learn the task, there were no significant changes in the spatial patterns of synapses in the pallium, which contains the equivalent of the mammalian amygdala and is essential for associative learning in teleost fish [M. Portavella, J. P. Vargas, B. Torres, C. Salas, Brain Res. Bull 57, 397-399 (2002)]. In zebrafish that formed memories, we saw a dramatic increase in the number of synapses in the ventrolateral pallium, which contains neurons active during memory formation and retrieval. Concurrently, synapse loss predominated in the dorsomedial pallium. Surprisingly, we did not observe significant changes in the intensity of synaptic labeling, a proxy for synaptic strength, with memory formation in any region of the pallium. Our results suggest that memory formation due to classical conditioning is associated with reciprocal changes in synapse numbers in the pallium.

Targeting acetyl-CoA metabolism attenuates the formation of fear memories through reduced activity-dependent histone acetylation.

Histone acetylation is a key component in the consolidation of long-term fear memories. Histone acetylation is fueled by acetyl-coenzyme A (acetyl-CoA), and recently, nuclear-localized metabolic enzymes that produce this metabolite have emerged as direct and local regulators of chromatin. In particular, acetyl-CoA synthetase 2 (ACSS2) mediates histone acetylation in the mouse hippocampus. However, whether ACSS2 regulates long-term fear memory remains to be determined. Here, we show that Acss2 knockout is well tolerated in mice, yet the Acss2-null mouse exhibits reduced acquisition of long-term fear memory. Loss of Acss2 leads to reductions in both histone acetylation and expression of critical learning and memory-related genes in the dorsal hippocampus, specifically following fear conditioning. Furthermore, systemic administration of blood-brain barrier-permeable Acss2 inhibitors during the consolidation window reduces fear-memory formation in mice and rats and reduces anxiety in a predator-scent stress paradigm. Our findings suggest that nuclear acetyl-CoA metabolism via ACSS2 plays a critical, previously unappreciated, role in the formation of fear memories.

Reinforcement expectation in the honeybee (Apis mellifera): Can downshifts in reinforcement show conditioned inhibition?

When animals learn the association of a conditioned stimulus (CS) with an unconditioned stimulus (US), later presentation of the CS invokes a representation of the US. When the expected US fails to occur, theoretical accounts predict that conditioned inhibition can accrue to any other stimuli that are associated with this change in the US. Empirical work with mammals has confirmed the existence of conditioned inhibition. But the way it is manifested, the conditions that produce it, and determining whether it is the opposite of excitatory conditioning are important considerations. Invertebrates can make valuable contributions to this literature because of the well-established conditioning protocols and access to the central nervous system (CNS) for studying neural underpinnings of behavior. Nevertheless, although conditioned inhibition has been reported, it has yet to be thoroughly investigated in invertebrates. Here, we evaluate the role of the US in producing conditioned inhibition by using proboscis extension response conditioning of the honeybee (Apis mellifera). Specifically, using variations of a "feature-negative" experimental design, we use downshifts in US intensity relative to US intensity used during initial excitatory conditioning to show that an odorant in an odor-odor mixture can become a conditioned inhibitor. We argue that some alternative interpretations to conditioned inhibition are unlikely. However, we show variation across individuals in how strongly they show conditioned inhibition, with some individuals possibly revealing a different means of learning about changes in reinforcement. We discuss how the resolution of these differences is needed to fully understand whether and how conditioned inhibition is manifested in the honeybee, and whether it can be extended to investigate how it is encoded in the CNS. It is also important for extension to other insect models. In particular, work like this will be important as more is revealed of the complexity of the insect brain from connectome projects.