Reward expectations direct learning and drive operant matching in Drosophila.

Foraging animals must use decision-making strategies that dynamically adapt to the changing availability of rewards in the environment. A wide diversity of animals do this by distributing their choices in proportion to the rewards received from each option, Herrnstein's operant matching law. Theoretical work suggests an elegant mechanistic explanation for this ubiquitous behavior, as operant matching follows automatically from simple synaptic plasticity rules acting within behaviorally relevant neural circuits. However, no past work has mapped operant matching onto plasticity mechanisms in the brain, leaving the biological relevance of the theory unclear. Here, we discovered operant matching in Drosophila and showed that it requires synaptic plasticity that acts in the mushroom body and incorporates the expectation of reward. We began by developing a dynamic foraging paradigm to measure choices from individual flies as they learn to associate odor cues with probabilistic rewards. We then built a model of the fly mushroom body to explain each fly's sequential choice behavior using a family of biologically realistic synaptic plasticity rules. As predicted by past theoretical work, we found that synaptic plasticity rules could explain fly matching behavior by incorporating stimulus expectations, reward expectations, or both. However, by optogenetically bypassing the representation of reward expectation, we abolished matching behavior and showed that the plasticity rule must specifically incorporate reward expectations. Altogether, these results reveal the first synapse-level mechanisms of operant matching and provide compelling evidence for the role of reward expectation signals in the fly brain.

Flexible specificity of memory in Drosophila depends on a comparison between choices.

Memory guides behavior across widely varying environments and must therefore be both sufficiently specific and general. A memory too specific will be useless in even a slightly different environment, while an overly general memory may lead to suboptimal choices. Animals successfully learn to both distinguish between very similar stimuli and generalize across cues. Rather than forming memories that strike a balance between specificity and generality, Drosophila can flexibly categorize a given stimulus into different groups depending on the options available. We asked how this flexibility manifests itself in the well-characterized learning and memory pathways of the fruit fly. We show that flexible categorization in neuronal activity as well as behavior depends on the order and identity of the perceived stimuli. Our results identify the neural correlates of flexible stimulus-categorization in the fruit fly.

Input density tunes Kenyon cell sensory responses in the Drosophila mushroom body.

The ability to discriminate sensory stimuli with overlapping features is thought to arise in brain structures called expansion layers, where neurons carrying information about sensory features make combinatorial connections onto a much larger set of cells. For 50 years, expansion coding has been a prime topic of theoretical neuroscience, which seeks to explain how quantitative parameters of the expansion circuit influence sensory sensitivity, discrimination, and generalization. Here, we investigate the developmental events that produce the quantitative parameters of the arthropod expansion layer, called the mushroom body. Using Drosophila melanogaster as a model, we employ genetic and chemical tools to engineer changes to circuit development. These allow us to produce living animals with hypothesis-driven variations on natural expansion layer wiring parameters. We then test the functional and behavioral consequences. By altering the number of expansion layer neurons (Kenyon cells) and their dendritic complexity, we find that input density, but not cell number, tunes neuronal odor selectivity. Simple odor discrimination behavior is maintained when the Kenyon cell number is reduced and augmented by Kenyon cell number expansion. Animals with increased input density to each Kenyon cell show increased overlap in Kenyon cell odor responses and become worse at odor discrimination tasks.

Hacking brain development to test models of sensory coding.

Animals can discriminate myriad sensory stimuli but can also generalize from learned experience. You can probably distinguish the favorite teas of your colleagues while still recognizing that all tea pales in comparison to coffee. Tradeoffs between detection, discrimination, and generalization are inherent at every layer of sensory processing. During development, specific quantitative parameters are wired into perceptual circuits and set the playing field on which plasticity mechanisms play out. A primary goal of systems neuroscience is to understand how material properties of a circuit define the logical operations-computations--that it makes, and what good these computations are for survival. A cardinal method in biology-and the mechanism of evolution--is to change a unit or variable within a system and ask how this affects organismal function. Here, we make use of our knowledge of developmental wiring mechanisms to modify hard-wired circuit parameters in the Drosophila melanogaster mushroom body and assess the functional and behavioral consequences. By altering the number of expansion layer neurons (Kenyon cells) and their dendritic complexity, we find that input number, but not cell number, tunes odor selectivity. Simple odor discrimination performance is maintained when Kenyon cell number is reduced and augmented by Kenyon cell expansion.

Stable Representations of Decision Variables for Flexible Behavior.

Decisions occur in dynamic environments. In the framework of reinforcement learning, the probability of performing an action is influenced by decision variables. Discrepancies between predicted and obtained rewards (reward prediction errors) update these variables, but they are otherwise stable between decisions. Although reward prediction errors have been mapped to midbrain dopamine neurons, it is unclear how the brain represents decision variables themselves. We trained mice on a dynamic foraging task in which they chose between alternatives that delivered reward with changing probabilities. Neurons in the medial prefrontal cortex, including projections to the dorsomedial striatum, maintained persistent firing rate changes over long timescales. These changes stably represented relative action values (to bias choices) and total action values (to bias response times) with slow decay. In contrast, decision variables were weakly represented in the anterolateral motor cortex, a region necessary for generating choices. Thus, we define a stable neural mechanism to drive flexible behavior.