Distinct Dopamine Receptor Pathways Underlie the Temporal Sensitivity of Associative Learning.

Animals rely on the relative timing of events in their environment to form and update predictive associations, but the molecular and circuit mechanisms for this temporal sensitivity remain incompletely understood. Here, we show that olfactory associations in Drosophila can be written and reversed on a trial-by-trial basis depending on the temporal relationship between an odor cue and dopaminergic reinforcement. Through the synchronous recording of neural activity and behavior, we show that reversals in learned odor attraction correlate with bidirectional neural plasticity in the mushroom body, the associative olfactory center of the fly. Two dopamine receptors, DopR1 and DopR2, contribute to this temporal sensitivity by coupling to distinct second messengers and directing either synaptic depression or potentiation. Our results reveal how dopamine-receptor signaling pathways can detect the order of events to instruct opposing forms of synaptic and behavioral plasticity, allowing animals to flexibly update their associations in a dynamic environment.

Integration of Parallel Opposing Memories Underlies Memory Extinction.

Accurately predicting an outcome requires that animals learn supporting and conflicting evidence from sequential experience. In mammals and invertebrates, learned fear responses can be suppressed by experiencing predictive cues without punishment, a process called memory extinction. Here, we show that extinction of aversive memories in Drosophila requires specific dopaminergic neurons, which indicate that omission of punishment is remembered as a positive experience. Functional imaging revealed co-existence of intracellular calcium traces in different places in the mushroom body output neuron network for both the original aversive memory and a new appetitive extinction memory. Light and ultrastructural anatomy are consistent with parallel competing memories being combined within mushroom body output neurons that direct avoidance. Indeed, extinction-evoked plasticity in a pair of these neurons neutralizes the potentiated odor response imposed in the network by aversive learning. Therefore, flies track the accuracy of learned expectations by accumulating and integrating memories of conflicting events.

Representations of Novelty and Familiarity in a Mushroom Body Compartment.

Animals exhibit a behavioral response to novel sensory stimuli about which they have no prior knowledge. We have examined the neural and behavioral correlates of novelty and familiarity in the olfactory system of Drosophila. Novel odors elicit strong activity in output neurons (MBONs) of the α'3 compartment of the mushroom body that is rapidly suppressed upon repeated exposure to the same odor. This transition in neural activity upon familiarization requires odor-evoked activity in the dopaminergic neuron innervating this compartment. Moreover, exposure of a fly to novel odors evokes an alerting response that can also be elicited by optogenetic activation of α'3 MBONs. Silencing these MBONs eliminates the alerting behavior. These data suggest that the α'3 compartment plays a causal role in the behavioral response to novel and familiar stimuli as a consequence of dopamine-mediated plasticity at the Kenyon cell-MBONα'3 synapse.

Coordinated and Compartmentalized Neuromodulation Shapes Sensory Processing in Drosophila.

Learned and adaptive behaviors rely on neural circuits that flexibly couple the same sensory input to alternative output pathways. Here, we show that the Drosophila mushroom body functions like a switchboard in which neuromodulation reroutes the same odor signal to different behavioral circuits, depending on the state and experience of the fly. Using functional synaptic imaging and electrophysiology, we reveal that dopaminergic inputs to the mushroom body modulate synaptic transmission with exquisite spatial specificity, allowing individual neurons to differentially convey olfactory signals to each of their postsynaptic targets. Moreover, we show that the dopaminergic neurons function as an interconnected network, encoding information about both an animal's external context and internal state to coordinate synaptic plasticity throughout the mushroom body. Our data suggest a general circuit mechanism for behavioral flexibility in which neuromodulatory networks act with synaptic precision to transform a single sensory input into different patterns of output activity. PAPERCLIP.

Whole-brain annotation and multi-connectome cell typing of Drosophila.

The fruit fly Drosophila melanogaster has emerged as a key model organism in neuroscience, in large part due to the concentration of collaboratively generated molecular, genetic and digital resources available for it. Here we complement the approximately 140,000 neuron FlyWire whole-brain connectome1 with a systematic and hierarchical annotation of neuronal classes, cell types and developmental units (hemilineages). Of 8,453 annotated cell types, 3,643 were previously proposed in the partial hemibrain connectome2, and 4,581 are new types, mostly from brain regions outside the hemibrain subvolume. Although nearly all hemibrain neurons could be matched morphologically in FlyWire, about one-third of cell types proposed for the hemibrain could not be reliably reidentified. We therefore propose a new definition of cell type as groups of cells that are each quantitatively more similar to cells in a different brain than to any other cell in the same brain, and we validate this definition through joint analysis of FlyWire and hemibrain connectomes. Further analysis defined simple heuristics for the reliability of connections between brains, revealed broad stereotypy and occasional variability in neuron count and connectivity, and provided evidence for functional homeostasis in the mushroom body through adjustments of the absolute amount of excitatory input while maintaining the excitation/inhibition ratio. Our work defines a consensus cell type atlas for the fly brain and provides both an intellectual framework and open-source toolchain for brain-scale comparative connectomics.

Multisensory learning binds neurons into a cross-modal memory engram.

Associating multiple sensory cues with objects and experience is a fundamental brain process that improves object recognition and memory performance. However, neural mechanisms that bind sensory features during learning and augment memory expression are unknown. Here we demonstrate multisensory appetitive and aversive memory in Drosophila. Combining colours and odours improved memory performance, even when each sensory modality was tested alone. Temporal control of neuronal function revealed visually selective mushroom body Kenyon cells (KCs) to be required for enhancement of both visual and olfactory memory after multisensory training. Voltage imaging in head-fixed flies showed that multisensory learning binds activity between streams of modality-specific KCs so that unimodal sensory input generates a multimodal neuronal response. Binding occurs between regions of the olfactory and visual KC axons, which receive valence-relevant dopaminergic reinforcement, and is propagated downstream. Dopamine locally releases GABAergic inhibition to permit specific microcircuits within KC-spanning serotonergic neurons to function as an excitatory bridge between the previously 'modality-selective' KC streams. Cross-modal binding thereby expands the KCs representing the memory engram for each modality into those representing the other. This broadening of the engram improves memory performance after multisensory learning and permits a single sensory feature to retrieve the memory of the multimodal experience.

The Drosophila Mushroom Body: From Architecture to Algorithm in a Learning Circuit.

The Drosophila brain contains a relatively simple circuit for forming Pavlovian associations, yet it achieves many operations common across memory systems. Recent advances have established a clear framework for Drosophila learning and revealed the following key operations: a) pattern separation, whereby dense combinatorial representations of odors are preprocessed to generate highly specific, nonoverlapping odor patterns used for learning; b) convergence, in which sensory information is funneled to a small set of output neurons that guide behavioral actions; c) plasticity, where changing the mapping of sensory input to behavioral output requires a strong reinforcement signal, which is also modulated by internal state and environmental context; and d) modularization, in which a memory consists of multiple parallel traces, which are distinct in stability and flexibility and exist in anatomically well-defined modules within the network. Cross-module interactions allow for higher-order effects where past experience influences future learning. Many of these operations have parallels with processes of memory formation and action selection in more complex brains.

Dopamine-based mechanism for transient forgetting.

Active forgetting is an essential component of the memory management system of the brain1. Forgetting can be permanent, in which prior memory is lost completely, or transient, in which memory exists in a temporary state of impaired retrieval. Temporary blocks on memory seem to be universal, and can disrupt an individual's plans, social interactions and ability to make rapid, flexible and appropriate choices. However, the neurobiological mechanisms that cause transient forgetting are unknown. Here we identify a single dopamine neuron in Drosophila that mediates the memory suppression that results in transient forgetting. Artificially activating this neuron did not abolish the expression of long-term memory. Instead, it briefly suppressed memory retrieval, with the memory becoming accessible again over time. The dopamine neuron modulates memory retrieval by stimulating a unique dopamine receptor that is expressed in a restricted physical compartment of the axons of mushroom body neurons. This mechanism for transient forgetting is triggered by the presentation of interfering stimuli immediately before retrieval.

Availability of food determines the need for sleep in memory consolidation.

Sleep remains a major mystery of biology, with little understood about its basic function. One of the most commonly proposed functions of sleep is the consolidation of memory1-3. However, as conditions such as starvation require the organism to be awake and active4, the ability to switch to a memory consolidation mechanism that is not contingent on sleep may confer an evolutionary advantage. Here we identify an adaptive circuit-based mechanism that enables Drosophila to form sleep-dependent and sleep-independent memory. Flies fed after appetitive conditioning needed increased sleep for memory consolidation, but flies starved after training did not require sleep to form memories. Memory in fed flies is mediated by the anterior-posterior α'/ß' neurons of the mushroom body, while memory under starvation is mediated by medial α'/ß' neurons. Sleep-dependent and sleep-independent memory rely on distinct dopaminergic neurons and corresponding mushroom body output neurons. However, sleep and memory are coupled such that mushroom body neurons required for sleep-dependent memory also promote sleep. Flies lacking Neuropeptide F display sleep-dependent memory even when starved, suggesting that circuit selection is determined by hunger. This plasticity in memory circuits enables flies to retain essential information in changing environments.

Independent insulin signaling modulators govern hot avoidance under different feeding states.

Thermosensation is critical for the survival of animals. However, mechanisms through which nutritional status modulates thermosensation remain unclear. Herein, we showed that hungry Drosophila exhibit a strong hot avoidance behavior (HAB) compared to food-sated flies. We identified that hot stimulus increases the activity of α'ß' mushroom body neurons (MBns), with weak activity in the sated state and strong activity in the hungry state. Furthermore, we showed that α'ß' MBn receives the same level of hot input from the mALT projection neurons via cholinergic transmission in sated and hungry states. Differences in α'ß' MBn activity between food-sated and hungry flies following heat stimuli are regulated by distinct Drosophila insulin-like peptides (Dilps). Dilp2 is secreted by insulin-producing cells (IPCs) and regulates HAB during satiety, whereas Dilp6 is secreted by the fat body and regulates HAB during the hungry state. We observed that Dilp2 induces PI3K/AKT signaling, whereas Dilp6 induces Ras/ERK signaling in α'ß' MBn to regulate HAB in different feeding conditions. Finally, we showed that the 2 α'ß'-related MB output neurons (MBONs), MBON-α'3 and MBON-ß'1, are necessary for the output of integrated hot avoidance information from α'ß' MBn. Our results demonstrate the presence of dual insulin modulation pathways in α'ß' MBn, which are important for suitable behavioral responses in Drosophila during thermoregulation under different feeding states.

Synapse-Specific Trapping of SNARE Machinery Proteins in the Anesthetized Drosophila Brain.

General anesthetics disrupt brain network dynamics through multiple pathways, in part through postsynaptic potentiation of inhibitory ion channels as well as presynaptic inhibition of neuroexocytosis. Common clinical general anesthetic drugs, such as propofol and isoflurane, have been shown to interact and interfere with core components of the exocytic release machinery to cause impaired neurotransmitter release. Recent studies however suggest that these drugs do not affect all synapse subtypes equally. We investigated the role of the presynaptic release machinery in multiple neurotransmitter systems under isoflurane general anesthesia in the adult female Drosophila brain using live-cell super-resolution microscopy and optogenetic readouts of exocytosis and neural excitability. We activated neurotransmitter-specific mushroom body output neurons and imaged presynaptic function under isoflurane anesthesia. We found that isoflurane impaired synaptic release and presynaptic protein dynamics in excitatory cholinergic synapses. In contrast, isoflurane had little to no effect on inhibitory GABAergic or glutamatergic synapses. These results present a distinct inhibitory mechanism for general anesthesia, whereby neuroexocytosis is selectively impaired at excitatory synapses, while inhibitory synapses remain functional. This suggests a presynaptic inhibitory mechanism that complements the other inhibitory effects of these drugs.

Learning with sparse reward in a gap junction network inspired by the insect mushroom body.

Animals can learn in real-life scenarios where rewards are often only available when a goal is achieved. This 'distal' or 'sparse' reward problem remains a challenge for conventional reinforcement learning algorithms. Here we investigate an algorithm for learning in such scenarios, inspired by the possibility that axo-axonal gap junction connections, observed in neural circuits with parallel fibres such as the insect mushroom body, could form a resistive network. In such a network, an active node represents the task state, connections between nodes represent state transitions and their connection to actions, and current flow to a target state can guide decision making. Building on evidence that gap junction weights are adaptive, we propose that experience of a task can modulate the connections to form a graph encoding the task structure. We demonstrate that the approach can be used for efficient reinforcement learning under sparse rewards, and discuss whether it is plausible as an account of the insect mushroom body.

The primacy model and the structure of olfactory space.

Understanding sensory processing involves relating the stimulus space, its neural representation, and perceptual quality. In olfaction, the difficulty in establishing these links lies partly in the complexity of the underlying odor input space and perceptual responses. Based on the recently proposed primacy model for concentration invariant odor identity representation and a few assumptions, we have developed a theoretical framework for mapping the odor input space to the response properties of olfactory receptors. We analyze a geometrical structure containing odor representations in a multidimensional space of receptor affinities and describe its low-dimensional implementation, the primacy hull. We propose the implications of the primacy hull for the structure of feedforward connectivity in early olfactory networks. We test the predictions of our theory by comparing the existing receptor-ligand affinity and connectivity data obtained in the fruit fly olfactory system. We find that the Kenyon cells of the insect mushroom body integrate inputs from the high-affinity (primacy) sets of olfactory receptors in agreement with the primacy theory.

Profiling by image registration reveals common origin of annelid mushroom bodies and vertebrate pallium.

The evolution of the highest-order human brain center, the "pallium" or "cortex," remains enigmatic. To elucidate its origins, we set out to identify related brain parts in phylogenetically distant animals, to then unravel common aspects in cellular composition and molecular architecture. Here, we compare vertebrate pallium development to that of the mushroom bodies, sensory-associative brain centers, in an annelid. Using a newly developed protocol for cellular profiling by image registration (PrImR), we obtain a high-resolution gene expression map for the developing annelid brain. Comparison to the vertebrate pallium reveals that the annelid mushroom bodies develop from similar molecular coordinates within a conserved overall molecular brain topology and that their development involves conserved patterning mechanisms and produces conserved neuron types that existed already in the protostome-deuterostome ancestors. These data indicate deep homology of pallium and mushroom bodies and date back the origin of higher brain centers to prebilaterian times.

Semaphorin 1a-mediated dendritic wiring of the Drosophila mushroom body extrinsic neurons.

SignificanceThe adult Drosophila mushroom body (MB) is one of the most extensively studied neural circuits. However, how its circuit organization is established during development is unclear. In this study, we provide an initial characterization of the assembly process of the extrinsic neurons (dopaminergic neurons and MB output neurons) that target the vertical MB lobes. We probe the cellular mechanisms guiding the neurite targeting of these extrinsic neurons and demonstrate that Semaphorin 1a is required in several MB output neurons for their dendritic innervations to three specific MB lobe zones. Our study reveals several intriguing molecular and cellular principles governing assembly of the MB circuit.

CREBB repression of protein synthesis in mushroom body gates long-term memory formation in Drosophila.

Learned experiences are not necessarily consolidated into long-term memory (LTM) unless they are periodic and meaningful. LTM depends on de novo protein synthesis mediated by cyclic AMP response element-binding protein (CREB) activity. In Drosophila, two creb genes (crebA, crebB) and multiple CREB isoforms have reported influences on aversive olfactory LTM in response to multiple cycles of spaced conditioning. How CREB isoforms regulate LTM effector genes in various neural elements of the memory circuit is unclear, especially in the mushroom body (MB), a prominent associative center in the fly brain that has been shown to participate in LTM formation. Here, we report that i) spaced training induces crebB expression in MB α-lobe neurons and ii) elevating specific CREBB isoform levels in the early α/ß subpopulation of MB neurons enhances LTM formation. By contrast, learning from weak training iii) induces 5-HT1A serotonin receptor synthesis, iv) activates 5-HT1A in early α/ß neurons, and v) inhibits LTM formation. vi) LTM is enhanced when this inhibitory effect is relieved by down-regulating 5-HT1A or overexpressing CREBB. Our findings show that spaced training-induced CREBB antagonizes learning-induced 5-HT1A in early α/ß MB neurons to modulate LTM consolidation.

Beyond prediction error: 25 years of modeling the associations formed in the insect mushroom body.

The insect mushroom body has gained increasing attention as a system in which the computational basis of neural learning circuits can be unraveled. We now understand in detail the key locations in this circuit where synaptic associations are formed between sensory patterns and values leading to actions. However, the actual learning rule (or rules) implemented by neural activity and leading to synaptic change is still an open question. Here, I survey the diversity of answers that have been offered in computational models of this system over the past decades, including the recurring assumption-in line with top-down theories of associative learning-that the core function is to reduce prediction error. However, I will argue, a more bottom-up approach may ultimately reveal a richer algorithmic capacity in this still enigmatic brain neuropil.

Diverse memory paradigms in Drosophila reveal diverse neural mechanisms.

In this review, we aggregated the different types of learning and memory paradigms developed in adult Drosophila and attempted to assess the similarities and differences in the neural mechanisms supporting diverse types of memory. The simplest association memory assays are conditioning paradigms (olfactory, visual, and gustatory). A great deal of work has been done on these memories, revealing hundreds of genes and neural circuits supporting this memory. Variations of conditioning assays (reversal learning, trace conditioning, latent inhibition, and extinction) also reveal interesting memory mechanisms, whereas mechanisms supporting spatial memory (thermal maze, orientation memory, and heat box) and the conditioned suppression of innate behaviors (phototaxis, negative geotaxis, anemotaxis, and locomotion) remain largely unexplored. In recent years, there has been an increased interest in multisensory and multicomponent memories (context-dependent and cross-modal memory) and higher-order memory (sensory preconditioning and second-order conditioning). Some of this work has revealed how the intricate mushroom body (MB) neural circuitry can support more complex memories. Finally, the most complex memories are arguably those involving social memory: courtship conditioning and social learning (mate-copying and egg-laying behaviors). Currently, very little is known about the mechanisms supporting social memories. Overall, the MBs are important for association memories of multiple sensory modalities and multisensory integration, whereas the central complex is important for place, orientation, and navigation memories. Interestingly, several different types of memory appear to use similar or variants of the olfactory conditioning neural circuitry, which are repurposed in different ways.

Future avenues in Drosophila mushroom body research.

How does the brain translate sensory information into complex behaviors? With relatively small neuronal numbers, readable behavioral outputs, and an unparalleled genetic toolkit, the Drosophila mushroom body (MB) offers an excellent model to address this question in the context of associative learning and memory. Recent technological breakthroughs, such as the freshly completed full-brain connectome, multiomics approaches, CRISPR-mediated gene editing, and machine learning techniques, led to major advancements in our understanding of the MB circuit at the molecular, structural, physiological, and functional levels. Despite significant progress in individual MB areas, the field still faces the fundamental challenge of resolving how these different levels combine and interact to ultimately control the behavior of an individual fly. In this review, we discuss various aspects of MB research, with a focus on the current knowledge gaps, and an outlook on the future methodological developments required to reach an overall view of the neurobiological basis of learning and memory.

Sensory encoding and memory in the mushroom body: signals, noise, and variability.

To survive in changing environments, animals need to learn to associate specific sensory stimuli with positive or negative valence. How do they form stimulus-specific memories to distinguish between positively/negatively associated stimuli and other irrelevant stimuli? Solving this task is one of the functions of the mushroom body, the associative memory center in insect brains. Here we summarize recent work on sensory encoding and memory in the Drosophila mushroom body, highlighting general principles such as pattern separation, sparse coding, noise and variability, coincidence detection, and spatially localized neuromodulation, and placing the mushroom body in comparative perspective with mammalian memory systems.