Identification of Dopaminergic Neurons That Can Both Establish Associative Memory and Acutely Terminate Its Behavioral Expression.

An adaptive transition from exploring the environment in search of vital resources to exploiting these resources once the search was successful is important to all animals. Here we study the neuronal circuitry that allows larval Drosophila melanogaster of either sex to negotiate this exploration-exploitation transition. We do so by combining Pavlovian conditioning with high-resolution behavioral tracking, optogenetic manipulation of individually identified neurons, and EM data-based analyses of synaptic organization. We find that optogenetic activation of the dopaminergic neuron DAN-i1 can both establish memory during training and acutely terminate learned search behavior in a subsequent recall test. Its activation leaves innate behavior unaffected, however. Specifically, DAN-i1 activation can establish associative memories of opposite valence after paired and unpaired training with odor, and its activation during the recall test can terminate the search behavior resulting from either of these memories. Our results further suggest that in its behavioral significance DAN-i1 activation resembles, but does not equal, sugar reward. Dendrogram analyses of all the synaptic connections between DAN-i1 and its two main targets, the Kenyon cells and the mushroom body output neuron MBON-i1, further suggest that the DAN-i1 signals during training and during the recall test could be delivered to the Kenyon cells and to MBON-i1, respectively, within previously unrecognized, locally confined branching structures. This would provide an elegant circuit motif to terminate search on its successful completion.SIGNIFICANCE STATEMENT In the struggle for survival, animals have to explore their environment in search of food. Once food is found, however, it is adaptive to prioritize exploiting it over continuing a search that would now be as pointless as searching for the glasses you are wearing. This exploration-exploitation trade-off is important for animals and humans, as well as for technical search devices. We investigate which of the only 10,000 neurons of a fruit fly larva can tip the balance in this trade-off, and identify a single dopamine neuron called DAN-i1 that can do so. Given the similarities in dopamine neuron function across the animal kingdom, this may reflect a general principle of how search is terminated once it is successful.

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila.

The brain adaptively integrates present sensory input, past experience, and options for future action. The insect mushroom body exemplifies how a central brain structure brings about such integration. Here we use a combination of systematic single-cell labeling, connectomics, transgenic silencing, and activation experiments to study the mushroom body at single-cell resolution, focusing on the behavioral architecture of its input and output neurons (MBINs and MBONs), and of the mushroom body intrinsic APL neuron. Our results reveal the identity and morphology of almost all of these 44 neurons in stage 3 Drosophila larvae. Upon an initial screen, functional analyses focusing on the mushroom body medial lobe uncover sparse and specific functions of its dopaminergic MBINs, its MBONs, and of the GABAergic APL neuron across three behavioral tasks, namely odor preference, taste preference, and associative learning between odor and taste. Our results thus provide a cellular-resolution study case of how brains organize behavior.

The complete connectome of a learning and memory centre in an insect brain.

Associating stimuli with positive or negative reinforcement is essential for survival, but a complete wiring diagram of a higher-order circuit supporting associative memory has not been previously available. Here we reconstruct one such circuit at synaptic resolution, the Drosophila larval mushroom body. We find that most Kenyon cells integrate random combinations of inputs but that a subset receives stereotyped inputs from single projection neurons. This organization maximizes performance of a model output neuron on a stimulus discrimination task. We also report a novel canonical circuit in each mushroom body compartment with previously unidentified connections: reciprocal Kenyon cell to modulatory neuron connections, modulatory neuron to output neuron connections, and a surprisingly high number of recurrent connections between Kenyon cells. Stereotyped connections found between output neurons could enhance the selection of learned behaviours. The complete circuit map of the mushroom body should guide future functional studies of this learning and memory centre.

The Ol1mpiad: concordance of behavioural faculties of stage 1 and stage 3 Drosophila larvae.

Mapping brain function to brain structure is a fundamental task for neuroscience. For such an endeavour, the Drosophila larva is simple enough to be tractable, yet complex enough to be interesting. It features about 10,000 neurons and is capable of various taxes, kineses and Pavlovian conditioning. All its neurons are currently being mapped into a light-microscopical atlas, and Gal4 strains are being generated to experimentally access neurons one at a time. In addition, an electron microscopic reconstruction of its nervous system seems within reach. Notably, this electron microscope-based connectome is being drafted for a stage 1 larva - because stage 1 larvae are much smaller than stage 3 larvae. However, most behaviour analyses have been performed for stage 3 larvae because their larger size makes them easier to handle and observe. It is therefore warranted to either redo the electron microscopic reconstruction for a stage 3 larva or to survey the behavioural faculties of stage 1 larvae. We provide the latter. In a community-based approach we called the Ol1mpiad, we probed stage 1 Drosophila larvae for free locomotion, feeding, responsiveness to substrate vibration, gentle and nociceptive touch, burrowing, olfactory preference and thermotaxis, light avoidance, gustatory choice of various tastants plus odour-taste associative learning, as well as light/dark-electric shock associative learning. Quantitatively, stage 1 larvae show lower scores in most tasks, arguably because of their smaller size and lower speed. Qualitatively, however, stage 1 larvae perform strikingly similar to stage 3 larvae in almost all cases. These results bolster confidence in mapping brain structure and behaviour across developmental stages.

Pavlovian Conditioning of Larval Drosophila: An Illustrated, Multilingual, Hands-On Manual for Odor-Taste Associative Learning in Maggots.

Larval Drosophila offer a study case for behavioral neurogenetics that is simple enough to be experimentally tractable, yet complex enough to be worth the effort. We provide a detailed, hands-on manual for Pavlovian odor-reward learning in these animals. Given the versatility of Drosophila for genetic analyses, combined with the evolutionarily shared genetic heritage with humans, the paradigm has utility not only in behavioral neurogenetics and experimental psychology, but for translational biomedicine as well. Together with the upcoming total synaptic connectome of the Drosophila nervous system and the possibilities of single-cell-specific transgene expression, it offers enticing opportunities for research. Indeed, the paradigm has already been adopted by a number of labs and is robust enough to be used for teaching in classroom settings. This has given rise to a demand for a detailed, hands-on manual directed at newcomers and/or at laboratory novices, and this is what we here provide. The paradigm and the present manual have a unique set of features: The paradigm is cheap, easy, and robust;The manual is detailed enough for newcomers or laboratory novices;It briefly covers the essential scientific context;It includes sheets for scoring, data analysis, and display;It is multilingual: in addition to an English version we provide German, French, Japanese, Spanish and Italian language versions as well.The present manual can thus foster science education at an earlier age and enable research by a broader community than has been the case to date.

Four Individually Identified Paired Dopamine Neurons Signal Reward in Larval Drosophila.

Dopaminergic neurons serve multiple functions, including reinforcement processing during associative learning [1-12]. It is thus warranted to understand which dopaminergic neurons mediate which function. We study larval Drosophila, in which only approximately 120 of a total of 10,000 neurons are dopaminergic, as judged by the expression of tyrosine hydroxylase (TH), the rate-limiting enzyme of dopamine biosynthesis [5, 13]. Dopaminergic neurons mediating reinforcement in insect olfactory learning target the mushroom bodies, a higher-order "cortical" brain region [1-5, 11, 12, 14, 15]. We discover four previously undescribed paired neurons, the primary protocerebral anterior medial (pPAM) neurons. These neurons are TH positive and subdivide the medial lobe of the mushroom body into four distinct subunits. These pPAM neurons are acutely necessary for odor-sugar reward learning and require intact TH function in this process. However, they are dispensable for aversive learning and innate behavior toward the odors and sugars employed. Optogenetical activation of pPAM neurons is sufficient as a reward. Thus, the pPAM neurons convey a likely dopaminergic reward signal. In contrast, DL1 cluster neurons convey a corresponding punishment signal [5], suggesting a cellular division of labor to convey dopaminergic reward and punishment signals. On the level of individually identified neurons, this uncovers an organizational principle shared with adult Drosophila and mammals [1-4, 7, 9, 10] (but see [6]). The numerical simplicity and connectomic tractability of the larval nervous system [16-19] now offers a prospect for studying circuit principles of dopamine function at unprecedented resolution.

Synapsin is required to "boost" memory strength for highly salient events.

Synapsin is an evolutionarily conserved presynaptic phosphoprotein. It is encoded by only one gene in the Drosophila genome and is expressed throughout the nervous system. It regulates the balance between reserve and releasable vesicles, is required to maintain transmission upon heavy demand, and is essential for proper memory function at the behavioral level. Task-relevant sensorimotor functions, however, remain intact in the absence of Synapsin. Using an odor-sugar reward associative learning paradigm in larval Drosophila, we show that memory scores in mutants lacking Synapsin (syn(97)) are lower than in wild-type animals only when more salient, higher concentrations of odor or of the sugar reward are used. Furthermore, we show that Synapsin is selectively required for larval short-term memory. Thus, without Synapsin Drosophila larvae can learn and remember, but Synapsin is required to form memories that match in strength to event salience-in particular to a high saliency of odors, of rewards, or the salient recency of an event. We further show that the residual memory scores upon a lack of Synapsin are not further decreased by an additional lack of the Sap47 protein. In combination with mass spectrometry data showing an up-regulated phosphorylation of Synapsin in the larval nervous system upon a lack of Sap47, this is suggestive of a functional interdependence of Synapsin and Sap47.

The impact of odor-reward memory on chemotaxis in larval Drosophila.

How do animals adaptively integrate innate with learned behavioral tendencies? We tackle this question using chemotaxis as a paradigm. Chemotaxis in the Drosophila larva largely results from a sequence of runs and oriented turns. Thus, the larvae minimally need to determine (i) how fast to run, (ii) when to initiate a turn, and (iii) where to direct a turn. We first report how odor-source intensities modulate these decisions to bring about higher levels of chemotactic performance for higher odor-source intensities during innate chemotaxis. We then examine whether the same modulations are responsible for alterations of chemotactic performance by learned odor "valence" (understood throughout as level of attractiveness). We find that run speed (i) is neither modulated by the innate nor by the learned valence of an odor. Turn rate (ii), however, is modulated by both: the higher the innate or learned valence of the odor, the less often larvae turn whenever heading toward the odor source, and the more often they turn when heading away. Likewise, turning direction (iii) is modulated concordantly by innate and learned valence: turning is biased more strongly toward the odor source when either innate or learned valence is high. Using numerical simulations, we show that a modulation of both turn rate and of turning direction is sufficient to account for the empirically found differences in preference scores across experimental conditions. Our results suggest that innate and learned valence organize adaptive olfactory search behavior by their summed effects on turn rate and turning direction, but not on run speed. This work should aid studies into the neural mechanisms by which memory impacts specific aspects of behavior.

Immediate and punitive impact of mechanosensory disturbance on olfactory behaviour of larval Drosophila.

The ability to respond to and to learn about mechanosensory disturbance is widespread among animals. Using Drosophila larvae, we describe how the frequency of mechanosensory disturbance ('buzz') affects three aspects of behaviour: free locomotion, innate olfactory preference, and potency as a punishment. We report that (i) during 2-3 seconds after buzz onset the larvae slowed down and then turned, arguably to escape this situation; this was seen for buzz frequencies of 10, 100, and 1000 Hz, (ii) innate olfactory preference was reduced when tested in the presence of the buzz; this effect was strongest for the 100 Hz frequency, (iii) after odour-buzz associative training, we observed escape from the buzz-associated odour; this effect was apparent for 10 and 100, but not for 1000 Hz. We discuss the multiple behavioural effects of mechanosensation and stress that the immediate effects on locomotion and the impact as punishment differ in their frequency-dependence. Similar dissociations between immediate, reflexive behavioural effects and reinforcement potency were previously reported for sweet, salty and bitter tastants. It should be interesting to see how these features map onto the organization of sensory, ascending pathways.

A behavior-based circuit model of how outcome expectations organize learned behavior in larval Drosophila.

Drosophila larvae combine a numerically simple brain, a correspondingly moderate behavioral complexity, and the availability of a rich toolbox for transgenic manipulation. This makes them attractive as a study case when trying to achieve a circuit-level understanding of behavior organization. From a series of behavioral experiments, we suggest a circuitry of chemosensory processing, odor-tastant memory trace formation, and the "decision" process to behaviorally express these memory traces--or not. The model incorporates statements about the neuronal organization of innate vs. conditioned chemosensory behavior, and the types of interaction between olfactory and gustatory pathways during the establishment as well as the behavioral expression of odor-tastant memory traces. It in particular suggests that innate olfactory behavior is responsive in nature, whereas conditioned olfactory behavior is captured better when seen as an action in pursuit of its outcome. It incorporates the available neuroanatomical and behavioral data and thus should be useful as scaffold for the ongoing investigations of the chemo-behavioral system in larval Drosophila.

Cellular site and molecular mode of synapsin action in associative learning.

Synapsin is an evolutionarily conserved, presynaptic vesicular phosphoprotein. Here, we ask where and how synapsin functions in associative behavioral plasticity. Upon loss or reduction of synapsin in a deletion mutant or via RNAi, respectively, Drosophila larvae are impaired in odor-sugar associative learning. Acute global expression of synapsin and local expression in only the mushroom body, a third-order "cortical" brain region, fully restores associative ability in the mutant. No rescue is found by synapsin expression in mushroom body input neurons or by expression excluding the mushroom bodies. On the molecular level, we find that a transgenically expressed synapsin with dysfunctional PKA-consensus sites cannot rescue the defect of the mutant in associative function, thus assigning synapsin as a behaviorally relevant effector of the AC-cAMP-PKA cascade. We therefore suggest that synapsin acts in associative memory trace formation in the mushroom bodies, as a downstream element of AC-cAMP-PKA signaling. These analyses provide a comprehensive chain of explanation from the molecular level to an associative behavioral change.

Behavioral and synaptic plasticity are impaired upon lack of the synaptic protein SAP47.

The synapse-associated protein of 47 kDa (SAP47) is a member of a phylogenetically conserved gene family of hitherto unknown function. In Drosophila, SAP47 is encoded by a single gene (Sap47) and is expressed throughout all synaptic regions of the wild-type larval brain; specifically, electron microscopy reveals anti-SAP47 immunogold labeling within 30 nm of presynaptic vesicles. To analyze SAP47 function, we used the viable and fertile deletion mutant Sap47(156), which suffers from a 1.7 kb deletion in the regulatory region and the first exon. SAP47 cannot be detected by either immunoblotting or immunohistochemistry in Sap47(156) mutants. These mutants exhibit normal sensory detection of odorants and tastants as well as normal motor performance and basic neurotransmission at the neuromuscular junction. However, short-term plasticity at this synapse is distorted. Interestingly, Sap47(156) mutant larvae also show a 50% reduction in odorant-tastant associative learning ability; a similar associative impairment is observed in a second deletion allele (Sap47(201)) and upon reduction of SAP47 levels using RNA interference. In turn, transgenically restoring SAP47 in Sap47(156) mutant larvae rescues the defect in associative function. This report thus is the first to suggest a function for SAP47. It specifically argues that SAP47 is required for proper behavioral and synaptic plasticity in flies-and prompts the question whether its homologs are required for proper behavioral and synaptic plasticity in other species as well.

Innate attractiveness and associative learnability of odors can be dissociated in larval Drosophila.

We investigate olfactory associative learning in larval Drosophila. A reciprocal training design is used, such that one group of animals receives a reward in the presence of odor X but not in the presence of odor Y (Train: X+ // Y), whereas another group is trained reciprocally (Train: X // Y+). After training, differences in odor preference between these reciprocally trained groups in a choice test (Test: X - Y) reflect associative learning. The current study, after showing which odor pairs can be used for such learning experiments, 1) introduces a one-odor version of such reciprocal paradigm that allows estimating the learnability of single odors. Regarding this reciprocal one-odor paradigm, we show that 2) paired presentations of an odor with a reward increase odor preference above baseline, whereas unpaired presentations of odor and reward decrease odor preference below baseline; this suggests that odors can become predictive either of reward or of reward absence. Furthermore, we show that 3) innate attractiveness and associative learnability can be dissociated. These data deepen our understanding of odor-reward learning in larval Drosophila on the behavioral level, and thus foster its neurogenetic analysis.

Genetic distortion of the balance between punishment and relief learning in Drosophila.

An experience with electric shock can support two opposing kinds of behavioral effects: Stimuli that precede shock during training are subsequently avoided as predictors for punishment, whereas stimuli that follow shock during training are later on approached, as they predict relief. We show here, for the fruit fly Drosophila, that upon the loss of white-function, the balance between these two kinds of learning is distorted in favor of punishment learning: white1118 mutants show stronger punishment learning and weaker relief learning, as compared to wild type flies. Thus, white1118 mutants establish, overall, more "negative" memories for the shock experience. This only concerns the mnemonic effects of the shock; the immediate, reflexive responsiveness to shock remains unaltered. Also, learning about reward is apparently unaffected, both in adult and larval Drosophila. Prompted by the proposed function of the White protein as the transporter for biogenic amine precursors, we probed the brains of white1118 mutants for the amounts of biogenic amines (octopamine, tyramine, dopamine, and serotonin) by using high-pressure liquid chromatography coupled to mass spectrometry. Using this method, we found, however, no difference between white1118 and wild type files for any of the probed amines. In any event, analyses of how the white1118 mutation affects the balance between punishment and relief learning should provide a study case of how heritable distortions of such balance can come about. Finally, the effects of the white1118 mutation should be considered as a source of confound when using white as the "marker gene" in behavior-genetic analyses of any sort.

Salt processing in larval Drosophila: choice, feeding, and learning shift from appetitive to aversive in a concentration-dependent way.

Sodium and chloride need to be ingested and cannot be stored. Therefore, choice of habitat and diet as related to NaCl needs to be tightly regulated. We thus expect that the behavioral effects of salt are organized according to its concentration. Here, we comparatively "fingerprint" the reflex releasing (in choice and feeding experiments) versus the reinforcing effects of sodium chloride ("salt") in terms of their concentration dependencies, using larval Drosophila. Qualitatively, we find that the behavioral effects of salt in all 3 assays are similar: choice, feeding, and reinforcing effect all change from appetitive to aversive as concentration is increased. Quantitatively, however, the appetitive effects for choice and feeding share their optimum at around 0.02 M, whereas the dose-response curve for the reinforcing effect is shifted by more than one order of magnitude toward higher concentrations. Interestingly, a similar shift between these 2 kinds of behavioral effect is also found for sugars (Schipanski et al. 2008). Thus, for salt and for sugar, the sensory-to-motor system is more sensitive regarding immediate, reflexive behavior than regarding reinforcement. We speculate that this may partially be due to a dissociation of the sensory pathways signaling toward either reflexive behavior or internal reinforcement.