Integration of Parallel Opposing Memories Underlies Memory Extinction.

Accurately predicting an outcome requires that animals learn supporting and conflicting evidence from sequential experience. In mammals and invertebrates, learned fear responses can be suppressed by experiencing predictive cues without punishment, a process called memory extinction. Here, we show that extinction of aversive memories in Drosophila requires specific dopaminergic neurons, which indicate that omission of punishment is remembered as a positive experience. Functional imaging revealed co-existence of intracellular calcium traces in different places in the mushroom body output neuron network for both the original aversive memory and a new appetitive extinction memory. Light and ultrastructural anatomy are consistent with parallel competing memories being combined within mushroom body output neurons that direct avoidance. Indeed, extinction-evoked plasticity in a pair of these neurons neutralizes the potentiated odor response imposed in the network by aversive learning. Therefore, flies track the accuracy of learned expectations by accumulating and integrating memories of conflicting events.

Layered reward signalling through octopamine and dopamine in Drosophila.

Dopamine is synonymous with reward and motivation in mammals. However, only recently has dopamine been linked to motivated behaviour and rewarding reinforcement in fruitflies. Instead, octopamine has historically been considered to be the signal for reward in insects. Here we show, using temporal control of neural function in Drosophila, that only short-term appetitive memory is reinforced by octopamine. Moreover, octopamine-dependent memory formation requires signalling through dopamine neurons. Part of the octopamine signal requires the α-adrenergic-like OAMB receptor in an identified subset of mushroom-body-targeted dopamine neurons. Octopamine triggers an increase in intracellular calcium in these dopamine neurons, and their direct activation can substitute for sugar to form appetitive memory, even in flies lacking octopamine. Analysis of the ß-adrenergic-like OCTß2R receptor reveals that octopamine-dependent reinforcement also requires an interaction with dopamine neurons that control appetitive motivation. These data indicate that sweet taste engages a distributed octopamine signal that reinforces memory through discrete subsets of mushroom-body-targeted dopamine neurons. In addition, they reconcile previous findings with octopamine and dopamine and suggest that reinforcement systems in flies are more similar to mammals than previously thought.

Two waves of transcription are required for long-term memory in the honeybee.

Storage of information into long-term memory (LTM) usually requires at least two waves of transcription in many species. However, there is no clear evidence of this phenomenon in insects, which are influential models for memory studies. We measured retention in honeybees after injecting a transcription inhibitor at different times before and after conditioning. We identified two separate time windows during which the transcription blockade impairs memory quantitatively and qualitatively, suggesting the occurrence of an early transcription wave (triggered during conditioning) and a later one (starting several hours after learning). Hence insects, like other species, would require two transcription waves for LTM formation.

Modulation of aversive value coding in the vertebrate and invertebrate brain.

Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.

Differential coding of absolute and relative aversive value in the Drosophila brain.

Animals use prior experience to assign absolute (good or bad) and relative (better or worse) value to new experience. These learned values guide appropriate later decision making. Even though our understanding of how the valuation system computes absolute value is relatively advanced, the mechanistic underpinnings of relative valuation are unclear. Here, we uncover mechanisms of absolute and relative aversive valuation in Drosophila. Three types of punishment-sensitive dopaminergic neurons (DANs) respond differently to electric shock intensity. During learning, these punishment-sensitive DANs drive intensity-scaled plasticity at their respective mushroom body output neuron (MBON) connections to code absolute aversive value. In contrast, by comparing the absolute value of current and previous aversive experiences, the MBON-DAN network can code relative aversive value by using specific punishment-sensitive DANs and recruiting a specific subtype of reward-coding DANs. Behavioral and physiological experiments revealed that a specific subtype of reward-coding DAN assigns a "better than" value to the lesser of the two aversive experiences. This study therefore highlights how appetitive-aversive system interactions within the MB network can code and compare sequential aversive experiences to learn relative aversive value.

Early calcium increase triggers the formation of olfactory long-term memory in honeybees.

BACKGROUND: Synaptic plasticity associated with an important wave of gene transcription and protein synthesis underlies long-term memory processes. Calcium (Ca2+) plays an important role in a variety of neuronal functions and indirect evidence suggests that it may be involved in synaptic plasticity and in the regulation of gene expression correlated to long-term memory formation. The aim of this study was to determine whether Ca2+ is necessary and sufficient for inducing long-term memory formation. A suitable model to address this question is the Pavlovian appetitive conditioning of the proboscis extension reflex in the honeybee Apis mellifera, in which animals learn to associate an odor with a sucrose reward. RESULTS: By modulating the intracellular Ca2+ concentration ([Ca2+]i) in the brain, we show that: (i) blocking [Ca2+]i increase during multiple-trial conditioning selectively impairs long-term memory performance; (ii) conversely, increasing [Ca2+]i during single-trial conditioning triggers long-term memory formation; and finally, (iii) as was the case for long-term memory produced by multiple-trial conditioning, enhancement of long-term memory performance induced by a [Ca2+]i increase depends on de novo protein synthesis. CONCLUSION: Altogether our data suggest that during olfactory conditioning Ca2+ is both a necessary and a sufficient signal for the formation of protein-dependent long-term memory. Ca2+ therefore appears to act as a switch between short- and long-term storage of learned information.

Long-term memory shapes the primary olfactory center of an insect brain.

The storage of stable memories is generally considered to rely on changes in the functional properties and/or the synaptic connectivity of neural networks. However, these changes are not easily tractable given the complexity of the learning procedures and brain circuits studied. Such a search can be narrowed down by studying memories of specific stimuli in a given sensory modality and by working on networks with a modular and relatively simple organization. We have therefore focused on associative memories of individual odors and the possible related changes in the honeybee primary olfactory center, the antennal lobe (AL). As this brain structure is organized in well-identified morpho-functional units, the glomeruli, we looked for evidence of structural and functional plasticity in these units in relation with the bees' ability to store long-term memories (LTMs) of specific odors. Restrained bees were trained to form an odor-specific LTM in an appetitive Pavlovian conditioning protocol. The stability and specificity of this memory was tested behaviorally 3 d after conditioning. At that time, we performed both a structural and a functional analysis on a subset of 17 identified glomeruli by measuring glomerular volume under confocal microscopy, and odor-evoked activity, using in vivo calcium imaging. We show that long-term olfactory memory for a given odor is associated with volume increases in a subset of glomeruli. Independent of these structural changes, odor-evoked activity was not modified. Lastly, we show that structural glomerular plasticity can be predicted based on a putative model of interglomerular connections.

Aversive Learning and Appetitive Motivation Toggle Feed-Forward Inhibition in the Drosophila Mushroom Body.

In Drosophila, negatively reinforcing dopaminergic neurons also provide the inhibitory control of satiety over appetitive memory expression. Here we show that aversive learning causes a persistent depression of the conditioned odor drive to two downstream feed-forward inhibitory GABAergic interneurons of the mushroom body, called MVP2, or mushroom body output neuron (MBON)-γ1pedc>α/ß. However, MVP2 neuron output is only essential for expression of short-term aversive memory. Stimulating MVP2 neurons preferentially inhibits the odor-evoked activity of avoidance-directing MBONs and odor-driven avoidance behavior, whereas their inhibition enhances odor avoidance. In contrast, odor-evoked activity of MVP2 neurons is elevated in hungry flies, and their feed-forward inhibition is required for expression of appetitive memory at all times. Moreover, imposing MVP2 activity promotes inappropriate appetitive memory expression in food-satiated flies. Aversive learning and appetitive motivation therefore toggle alternate modes of a common feed-forward inhibitory MVP2 pathway to promote conditioned odor avoidance or approach.

Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila.

Dopaminergic neurons provide reward learning signals in mammals and insects [1-4]. Recent work in Drosophila has demonstrated that water-reinforcing dopaminergic neurons are different to those for nutritious sugars [5]. Here, we tested whether the sweet taste and nutrient properties of sugar reinforcement further subdivide the fly reward system. We found that dopaminergic neurons expressing the OAMB octopamine receptor [6] specifically convey the short-term reinforcing effects of sweet taste [4]. These dopaminergic neurons project to the ß'2 and γ4 regions of the mushroom body lobes. In contrast, nutrient-dependent long-term memory requires different dopaminergic neurons that project to the γ5b regions, and it can be artificially reinforced by those projecting to the ß lobe and adjacent α1 region. Surprisingly, whereas artificial implantation and expression of short-term memory occur in satiated flies, formation and expression of artificial long-term memory require flies to be hungry. These studies suggest that short-term and long-term sugar memories have different physiological constraints. They also demonstrate further functional heterogeneity within the rewarding dopaminergic neuron population.

Activity of defined mushroom body output neurons underlies learned olfactory behavior in Drosophila.

During olfactory learning in fruit flies, dopaminergic neurons assign value to odor representations in the mushroom body Kenyon cells. Here we identify a class of downstream glutamatergic mushroom body output neurons (MBONs) called M4/6, or MBON-ß2ß'2a, MBON-ß'2mp, and MBON-γ5ß'2a, whose dendritic fields overlap with dopaminergic neuron projections in the tips of the ß, ß', and γ lobes. This anatomy and their odor tuning suggests that M4/6 neurons pool odor-driven Kenyon cell synaptic outputs. Like that of mushroom body neurons, M4/6 output is required for expression of appetitive and aversive memory performance. Moreover, appetitive and aversive olfactory conditioning bidirectionally alters the relative odor-drive of M4ß' neurons (MBON-ß'2mp). Direct block of M4/6 neurons in naive flies mimics appetitive conditioning, being sufficient to convert odor-driven avoidance into approach, while optogenetically activating these neurons induces avoidance behavior. We therefore propose that drive to the M4/6 neurons reflects odor-directed behavioral choice.

Drosophila learn opposing components of a compound food stimulus.

Dopaminergic neurons provide value signals in mammals and insects. During Drosophila olfactory learning, distinct subsets of dopaminergic neurons appear to assign either positive or negative value to odor representations in mushroom body neurons. However, it is not known how flies evaluate substances that have mixed valence. Here we show that flies form short-lived aversive olfactory memories when trained with odors and sugars that are contaminated with the common insect repellent DEET. This DEET-aversive learning required the MB-MP1 dopaminergic neurons that are also required for shock learning. Moreover, differential conditioning with DEET versus shock suggests that formation of these distinct aversive olfactory memories relies on a common negatively reinforcing dopaminergic mechanism. Surprisingly, as time passed after training, the behavior of DEET-sugar-trained flies reversed from conditioned odor avoidance into odor approach. In addition, flies that were compromised for reward learning exhibited a more robust and longer-lived aversive-DEET memory. These data demonstrate that flies independently process the DEET and sugar components to form parallel aversive and appetitive olfactory memories, with distinct kinetics, that compete to guide learned behavior.

Shocking revelations and saccharin sweetness in the study of Drosophila olfactory memory.

It is now almost forty years since the first description of learning in the fruit fly Drosophila melanogaster. Various incarnations of the classic mutagenesis approach envisaged in the early days have provided around one hundred learning defective mutant fly strains. Recent technological advances permit temporal control of neural function in the behaving fly. These approaches have radically changed experiments in the field and have provided a neural circuit perspective of memory formation, consolidation and retrieval. Combining neural perturbations with more classical mutant intervention allows investigators to interrogate the molecular and cellular processes of memory within the defined neural circuits. Here, we summarize some of the progress made in the last ten years that indicates a remarkable conservation of the neural mechanisms of memory formation between flies and mammals. We emphasize that considering an ethologically-relevant viewpoint might provide additional experimental power in studies of Drosophila memory.

Different kenyon cell populations drive learned approach and avoidance in Drosophila.

In Drosophila, anatomically discrete dopamine neurons that innervate distinct zones of the mushroom body (MB) assign opposing valence to odors during olfactory learning. Subsets of MB neurons have temporally unique roles in memory processing, but valence-related organization has not been demonstrated. We functionally subdivided the αß neurons, revealing a value-specific role for the ∼160 αß core (αßc) neurons. Blocking neurotransmission from αß surface (αßs) neurons revealed a requirement during retrieval of aversive and appetitive memory, whereas blocking αßc only impaired appetitive memory. The αßc were also required to express memory in a differential aversive paradigm demonstrating a role in relative valuation and approach behavior. Strikingly, both reinforcing dopamine neurons and efferent pathways differentially innervate αßc and αßs in the MB lobes. We propose that conditioned approach requires pooling synaptic outputs from across the αß ensemble but only from the αßs for conditioned aversion.

Associative memory: without a trace.

Some transient sensory stimuli can cause prolonged activity in the brain. Trace conditioning experiments can reveal the time over which these lasting representations can be utilized and where they reside.

Further characterization of an aversive learning task in Drosophila melanogaster: intensity of the stimulus, relearning, and use of rutabaga mutants.

Various learning tasks have been described in Drosophila melanogaster, flies being either tested in groups or at the individual level. Le Bourg and Buecher (Anim Learn Behav 33:330-341, 2002) have designed a task at the individual level: photopositive flies crossing a T-maze learn to prefer the dark exit when the lighted one is associated with the presence of aversive stimuli (humidity and quinine). Previous studies have reported various results (e.g. no effect of age) and the present article further characterizes this task by studying the possible effects of: (1) the intensity of the stimuli (quantity of water or concentration of quinine), (2) various delays between two learning sessions on the learning score at the second session, (3) the rutabaga learning mutation on the learning score. More concentrated quinine solutions increased learning scores but the quantity of water had no effect. Learning scores at the second session were higher with shorter delays between the two learning sessions and retrograde amnesia could decrease this memory score. rutabaga mutants showed learning deficits as in experiments testing groups of flies. This learning task could particularly be used to verify whether learning mutants isolated after experiments testing flies in groups display similar deficits when tested at the individual level.