Dopaminergic systems create reward seeking despite adverse consequences.

Resource-seeking behaviours are ordinarily constrained by physiological needs and threats of danger, and the loss of these controls is associated with pathological reward seeking1. Although dysfunction of the dopaminergic valuation system of the brain is known to contribute towards unconstrained reward seeking2,3, the underlying reasons for this behaviour are unclear. Here we describe dopaminergic neural mechanisms that produce reward seeking despite adverse consequences in Drosophila melanogaster. Odours paired with optogenetic activation of a defined subset of reward-encoding dopaminergic neurons become cues that starved flies seek while neglecting food and enduring electric shock punishment. Unconstrained seeking of reward is not observed after learning with sugar or synthetic engagement of other dopaminergic neuron populations. Antagonism between reward-encoding and punishment-encoding dopaminergic neurons accounts for the perseverance of reward seeking despite punishment, whereas synthetic engagement of the reward-encoding dopaminergic neurons also impairs the ordinary need-dependent dopaminergic valuation of available food. Connectome analyses reveal that the population of reward-encoding dopaminergic neurons receives highly heterogeneous input, consistent with parallel representation of diverse rewards, and recordings demonstrate state-specific gating and satiety-related signals. We propose that a similar dopaminergic valuation system dysfunction is likely to contribute to maladaptive seeking of rewards by mammals.

Compensatory enhancement of input maintains aversive dopaminergic reinforcement in hungry Drosophila.

Hungry animals need compensatory mechanisms to maintain flexible brain function, while modulation reconfigures circuits to prioritize resource seeking. In Drosophila, hunger inhibits aversively reinforcing dopaminergic neurons (DANs) to permit the expression of food-seeking memories. Multitasking the reinforcement system for motivation potentially undermines aversive learning. We find that chronic hunger mildly enhances aversive learning and that satiated-baseline and hunger-enhanced learning require endocrine adipokinetic hormone (AKH) signaling. Circulating AKH influences aversive learning via its receptor in four neurons in the ventral brain, two of which are octopaminergic. Connectomics revealed AKH receptor-expressing neurons to be upstream of several classes of ascending neurons, many of which are presynaptic to aversively reinforcing DANs. Octopaminergic modulation of and output from at least one of these ascending pathways is required for shock- and bitter-taste-reinforced aversive learning. We propose that coordinated enhancement of input compensates for hunger-directed inhibition of aversive DANs to preserve reinforcement when required.

Input Connectivity Reveals Additional Heterogeneity of Dopaminergic Reinforcement in Drosophila.

Different types of Drosophila dopaminergic neurons (DANs) reinforce memories of unique valence and provide state-dependent motivational control [1]. Prior studies suggest that the compartment architecture of the mushroom body (MB) is the relevant resolution for distinct DAN functions [2, 3]. Here we used a recent electron microscope volume of the fly brain [4] to reconstruct the fine anatomy of individual DANs within three MB compartments. We find the 20 DANs of the γ5 compartment, at least some of which provide reward teaching signals, can be clustered into 5 anatomical subtypes that innervate different regions within γ5. Reconstructing 821 upstream neurons reveals input selectivity, supporting the functional relevance of DAN sub-classification. Only one PAM-γ5 DAN subtype γ5(fb) receives direct recurrent feedback from γ5ß'2a mushroom body output neurons (MBONs) and behavioral experiments distinguish a role for these DANs in memory revaluation from those reinforcing sugar memory. Other DAN subtypes receive major, and potentially reinforcing, inputs from putative gustatory interneurons or lateral horn neurons, which can also relay indirect feedback from MBONs. We similarly reconstructed the single aversively reinforcing PPL1-γ1pedc DAN. The γ1pedc DAN inputs mostly differ from those of γ5 DANs and they cluster onto distinct dendritic branches, presumably separating its established roles in aversive reinforcement and appetitive motivation [5, 6]. Tracing also identified neurons that provide broad input to γ5, ß'2a, and γ1pedc DANs, suggesting that distributed DAN populations can be coordinately regulated. These connectomic and behavioral analyses therefore reveal further complexity of dopaminergic reinforcement circuits between and within MB compartments.

The connectome of the adult Drosophila mushroom body provides insights into function.

Making inferences about the computations performed by neuronal circuits from synapse-level connectivity maps is an emerging opportunity in neuroscience. The mushroom body (MB) is well positioned for developing and testing such an approach due to its conserved neuronal architecture, recently completed dense connectome, and extensive prior experimental studies of its roles in learning, memory, and activity regulation. Here, we identify new components of the MB circuit in Drosophila, including extensive visual input and MB output neurons (MBONs) with direct connections to descending neurons. We find unexpected structure in sensory inputs, in the transfer of information about different sensory modalities to MBONs, and in the modulation of that transfer by dopaminergic neurons (DANs). We provide insights into the circuitry used to integrate MB outputs, connectivity between the MB and the central complex and inputs to DANs, including feedback from MBONs. Our results provide a foundation for further theoretical and experimental work.