Distinct Dopamine Receptor Pathways Underlie the Temporal Sensitivity of Associative Learning.

Animals rely on the relative timing of events in their environment to form and update predictive associations, but the molecular and circuit mechanisms for this temporal sensitivity remain incompletely understood. Here, we show that olfactory associations in Drosophila can be written and reversed on a trial-by-trial basis depending on the temporal relationship between an odor cue and dopaminergic reinforcement. Through the synchronous recording of neural activity and behavior, we show that reversals in learned odor attraction correlate with bidirectional neural plasticity in the mushroom body, the associative olfactory center of the fly. Two dopamine receptors, DopR1 and DopR2, contribute to this temporal sensitivity by coupling to distinct second messengers and directing either synaptic depression or potentiation. Our results reveal how dopamine-receptor signaling pathways can detect the order of events to instruct opposing forms of synaptic and behavioral plasticity, allowing animals to flexibly update their associations in a dynamic environment.

Pupillary Responses Reflect Dynamic Changes in Multiple Cognitive Factors During Associative Learning in Primates.

Associative learning involves complex interactions of multiple cognitive factors. While adult subjects can articulate these factors verbally, for model animals such as macaques, we rely on behavioral outputs. In our study, we used pupillary responses as an alternative measure to capture these underlying cognitive changes. We recorded the dynamic changes in the pupils of three male macaques when they learned the associations between visual stimuli and reward sizes under the classical Pavlovian experimental paradigm. We found that during the long-term learning process, the gradual changes in the pupillary response reflect the changes in the cognitive state of the animals. The pupillary response can be explained by a linear combination of components corresponding to multiple cognitive factors. These components reflect the impact of visual stimuli on the pupils, the prediction of reward values associated with the visual stimuli, and the macaques' understanding of the current experimental reward rules. The changing patterns of these factors during interday and intraday learning clearly demonstrate the enhancement of current reward-stimulus association and the weakening of previous reward-stimulus association. Our study shows that the dynamic response of pupils can serve as an objective indicator to characterize the psychological changes of animals, understand their learning process, and provide important tools for exploring animal behavior during the learning process.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning.

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Neural correlates of retrospective memory confidence during face-name associative learning.

The ability to accurately assess one's own memory performance during learning is essential for adaptive behavior, but the brain mechanisms underlying this metamemory function are not well understood. We investigated the neural correlates of memory accuracy and retrospective memory confidence in a face-name associative learning task using magnetoencephalography in healthy young adults (n = 32). We found that high retrospective confidence was associated with stronger occipital event-related fields during encoding and widespread event-related fields during retrieval compared to low confidence. On the other hand, memory accuracy was linked to medial temporal activities during both encoding and retrieval, but only in low-confidence trials. A decrease in oscillatory power at alpha/beta bands in the parietal regions during retrieval was associated with higher memory confidence. In addition, representational similarity analysis at the single-trial level revealed distributed but differentiable neural activities associated with memory accuracy and confidence during both encoding and retrieval. In summary, our study unveiled distinct neural activity patterns related to memory confidence and accuracy during associative learning and underscored the crucial role of parietal regions in metamemory.

Interactions between physical exercise, associative memory, and genetic risk for Alzheimer's disease.

The ε4 allele of the APOE gene heightens the risk of late onset Alzheimer's disease. ε4 carriers, may exhibit cognitive and neural changes early on. Given the known memory-enhancing effects of physical exercise, particularly through hippocampal plasticity via endocannabinoid signaling, here we aimed to test whether a single session of physical exercise may benefit memory and underlying neurophysiological processes in young ε3 carriers (ε3/ε4 heterozygotes, risk group) compared with a matched control group (homozygotes for ε3). Participants underwent fMRI while learning picture sequences, followed by cycling or rest before a memory test. Blood samples measured endocannabinoid levels. At the behavioral level, the risk group exhibited poorer associative memory performance, regardless of the exercising condition. At the brain level, the risk group showed increased medial temporal lobe activity during memory retrieval irrespective of exercise (suggesting neural compensatory effects even at baseline), whereas, in the control group, such increase was only detectable after physical exercise. Critically, an exercise-related endocannabinoid increase correlated with task-related hippocampal activation in the control group only. In conclusion, healthy young individuals carrying the ε4 allele may present suboptimal associative memory performance (when compared with homozygote ε3 carriers), together with reduced plasticity (and functional over-compensation) within medial temporal structures.

Superstitious learning of abstract order from random reinforcement.

Humans and other animals often infer spurious associations among unrelated events. However, such superstitious learning is usually accounted for by conditioned associations, raising the question of whether an animal could develop more complex cognitive structures independent of reinforcement. Here, we tasked monkeys with discovering the serial order of two pictorial sets: a "learnable" set in which the stimuli were implicitly ordered and monkeys were rewarded for choosing the higher-rank stimulus and an "unlearnable" set in which stimuli were unordered and feedback was random regardless of the choice. We replicated prior results that monkeys reliably learned the implicit order of the learnable set. Surprisingly, the monkeys behaved as though some ordering also existed in the unlearnable set, showing consistent choice preference that transferred to novel untrained pairs in this set, even under a preference-discouraging reward schedule that gave rewards more frequently to the stimulus that was selected less often. In simulations, a model-free reinforcement learning algorithm (Q-learning) displayed a degree of consistent ordering among the unlearnable set but, unlike the monkeys, failed to do so under the preference-discouraging reward schedule. Our results suggest that monkeys infer abstract structures from objectively random events using heuristics that extend beyond stimulus-outcome conditional learning to more cognitive model-based learning mechanisms.

Beyond prediction error: 25 years of modeling the associations formed in the insect mushroom body.

The insect mushroom body has gained increasing attention as a system in which the computational basis of neural learning circuits can be unraveled. We now understand in detail the key locations in this circuit where synaptic associations are formed between sensory patterns and values leading to actions. However, the actual learning rule (or rules) implemented by neural activity and leading to synaptic change is still an open question. Here, I survey the diversity of answers that have been offered in computational models of this system over the past decades, including the recurring assumption-in line with top-down theories of associative learning-that the core function is to reduce prediction error. However, I will argue, a more bottom-up approach may ultimately reveal a richer algorithmic capacity in this still enigmatic brain neuropil.

Future avenues in Drosophila mushroom body research.

How does the brain translate sensory information into complex behaviors? With relatively small neuronal numbers, readable behavioral outputs, and an unparalleled genetic toolkit, the Drosophila mushroom body (MB) offers an excellent model to address this question in the context of associative learning and memory. Recent technological breakthroughs, such as the freshly completed full-brain connectome, multiomics approaches, CRISPR-mediated gene editing, and machine learning techniques, led to major advancements in our understanding of the MB circuit at the molecular, structural, physiological, and functional levels. Despite significant progress in individual MB areas, the field still faces the fundamental challenge of resolving how these different levels combine and interact to ultimately control the behavior of an individual fly. In this review, we discuss various aspects of MB research, with a focus on the current knowledge gaps, and an outlook on the future methodological developments required to reach an overall view of the neurobiological basis of learning and memory.

Cognitive limits of larval Drosophila: testing for conditioned inhibition, sensory preconditioning, and second-order conditioning.

Drosophila larvae are an established model system for studying the mechanisms of innate and simple forms of learned behavior. They have about 10 times fewer neurons than adult flies, and it was the low total number of their neurons that allowed for an electron microscopic reconstruction of their brain at synaptic resolution. Regarding the mushroom body, a central brain structure for many forms of associative learning in insects, it turned out that more than half of the classes of synaptic connection had previously escaped attention. Understanding the function of these circuit motifs, subsequently confirmed in adult flies, is an important current research topic. In this context, we test larval Drosophila for their cognitive abilities in three tasks that are characteristically more complex than those previously studied. Our data provide evidence for (i) conditioned inhibition, as has previously been reported for adult flies and honeybees. Unlike what is described for adult flies and honeybees, however, our data do not provide evidence for (ii) sensory preconditioning or (iii) second-order conditioning in Drosophila larvae. We discuss the methodological features of our experiments as well as four specific aspects of the organization of the larval brain that may explain why these two forms of learning are observed in adult flies and honeybees, but not in larval Drosophila.

Skewing information flow through pre- and postsynaptic plasticity in the mushroom bodies of Drosophila.

Animal brains need to store information to construct a representation of their environment. Knowledge of what happened in the past allows both vertebrates and invertebrates to predict future outcomes by recalling previous experience. Although invertebrate and vertebrate brains share common principles at the molecular, cellular, and circuit-architectural levels, there are also obvious differences as exemplified by the use of acetylcholine versus glutamate as the considered main excitatory neurotransmitters in the respective central nervous systems. Nonetheless, across central nervous systems, synaptic plasticity is thought to be a main substrate for memory storage. Therefore, how brain circuits and synaptic contacts change following learning is of fundamental interest for understanding brain computations tied to behavior in any animal. Recent progress has been made in understanding such plastic changes following olfactory associative learning in the mushroom bodies (MBs) of Drosophila A current framework of memory-guided behavioral selection is based on the MB skew model, in which antagonistic synaptic pathways are selectively changed in strength. Here, we review insights into plasticity at dedicated Drosophila MB output pathways and update what is known about the plasticity of both pre- and postsynaptic compartments of Drosophila MB neurons.

The caloric value of food intake structurally adjusts a neuronal mushroom body circuit mediating olfactory learning in Drosophila.

Associative learning enables the adaptive adjustment of behavioral decisions based on acquired, predicted outcomes. The valence of what is learned is influenced not only by the learned stimuli and their temporal relations, but also by prior experiences and internal states. In this study, we used the fruit fly Drosophila melanogaster to demonstrate that neuronal circuits involved in associative olfactory learning undergo restructuring during extended periods of low-caloric food intake. Specifically, we observed a decrease in the connections between specific dopaminergic neurons (DANs) and Kenyon cells at distinct compartments of the mushroom body. This structural synaptic plasticity was contingent upon the presence of allatostatin A receptors in specific DANs and could be mimicked optogenetically by expressing a light-activated adenylate cyclase in exactly these DANs. Importantly, we found that this rearrangement in synaptic connections influenced aversive, punishment-induced olfactory learning but did not impact appetitive, reward-based learning. Whether induced by prolonged low-caloric conditions or optogenetic manipulation of cAMP levels, this synaptic rearrangement resulted in a reduction of aversive associative learning. Consequently, the balance between positive and negative reinforcing signals shifted, diminishing the ability to learn to avoid odor cues signaling negative outcomes. These results exemplify how a neuronal circuit required for learning and memory undergoes structural plasticity dependent on prior experiences of the nutritional value of food.

Transient enhancement of stimulus-evoked activity in neocortex during sensory learning.

Synaptic potentiation has been linked to learning in sensory cortex, but the connection between this potentiation and increased sensory-evoked neural activity is not clear. Here, we used longitudinal in vivo Ca2+ imaging in the barrel cortex of awake mice to test the hypothesis that increased excitatory synaptic strength during the learning of a whisker-dependent sensory-association task would be correlated with enhanced stimulus-evoked firing. To isolate stimulus-evoked responses from dynamic, task-related activity, imaging was performed outside of the training context. Although prior studies indicate that multiwhisker stimuli drive robust subthreshold activity, we observed sparse activation of L2/3 pyramidal (Pyr) neurons in both control and trained mice. Despite evidence for excitatory synaptic strengthening at thalamocortical and intracortical synapses in this brain area at the onset of learning-indeed, under our imaging conditions thalamocortical axons were robustly activated-we observed that L2/3 Pyr neurons in somatosensory (barrel) cortex displayed only modest increases in stimulus-evoked activity that were concentrated at the onset of training. Activity renormalized over longer training periods. In contrast, when stimuli and rewards were uncoupled in a pseudotraining paradigm, stimulus-evoked activity in L2/3 Pyr neurons was significantly suppressed. These findings indicate that sensory-association training but not sensory stimulation without coupled rewards may briefly enhance sensory-evoked activity, a phenomenon that might help link sensory input to behavioral outcomes at the onset of learning.

Performing a Motor Action Enhances Social Reward Processing and Modulates the Neural Processing of Predictive Cues.

Associative learning affects many areas of human behavior. Recently, we showed that the neural response to monetary reward is enhanced by performing an action, suggesting interactions between neural systems controlling motor behavior and reward processing. Given that many psychiatric disorders are associated with social anhedonia, a key open question is whether such effects generalize to social rewards, and in how far they affect associative learning. We developed a novel task in which participants (n = 66) received social reward feedback and social punishment either by pressing a button or waiting. Predictive cues were linked to feedback valence with 80% accuracy. Using EEG, we measured the neural response to both predictive cues and social feedback. We found enhanced reward positivity for social reward preceded by an action, and an enhanced N2 for cues predicting negative feedback. Cue-locked P3 amplitude was reduced for cues associated with negative feedback in passive trials only, showing a modulation of outcome anticipation by performing a motor action. This was supported by connectivity analyses showing stronger directed theta synchronization, in line with increased top-down modulation of attention, in active compared with passive trials. These findings suggest that actively obtaining social feedback enhances reward sensitivity and modulates outcome anticipation.

Midkine is upregulated in the hippocampus following both spatial and olfactory reward association learning and enhances memory.

Hippocampal neuronal plasticity is a fundamental process underpinning learning and memory formation and requiring elaborate molecular mechanisms that result in the dynamic remodelling of synaptic connectivity. The neurotrophic properties of midkine (Mdk) have been implicated in the development and repair of the nervous system, while Mdk knockout resulted in deficits in the formation of certain types of memory. The role of Mdk in the process of memory-associated neuronal plasticity, however, remains poorly understood. We investigated the learning-induced regulation of Mdk in spatial navigation and association learning using the water maze and the odour reward association learning paradigms, characterising a temporal profile of Mdk protein expression post-learning. Both learning events revealed similar patterns of upregulation of expression of the protein in the rat hippocampal dentate gyrus, which were rapid and transient. Moreover, administration of recombinant Mdk during the endogenous Mdk upregulation following learning enhanced memory in the water maze task revealing a pro-cognitive action of Mdk. We further show that, within the adult hippocampus, Mdk mRNA is predominantly expressed in granular and pyramidal neurons and that hippocampal neuronal Mdk expression is regulated by the canonical plasticity-associated neurotransmitter glutamate. Finally, we confirm that the positive action of Mdk on neurite outgrowth previously noted in cortical and cerebellar neurons extends to hippocampal neurons. Together, our findings suggest a role for Mdk in glutamate-mediated hippocampal neuronal plasticity important for long-term memory consolidation.

Examining the neural basis of unitization: A review.

Associative memory refers to the ability to form and remember associations between individual pieces of information rather than memory for a single object or word. Encoding associations in memory tends to be a more difficult task than item (only) encoding, because associative memory requires encoding multiple items as well as the specific links amongst the items. Accordingly, researchers have worked to identify interventions and strategies to reduce the effort and neural resources required for successful associative memory processing. Unitization is one such strategy that has traditionally been defined as the process by which two or more discrete items are processed, or encoded, such that they are perceived as a single ensemble. The current review explores the neural research on unitization while considering the behavioral benefits that accompany the process.

Contextual fear conditioning in zebrafish: Influence of different shock frequencies, context, and pharmacological modulation on behavior.

Contextual fear conditioning is a protocol used to assess associative learning across species, including fish. Here, our goal was to expand the analysis of behavioral parameters that may reflect aversive behaviors in a contextual fear conditioning protocol using adult zebrafish (Danio rerio) and to verify how such parameters can be modulated. First, we analyzed the influence of an aversive stimulus (3 mild electric shocks for 5 s each at frequencies of 10, 100 or 1000 Hz) on fish behavior, and their ability to elicit fear responses in the absence of shock during a test session. To confirm whether the aversive responses are context-dependent, behaviors were also measured in a different experimental environment in a test session. Furthermore, we investigated the effects of dizocilpine (MK-801, 2 mg/kg, i.p.) on fear-related responses. Zebrafish showed significant changes in baseline activity immediately after shock exposure in the training session, in which 100 Hz induced robust contextual fear responses during the test session. Importantly, when introduced to a different environment, animals exposed to the aversive stimulus did not show any differences in locomotion and immobility-related parameters. MK-801 administered after the training session reduced fear responses during the test, indicating that glutamate NMDA-receptors play a key role in the consolidation of contextual fear-related memory in zebrafish. In conclusion, by further exploring fear-related behaviors in a contextual fear conditioning task, we show the effects of different shock frequencies and confirm the importance of context on aversive responses for associative learning in zebrafish. Additionally, our data support the use of zebrafish in contextual fear conditioning tasks, as well as for advancing pharmacological studies related to associative learning in translational neurobehavioral research.

The brain's default network: updated anatomy, physiology and evolving insights.

Discoveries over the past two decades demonstrate that regions distributed throughout the association cortex, often called the default network, are suppressed during tasks that demand external attention and are active during remembering, envisioning the future and making social inferences. This Review describes progress in understanding the organization and function of networks embedded within these association regions. Detailed high-resolution analyses of single individuals suggest that the default network is not a single network, as historically described, but instead comprises multiple interwoven networks. The multiple networks share a common organizational motif (also evident in marmoset and macaque anatomical circuits) that might support a general class of processing function dependent on internally constructed rather than externally constrained representations, with each separate interwoven network specialized for a distinct processing domain. Direct neuronal recordings in humans and monkeys reveal evidence for competitive relationships between the internally and externally oriented networks. Findings from rodent studies suggest that the thalamus might be essential to controlling which networks are engaged through specialized thalamic reticular neurons, including antagonistic subpopulations. These association networks (and presumably thalamocortical circuits) are expanded in humans and might be particularly vulnerable to dysregulation implicated in mental illness.

Conditioned preferences: Gated by experience, context, and endocrine systems.

Central to the navigation of an ever-changing environment is the ability to form positive associations with places and conspecifics. The functions of location and social conditioned preferences are often studied independently, limiting our understanding of their interplay. Furthermore, a de-emphasis on natural functions of conditioned preferences has led to neurobiological interpretations separated from ecological context. By adopting a naturalistic and ethological perspective, we uncover complexities underlying the expression of conditioned preferences. Development of conditioned preferences is a combination of motivation, reward, associative learning, and context, including for social and spatial environments. Both social- and location-dependent reward-responsive behaviors and their conditioning rely on internal state-gating mechanisms that include neuroendocrine and hormone systems such as opioids, dopamine, testosterone, estradiol, and oxytocin. Such reinforced behavior emerges from mechanisms integrating past experience and current social and environmental conditions. Moreover, social context, environmental stimuli, and internal state gate and modulate motivation and learning via associative reward, shaping the conditioning process. We highlight research incorporating these concepts, focusing on the integration of social neuroendocrine mechanisms and behavioral conditioning. We explore three paradigms: 1) conditioned place preference, 2) conditioned social preference, and 3) social conditioned place preference. We highlight nonclassical species to emphasize the naturalistic applications of these conditioned preferences. To fully appreciate the complex integration of spatial and social information, future research must identify neural networks where endocrine systems exert influence on such behaviors. Such research promises to provide valuable insights into conditioned preferences within a broader naturalistic context.

Enhanced audiovisual associative pair learning in migraine without aura in adult patients: An unexpected finding.

BACKGROUND: Altered sensory processing in migraine has been demonstrated by several studies in unimodal, and especially visual, tasks. While there is some limited evidence hinting at potential alterations in multisensory processing among migraine sufferers, this aspect remains relatively unexplored. This study investigated the interictal cognitive performance of migraine patients without aura compared to matched controls, focusing on associative learning, recall, and transfer abilities through the Sound-Face Test, an audiovisual test based on the principles of the Rutgers Acquired Equivalence Test. MATERIALS AND METHODS: The performance of 42 volunteering migraine patients was compared to the data of 42 matched controls, selected from a database of healthy volunteers who had taken the test earlier. The study aimed to compare the groups' performance in learning, recall, and the ability to transfer learned associations. RESULTS: Migraine patients demonstrated significantly superior associative learning as compared to controls, requiring fewer trials, and making fewer errors during the acquisition phase. However, no significant differences were observed in retrieval error ratios, generalization error ratios, or reaction times between migraine patients and controls in later stages of the test. CONCLUSION: The results of our study support those of previous investigations, which concluded that multisensory processing exhibits a unique pattern in migraine. The specific finding that associative audiovisual pair learning is more effective in adult migraine patients than in matched controls is unexpected. If the phenomenon is not an artifact, it may be assumed to be a combined result of the hypersensitivity present in migraine and the sensory threshold-lowering effect of multisensory integration.

Learning performance and GABAergic pathway link to deformed wing virus in the mushroom bodies of naturally infected honey bees.

Viral infections can be detrimental to the foraging ability of the western honey bee, Apis mellifera. The deformed wing virus (DWV) is the most common honey bee virus and has been proposed as a possible cause of learning and memory impairment. However, evidence for this phenomenon so far has come from artificially infected bees, while less is known about the implications of natural infections with the virus. Using the proboscis extension reflex (PER), we uncovered no significant association between a simple associative learning task and natural DWV load. However, when assessed through a reversal associative learning assay, bees with higher DWV load performed better in the reversal learning phase. DWV is able to replicate in the honey bee mushroom bodies, where the GABAergic signalling pathway has an antagonistic effect on associative learning but is crucial for reversal learning. Hence, we assessed the pattern of expression of several GABA-related genes in bees with different learning responses. Intriguingly, mushroom body expression of selected genes was positively correlated with DWV load, but only for bees with good reversal learning performance. We hypothesise that DWV might improve olfactory learning performance by enhancing the GABAergic inhibition of responses to unrewarded stimuli, which is consistent with the behavioural patterns that we observed. However, at higher disease burdens, which might be induced by an artificial infection or by a severe, natural Varroa infestation, this DWV-associated increase in GABA signalling could impair associative learning as previously reported by other studies.