Distinct Dopamine Receptor Pathways Underlie the Temporal Sensitivity of Associative Learning.

Animals rely on the relative timing of events in their environment to form and update predictive associations, but the molecular and circuit mechanisms for this temporal sensitivity remain incompletely understood. Here, we show that olfactory associations in Drosophila can be written and reversed on a trial-by-trial basis depending on the temporal relationship between an odor cue and dopaminergic reinforcement. Through the synchronous recording of neural activity and behavior, we show that reversals in learned odor attraction correlate with bidirectional neural plasticity in the mushroom body, the associative olfactory center of the fly. Two dopamine receptors, DopR1 and DopR2, contribute to this temporal sensitivity by coupling to distinct second messengers and directing either synaptic depression or potentiation. Our results reveal how dopamine-receptor signaling pathways can detect the order of events to instruct opposing forms of synaptic and behavioral plasticity, allowing animals to flexibly update their associations in a dynamic environment.

Pupillary Responses Reflect Dynamic Changes in Multiple Cognitive Factors During Associative Learning in Primates.

Associative learning involves complex interactions of multiple cognitive factors. While adult subjects can articulate these factors verbally, for model animals such as macaques, we rely on behavioral outputs. In our study, we used pupillary responses as an alternative measure to capture these underlying cognitive changes. We recorded the dynamic changes in the pupils of three male macaques when they learned the associations between visual stimuli and reward sizes under the classical Pavlovian experimental paradigm. We found that during the long-term learning process, the gradual changes in the pupillary response reflect the changes in the cognitive state of the animals. The pupillary response can be explained by a linear combination of components corresponding to multiple cognitive factors. These components reflect the impact of visual stimuli on the pupils, the prediction of reward values associated with the visual stimuli, and the macaques' understanding of the current experimental reward rules. The changing patterns of these factors during interday and intraday learning clearly demonstrate the enhancement of current reward-stimulus association and the weakening of previous reward-stimulus association. Our study shows that the dynamic response of pupils can serve as an objective indicator to characterize the psychological changes of animals, understand their learning process, and provide important tools for exploring animal behavior during the learning process.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning.

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Neural correlates of retrospective memory confidence during face-name associative learning.

The ability to accurately assess one's own memory performance during learning is essential for adaptive behavior, but the brain mechanisms underlying this metamemory function are not well understood. We investigated the neural correlates of memory accuracy and retrospective memory confidence in a face-name associative learning task using magnetoencephalography in healthy young adults (n = 32). We found that high retrospective confidence was associated with stronger occipital event-related fields during encoding and widespread event-related fields during retrieval compared to low confidence. On the other hand, memory accuracy was linked to medial temporal activities during both encoding and retrieval, but only in low-confidence trials. A decrease in oscillatory power at alpha/beta bands in the parietal regions during retrieval was associated with higher memory confidence. In addition, representational similarity analysis at the single-trial level revealed distributed but differentiable neural activities associated with memory accuracy and confidence during both encoding and retrieval. In summary, our study unveiled distinct neural activity patterns related to memory confidence and accuracy during associative learning and underscored the crucial role of parietal regions in metamemory.

Interactions between physical exercise, associative memory, and genetic risk for Alzheimer's disease.

The ε4 allele of the APOE gene heightens the risk of late onset Alzheimer's disease. ε4 carriers, may exhibit cognitive and neural changes early on. Given the known memory-enhancing effects of physical exercise, particularly through hippocampal plasticity via endocannabinoid signaling, here we aimed to test whether a single session of physical exercise may benefit memory and underlying neurophysiological processes in young ε3 carriers (ε3/ε4 heterozygotes, risk group) compared with a matched control group (homozygotes for ε3). Participants underwent fMRI while learning picture sequences, followed by cycling or rest before a memory test. Blood samples measured endocannabinoid levels. At the behavioral level, the risk group exhibited poorer associative memory performance, regardless of the exercising condition. At the brain level, the risk group showed increased medial temporal lobe activity during memory retrieval irrespective of exercise (suggesting neural compensatory effects even at baseline), whereas, in the control group, such increase was only detectable after physical exercise. Critically, an exercise-related endocannabinoid increase correlated with task-related hippocampal activation in the control group only. In conclusion, healthy young individuals carrying the ε4 allele may present suboptimal associative memory performance (when compared with homozygote ε3 carriers), together with reduced plasticity (and functional over-compensation) within medial temporal structures.

Beyond prediction error: 25 years of modeling the associations formed in the insect mushroom body.

The insect mushroom body has gained increasing attention as a system in which the computational basis of neural learning circuits can be unraveled. We now understand in detail the key locations in this circuit where synaptic associations are formed between sensory patterns and values leading to actions. However, the actual learning rule (or rules) implemented by neural activity and leading to synaptic change is still an open question. Here, I survey the diversity of answers that have been offered in computational models of this system over the past decades, including the recurring assumption-in line with top-down theories of associative learning-that the core function is to reduce prediction error. However, I will argue, a more bottom-up approach may ultimately reveal a richer algorithmic capacity in this still enigmatic brain neuropil.

Future avenues in Drosophila mushroom body research.

How does the brain translate sensory information into complex behaviors? With relatively small neuronal numbers, readable behavioral outputs, and an unparalleled genetic toolkit, the Drosophila mushroom body (MB) offers an excellent model to address this question in the context of associative learning and memory. Recent technological breakthroughs, such as the freshly completed full-brain connectome, multiomics approaches, CRISPR-mediated gene editing, and machine learning techniques, led to major advancements in our understanding of the MB circuit at the molecular, structural, physiological, and functional levels. Despite significant progress in individual MB areas, the field still faces the fundamental challenge of resolving how these different levels combine and interact to ultimately control the behavior of an individual fly. In this review, we discuss various aspects of MB research, with a focus on the current knowledge gaps, and an outlook on the future methodological developments required to reach an overall view of the neurobiological basis of learning and memory.

Cognitive limits of larval Drosophila: testing for conditioned inhibition, sensory preconditioning, and second-order conditioning.

Drosophila larvae are an established model system for studying the mechanisms of innate and simple forms of learned behavior. They have about 10 times fewer neurons than adult flies, and it was the low total number of their neurons that allowed for an electron microscopic reconstruction of their brain at synaptic resolution. Regarding the mushroom body, a central brain structure for many forms of associative learning in insects, it turned out that more than half of the classes of synaptic connection had previously escaped attention. Understanding the function of these circuit motifs, subsequently confirmed in adult flies, is an important current research topic. In this context, we test larval Drosophila for their cognitive abilities in three tasks that are characteristically more complex than those previously studied. Our data provide evidence for (i) conditioned inhibition, as has previously been reported for adult flies and honeybees. Unlike what is described for adult flies and honeybees, however, our data do not provide evidence for (ii) sensory preconditioning or (iii) second-order conditioning in Drosophila larvae. We discuss the methodological features of our experiments as well as four specific aspects of the organization of the larval brain that may explain why these two forms of learning are observed in adult flies and honeybees, but not in larval Drosophila.

Skewing information flow through pre- and postsynaptic plasticity in the mushroom bodies of Drosophila.

Animal brains need to store information to construct a representation of their environment. Knowledge of what happened in the past allows both vertebrates and invertebrates to predict future outcomes by recalling previous experience. Although invertebrate and vertebrate brains share common principles at the molecular, cellular, and circuit-architectural levels, there are also obvious differences as exemplified by the use of acetylcholine versus glutamate as the considered main excitatory neurotransmitters in the respective central nervous systems. Nonetheless, across central nervous systems, synaptic plasticity is thought to be a main substrate for memory storage. Therefore, how brain circuits and synaptic contacts change following learning is of fundamental interest for understanding brain computations tied to behavior in any animal. Recent progress has been made in understanding such plastic changes following olfactory associative learning in the mushroom bodies (MBs) of Drosophila A current framework of memory-guided behavioral selection is based on the MB skew model, in which antagonistic synaptic pathways are selectively changed in strength. Here, we review insights into plasticity at dedicated Drosophila MB output pathways and update what is known about the plasticity of both pre- and postsynaptic compartments of Drosophila MB neurons.

The caloric value of food intake structurally adjusts a neuronal mushroom body circuit mediating olfactory learning in Drosophila.

Associative learning enables the adaptive adjustment of behavioral decisions based on acquired, predicted outcomes. The valence of what is learned is influenced not only by the learned stimuli and their temporal relations, but also by prior experiences and internal states. In this study, we used the fruit fly Drosophila melanogaster to demonstrate that neuronal circuits involved in associative olfactory learning undergo restructuring during extended periods of low-caloric food intake. Specifically, we observed a decrease in the connections between specific dopaminergic neurons (DANs) and Kenyon cells at distinct compartments of the mushroom body. This structural synaptic plasticity was contingent upon the presence of allatostatin A receptors in specific DANs and could be mimicked optogenetically by expressing a light-activated adenylate cyclase in exactly these DANs. Importantly, we found that this rearrangement in synaptic connections influenced aversive, punishment-induced olfactory learning but did not impact appetitive, reward-based learning. Whether induced by prolonged low-caloric conditions or optogenetic manipulation of cAMP levels, this synaptic rearrangement resulted in a reduction of aversive associative learning. Consequently, the balance between positive and negative reinforcing signals shifted, diminishing the ability to learn to avoid odor cues signaling negative outcomes. These results exemplify how a neuronal circuit required for learning and memory undergoes structural plasticity dependent on prior experiences of the nutritional value of food.

Transient enhancement of stimulus-evoked activity in neocortex during sensory learning.

Synaptic potentiation has been linked to learning in sensory cortex, but the connection between this potentiation and increased sensory-evoked neural activity is not clear. Here, we used longitudinal in vivo Ca2+ imaging in the barrel cortex of awake mice to test the hypothesis that increased excitatory synaptic strength during the learning of a whisker-dependent sensory-association task would be correlated with enhanced stimulus-evoked firing. To isolate stimulus-evoked responses from dynamic, task-related activity, imaging was performed outside of the training context. Although prior studies indicate that multiwhisker stimuli drive robust subthreshold activity, we observed sparse activation of L2/3 pyramidal (Pyr) neurons in both control and trained mice. Despite evidence for excitatory synaptic strengthening at thalamocortical and intracortical synapses in this brain area at the onset of learning-indeed, under our imaging conditions thalamocortical axons were robustly activated-we observed that L2/3 Pyr neurons in somatosensory (barrel) cortex displayed only modest increases in stimulus-evoked activity that were concentrated at the onset of training. Activity renormalized over longer training periods. In contrast, when stimuli and rewards were uncoupled in a pseudotraining paradigm, stimulus-evoked activity in L2/3 Pyr neurons was significantly suppressed. These findings indicate that sensory-association training but not sensory stimulation without coupled rewards may briefly enhance sensory-evoked activity, a phenomenon that might help link sensory input to behavioral outcomes at the onset of learning.

Examining the neural basis of unitization: A review.

Associative memory refers to the ability to form and remember associations between individual pieces of information rather than memory for a single object or word. Encoding associations in memory tends to be a more difficult task than item (only) encoding, because associative memory requires encoding multiple items as well as the specific links amongst the items. Accordingly, researchers have worked to identify interventions and strategies to reduce the effort and neural resources required for successful associative memory processing. Unitization is one such strategy that has traditionally been defined as the process by which two or more discrete items are processed, or encoded, such that they are perceived as a single ensemble. The current review explores the neural research on unitization while considering the behavioral benefits that accompany the process.

The brain's default network: updated anatomy, physiology and evolving insights.

Discoveries over the past two decades demonstrate that regions distributed throughout the association cortex, often called the default network, are suppressed during tasks that demand external attention and are active during remembering, envisioning the future and making social inferences. This Review describes progress in understanding the organization and function of networks embedded within these association regions. Detailed high-resolution analyses of single individuals suggest that the default network is not a single network, as historically described, but instead comprises multiple interwoven networks. The multiple networks share a common organizational motif (also evident in marmoset and macaque anatomical circuits) that might support a general class of processing function dependent on internally constructed rather than externally constrained representations, with each separate interwoven network specialized for a distinct processing domain. Direct neuronal recordings in humans and monkeys reveal evidence for competitive relationships between the internally and externally oriented networks. Findings from rodent studies suggest that the thalamus might be essential to controlling which networks are engaged through specialized thalamic reticular neurons, including antagonistic subpopulations. These association networks (and presumably thalamocortical circuits) are expanded in humans and might be particularly vulnerable to dysregulation implicated in mental illness.

Conditioned preferences: Gated by experience, context, and endocrine systems.

Central to the navigation of an ever-changing environment is the ability to form positive associations with places and conspecifics. The functions of location and social conditioned preferences are often studied independently, limiting our understanding of their interplay. Furthermore, a de-emphasis on natural functions of conditioned preferences has led to neurobiological interpretations separated from ecological context. By adopting a naturalistic and ethological perspective, we uncover complexities underlying the expression of conditioned preferences. Development of conditioned preferences is a combination of motivation, reward, associative learning, and context, including for social and spatial environments. Both social- and location-dependent reward-responsive behaviors and their conditioning rely on internal state-gating mechanisms that include neuroendocrine and hormone systems such as opioids, dopamine, testosterone, estradiol, and oxytocin. Such reinforced behavior emerges from mechanisms integrating past experience and current social and environmental conditions. Moreover, social context, environmental stimuli, and internal state gate and modulate motivation and learning via associative reward, shaping the conditioning process. We highlight research incorporating these concepts, focusing on the integration of social neuroendocrine mechanisms and behavioral conditioning. We explore three paradigms: 1) conditioned place preference, 2) conditioned social preference, and 3) social conditioned place preference. We highlight nonclassical species to emphasize the naturalistic applications of these conditioned preferences. To fully appreciate the complex integration of spatial and social information, future research must identify neural networks where endocrine systems exert influence on such behaviors. Such research promises to provide valuable insights into conditioned preferences within a broader naturalistic context.

Behaviorally Conditioned Immune Responses: "To Learn New Things, Read Old Books and Papers".

BACKGROUND: More than a century ago, experimental work and clinical observations revealed the functional communication between the brain and the peripheral immune system. This is documented on the one hand by studies first demonstrating the effects of catecholamines on the circulation of leukocytes in experimental animals and humans, and on the other hand via the work of Russian physiologist Ivan Petrovic Pavlov and his coworkers, reporting observations that associative learning can modify peripheral immune functions. This work later fell into oblivion since little was known about the endocrine and immune system's function and even less about the underlying mechanisms of how learning, a central nervous system activity, could affect peripheral immune responses. SUMMARY: In this article, we embark on a fascinating exploration of the historical trajectory of behaviorally conditioned immune responses. KEY MESSAGE: We will pay homage to the visionary scientists who laid the groundwork for this field of research, tracing its evolution from early theories of how associative learning can affect immunity to the modern-day insights that behavioral conditioning of pharmacological responses can be exploited to improve the efficacy of medical interventions for patients.

Active math and grammar learning engages overlapping brain networks.

We here demonstrate common neurocognitive long-term memory effects of active learning that generalize over course subjects (mathematics and vocabulary) by the use of fMRI. One week after active learning, relative to more passive learning, performance and fronto-parietal brain activity was significantly higher during retesting, possibly related to the formation and reactivation of semantic representations. These observations indicate that active learning conditions stimulate common processes that become part of the representations and can be reactivated during retrieval to support performance. Our findings are of broad interest and educational significance related to the emerging consensus of active learning as critical in promoting good long-term retention.

FosGFP expression does not capture a sensory learning-related engram in superficial layers of mouse barrel cortex.

Immediate-early gene (IEG) expression has been used to identify small neural ensembles linked to a particular experience, based on the principle that a selective subset of activated neurons will encode specific memories or behavioral responses. The majority of these studies have focused on "engrams" in higher-order brain areas where more abstract or convergent sensory information is represented, such as the hippocampus, prefrontal cortex, or amygdala. In primary sensory cortex, IEG expression can label neurons that are responsive to specific sensory stimuli, but experience-dependent shaping of neural ensembles marked by IEG expression has not been demonstrated. Here, we use a fosGFP transgenic mouse to longitudinally monitor in vivo expression of the activity-dependent gene c-fos in superficial layers (L2/3) of primary somatosensory cortex (S1) during a whisker-dependent learning task. We find that sensory association training does not detectably alter fosGFP expression in L2/3 neurons. Although training broadly enhances thalamocortical synaptic strength in pyramidal neurons, we find that synapses onto fosGFP+ neurons are not selectively increased by training; rather, synaptic strengthening is concentrated in fosGFP- neurons. Taken together, these data indicate that expression of the IEG reporter fosGFP does not facilitate identification of a learning-specific engram in L2/3 in barrel cortex during whisker-dependent sensory association learning.

Better in sync: Temporal dynamics explain multisensory word-action-object learning in early development.

We investigated the temporal impact of multisensory settings on children's learning of word-object and action-object associations at 1- and 2-years of age. Specifically, we examined whether the temporal alignment of words and actions influenced the acquisition of novel word-action-object associations. We used a preferential looking and violation of expectation task in which infants and young children were first presented with two distinct word-object and action-object pairings either in a synchronous (overlapping in time) or sequential manner (one after the other). Findings revealed that 2-year-olds recognized both, action-object and word-object associations when they first saw the word-action-object combinations synchronously, but not sequentially, as evidenced by looking behavior. 1-year-olds did not show evidence for recognition for either of the word-object and action-object pairs, regardless of the initial temporal alignment of these cues. To control for individual differences, we explored factors that might influence associative learning based on parental reports of 1- and 2-year-olds development, however, developmental measures did not explain word-action-object associative learning in either group. We discuss that while young children may benefit from the temporal alignment of multisensory cues as it enables them to actively engage with the multisensory content in real-time, infants may have been overwhelmed by the complexity of this input.

Transgenic mice with an R342X mutation in Phf6 display clinical features of Börjeson-Forssman-Lehmann Syndrome.

The PHF6 mutation c.1024C > T; p.R342X, is a recurrent cause of Börjeson-Forssman-Lehmann Syndrome (BFLS), a neurodevelopmental disorder characterized by moderate-severe intellectual disability, truncal obesity, gynecomastia, hypogonadism, long tapering fingers and large ears (MIM#301900). Here, we generated transgenic mice with the identical substitution (R342X mice) using CRISPR technology. We show that the p.R342X mutation causes a reduction in PHF6 protein levels, in both human and mice, from nonsense-mediated decay and nonsense-associated alternative splicing, respectively. Magnetic resonance imaging studies indicated that R342X mice had a reduced brain volume on a mixed genetic background but developed hydrocephaly and a high incidence of postnatal death on a C57BL/6 background. Cortical development proceeded normally, while hippocampus and hypothalamus relative brain volumes were altered. A hypoplastic anterior pituitary was also observed that likely contributes to the small size of the R342X mice. Behavior testing demonstrated deficits in associative learning, spatial memory and an anxiolytic phenotype. Taken together, the R342X mice represent a good preclinical model of BFLS that will allow further dissection of PHF6 function and disease pathogenesis.

Rhythmic Modulation of Visual Perception by Continuous Rhythmic Auditory Stimulation.

At any given moment our sensory systems receive multiple, often rhythmic, inputs from the environment. Processing of temporally structured events in one sensory modality can guide both behavioral and neural processing of events in other sensory modalities, but whether this occurs remains unclear. Here, we used human electroencephalography (EEG) to test the cross-modal influences of a continuous auditory frequency-modulated (FM) sound on visual perception and visual cortical activity. We report systematic fluctuations in perceptual discrimination of brief visual stimuli in line with the phase of the FM-sound. We further show that this rhythmic modulation in visual perception is related to an accompanying rhythmic modulation of neural activity recorded over visual areas. Importantly, in our task, perceptual and neural visual modulations occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. As such, the results provide a critical validation for the existence and functional role of cross-modal entrainment and demonstrates its utility for organizing the perception of multisensory stimulation in the natural environment.SIGNIFICANCE STATEMENT Our sensory environment is filled with rhythmic structures that are often multi-sensory in nature. Here, we show that the alignment of neural activity to the phase of an auditory frequency-modulated (FM) sound has cross-modal consequences for vision: yielding systematic fluctuations in perceptual discrimination of brief visual stimuli that are mediated by accompanying rhythmic modulation of neural activity recorded over visual areas. These cross-modal effects on visual neural activity and perception occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. The current work shows that continuous auditory fluctuations in the natural environment can provide a pacing signal for neural activity and perception across the senses.