Climbing fibers provide essential instructive signals for associative learning.

Supervised learning depends on instructive signals that shape the output of neural circuits to support learned changes in behavior. Climbing fiber (CF) inputs to the cerebellar cortex represent one of the strongest candidates in the vertebrate brain for conveying neural instructive signals. However, recent studies have shown that Purkinje cell stimulation can also drive cerebellar learning and the relative importance of these two neuron types in providing instructive signals for cerebellum-dependent behaviors remains unresolved. In the present study we used cell-type-specific perturbations of various cerebellar circuit elements to systematically evaluate their contributions to delay eyeblink conditioning in mice. Our findings reveal that, although optogenetic stimulation of either CFs or Purkinje cells can drive learning under some conditions, even subtle reductions in CF signaling completely block learning to natural stimuli. We conclude that CFs and corresponding Purkinje cell complex spike events provide essential instructive signals for associative cerebellar learning.

Distinct Hippocampal Oscillation Dynamics in Trace Eyeblink Conditioning Task for Retrieval and Consolidation of Associations.

Trace eyeblink conditioning (TEBC) has been widely used to study associative learning in both animals and humans. In this paradigm, conditioned responses (CRs) to conditioned stimuli (CS) serve as a measure for retrieving learned associations between the CS and the unconditioned stimuli (US) within a trial. Memory consolidation, that is, learning over time, can be quantified as an increase in the proportion of CRs across training sessions. However, how hippocampal oscillations differentiate between successful memory retrieval within a session and consolidation across TEBC training sessions remains unknown. To address this question, we recorded local field potentials (LFPs) from the rat dorsal hippocampus during TEBC and investigated hippocampal oscillation dynamics associated with these two functions. We show that transient broadband responses to the CS were correlated with memory consolidation, as indexed by an increase in CRs across TEBC sessions. In contrast, induced alpha (8-10 Hz) and beta (16-20 Hz) band responses were correlated with the successful retrieval of the CS-US association within a session, as indexed by the difference in trials with and without CR.

Distributional coding of associative learning in discrete populations of midbrain dopamine neurons.

Midbrain dopamine neurons are thought to play key roles in learning by conveying the difference between expected and actual outcomes. Recent evidence suggests diversity in dopamine signaling, yet it remains poorly understood how heterogeneous signals might be organized to facilitate the role of downstream circuits mediating distinct aspects of behavior. Here, we investigated the organizational logic of dopaminergic signaling by recording and labeling individual midbrain dopamine neurons during associative behavior. Our findings show that reward information and behavioral parameters are not only heterogeneously encoded but also differentially distributed across populations of dopamine neurons. Retrograde tracing and fiber photometry suggest that populations of dopamine neurons projecting to different striatal regions convey distinct signals. These data, supported by computational modeling, indicate that such distributional coding can maximize dynamic range and tailor dopamine signals to facilitate specialized roles of different striatal regions.

The role of uncertainty in regulating associative change.

Rescorla (2000, 2001) interpreted his compound test results to show that both common and individual error terms regulate associative change such that the element of a conditioned compound with the greater prediction error undergoes greater associative change than the one with the smaller prediction error. However, it has recently been suggested that uncertainty, not prediction error, is the primary determinant of associative change in people (Spicer et al., 2020, 2022). The current experiments use the compound test in a continuous outcome allergist task to assess the role of uncertainty in associative change, using two different manipulations of uncertainty: outcome uncertainty (where participants are uncertain of the level of the outcome on a particular trial) and causal uncertainty (where participants are uncertain of the contribution of the cue to the level of the outcome). We replicate Rescorla's compound test results in the case of both associative gains (Experiment 1) and associative losses (Experiment 3) and then provide evidence for greater change to more uncertain cues in the case of associative gains (Experiments 2 and 4), but not associative losses (Experiments 3 and 5). We discuss the findings in terms of the notion of theory protection advanced by Spicer et al., and other ways of thinking about the compound test procedure, such as that proposed by Holmes et al. (2019). (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Conditioned preferences: Gated by experience, context, and endocrine systems.

Central to the navigation of an ever-changing environment is the ability to form positive associations with places and conspecifics. The functions of location and social conditioned preferences are often studied independently, limiting our understanding of their interplay. Furthermore, a de-emphasis on natural functions of conditioned preferences has led to neurobiological interpretations separated from ecological context. By adopting a naturalistic and ethological perspective, we uncover complexities underlying the expression of conditioned preferences. Development of conditioned preferences is a combination of motivation, reward, associative learning, and context, including for social and spatial environments. Both social- and location-dependent reward-responsive behaviors and their conditioning rely on internal state-gating mechanisms that include neuroendocrine and hormone systems such as opioids, dopamine, testosterone, estradiol, and oxytocin. Such reinforced behavior emerges from mechanisms integrating past experience and current social and environmental conditions. Moreover, social context, environmental stimuli, and internal state gate and modulate motivation and learning via associative reward, shaping the conditioning process. We highlight research incorporating these concepts, focusing on the integration of social neuroendocrine mechanisms and behavioral conditioning. We explore three paradigms: 1) conditioned place preference, 2) conditioned social preference, and 3) social conditioned place preference. We highlight nonclassical species to emphasize the naturalistic applications of these conditioned preferences. To fully appreciate the complex integration of spatial and social information, future research must identify neural networks where endocrine systems exert influence on such behaviors. Such research promises to provide valuable insights into conditioned preferences within a broader naturalistic context.

Pupillary Responses Reflect Dynamic Changes in Multiple Cognitive Factors During Associative Learning in Primates.

Associative learning involves complex interactions of multiple cognitive factors. While adult subjects can articulate these factors verbally, for model animals such as macaques, we rely on behavioral outputs. In our study, we used pupillary responses as an alternative measure to capture these underlying cognitive changes. We recorded the dynamic changes in the pupils of three male macaques when they learned the associations between visual stimuli and reward sizes under the classical Pavlovian experimental paradigm. We found that during the long-term learning process, the gradual changes in the pupillary response reflect the changes in the cognitive state of the animals. The pupillary response can be explained by a linear combination of components corresponding to multiple cognitive factors. These components reflect the impact of visual stimuli on the pupils, the prediction of reward values associated with the visual stimuli, and the macaques' understanding of the current experimental reward rules. The changing patterns of these factors during interday and intraday learning clearly demonstrate the enhancement of current reward-stimulus association and the weakening of previous reward-stimulus association. Our study shows that the dynamic response of pupils can serve as an objective indicator to characterize the psychological changes of animals, understand their learning process, and provide important tools for exploring animal behavior during the learning process.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning.

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Examining the neural basis of unitization: A review.

Associative memory refers to the ability to form and remember associations between individual pieces of information rather than memory for a single object or word. Encoding associations in memory tends to be a more difficult task than item (only) encoding, because associative memory requires encoding multiple items as well as the specific links amongst the items. Accordingly, researchers have worked to identify interventions and strategies to reduce the effort and neural resources required for successful associative memory processing. Unitization is one such strategy that has traditionally been defined as the process by which two or more discrete items are processed, or encoded, such that they are perceived as a single ensemble. The current review explores the neural research on unitization while considering the behavioral benefits that accompany the process.

Cognitive control controls the effect of irrelevant stimulus-response learning.

Research has established that two cognitive processes, cognitive control and irrelevant stimulus-response (S-R) learning, may underlie the proportion congruency effect, which refers to the findings that the size of interference effects (e.g., the Stroop, Simon, or Eriksen flanker effect) reduces with increasing the proportion of incongruent trials. Further studies have begun to investigate the interaction between these two cognitive processes, which not only provide more plausible accounts for empirical data, but also advance theories. The present study set out to investigate whether cognitive control can modulate the effect of irrelevant S-R learning. In two experiments, we combined a color-letter contingency task, in which we manipulated the contingencies (low vs. high) of irrelevant S-R associations, with a color-Chinese character Stroop task, in which we manipulated the ratio of neutral to incongruent trials (mostly neutral (MN) versus mostly incongruent (MI)). Experiment 1 showed a proportion neutral effect (the Stroop effect was smaller in the MI than in the MN condition), suggesting changes in control demand. Critically, the contingency effect (faster responses in the high- than in the low-contingency condition) reduced in the MI than in the MN condition. Experiment 2 (preregistered) increased the number of Chinese characters to exclude a familiarity account for the proportion neutral effect, which replicated the findings of Experiment 1. These results suggest that cognitive control induced in the Stroop task transferred to the contingency task and modulated the contingency effect. Thus, this study provides clear evidence that cognitive control can modulate the effect of irrelevant S-R learning.

Testing the role of associative learning in evidence-based treatments for anorexia nervosa.

Treatments for anorexia nervosa (AN) remain ineffective for many patients. Processes that can account for differential treatment outcomes remain mostly unknown. We propose that the field test the role of associative learning in current psychological treatments. We hold that this line of research could yield actionable information for understanding non-response and improving long-term outcomes. To make this argument, we define associative learning and outline its proposed role in understanding psychiatric disorders and their treatment. We then briefly review data exploring associative learning in AN. We argue that associative learning processes are implicitly implicated in existing treatments; by this rationale, baseline differences in learning may interfere with treatment response. Finally, we outline future research to test our hypotheses. Altogether, future research aimed at better understanding how associative learning may contribute to AN symptom persistence has the potential to inform novel directions in intervention research. PUBLIC SIGNIFICANCE: There is a pressing need to improve outcomes in treatments for anorexia nervosa (AN). We propose that individual differences in associative learning-the ability to form and update associations between cues, contexts, behaviors, and outcomes-may account for differential response to existing treatments. Undertaking this research could provide an understanding of how current treatments work and inform new approaches for those who may be at risk of poor outcomes.

Older adults' name-face association learning is facilitated for names with high-frequency first syllables.

Older adults have even greater difficulty learning name-face associations than young adults, although many variables reflecting properties of the names have been shown to affect young and older adults' name learning similarly. Older adults' name-face association learning was compared for names with high-frequency (HF) first syllables versus names with low-frequency (LF) first syllables. Twenty-eight adults ages 65 to 80 learned five names with HF first syllables and five names with LF first syllables in association with 10 new faces over repeated testing rounds with feedback. Participants learned more name-face associations when the names had HF first syllables than LF first syllables. Findings indicate that older adults benefit from increased frequency of phonological segments within a word on a task other than word retrieval and are consistent with a theoretical framework that accounts for learning new name-face associations, the effects of linguistic properties of the names, and ageing.

Stimulus-outcome associations are required for the expression of specific Pavlovian-instrumental transfer.

A series of experiments employed a specific Pavlovian-instrumental transfer (PIT) task in rats to determine the capacity of various treatments to undermine two outcome-specific stimulus-outcome (S-O) associations. Experiment 1 tested a random treatment, which involved uncorrelated presentations of the two stimuli and their predicted outcomes. This treatment disrupted the capacity of the outcome-specific S-O associations to drive specific PIT. Experiment 2 used a negative-contingency treatment during which the predicted outcomes were exclusively delivered in the absence of their associated stimulus. This treatment spared specific PIT, suggesting that it left the outcome-specific S-O associations relatively intact. The same outcome was obtained in Experiment 3, which implemented a zero-contingency treatment consisting of delivering the predicted outcomes in the presence and absence of their associated stimulus. Experiment 4 tested a mixed treatment, which distributed the predicted outcomes at an equal rate during each stimulus. This treatment disrupted the capacity of the outcome-specific S-O associations to drive specific PIT. We suggest that the mixed treatment disrupted specific PIT by generating new and competing outcome-specific S-O associations. By contrast, we propose that the random treatment disrupted specific PIT by undermining the original outcome-specific S-O associations, indicating that these associations must be retrieved to express specific PIT. We discuss how these findings inform our theoretical understanding of the mechanisms underlying this phenomenon. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The effect of hippocampal subfield damage on rapid temporal integration through statistical learning and associative inference.

INTRODUCTION: The hippocampus (HPC) supports integration of information across time, often indexed by associative inference (AI) and statistical learning (SL) tasks. In AI, an indirect association between stimuli that never appeared together is inferred, whereas SL involves learning item relationships by extracting regularities across experiences. A recent model of hippocampal function (Schapiro et al., 2017) proposes that the HPC can support temporal integration in both paradigms through its two distinct pathways. METHODS: We tested this models' predictions in four patients with varying degrees of bilateral HPC damage and matched healthy controls, with two patients with complementary damage to either the monosynaptic or trisynaptic pathway. During AI, participants studied overlapping paired associates (AB, BC) and their memory was tested for premise pairs (AB) and for inferred pairs (AC). During SL, participants passively viewed a continuous picture sequence that contained an underlying structure of triplets that later had to be recognized. RESULTS: Binomial distributions were used to calculate above chance performance at the individual level. For AI, patients with focal HPC damage were impaired at inference but could correctly infer pairs above chance once premise pair acquisition was equated to controls; however, the patient with HPC and cortical damage showed severe impairment at recalling premise and inferred pairs, regardless of accounting for premise pair performance. For SL, none of the patients performed above chance, but notably neither did most controls. CONCLUSIONS: Associative inference of indirect relationships can be intact with HPC damage to either hippocampal pathways or the HPC more broadly, provided premise pairs can first be formed. Inference may remain intact through residual HPC tissue supporting premise pair acquisition, and/or through extra-hippocampal structures supporting inference at retrieval. Clear conclusions about hippocampal contributions to SL are precluded by low performance in controls, which we caution is not dissimilar to previous amnesic studies using the same task. This complicates interpretations of studies claiming necessity of hippocampal contributions to SL and warrants the use of a common and reliable task before conclusions can be drawn.

A simple semi-automated home-tank method and procedure to explore classical associative learning in adult zebrafish.

The zebrafish is a laboratory species that gained increasing popularity the last decade in a variety of subfields of biology, including toxicology, ecology, medicine, and the neurosciences. An important phenotype often measured in these fields is behaviour. Consequently, numerous new behavioural apparati and paradigms have been developed for the zebrafish, including methods for the analysis of learning and memory in adult zebrafish. Perhaps the biggest obstacle in these methods is that zebrafish is particularly sensitive to human handling. To overcome this confound, automated learning paradigms have been developed with varying success. In this manuscript, we present a semi-automated home tank-based learning/memory test paradigm utilizing visual cues, and show that it is capable of quantifying classical associative learning performance in zebrafish. We demonstrate that in this task, zebrafish successfully acquire the association between coloured-light and food reward. The hardware and software components of the task are easy and cheap to obtain and simple to assemble and set up. The procedures of the paradigm allow the test fish to remain completely undisturbed by the experimenter for several days in their home (test) tank, eliminating human handling or human interference induced stress. We demonstrate that the development of cheap and simple automated home-tank-based learning paradigms for the zebrafish is feasible. We argue that such tasks will allow us to better characterize numerous cognitive and mnemonic features of the zebrafish, including elemental as well as configural learning and memory, which will, in turn, also enhance our ability to study neurobiological mechanisms underlying learning and memory using this model organism.

Schema-congruency supports the formation of unitized representations: Evidence from event-related potentials.

The main goal of the present study was to investigate whether schema-based encoding of novel word pairs (i.e., novel compound words) supports the formation of unitized representations and thus, associative familiarity-based recognition. We report two experiments that both comprise an incidental learning task, in which novel noun-noun compound words were presented in semantically congruent contexts, enabling schema-supported processing of both constituents, contrasted with a schema-neutral condition. In Experiment 1, the effects of schema congruency on memory performance were larger for associative memory performance than for item memory performance in a memory test in which intact, recombined, and new compound words had to be discriminated. This supports the view that schema congruency boosts associative memory by promoting unitization. When contrasting event-related potentials (ERPs) for hits with correct rejections or associative misses, an N400 attenuation effect (520-676 ms) indicating absolute familiarity was present in the congruent condition, but not in the neutral condition. In line with this, a direct comparison of ERPs on hits across conditions revealed more positive waveforms in the congruent than in the neutral condition. This suggests that absolute familiarity contributes to associative recognition memory when schema-supported processing is established. In Experiment 2, we tested whether schema congruency enables the formation of semantically overlapping representations. Therefore, we included semantically similar lure compound words in the test phase and compared false alarm rates to these lures across conditions. In line with our hypothesis, we found higher false alarm rates in the congruent as compared to the neutral condition. In conclusion, we provide converging evidence for the view that schema congruency enables the formation of unitized representations and supports familiarity-based memory retrieval.

Optogenetic activation of dopamine D1 receptors in island cells of medial entorhinal cortex inhibits temporal association learning.

A critical feature of episodic memory formation is to associate temporally segregated events as an episode, called temporal association learning. The medial entorhinal cortical-hippocampal (EC-HPC) networks is essential for temporal association learning. We have previously demonstrated that pyramidal cells in the medial EC (MEC) layer III project to the hippocampal CA1 pyramidal cells and are necessary for trace fear conditioning (TFC), which is an associative learning between tone and aversive shock with the temporal gap. On the other hand, Island cells in MECII, project to GABAergic neurons in hippocampal CA1, suppress the MECIII input into the CA1 pyramidal cells through the feed-forward inhibition, and inhibit TFC. However, it remains unknown about how Island cells activity is regulated during TFC. In this study, we report that dopamine D1 receptor is preferentially expressed in Island cells in the MEC. Optogenetic activation of dopamine D1 receptors in Island cells facilitate the Island cell activity and inhibited hippocampal CA1 pyramidal cell activity during TFC. The optogenetic activation caused the impairment of TFC memory recall without affecting contextual fear memory recall. These results suggest that dopamine D1 receptor in Island cells have a crucial role for the regulation of temporal association learning.

Associative and predictive hippocampal codes support memory-guided behaviors.

Episodic memory involves learning and recalling associations between items and their spatiotemporal context. Those memories can be further used to generate internal models of the world that enable predictions to be made. The mechanisms that support these associative and predictive aspects of memory are not yet understood. In this study, we used an optogenetic manipulation to perturb the sequential structure, but not global network dynamics, of place cells as rats traversed specific spatial trajectories. This perturbation abolished replay of those trajectories and the development of predictive representations, leading to impaired learning of new optimal trajectories during memory-guided navigation. However, place cell assembly reactivation and reward-context associative learning were unaffected. Our results show a mechanistic dissociation between two complementary hippocampal codes: an associative code (through coactivity) and a predictive code (through sequences).

Activity-dependent organization of prefrontal hub-networks for associative learning and signal transformation.

Associative learning is crucial for adapting to environmental changes. Interactions among neuronal populations involving the dorso-medial prefrontal cortex (dmPFC) are proposed to regulate associative learning, but how these neuronal populations store and process information about the association remains unclear. Here we developed a pipeline for longitudinal two-photon imaging and computational dissection of neural population activities in male mouse dmPFC during fear-conditioning procedures, enabling us to detect learning-dependent changes in the dmPFC network topology. Using regularized regression methods and graphical modeling, we found that fear conditioning drove dmPFC reorganization to generate a neuronal ensemble encoding conditioned responses (CR) characterized by enhanced internal coactivity, functional connectivity, and association with conditioned stimuli (CS). Importantly, neurons strongly responding to unconditioned stimuli during conditioning subsequently became hubs of this novel associative network for the CS-to-CR transformation. Altogether, we demonstrate learning-dependent dynamic modulation of population coding structured on the activity-dependent formation of the hub network within the dmPFC.

How associations become behavior.

The Rescorla and Wagner (1972) model is the first mathematical theory to explain associative learning in the presence of multiple stimuli. Its main theoretical construct is that of associative strength, but this is connected to behavior only loosely. We propose a model in which behavior is described by a collection of Poisson processes, each with a rate proportional to an associative strength. The model predicts that the time between behaviors follows an exponential or hypoexponential distribution. This prediction is supported by two data sets on autoshaped and instrumental behavior in rats.