Basal ganglia and dopamine contributions to probabilistic category learning.

Studies of the medial temporal lobe and basal ganglia memory systems have recently been extended towards understanding the neural systems contributing to category learning. The basal ganglia, in particular, have been linked to probabilistic category learning in humans. A separate parallel literature in systems neuroscience has emerged, indicating a role for the basal ganglia and related dopamine inputs in reward prediction and feedback processing. Here, we review behavioral, neuropsychological, functional neuroimaging, and computational studies of basal ganglia and dopamine contributions to learning in humans. Collectively, these studies implicate the basal ganglia in incremental, feedback-based learning that involves integrating information across multiple experiences. The medial temporal lobes, by contrast, contribute to rapid encoding of relations between stimuli and support flexible generalization of learning to novel contexts and stimuli. By breaking down our understanding of the cognitive and neural mechanisms contributing to different aspects of learning, recent studies are providing insight into how, and when, these different processes support learning, how they may interact with each other, and the consequence of different forms of learning for the representation of knowledge.

Probabilistic categorization: how do normal participants and amnesic patients do it?

In probabilistic categorization tasks, various cues are probabilistically (but not perfectly) predictive of class membership. This means that a given combination of cues sometimes belongs to one class and sometimes to another. It is not yet clear how categorizers approach such tasks. Here, we review evidence in favor of two alternative conceptualizations of learning in probabilistic categorization: as rule-based learning, or as incremental learning. Each conceptualization forms the basis of a way of analyzing performance: strategy analysis assumes rule-based learning, while rolling regression analysis assumes incremental learning. Here, we contrasted the ability of each to predict performance of normal categorizers. Both turned out to predict responses about equally well. We then reviewed performance of patients with damage to regions deemed important for either rule-based or incremental learning. Evidence was again about equally compatible with either alternative conceptualization of learning, although neither predicted an involvement of the medial temporal lobe. We suggest that a new way of conceptualizing probabilistic categorization might be fruitful, in which the medial temporal lobe help set up representations that are then used by other regions to assign patterns to categories.

Conditional discrimination and reversal in amnesia subsequent to hypoxic brain injury or anterior communicating artery aneurysm rupture.

Human anterograde amnesia can develop following bilateral damage to the hippocampus and medial temporal lobes, as in hypoxic brain injury, or following damage to the basal forebrain, as following anterior communicating artery (ACoA) aneurysm rupture. In both cases, the mnestic deficit may be similar when assessed by standard neuropsychological measures. However, animal and computational models suggest that there are qualitative differences in the pattern of impaired and spared memory abilities following damage to hippocampus versus basal forebrain. Here, we show such a dissociation in human amnesia using a single two-stage task, involving conditional discrimination and reversal. Consistent with a prior study, 10 individuals with anterograde amnesia subsequent to hypoxic brain injury were spared on acquisition but impaired at reversal. However, 10 individuals with amnesia subsequent to ACoA aneurysm showed the opposite pattern of impaired acquisition but spared reversal. The differences between groups cannot be easily ascribed to severity of mnestic or cognitive deficit, since the two amnesic groups performed similarly on neuropsychological tests of memory, intelligence and attention. The results illustrate qualitative differences in memory impairments in hypoxic and ACoA amnesics and highlight the importance of considering etiology in evaluating mnemonic deficits in amnesic populations.

Integrating incremental learning and episodic memory models of the hippocampal region.

By integrating previous computational models of corticohippocampal function, the authors develop and test a unified theory of the neural substrates of familiarity, recollection, and classical conditioning. This approach integrates models from 2 traditions of hippocampal modeling, those of episodic memory and incremental learning, by drawing on an earlier mathematical model of conditioning, SOP (A. Wagner, 1981). The model describes how a familiarity signal may arise from parahippocampal cortices, giving a novel explanation for the finding that the neural response to a stimulus in these regions decreases with increasing stimulus familiarity. Recollection is ascribed to the hippocampus proper. It is shown how the properties of episodic representations in the neocortex, parahippocampal gyrus, and hippocampus proper may explain phenomena in classical conditioning. The model reproduces the effects of hippocampal, septal, and broad hippocampal region lesions on contextual modulation of classical conditioning, blocking, learned irrelevance, and latent inhibition.

From conditioning to category learning: an adaptive network model.

We used adaptive network theory to extend the Rescorla-Wagner (1972) least mean squares (LMS) model of associative learning to phenomena of human learning and judgment. In three experiments subjects learned to categorize hypothetical patients with particular symptom patterns as having certain diseases. When one disease is far more likely than another, the model predicts that subjects will substantially overestimate the diagnosticity of the more valid symptom for the rare disease. The results of Experiments 1 and 2 provide clear support for this prediction in contradistinction to predictions from probability matching, exemplar retrieval, or simple prototype learning models. Experiment 3 contrasted the adaptive network model with one predicting pattern-probability matching when patients always had four symptoms (chosen from four opponent pairs) rather than the presence or absence of each of four symptoms, as in Experiment 1. The results again support the Rescorla-Wagner LMS learning rule as embedded within an adaptive network model.

Context, conditioning, and hippocampal rerepresentation in animal learning.

The researchers argue that a previous computational account of hippocampal region function in associative learning (M. Gluck & C. Myers, 1993) has emergent implications that accurately describe the role of the hippocampal region in contextual processing. This article unifies 2 seemingly conflicting views of contextual processing: It accords contextual cues no special representational status (e.g., R. Rescorla & A. Wagner, 1972), yet it also allows context to stand in a superordinate relationship to the cues it contains (e.g., L. Nadel & J. Willner, 1980). As a result, the account correctly expects that context can develop occasion-setting properties and that context shifts can weaken learned responses or attenuate latent inhibition. The article also explains data suggesting that hippocampal lesions reduce contextual sensitivity. It may help unify several previous theoretical accounts of the hippocampal region's role in contextual processing.

Cortico-hippocampal representations in simultaneous odor discrimination: a computational interpretation of Eichenbaum, Mathews, and Cohen (1989).

A previous model of hippocampal region function in classical conditioning is generalized to H. Eichenbaum, A. Fagan, P. Mathews, and N.J. Cohen's (1989) and H. Eichenbaum, A. Fagan, and N.J. Cohen's (1989) simultaneous odor discrimination studies in rats. The model assumes that the hippocampal region forms new stimulus representations that compress redundant information while differentiating predictie information; the piriform (olfactory) cortex meanwhile clusters similar and co-occurring odors. Hippocampal damage interrupts the ability to differentiate odor representations, while leaving piriform-mediated odor clustering unchecked. The result is a net tendency to overcompress in the lesioned model. Behavior in the model is very similar to that of the rats, including lesion deficits, facilitation of successively learned tasks, and transfer performance. The computational mechanisms underlying model performance are consistent with the qualitative interpretations suggested by Eichen baum et al. to explain their empirical data.

Dissociating entorhinal and hippocampal involvement in latent inhibition.

This study used anatomical cues to suggest a functional dissociation between the roles of the entorhinal cortex and the hippocampus in learning. The authors proposed that the highly convergent inputs to the entorhinal cortex indicate this region may be particularly important for selecting or compressing information. This hypothesis was tested in rabbits (Oryctolagus cunniculus) trained on an associative learning task that is a common index of stimulus selection. In this task, known as latent inhibition, preexposure to a stimulus (such as a tone) leads to slowed learning when the same tone is subsequently paired with an outcome (such as an airpuff to the eye). As hypothesized, rabbits with neurotoxic lesions of the entorhinal cortex failed to show slowed learning following preexposure (no latent inhibition) and learned the association faster than control rabbits. In contrast, hippocampal-lesioned animals showed normal (slowed) learning.

Role of the basal ganglia in category learning: how do patients with Parkinson's disease learn?

The purpose of the present study was to gain a deeper understanding of the role of the basal ganglia in learning and memory by examining learning strategies among patients with basal ganglia dysfunction. Using a probabilistic category learning task (the "weather prediction" task) previously shown to be sensitive to basal ganglia function, the authors examined patterns of performance during learning and used mathematical models to capture different learning strategies. Results showed that patients with Parkinson's disease exhibit different patterns of strategy use. Specifically, most controls initially used a simple, but suboptimal, strategy that focused on single-cue-outcome associations; eventually, however, most controls adopted a more complex, optimal learning strategy, integrating single-cue associations to predict outcomes for multiple-cue stimuli. In contrast, the majority of individuals with Parkinson's disease continued to rely on simple single-cue learning strategies throughout the experiment.

Intact delay-eyeblink classical conditioning in amnesia.

The status of classical conditioning in human amnesia was examined by comparing conditioning of the eyeblink response (the unconditional response) to a tone conditioned stimulus (CS) paired with an airpuff unconditioned stimulus (US) in the delay paradigm between 7 amnesic and 7 age- and education-matched normal control participants. Amnesic patients exhibited normal baseline performance in pseudoconditioning and normal acquisition and extinction of conditioned responses in terms of the number, latency, and magnitude of eyeblinks. These results indicate that in humans, as in rabbits, brain structures critical for declarative memory are not essential for the acquisition of elementary CS-US associations.

Impaired delay eyeblink classical conditioning in individuals with anterograde amnesia resulting from anterior communicating artery aneurysm rupture.

Anterior communicating artery (ACoA) aneurysm rupture can lead to an anterograde amnesia syndrome similar to that observed after damage to the hippocampus and medial temporal lobes (MT). It is currently believed that ACoA amnesia results from basal forebrain damage that disrupts hippocampal processing without direct hippocampal damage. Converging evidence from animal studies and computational modeling suggests that qualitative differences may exist in the pattern of memory impairment after basal forebrain or MT damage. For example, animals with basal forebrain but not hippocampal damage are impaired at delay eyeblink classical conditioning (EBCC). In this study, individuals with ACoA amnesia were shown to be impaired at delay EBCC compared with matched controls; this contrasts with the spared delay EBCC previously observed in MT amnesia. This finding suggests the beginning of a possible dissociation between the memory impairments in MT versus ACoA amnesia.

Basal forebrain stimulation changes cortical sensitivities to complex sound.

Experience affects how brains respond to sound. Here, we examined how the sensitivity and selectivity of auditory cortical neuronal responses were affected in adult rats by the repeated presentation of a complex sound that was paired with basal forebrain stimulation. The auditory cortical region that was responsive to complex sound was 2-5 five times greater in area in paired-stimulation rats than in naive rats. Magnitudes of neuronal responses evoked by complex sounds were also greatly increased by associative pairing, as were the percentages of neurons that responded selectively to the specific spectrotemporal features that were paired with stimulation. These findings demonstrate that feature selectivity within the auditory cortex can be flexibly altered in adult mammals through appropriate intensive training.

Latent learning in medial temporal amnesia: evidence for disrupted representational but preserved attentional processes.

Damage to the hippocampus and medial temporal (MT) structures can lead to anterograde amnesia and may also impair latent learning, in which prior exposure to cues affects their subsequent associability. Normally, latent learning may reflect both representational and attentional mechanisms. Prior work has suggested that individuals with MT amnesia have specific deficits in representational processing; thus, latent learning that invokes primarily representational mechanisms might be especially impaired in MT amnesia. The current results provide preliminary confirmation of this prediction. In Experiment 1, a latent learning paradigm expected to invoke representational mechanisms was impaired in individuals with MT amnesia, whereas in Experiment 2, a paradigm expected to invoke other attentional mechanisms was spared in individuals with MT amnesia. This suggests the representational and attentional components of latent learning are dissociable and differentially affected in anterograde amnesia.

Spectrotemporal sensitivities in rat auditory cortical neurons.

Studies in several mammalian species have demonstrated that auditory cortical neurons respond strongly to single frequency-modulated (FM) sweeps, and that most responses are selective for sweep direction and/or rate. In the present study, we used extracellular recordings to examine how neurons in the auditory cortices of anesthetized rats respond to continuous, periodic trains of FM sweeps (described previously by deCharms et al., Science 280 (1998) pp. 1439-1444, as moving auditory gratings). Consistent with previous observations in owl monkeys, we found that the majority of cortical neurons responded selectively to trains of either up-sweeps or down-sweeps; selectivity for down-sweeps was most common. Periodic responses were typically evoked only by sweep trains with repetition rates less than 12 sweeps per second. Directional differences in responses were dependent on repetition rate. Our results support the proposal that a combination of both spectral and temporal acoustic features determines the responses of auditory cortical neurons to sound, and add to the growing body of evidence indicating that the traditional view of the auditory cortex as a frequency analyzer is not sufficient to explain how the mammalian brain represents complex sounds.

Parallel neural systems for classical conditioning: support from computational modeling.

Classical conditioning has been explained by two main types of theories that postulate different learning mechanisms. Rescorla and Wagner (1972) put forth a theory in which conditioning is based on the ability of the US to drive learning through error correction. Alternatively, Mackintosh (1973) put forth a theory in which the ability of the CS to be associated with the unconditioned stimulus is modulated. We have proposed a reconciliation of these two mechanisms as working in parallel within different neural systems: a cerebellar system for US modulation and a hippocampal system for CS modulation. We developed a computational model of cerebellar function in eyeblink conditioning based on the error correction mechanism of the Rescorla-Wagner rule in which learning-related activity from the cerebellum inhibits the inferior olive, which is the US input pathway to the cerebellum (Gluck et al., 1994). We developed a computational model of the hippocampal region that forms altered representations of conditioned stimuli based on their behavioral outcomes (Gluck & Myers, 1993; Myers et al., 1995). Overall, computational modeling and empirical findings support the idea that, at least in the case of eyeblink conditioning, there may be two different neural systems: the cerebellum which mediates US-based error correction and hippocampus which alters representations of CSs.

Novel age-dependent learning deficits in a mouse model of Alzheimer's disease: implications for translational research.

Computational modeling predicts that the hippocampus plays an important role in the ability to apply previously learned information to novel problems and situations (referred to as the ability to generalize information or simply as 'transfer learning'). These predictions have been tested in humans using a computer-based task on which individuals with hippocampal damage are able to learn a series of complex discriminations with two stimulus features (shape and color), but are impaired in their ability to transfer this information to newly configured problems in which one of the features is altered. This deficit occurs despite the fact that the feature predictive of the reward (the relevant information) is not changed. The goal of the current study was to develop a mouse analog of transfer learning and to determine if this new task was sensitive to pathological changes in a mouse model of AD. We describe a task in which mice were able to learn a series of concurrent discriminations that contained two stimulus features (odor and digging media) and could transfer this learned information to new problems in which the irrelevant feature in each discrimination pair was altered. Moreover, we report age-dependent deficits specific to transfer learning in APP+PS1 mice relative to non-transgenic littermates. The robust impairment in transfer learning may be more sensitive to AD-like pathology than traditional cognitive assessments in that no deficits were observed in the APP+PS1 mice on the widely used Morris water maze task. These data describe a novel and sensitive paradigm to evaluate mnemonic decline in AD mouse models that has unique translational advantages over standard species-specific cognitive assessments (e.g., water maze for rodent and delayed paragraph recall for humans).

A neurocomputational model of tonic and phasic dopamine in action selection: a comparison with cognitive deficits in Parkinson's disease.

The striatal dopamine signal has multiple facets; tonic level, phasic rise and fall, and variation of the phasic rise/fall depending on the expectation of reward/punishment. We have developed a network model of the striatal direct pathway using an ionic current level model of the medium spiny neuron that incorporates currents sensitive to changes in the tonic level of dopamine. The model neurons in the network learn action selection based on a novel set of mathematical rules that incorporate the phasic change in the dopamine signal. This network model is capable of learning to perform a sequence learning task that in humans is thought to be dependent on the basal ganglia. When both tonic and phasic levels of dopamine are decreased, as would be expected in unmedicated Parkinson's disease (PD), the model reproduces the deficits seen in a human PD group off medication. When the tonic level is increased to normal, but with reduced phasic increases and decreases in response to reward and punishment, respectively, as would be expected in PD medicated with L-Dopa, the model again reproduces the human data. These findings support the view that the cognitive dysfunctions seen in Parkinson's disease are not solely either due to the decreased tonic level of dopamine or to the decreased responsiveness of the phasic dopamine signal to reward and punishment, but to a combination of the two factors that varies dependent on disease stage and medication status.

Risk and protective haplotypes of the alpha-synuclein gene associated with Parkinson's disease differentially affect cognitive sequence learning.

Alpha-synuclein (SNCA) is a key factor in the regulation of dopaminergic transmission and is related to Parkinson's disease. In this study, we investigated the effects of risk and protective SNCA haplotypes associated with Parkinson's disease on cognitive sequence learning in 204 healthy volunteers. We found that the 3'-block risk SNCA haplotypes are associated with less effective stimulus-reward learning of sequences and with superior context representation of sequences. In contrast, participants with protective haplotypes exhibit better stimulus-reward learning and worse context representation, which suggest that these functions are inversely affected by risk and protective haplotypes. The Rep1 promoter polymorphism does not influence cognitive sequence learning. Because stimulus-reward learning may be mediated by the basal ganglia and context learning may be related to the medial temporal lobe, our data raise the possibility that dopaminergic signals regulated by SNCA inversely affect these memory systems.

Dopaminergic contribution to cognitive sequence learning.

Evidence suggests that dopaminergic mechanisms in the basal ganglia are important in feedback-guided habit learning. To test hypothesis, we assessed cognitive sequence learning in 120 healthy volunteers and measured plasma levels of homovanillic acid [HVA] (a metabolite of dopamine), 5-hydroxyindoleacetic acid [5-HIAA] (a metabolite of serotonin), and 3-methoxy-4-hydroxypheylglycol [MHPG] (a metabolite of norepinephrine). Results revealed a significant negative relationship between errors in the feedback-guided training phase of the sequence learning task and the plasma HVA level. The HVA level accounted for 10.5% of variance of performance. Participant who had lower HVA level than the median value of the whole sample committed more errors during the training phase compared with participants who had higher HVA plasma level than the median value. A similar phenomenon was not observed for the context-dependent phase of the task and for 5-HIAA and MHPG. These results suggest that dopamine plays a special role in feedback-guided cognitive sequence learning.