Exacerbation of the credit assignment problem in rats with lesions of the medial prefrontal cortex is revealed by Bayesian analysis of behavior in the pre-solution period of learning.

Our internal models of the world help us to process information rapidly: in general model-based learning is more rapid than model-free learning. However, the cognitive flexibility required to overcome cognitive predispositions can let us down: it is not fully developed until adulthood; predispositions can be unconscious biases; and cognitive flexibility is impaired in many psychiatric and neurological conditions. To understand these limits to flexibility, we need to know how the brain generates predispositions and deploys flexibility. We performed a detailed analysis of the exploratory behavior of rats in the pre-solution period of a two-alternative forced choice discrimination learning task. Rats readily learn in which of two bowls, filled with differentially scented and textured digging materials, there is hidden bait. In a single session, they are presented with a series of discrimination learning and reversal stages. We performed a simple Bayesian analysis on the data from 68 rats, 33 of which had lesions of the medial prefrontal cortex, to examine patterns of responding in the pre-solution period. Control rats rapidly focussed on the relevant stimulus attributes and showed flexibility when required to learn about a different stimulus attribute. Rats with prefrontal cortex damage had reduced sensitivity to negative feedback. They were able to overcome this deficit and solve the credit assignment problem when there were limited alternatives or when attention was appropriately focused and predispositions matched the required response. However, the learning impairment presents as a problem with shifting attention due to the additional difficulty of solving the credit assignment problem when the attentional set is inconsistent with the required response.

More rapid reversal learning following overtraining in the rat is evidence that behavioural and cognitive flexibility are dissociable.

Cognitive flexibility is a term used to describe the brain processes underlying the phenomenon of adaptive change in behaviour in response to changed contingencies in the internal or external environment. Cognitive flexibility is often assessed in complex tasks measuring perceptual attentional shifting or response or task switching, but, arguably, reversal learning is a simple assay of cognitive flexibility. Reversal learning requires the detection of a changed outcome, the cessation of a previously-rewarded response and the selection of an alternative, previously-unrewarded, response. This study addressed the issue of the relationship between reversal learning and cognitive flexibility. In a single testing session, rats completed a series of 2-alternative forced-choice discriminations between digging bowls. The bowls differed according to both the medium within the bowl and the odor of the bowl. Having learned which cue (one of the odors or one of the digging media) indicated the food-baited bowl, half the rats were given additional trials of "over-training". To test reversal learning, the meaning of the cues predictive of reward/non-reward was then switched. There was a robust effect of over-training, with over-trained rats performing reversal learning in fewer trials than rats trained to criterion only. The pattern of errors supported the hypothesis that more rapid reversing results from the formation of an attentional set. This is the same attentional mechanism that results in less rapid shifting or switching. We conclude that the behavioural flexibility demonstrated in reversal learning does not provide a scale on which cognitive flexibility can be measured.

Oral dosing of rodents using a palatable tablet.

RATIONALE: Delivering orally bioavailable drugs to rodents is an important component to investigating that route of administration in novel treatments for humans. However, the traditional method of oral gavage requires training, is stressful, and can induce oesophageal damage in rodents. OBJECTIVES: To demonstrate a novel administrative technique-palatable gelatine tablets-as a stress-free route of oral delivery. METHODS: Twenty-four male Lister hooded rats were sacrificed for brain tissue analysis at varying time-points after jelly administration of 30 mg/kg of the wake-promoting drug modafinil. A second group of 22 female rats were tested on locomotor activity after 30 mg/kg modafinil, or after vehicle jellies, with the locomotor data compared to the brain tissue concentrations at the corresponding times. RESULTS: Modafinil was present in the brain tissue at all time-points, reducing in concentration over time. The pattern of brain tissue modafinil concentration is comparable to previously reported results following oral gavage. Modafinil-treated rats were more active than control rats, with greater activity during the later time-periods-similar to that previously reported following intraperitoneal injection of 40 mg/kg modafinil. CONCLUSIONS: Palatable jelly tablets are an effective route of administration of thermally stable orally bioavailable compounds, eliminating the stress/discomfort and health risk of oral gavage and presenting as an alternative to previously reported palatable routes of administration where high protein and fat levels may adversely affect appetite for food reward, and uptake rate in the gastrointestinal tract.

Assessment of intradimensional/extradimensional attentional set-shifting in rats.

The rat intradimensional/extradimensional (ID/ED) task, first described by Birrell and Brown 18 years ago, has become the predominant means by which attentional set-shifting is investigated in rodents: the use of rats in the task has been described in over 135 publications by researchers from nearly 90 universities and pharmaceutical companies. There is variation in the protocols used by different groups, including differences in apparatus, stimuli (both stimulus dimensions and exemplars within), and also the methodology. Nevertheless, most of these variations seem to be of little consequence: there is remarkable similarity in the profile of published data, with consistency of learning rates and in the size and reliability of the set-shifting and reversal 'costs'. However, we suspect that there may be inconsistent data that is unpublished or perhaps 'failed experiments' that may have been caused by unintended deviations from effective protocols. The purpose of this review is to describe our approach and the rationale behind certain aspects of the protocol, including common pitfalls that are encountered when establishing an effective local protocol.

Effects of lesions of the subthalamic nucleus/zona incerta area and dorsomedial striatum on attentional set-shifting in the rat.

Patients with Parkinson's disease (PD) show cognitive impairments, including difficulty in shifting attention between perceptual dimensions of complex stimuli. Inactivation of the subthalamic nucleus (STN) has been shown to be effective in ameliorating the motor abnormalities associated with striatal dopamine (DA) depletion, but it is possible that STN inactivation might result in additional, perhaps attentional, deficits. This study examined the effects of: DA depletion from the dorsomedial striatum (DMS); lesions of the STN area; and the effects of the two lesions together, on the ability to shift attentional set in the rat. In a single session, rats performed the intradimensional/extradimensional (ID/ED) test of attentional set-shifting. This comprises a series of seven, two-choice discriminations, including acquisitions of novel discriminations in which the relevant stimulus is either in the currently attended dimension (ID) or the currently unattended dimension (ED shift) and reversals (REVs) following each acquisition stage. Bilateral lesions were made by injection of 6-hydroxydopamine (6-OHDA) into the DMS, resulting in a selective impairment in reversal learning. Large bilateral ibotenic acid lesions centered on the STN resulted in an increase in trials to criterion in the initial stages, but learning rate improved within the session. There was no evidence of a 'cost' of set-shifting - the ED stage was completed in fewer trials than the ID stage - and neither was there a cost of reversal learning. Strikingly, combined lesions of both regions did not resemble the effects of either lesion alone and resulted in no apparent deficits.

Attentional Set-Shifting Across Species.

Attentional set-shifting, as a measure of executive flexibility, has been a staple of investigations into human cognition for over six decades. Mediated by the frontal cortex in mammals, the cognitive processes involved in forming, maintaining and shifting an attentional set are vulnerable to dysfunction arising from a number of human neurodegenerative diseases (such as Alzheimer's, Parkinson's and Huntington's diseases) and other neurological disorders (such as schizophrenia, depression, and attention deficit/hyperactivity disorder). Our understanding of these diseases and disorders, and the cognitive impairments induced by them, continues to advance, in tandem with an increasing number of tools at our disposal. In this chapter, we review and compare commonly used attentional set-shifting tasks (the Wisconsin Card Sorting Task and Intradimensional/Extradimensional tasks) and their applicability across species. In addition to humans, attentional set-shifting has been observed in a number of other animals, with a substantial body of literature describing performance in monkeys and rodents. We consider the task designs used to investigate attentional set-shifting in these species and the methods used to model human diseases and disorders, and ultimately the comparisons and differences between species-specific tasks, and between performance across species.

Attentional set-shifting in rodents: a review of behavioural methods and pharmacological results.

Attentional set-shifting tasks have been used as a measure of human fronto-executive function for over 60 years. The major contribution these tasks have made has been the quantification of cognitive deficits associated with human pathologies such as schizophrenia, attention deficit/hyperactivity disorder and dementias related to Parkinson's, Huntington's and Alzheimer's diseases. Thirteen years ago an intradimensional/extradimensional attentional set-shifting task was developed for rats. Since then, there have been over 70 publications detailing the effects of various manipulations on task performance in rats, and 17 publications describing adaptations of the task for mice. Much of this literature has focused on animal models of neuropathology and cognitive deficits associated with schizophrenia and other human conditions. Altogether, these results have elucidated the roles of multiple neurotransmitters in the manifestation of cognitive deficits, and their subsequent amelioration, including dopamine, serotonin, acetylcholine and noradrenaline. However, the fundamental promise of the attentional set-shifting task, to measure cognitive flexibility in humans and rodents in a formally analogous way, has often been under investigated and over simplified. This review explores the research that led to the development of the rat attentional set-shifting task, and how subsequent use of the task has expanded our understanding of the psychological and neurological underpinnings of discrimination and reversal learning, as well as the formation, maintenance and shifting of attentional set.

Tacrine improves reversal learning in older rats.

Age-related decline has been reported in most cognitive domains, including executive function: in particular, attentional set-shifting and reversal learning, as measures of executive control, are impaired in aged populations of both humans and rats. Despite the importance of the cholinergic system in age-related cognitive decline, no data are available on the effects of cholinergic enhancement on age-related performance deficits in tests of attentional set-shifting. We investigated the effects of the cholinesterase inhibitor tetrahydroacridin-9-amine (tacrine) on reversal learning and attentional set-shifting in older rats (aged 16-21 months) using the rodent version of the intradimensional/extradimensional attentional set-shifting task in a repeated-measures design. Discrimination acquisition was not impaired, but age-related impairments in reversal learning were persistent between tests, and ameliorated by the 3 mg/kg dose of tacrine. No age-related impairments in set-shifting were seen, but there was a tendency for tacrine to reduce the cost of shifting set. Given the lack of previous evidence for a role of cortical acetylcholine in attentional set-shifting tasks, it is likely that altered neurotransmitter interactions in striatum underlie this improvement.

Lesions of the dorsomedial striatum impair formation of attentional set in rats.

Behavioural flexibility refers to the ability to rapidly adapt to novel situations and it has been suggested that the frontal lobe and basal ganglia are implicated in various components of adjusting to changes in environmental contingencies. Behavioural flexibility can be assessed using attentional set-shifting tasks, in which performance is impaired after damage to the prefrontal cortex. The present study explores the downstream contribution of the prefrontal projection zone in the dorsomedial striatum (DMS) to attentional set shifting. Rats were tested in two set-shifting tasks following quinolinic acid injections bilaterally into the DMS. When tested in a rodent version of the set-shifting task, rats with a DMS lesion displayed a greater number of errors during the reversal stages of the task than sham lesion controls but the nature of the errors did not differ between the two groups. Interestingly, when the rats were tested in a modified version of the set-shifting task, directly designed for measuring the formation of an attentional set, sham lesion controls displayed a pronounced shift-cost, evident of successful set-formation. In contrast, rats with DMS lesions failed to form an attentional set, showing no performance cost when a shift of attention was required. These results support previous reports of the importance of the DMS in behavioural flexibility but also suggest that this region is vital for the formation of set, possibly by extrapolating different perceptions into a unified representation of a dimension.

Measuring the construct of executive control in schizophrenia: defining and validating translational animal paradigms for discovery research.

Executive control is an aspect of cognitive function known to be impaired in schizophrenia. Previous meetings of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) group have more precisely defined executive control in terms of two constructs: "rule generation and selection", and "dynamic adjustments of control". Next, human cognitive tasks that may effectively measure performance with regard to these constructs were identified to be developed into practical and reliable measures for use in treatment development. The aim of this round of CNTRICS meetings was to define animal paradigms that have sufficient promise to warrant further investigation for their utility in measuring these constructs. Accordingly, "reversal learning" and the "attentional set-shifting task" were nominated to assess the construct of rule generation and selection, and the "stop signal task" for the construct of dynamic adjustments of control. These tasks are described in more detail here, with a particular focus on their utility for drug discovery efforts. Presently, each assay has strengths and weaknesses with regard to this point and increased emphasis on improving practical aspects of testing, understanding predictive validity, and defining biomarkers of performance represent important objectives in attaining confidence in translational validity here.

Lesions of the orbital prefrontal cortex impair the formation of attentional set in rats.

In rats, reversal learning impairments are commonly reported after lesions of the orbital prefrontal cortex (OFC), in contrast to the effect of lesions of the medial prefrontal cortex, which impair attentional set-shifting. Comparable dissociations have also been reported in humans, monkeys and mice. However, these two manifestations of behavioural flexibility may share common cognitive processes. The present study tested the hypothesis that lesions of the OFC (an area that integrates expected and actual outcomes to signal which cues in the environment predict reward) would impair the formation of attentional set as well as impairing reversal learning. We compared the performance of lesioned and control rats on two set-shifting tasks. The first task we used, 'the 4ID task', had no reversal stages, but multiple intradimensional acquisitions before the extradimensional shift stage, to assess set-formation as well as set-shifting. The second task was the standard intradimensional/extradimensional '7-stage task', which includes reversal learning stages after each compound acquisition. Compared with controls, lesioned rats were slower to form attentional set on the 4ID task. When they did form a set, they required more trials to complete the extradimensional shift stage. On the 7-stage task, we replicated our previous finding of impaired reversal learning and reduced shift-costs. We interpret these findings as reflecting a single deficit in identifying relevant cues after unexpected outcomes, which supports recent models of OFC function. Our findings challenge the assumption that the contribution of the OFC to behavioural flexibility is limited to reversal learning.

Asenapine restores cognitive flexibility in rats with medial prefrontal cortex lesions.

RATIONALE: Cognitive inflexibility in schizophrenia is treatment-resistant and predictive of poor outcome. This study examined the effect of asenapine, a novel psychopharmacologic agent being developed for schizophrenia and bipolar disorder, on cognitive dysfunction in the rat. OBJECTIVES: The objective of this paper was to establish whether asenapine has a beneficial effect on the performance of rats with ibotenic acid-induced lesion of the medial prefrontal cortex (mPFC) in an intradimensional/extradimensional (ID/ED) test of cognitive flexibility. METHODS: The effect of subcutaneously administered asenapine (0.75, 7.5, 75 microg/kg) on ID/ED performance of controls or mPFC-lesioned rats was examined using a within-subjects, repeated-measures design. In a second experiment, lesioned and control rats were tested with or without asenapine in a modified version of the task, with multiple set-shifts, before brains were processed for Fos-immunoreactivity in the mPFC. RESULTS: The mPFC lesion-induced deficit in the ID/ED task was stable with repeated testing over more than two months. Asenapine (75 microg/kg s.c., p < 0.05) completely restored the performance of lesioned rats. Experiment 2 replicated both lesion and asenapine effects and demonstrated that it is possible to measure set-shifting multiple times within a test session. Asenapine (75 microg/kg s.c.) was associated with differential activation of the neurons in the anterior mPFC of lesioned animals, but was without effect in controls. CONCLUSION: Asenapine can ameliorate mPFC lesion-induced impairment in attentional set-shifting, and is associated with a greater activation of the spared neurons in the anterior mPFC. These data suggest that asenapine may benefit impaired cognitive flexibility in disorders such as schizophrenia.

Lesions of the dorsal noradrenergic bundle impair attentional set-shifting in the rat.

Rats with medial prefrontal cortex (mPFC) lesions are impaired in attentional set-shifting, when it is required to shift to a previously irrelevant perceptual dimension. The main source of noradrenergic input to the mPFC is from the locus coeruleus via the dorsal noradrenergic ascending bundle (DNAB). This study examined the effects of selective cortical noradrenaline depletion following 6-hydroxydopamine-induced lesions of the DNAB on attentional set-shifting and other aspects of discrimination learning and performance. Rats learned to dig in baited bowls, and then acquired discriminations based on one of two aspects of a bowl--odour or digging medium. The task tested acquisition of novel discriminations (both intra- and extra-dimensional) and reversal learning when contingencies were reversed with the same stimuli. At the conclusion of testing, the DNAB-lesioned rats were shown to have a selective depletion of noradrenaline of approximately 70% within the mPFC (cingulate and prelimbic cortex subregions), with no other significant changes in dopamine or 5-hydroxytryptamine. Rats required more trials to learn new discriminations when attentional shifting was required [extra-dimensional (ED)-shift]. Rats with dorsal noradrenergic ascending bundle (DNAB) lesions were impaired in novel acquisitions when an ED-shift was required, but were unimpaired in reversal learning and other aspects of discrimination learning, relative to controls. These data are consistent with other evidence implicating noradrenaline (NA) in attentional set-shifting, and contrast with effects of manipulations of 5-hydroxytryptamine (5-HT) and acetylcholine within the medial prefrontal cortex (mPFC). The findings are also relevant to recent theorizing about the functions of the coeruleo-cortical noradrenergic system.

5-HT6 receptor antagonists improve performance in an attentional set shifting task in rats.

RATIONALE AND OBJECTIVE: Performance on the Wisconsin Card Sorting Test (WCST), which requires patients to 'shift attention' between stimulus dimensions (sorting categories), is impaired in diseases such as schizophrenia. The rat attentional set shifting task is an analogue of the WCST. Given that 5-HT(6) receptor antagonists improve cognitive performance and influence cortical neurochemistry in rats, the present study investigated the effects of 5-HT(6) receptor antagonists upon attentional set shifting in rats. METHODS: Rats were tested in this paradigm following sub-chronic SB-399885-T or SB-271046-A (both 10 mg kg(-1) bid, p.o. for 8 days prior to testing and either 4 or 2 h prior to testing on day 9, respectively). Rats were trained to dig in baited bowls for a food reward and to discriminate based on odour or digging media (Habituation, day 8). In a single session (day 9), rats performed a series of discriminations, including reversals (REV), intra-dimensional (ID) and extra-dimensional (ED) shifts. RESULTS: Neither compound altered performance during Habituation. On the test day, both SB-399885-T and SB-271046-A reduced the total trials to reach criterion and the total errors made when data were collapsed across all discriminations (P<0.05-0.01). Further, both compounds significantly reduced the trials to criterion for REV-1 (P<0.05-0.01) and abolished the ID/ED shift. SB-399885-T, but not SB-271046-A, reduced trials required to complete the ED shift (P<0.05) and the number of errors made during completion of the ID (P<0.05) and ED shifts (P<0.01). CONCLUSION: 5-HT(6) receptor antagonists improved performance in the attentional set shifting task and may have therapeutic potential in the treatment of disorders where cognitive deficits are a feature, including schizophrenia.