Physiological responses to near-miss outcomes and personal control during simulated gambling.

Near-miss outcomes during gambling are non-win outcomes that fall close to a pay-out. While objectively equivalent to an outright miss, near-misses motivate ongoing play and may therefore be implicated in the development of disordered gambling. Given naturalistic data showing increases in heart rate (HR) and electrodermal activity (EDA) during periods of real gambling play, we sought to explore the phasic impact of win, near-miss and full-miss outcomes on physiological arousal in a controlled laboratory environment. EDA and HR were monitored as healthy, student participants (n = 33) played a simulated slot-machine task involving unpredictable monetary wins. A second gambling distortion, perceived personal control, was manipulated within the same task by allowing the participant to select the play icon on some trials, and having the computer automatically select the play icon on other trials. Near-misses were rated as less pleasant than full-misses. However, on trials that involved personal choice, near-misses produced higher ratings of 'continue to play' than full-misses. Winning outcomes were associated with phasic EDA responses that did not vary with personal choice. Compared to full-misses, near-miss outcomes also elicited an EDA increase, which was greater on personal choice trials. Near-misses were also associated with greater HR acceleration than other outcomes. Near-miss outcomes are capable of eliciting phasic changes in physiological arousal consistent with a state of subjective excitement, despite their objective non-win status.

Whisker: a client-server high-performance multimedia research control system.

We describe an original client-server approach to behavioral research control and the Whisker system, a specific implementation of this design. The server process controls several types of hardware, including digital input/output devices, multiple graphical monitors and touchscreens, keyboards, mice, and sound cards. It provides a way to access this hardware for client programs, communicating with them via a simple text-based network protocol based on the standard Internet protocol. Clients to implement behavioral tasks may be written in any network-capable programming language. Applications to date have been in experimental psychology and behavioral and cognitive neuroscience, using rodents, humans, nonhuman primates, dogs, pigs, and birds. This system is flexible and reliable, although there are potential disadvantages in terms of complexity. Its design, features, and performance are described.

Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning.

Associative learning theory assumes that prediction error is a driving force in learning. A competing view, probabilistic contrast (PC) theory, is that learning and prediction error are unrelated. We tested a learning phenomenon that has proved troublesome for associative theory--retrospective revaluation--to evaluate these two models. We previously showed that activation in right lateral prefrontal cortex (PFC) provides a reliable signature for the presence of prediction error. Thus, if the associative view is correct, retrospective revaluation should be accompanied by right lateral PFC activation. PC theory would be supported by the absence of this activation. Right PFC and ventral striatal activation occurred during retrospective revaluation, supporting the associative account. Activations appeared to reflect the degree of revaluation, predicting later brain responses to revalued cues. Our results support a modified associative account of retrospective revaluation and demonstrate the potential of functional neuroimaging as a tool for evaluating competing learning models.

A re-examination of responding on ratio and regulated-probability interval schedules.

The higher response rates observed on ratio than on matched interval reward schedules has been attributed to the differential reinforcement of longer inter-response times (IRTs) on the interval contingency. Some data, however, seem to contradict this hypothesis, showing that the difference is still observed when the role of IRT reinforcement is neutralized by using a regulated-probability interval schedule (RPI). Given the mixed evidence for these predictions, we re-examined this hypothesis by training three groups of rats to lever press under ratio, interval and RPI schedules across two phases while matching reward rates within triads. At the end of the first phase, the master ratio and RPI groups responded at similar rates. In the second phase, an interval group yoked to the same master ratio group of the first phase responded at a lower rate than the RPI group. Post-hoc analysis showed comparable reward rates for master and yoked schedules. The experienced response-outcome rate correlations were likewise similar and approached zero as training progressed. We discuss these results in terms of a contemporary dual-system model of instrumental conditioning.

Frontal responses during learning predict vulnerability to the psychotogenic effects of ketamine: linking cognition, brain activity, and psychosis.

CONTEXT: Establishing a neurobiological account of delusion formation that links cognitive processes, brain activity, and symptoms is important to furthering our understanding of psychosis. OBJECTIVE: To explore a theoretical model of delusion formation that implicates prediction error-dependent associative learning processes in a pharmacological functional magnetic resonance imaging study using the psychotomimetic drug ketamine. DESIGN: Within-subject, randomized, placebo-controlled study. SETTING: Hospital-based clinical research facility, Addenbrooke's Hospital, Cambridge, England. The work was completed within the Wellcome Trust and Medical Research Council Behavioral and Clinical Neuroscience Institute, Cambridge. PARTICIPANTS: Fifteen healthy, right-handed volunteers (8 of whom were male) with a mean +/- SD age of 29 +/- 7 years and a mean +/- SD predicted full-scale IQ of 113 +/- 4 were recruited from within the local community by advertisement. INTERVENTIONS: Subjects were given low-dose ketamine (100 ng/mL of plasma) or placebo while performing a causal associative learning task during functional magnetic resonance imaging. In a separate session outside the scanner, the dose was increased (to 200 ng/mL of plasma) and subjects underwent a structured clinical interview. MAIN OUTCOME MEASURES: Brain activation, blood plasma levels of ketamine, and scores from psychiatric ratings scales (Brief Psychiatric Ratings Scale, Present State Examination, and Clinician-Administered Dissociative States Scale). RESULTS: Low-dose ketamine perturbs error-dependent learning activity in the right frontal cortex (P = .03). High-dose ketamine produces perceptual aberrations (P = .01) and delusion-like beliefs (P = .007). Critically, subjects showing the highest degree of frontal activation with placebo show the greatest occurrence of drug-induced perceptual aberrations (P = .03) and ideas or delusions of reference (P = .04). CONCLUSIONS: These findings relate aberrant prediction error-dependent associative learning to referential ideas and delusions via a perturbation of frontal cortical function. They are consistent with a model of delusion formation positing disruptions in error-dependent learning.

Lack of deleterious effects of buspirone on cognition in healthy male volunteers.

Buspirone is a serotonin 5-HT(1A) receptor agonist licensed for the treatment of anxiety. Other anxiolytic drugs such as benzodiazepines show significant sedative and other unwanted effects on cognition. Studies to date have yet to investigate cognitive effects of buspirone using well-validated computerized tests. The aim of this study was to assess acute subjective and cognitive effects of buspirone in healthy volunteers. Sixty healthy male volunteers received 20 mg buspirone, 30 mg buspirone, or placebo per os in a double-blind parallel groups design (N=20 per group). Subjective ratings (visual analogue scales) were completed at baseline, and at 1.5 and 3.5 hours post-capsule. Cognitive assessment was undertaken between 1.5 and 3.5 hours post-capsule, including tests of memory, executive planning, impulse control, decision making and cognitive flexibility. The 30 mg buspirone group showed significantly higher subjective ratings of contentedness 3.5 hours after capsule relative to placebo. Treatment and placebo groups did not differ significantly on cognitive measures. In contrast to benzodiazepines, the anxiolytic buspirone appears to lack detectable deleterious effects on cognition when administered acutely at clinically meaningful doses. Future research directions are discussed in relation to acute and chronic studies in neuropsychiatric populations.

Let me take the wheel: Illusory control and sense of agency.

Illusory control refers to an effect in games of chance where features associated with skilful situations increase expectancies of success. Past work has operationalized illusory control in terms of subjective ratings or behaviour, with limited consideration of the relationship between these definitions, or the broader construct of agency. This study used a novel card-guessing task in 78 participants to investigate the relationship between subjective and behavioural illusory control. We compared trials in which participants (a) had no opportunity to exercise illusory control, (b) could exercise illusory control for free, or (c) could pay to exercise illusory control. Contingency Judgment and Intentional Binding tasks assessed explicit and implicit sense of agency, respectively. On the card-guessing task, confidence was higher when participants exerted control than in the baseline condition. In a complementary model, participants were more likely to exercise control when their confidence was high, and this effect was accentuated in the pay condition relative to the free condition. Decisions to pay were positively correlated with control ratings on the Contingency Judgment task, but were not significantly related to Intentional Binding. These results establish an association between subjective and behavioural illusory control and locate the construct within the cognitive literature on agency.

Diagnosing and phenotyping visual synaesthesia: a preliminary evaluation of the revised test of genuineness (TOG-R).

Synaesthesia, a neurological condition affecting approximately .05% of the population, is characterised by anomalous sensory perception: a stimulus in one sensory modality triggers an automatic, instantaneous, consistent response in another modality (e.g., sound evokes colour) or in a different aspect of the same modality (e.g., black text evokes colour). As evidence was limited to case studies based on self-report, the existence of synaesthesia was regarded with scepticism until the development of the Test of Genuineness (TOG) in 1987, which measures the consistency of stimulus-response linkage: synaesthetes typically score between 70-90% range, whereas controls typically score between 20-38%. However, the TOG had only limited ability to quantify the characteristics of visual synaesthesia. In this study, the revised Test of Genuineness (TOG-R), utilising the Pantone-based Cambridge Synaesthesia Charts, was given to 26 synaesthetes and 23 controls. Results confirmed that the TOG-R is equally accurate in the diagnosis of synaesthesia; synaesthetes scored significantly (t47 = 16.01, p < .001) higher (mean = 71.3%, SEM = 1.4%) than controls (mean = 33%, SEM = 2.0%). The TOG-R provides greater precision in quantifying the closeness of colour matches and enables a more detailed analysis of visual synaesthesia. Synaesthetes were phenotyped into broad- and narrowband based on their overall responsiveness to auditory stimuli, with bandwidth determined primarily by responsiveness to non-word stimuli. They were further sub-phenotyped based on responses to sub-groups of stimuli into word-colour (WC) and music-colour (MC). Development of this instrument has important implications for the diagnosis and phenotyping of visual synaesthesia.

Effects of psychosocial stress on psychophysiological activity during risky decision-making in male adolescents.

Adolescence is characterized by increases in both perceived stress and risk-taking, although the effects of stress on risk-sensitive decision-making have received little attention in adolescent groups. We report psychophysiological data from the healthy control group of a larger project examining neuroendocrine and neuropsychological function in boys with conduct disorder. The present analysis focussed on healthy male adolescents (n = 66) performing a decision-making task that involved selection between two wheel-of-fortune gambles. The task was completed in a neutral state, and again following a psychosocial stress induction that robustly increased salivary cortisol levels and baseline autonomic arousal. Task-related changes in electrodermal activity (EDA) and heart rate (HR) were monitored during the receipt of win and loss outcomes. On gamble choice, stress attenuated the difference in risk taking between the losses-only and wins-only trials (the 'reflection effect') and reduced risk-taking on one further gamble type (i.e. a stress × gamble type interaction). In the neutral condition, EDA and HR deceleration responses were significantly greater for losses compared to wins. This physiological differentiation of losses and wins was reduced under stress, with a significant attenuation of the HR deceleration response. In addition, higher trait impulsivity scores predicted reduced EDA differentiation of the outcomes, and reduced EDA stress reactivity. As a limitation, the order of neutral and stress sessions was not counter-balanced. Reduced psychophysiological discrimination between positive and negative outcomes may contribute to the effects of stress on risky decision-making in adolescents.

Ketamine effects on memory reconsolidation favor a learning model of delusions.

Delusions are the persistent and often bizarre beliefs that characterise psychosis. Previous studies have suggested that their emergence may be explained by disturbances in prediction error-dependent learning. Here we set up complementary studies in order to examine whether such a disturbance also modulates memory reconsolidation and hence explains their remarkable persistence. First, we quantified individual brain responses to prediction error in a causal learning task in 18 human subjects (8 female). Next, a placebo-controlled within-subjects study of the impact of ketamine was set up on the same individuals. We determined the influence of this NMDA receptor antagonist (previously shown to induce aberrant prediction error signal and lead to transient alterations in perception and belief) on the evolution of a fear memory over a 72 hour period: they initially underwent Pavlovian fear conditioning; 24 hours later, during ketamine or placebo administration, the conditioned stimulus (CS) was presented once, without reinforcement; memory strength was then tested again 24 hours later. Re-presentation of the CS under ketamine led to a stronger subsequent memory than under placebo. Moreover, the degree of strengthening correlated with individual vulnerability to ketamine's psychotogenic effects and with prediction error brain signal. This finding was partially replicated in an independent sample with an appetitive learning procedure (in 8 human subjects, 4 female). These results suggest a link between altered prediction error, memory strength and psychosis. They point to a core disruption that may explain not only the emergence of delusional beliefs but also their persistence.

Risk-avoidant decision making increased by threat of electric shock.

Threat cues elicit defensive reactions mediated by limbic brain circuitry that is also implicated in risk-sensitive decision making. Building upon research looking at stress effects on decision making, a gambling task was administered to 65 healthy adults, comparing decision making on trials on which a red screen background signalled threat of shocks against trials when shocks could not occur. The threat cues elicited increased electrodermal activity and a sustained decrease in heart rate, consistent with defensive vigilance. The threat condition was associated with risk-avoidant choices, on trials where the risky option involved moderate losses and when choosing between options involving only losses. These effects were not explained by changes in latency. Threat exerts immediate effects on decision making and physiological arousal, biasing subjects towards safer alternatives, potentially through a magnified processing of loss information.

Decision making and executive function in male adolescents with early-onset or adolescence-onset conduct disorder and control subjects.

BACKGROUND: Although conduct disorder (CD) is associated with an increased susceptibility to substance use disorders, little is known about decision-making processes or reward mechanisms in CD. This study investigated decision making under varying motivational conditions in CD. METHODS: Performances on the Risky Choice Task (RCT) and the Wisconsin Card Sorting Test (WCST) were assessed in 156 adolescents (84 control subjects, 34 with adolescence-onset CD, and 38 with early-onset CD). The RCT was performed twice, once under normal motivational conditions and once under conditions of increased motivation and psychosocial stress. RESULTS: Increased motivation and stress led to more cautious decision making and changes in framing effects on the RCT in all groups, although such effects were least pronounced in the early-onset CD group. Participants from both CD subgroups selected the risky choice more frequently than control subjects. Under normal motivational conditions, early-onset CD participants chose the risky choice more frequently in trials occurring after small gains, relative to control subjects and adolescence-onset CD participants. Following adjustment for IQ differences, the groups did not differ significantly in terms of WCST performance. CONCLUSIONS: Differences in decision making between control subjects and individuals with CD suggest that the balance between sensitivity to reward and punishment is shifted in this disorder, particularly the early-onset form. Our data on modulation of decision making according to previous outcomes suggest altered reward mechanisms in early-onset CD. The WCST data suggest that impairments in global executive function do not underlie altered decision making in CD.

Methylphenidate improves response inhibition but not reflection-impulsivity in children with attention deficit hyperactivity disorder (ADHD).

RATIONALE: Impulsivity is a cardinal feature of attention deficit hyperactivity disorder (ADHD), which is thought to underlie many of the cognitive and behavioural symptoms associated with the disorder. Impairments on some measures of impulsivity have been shown to be responsive to pharmacotherapy. However, impulsivity is a multi-factorial construct and the degree to which different forms of impulsivity contribute to impairments in ADHD or respond to pharmacological treatments remains unclear. OBJECTIVES: The aims of the study were to assess the effects of methylphenidate (MPH) on the performance of children with ADHD on measures of reflection-impulsivity and response inhibition and to compare with the performance of healthy volunteers. METHODS: Twenty-one boys (aged 7-13 years) diagnosed with ADHD underwent a double-blind, placebo-controlled trial of MPH (0.5 mg/kg) during which they performed the Information Sampling Task (IST) and the Stop Signal Task. A healthy age- and education-matched control group was tested on the same measures without medication. RESULTS: Children with ADHD were impaired on measures of response inhibition, but did not demonstrate reflection-impulsivity on the IST. However, despite sampling a similar amount of information as their peers, the ADHD group made more poor decisions. MPH improved performance on measures of response inhibition and variability of response, but did not affect measures of reflection-impulsivity or quality of decision-making. CONCLUSIONS: MPH differentially affected two forms of impulsivity in children with ADHD and failed to ameliorate their poor decision-making on the information sampling test.

Predictors of punding in Parkinson's disease: results from a questionnaire survey.

Dopamine replacement therapy (DRT) for Parkinson's disease (PD) has recently been linked to the development of a number of nonmotor behavioral control problems. Punding, one of these nonmotor problems, is a term used to describe complex, purposeless stereotyped behaviors such as the repetitive handling or sorting of objects. A self-report questionnaire was adapted to assess punding in the context of dysfunctional hobby-related activities. We report the results of a survey of PD outpatients from a PD research clinic (n = 141) and non-PD controls (n = 103); conducted to identify clinical and psychological factors predictive of punding behaviors. The PD group reported hobbies and activities, which scored significantly higher on the Punding Scale than controls. Higher impulsivity, poorer disease-related quality of life, younger age of disease onset, and concomitant daily medication dosage from dopamine receptor agonists were independently predictive of higher Punding Scale scores in the PD group. These findings are similar to those seen in dopamine dysregulation syndrome, and provide further evidence for the role of impulsivity and age at disease onset in DRT-related nonmotor behavioral problems in PD.

Simulations of a modified SOP model applied to retrospective revaluation of human causal learning.

Dickinson and Burke (1996) proposed a modified version of Wagner's (1981) SOP associative theory to explain retrospective revaluation of human causal judgments. In this modified SOP (MSOP), excitatory learning occurs when cue and outcome representations are either both directly activated or both associatively activated. By contrast, inhibitory learning occurs when one representation is directly activated while the other is associatively activated. Finite node simulations of MSOP yielded simple acquisition, overshadowing, blocking, and inhibitory learning under forward contingencies. Importantly, retrospective revaluation was predicted in the form of unovershadowing and backward inhibitory learning. However, MSOP did not yield backward blocking. These predictions are evaluated against the relevant empirical evidence and contrasted with the predictions of other associative theories that have been applied to retrospective revaluation of human causal and predictive learning.

Executive function in Tourette's syndrome and obsessive-compulsive disorder.

BACKGROUND: Cognitive performance was compared in the genetically and neurobiologically related disorders of Tourette's syndrome (TS) and obsessive-compulsive disorder (OCD), in three domains of executive function: planning, decision-making and inhibitory response control. METHOD: Twenty TS patients, twenty OCD patients and a group of age- and IQ-matched normal controls completed psychometric and computerized cognitive tests and psychiatric rating scales. The cognitive tests were well-characterized in terms of their sensitivity to other fronto-striatal disorders, and included pattern and spatial recognition memory, attentional set-shifting, and a Go/No-go set-shifting task, planning, and decision-making. RESULTS: Compared to controls, OCD patients showed selective deficits in pattern recognition memory and slower responding in both pattern and spatial recognition, impaired extra-dimensional shifting on the set-shifting test and impaired reversal of response set on the Go/No-go test. In contrast, TS patients were impaired in spatial recognition memory, extra-dimensional set-shifting, and decision-making. Neither group was impaired in planning. Direct comparisons between the TS and OCD groups revealed significantly different greater deficits for recognition memory latency and Go/No-go reversal for the OCD group, and quality of decision-making for the TS group. CONCLUSIONS: TS and OCD show both differences (recognition memory, decision-making) and similarities (set-shifting) in selective profiles of cognitive function. Specific set-shifting deficits in the OCD group contrasted with their intact performance on other tests of executive function, such as planning and decision-making, and suggested only limited involvement of frontal lobe dysfunction, possibly consistent with OCD symptomatology.

Systemic sulpiride modulates striatal blood flow: relationships to spatial working memory and planning.

The dopamine D2 receptor antagonist sulpiride can produce a range of cognitive deficits in normal volunteers, consistent with those seen in Parkinson's disease (PD). This, together with studies in experimental animals, implies sulpiride might be acting in the striatum. However, subtle changes in prefrontal cortex (PFC) activity are seen following L-Dopa withdrawal in PD during working memory tasks, suggesting that this may be a further site of action for dopamine D2 receptor antagonists. We have investigated the effects of sulpiride within the PFC and striatum in normal male volunteers. In two separate experiments, using identical PET regional cerebral blood flow (rCBF) methods, a combined drug and psychological challenge was performed, utilising working memory and planning tasks, and oral sulpiride 400 mg and placebo. Data were analysed using SPM99. Sulpiride increased striatal rCBF bilaterally and the working memory and planning tasks activated discrete frontoparietal networks in keeping with previous studies. However, for the working memory tasks, no changes in performance or task-induced rCBF were observed after sulpiride. For the planning task, improved performance was seen on sulpiride. Also, sulpiride attenuated striatal activity during planning (as assessed using a small volume correction, P<0.05 corrected), and this attenuation was related to performance changes. These findings suggest that (1) sulpiride produces clear increases in striatal rCBF, (2) in contrast to previous studies no effects of sulpiride on performance of the working memory tasks or the associated neural networks were observed, and (3) sulpiride may modulate performance of more complex cognitive tasks via alterations in striatal neural activity.

The role of the lateral frontal cortex in causal associative learning: exploring preventative and super-learning.

Prediction error--a mismatch between expected and actual outcome--is critical to associative accounts of inferential learning. However, it has proven difficult to explore the effects of prediction error using functional magnetic resonance imaging (fMRI) while excluding the confounding effects of stimulus novelty and incorrect responses. In this event-related fMRI study we used a three-stage experiment generating preventative- and super-learning conditions. In both cases, it was possible to generate prediction error within a causal associative learning experiment while subtracting the effects of novelty and error. We show that right lateral prefrontal cortex (PFC) activation is sensitive to the magnitude of prediction error. Furthermore, super-learning activation in this region of PFC correlates, across subjects, with the amount learned. We thus provide direct evidence for a brain correlate of the surprise-dependent mechanisms proposed by associative accounts of causal learning. We show that activity in right lateral PFC is sensitive to the magnitude, though not the direction, of the prediction error. Furthermore, its activity is not directly explicable in terms of novelty or response errors and appears directly related to the learning that arises out of prediction error.