Simulated Dopamine Modulation of a Neurorobotic Model of the Basal Ganglia.

The vertebrate basal ganglia play an important role in action selection-the resolution of conflicts between alternative motor programs. The effective operation of basal ganglia circuitry is also known to rely on appropriate levels of the neurotransmitter dopamine. We investigated reducing or increasing the tonic level of simulated dopamine in a prior model of the basal ganglia integrated into a robot control architecture engaged in a foraging task inspired by animal behaviour. The main findings were that progressive reductions in the levels of simulated dopamine caused slowed behaviour and, at low levels, an inability to initiate movement. These states were partially relieved by increased salience levels (stronger sensory/motivational input). Conversely, increased simulated dopamine caused distortion of the robot's motor acts through partially expressed motor activity relating to losing actions. This could also lead to an increased frequency of behaviour switching. Levels of simulated dopamine that were either significantly lower or higher than baseline could cause a loss of behavioural integration, sometimes leaving the robot in a 'behavioral trap'. That some analogous traits are observed in animals and humans affected by dopamine dysregulation suggests that robotic models could prove useful in understanding the role of dopamine neurotransmission in basal ganglia function and dysfunction.

The Impact of Emotions on Habitual Inhibition.

Emotional information prioritizes human behavior. How much emotions influence ongoing behavior critically depends on the extent of executive control functions in a given context. One form of executive control is based on stimulus-stop associations (i.e., habitual inhibition) that rapidly and effortlessly elicits control over the interruption of ongoing behavior. So far, no behavioral accounts have explored the emotional impact on habitual inhibition. We aimed to examine the emotional modulation on habitual inhibition and associated psycho-physiological changes. A go/no-go association task asked participants to learn stimulus-stop and stimulus-response associations during 10-day training to form habitual inhibition (without emotional interference). Probabilistic feedback guided learning with varying probabilities of congruent feedback, generating stronger versus weaker pairings. A reversal test measured habitual inhibition strength counteracted by emotional cues (high-arousal positive and negative stimuli compared with neutral ones). Our training protocol induced stable behavioral and psycho-physiological responses compatible with habitual behavior. At reversal, habitual inhibition was evident as marked by significant speed costs of reversed no-go trials for strongly associated stimuli. Positive and negative emotional cues produced larger impact on habitual inhibition. We report first evidence on a cognitive control mechanism that is vulnerable to emotional stimuli and suggest alternative explanations on how emotions may boost or counteract certain behavioral abnormalities mediated by habitual inhibition.

Sensory Reinforced Corticostriatal Plasticity.

BACKGROUND: Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions. OBJECTIVE: While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity. METHODS: We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation. RESULTS: We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission. CONCLUSION: This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Selective activation of striatal indirect pathway suppresses levodopa induced-dyskinesias.

Levodopa (L-DOPA) administration remains the gold standard therapy for Parkinson's disease (PD). Despite several pharmacological advances in the use of L-DOPA, a high proportion of chronically treated patients continues to suffer disabling involuntary movements, namely, L-DOPA-induced dyskinesias (LIDs). As part of the effort to stop these unwanted side effects, the present study used a rodent model to identify and manipulate the striatal outflow circuitry responsible for LIDs. To do so, optogenetic technology was used to activate separately the striatal direct (D1R- expressing) and indirect (D2R- expressing) pathways in a mouse model of PD. Firstly, D1-cre or A2a-cre animals received unilateral injections of neurotoxin 6-hydroxydopamine (6-OHDA) to simulate the loss of dopamine observed in PD patients. The effects of independently stimulating each pathway were tested to see if experimental dyskinesias could be induced. Secondly, dopamine depleted A2a-cre animals received systemic L-DOPA to evoke dyskinetic movements. The ability of indirect pathway optogenetic stimulation to suppress pre-established LIDs was then tested. Selective manipulation of direct pathway evoked optodyskinesias both in dopamine depleted and intact animals, but optical inhibition of these neurons failed to suppress LIDs. On the other hand, selective activation of indirect striatal projection neurons produced an immediate and reliable suppression of LIDs. Thus, a functional dissociation has been found here whereby activation of D1R- and D2R-expressing projection neurons evokes and inhibits LIDs respectively, supporting the notion of tight interaction between the two striatal efferent systems in both normal and pathological conditions. This points to the importance of maintaining an equilibrium in the activity of both striatal pathways to produce normal movement. Finally, the ability of selective indirect pathway optogenetic activation to block the expression of LIDs in an animal model of PD sheds light on intrinsic mechanisms responsible for striatal-based dyskinesias and identifies a potential therapeutic target for suppressing LIDs in PD patients.

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits.

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Visual instrumental learning in blindsight monkeys.

Blindsight is the residual visuo-motor ability without subjective awareness observed after lesions of the primary visual cortex (V1). Various visual functions are retained, however, instrumental visual associative learning remains to be investigated. Here we examined the secondary reinforcing properties of visual cues presented to the hemianopic field of macaque monkeys with unilateral V1 lesions. Our aim was to test the potential role of visual pathways bypassing V1 in reinforcing visual instrumental learning. When learning the location of a hidden area in an oculomotor search task, conditioned visual cues presented to the lesion-affected hemifield operated as an effective secondary reinforcer. We noted that not only the hidden area location, but also the vector of the saccade entering the target area was reinforced. Importantly, when the visual reinforcement signal was presented in the lesion-affected field, the monkeys continued searching, as opposed to stopping when the cue was presented in the intact field. This suggests the monkeys were less confident that the target location had been discovered when the reinforcement cue was presented in the affected field. These results indicate that the visual signals mediated by the residual visual pathways after V1 lesions can access fundamental reinforcement mechanisms but with impaired visual awareness.

Neuropsychological spectrum in early PD: Insights from controlled and automatic behavioural regulation.

Initial changes in Parkinson's disease (PD) are marked by loss of automatic movements and decline of some cognitive functions. Yet, the exact profile and extent of cognitive impairments in early stages of PD as well as their mechanisms related to automatic motor dysfunction remain unclear. Our objective was to examine the neuropsychological changes in early PD and their association to automatic and controlled modes of behavioural control. Significant relationships between early PD and cognitive dysfunction in set-shifting, abstraction ability/concept formation, processing speed, visuospatial/constructional abilities and verbal-visual memory was found. We also noted that tests with a strong effortful and controlled component were similarly affected as automatic tests by early PD, particularly those testing verbal memory, processing speed and visuospatial/constructional functions. Our findings indicate that initial stages of PD sets constraints over most of the cognitive domains normally assessed and are not easily explained in terms of either automatic or controlled mechanisms, as both appear similarly altered in early PD.

Dissecting the Tectal Output Channels for Orienting and Defense Responses.

Electrical stimulation and lesion experiments in 1980's suggested that the crossed descending pathway from the deeper layers of superior colliculus (SCd) controls orienting responses, while the uncrossed pathway mediates defense-like behavior. To overcome the limitation of these classical studies and explicitly dissect the structure and function of these two pathways, we performed selective optogenetic activation of each pathway in male mice with channelrhodopsin 2 (ChR2) expression by Cre driver using double viral vector techniques. Brief photostimulation of the crossed pathway evoked short latency contraversive orienting-like head turns, while extended stimulation induced body turn responses. In contrast, stimulation of the uncrossed pathway induced short-latency upward head movements followed by longer-latency defense-like behaviors including retreat and flight. The novel discovery was that while the evoked orienting responses were stereotyped, the defense-like responses varied considerably depending on the environment, suggesting that uncrossed output can be influenced by top-down modification of the SC or its target areas. This further suggests that the connection of the SCd-defense system with non-motor, affective and cognitive structures. Tracing the whole axonal trajectories of these two pathways revealed existence of both ascending and descending branches targeting different areas in the thalamus, midbrain, pons, medulla, and/or spinal cord, including projections which could not be detected in the classical studies; the crossed pathway has some ipsilaterally descending collaterals and the uncrossed pathway has some contralaterally descending collaterals. Some of the connections might explain the context-dependent modulation of the defense-like responses. Thus, the classical views on the tectal output systems are updated.

The Neural Basis of Escape Behavior in Vertebrates.

Escape is one of the most studied animal behaviors, and there is a rich normative theory that links threat properties to evasive actions and their timing. The behavioral principles of escape are evolutionarily conserved and rely on elementary computational steps such as classifying sensory stimuli and executing appropriate movements. These are common building blocks of general adaptive behaviors. Here we consider the computational challenges required for escape behaviors to be implemented, discuss possible algorithmic solutions, and review some of the underlying neural circuits and mechanisms. We outline shared neural principles that can be implemented by evolutionarily ancient neural systems to generate escape behavior, to which cortical encephalization has been added to allow for increased sophistication and flexibility in responding to threat.

Slowed Luminance Reaction Times in Cervical Dystonia: Disordered Superior Colliculus Processing.

BACKGROUND: Abnormal temporal discrimination in cervical dystonia is hypothesized to be attributable to disrupted processing in the superior colliculus. The fast, luminance-based, retinotectal pathway, projects to the superior colliculus; chromatic stimuli responses, by the retino-geniculo-calcarine pathway, are up to 30 ms longer. OBJECTIVES: We sought to interrogate visual processing and reaction times in patients with cervical dystonia compared with healthy controls. We hypothesized that cervical dystonia patients would have impaired reaction times to luminance based stimuli accessing the retino-tectal pathway in comparison to healthy control participants. METHODS: In 20 cervical dystonia and 20 age-matched control participants, we compared reaction times to two flashing visual stimuli: (1) a chromatic annulus and (2) a luminant, noncolored annulus. Participants pressed a joystick control when they perceived the annulus flashing. RESULTS: Reaction times in control participants were 20 ms significantly faster in the luminant condition than the chromatic (P = 0.017). Patients with cervical dystonia had no reaction time advantage in response to the luminant stimulus. CONCLUSION: Cervical dystonia patients (compared to control participants) demonstrated no reduction in their reaction time to luminant stimuli, processed through the retinotectal pathway. This finding is consistent with superior colliculus dysfunction in cervical dystonia. © 2020 International Parkinson and Movement Disorder Society.

Neurovascular coupling preserved in a chronic mouse model of Alzheimer's disease: Methodology is critical.

Impaired neurovascular coupling has been suggested as an early pathogenic factor in Alzheimer's disease (AD), which could serve as an early biomarker of cerebral pathology. We have established an anaesthetic regime to allow repeated measurements of neurovascular function over three months in the J20 mouse model of AD (J20-AD) and wild-type (WT) controls. Animals were 9-12 months old at the start of the experiment. Mice were chronically prepared with a cranial window through which 2-Dimensional optical imaging spectroscopy (2D-OIS) was used to generate functional maps of the cerebral blood volume and saturation changes evoked by whisker stimulation and vascular reactivity challenges. Unexpectedly, the hemodynamic responses were largely preserved in the J20-AD group. This result failed to confirm previous investigations using the J20-AD model. However, a final acute electrophysiology and 2D-OIS experiment was performed to measure both neural and hemodynamic responses concurrently. In this experiment, previously reported deficits in neurovascular coupling in the J20-AD model were observed. This suggests that J20-AD mice may be more susceptible to the physiologically stressing conditions of an acute experimental procedure compared to WT animals. These results therefore highlight the importance of experimental procedure when determining the characteristics of animal models of human disease.

Dopaminergic Vulnerability in Parkinson Disease: The Cost of Humans' Habitual Performance.

Humans can simultaneously combine automatic/habitual and voluntary/goal-directed aspects of behavioral control. Habitual routines permit us to perform well practiced task-components with minimal or no voluntary attention. Evidence from animal and human investigations indicates that dopaminergic neurons in lateral substantia nigra, which innervate the sensorimotor striatum, are engaged during the acquisition and performance of automatized skills and habits. Typically, in Parkinson disease (PD), there is a differential loss of dopamine, which occurs earliest and most severely in the caudal sensorimotor striatum, a subdivision of the striatum implicated in habitual control. We suggest that frequent reliance on habitual performance may be a critical functional stressor, which, when combined with other more general risk factors, could explain the selective neurodegeneration of the nigrostriatal motor projection in PD.

Reduced habit-driven errors in Parkinson's Disease.

Parkinson's Disease can be understood as a disorder of motor habits. A prediction of this theory is that early stage Parkinson's patients will display fewer errors caused by interference from previously over-learned behaviours. We test this prediction in the domain of skilled typing, where actions are easy to record and errors easy to identify. We describe a method for categorizing errors as simple motor errors or habit-driven errors. We test Spanish and English participants with and without Parkinson's, and show that indeed patients make fewer habit errors than healthy controls, and, further, that classification of error type increases the accuracy of discriminating between patients and healthy controls. As well as being a validation of a theory-led prediction, these results offer promise for automated, enhanced and early diagnosis of Parkinson's Disease.

Cortical visual processing evokes short-latency reward-predicting cue responses in primate midbrain dopamine neurons.

After classical conditioning dopamine (DA) neurons exhibit short latency responses to reward-predicting visual cues. At least two possible projections could induce such DA responses; the cortical and subcortical visual pathways. Our recent study has shown that after a lesion of the striate cortex (V1), the superior colliculus (SC), a critical node of the subcortical visual pathway, can mediate short latency cue responses in the DA neurons of macaque monkeys. An obvious question then is does the cortical pathway have a similar capacity? Using the monkeys with a unilateral V1 lesion that took part in the preceding study, we recorded DA activity while they were performing the same classical conditioning task. However, in this study conditioned visual stimuli were presented to the intact visual field, and the effects of ipsilateral SC inactivation were examined. We found that after the SC was inactivated by injections of muscimol both conditioned behavioral responding and reward-predicting, short latency (~100 ms) cue-elicited DA neuronal responses were unaffected These results indicate that the intact cortical visual pathway can also mediate short latency cue elicited responses in DA neurons in the absence of a normally functioning subcortical visual system.

Physiological and Pathological Brain Activation in the Anesthetized Rat Produces Hemodynamic-Dependent Cortical Temperature Increases That Can Confound the BOLD fMRI Signal.

Anesthetized rodent models are ubiquitous in pre-clinical neuroimaging studies. However, because the associated cerebral morphology and experimental methodology results in a profound negative brain-core temperature differential, cerebral temperature changes during functional activation are likely to be principally driven by local inflow of fresh, core-temperature, blood. This presents a confound to the interpretation of blood-oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) data acquired from such models, since this signal is also critically temperature-dependent. Nevertheless, previous investigation on the subject is surprisingly sparse. Here, we address this issue through use of a novel multi-modal methodology in the urethane anesthetized rat. We reveal that sensory stimulation, hypercapnia and recurrent acute seizures induce significant increases in cortical temperature that are preferentially correlated to changes in total hemoglobin concentration (Hbt), relative to cerebral blood flow and oxidative metabolism. Furthermore, using a phantom-based evaluation of the effect of such temperature changes on the BOLD fMRI signal, we demonstrate a robust inverse relationship between both variables. These findings suggest that temperature increases, due to functional hyperemia, should be accounted for to ensure accurate interpretation of BOLD fMRI signals in pre-clinical neuroimaging studies.

Activation of the subthalamic nucleus suppressed by high frequency stimulation: A c-Fos immunohistochemical study.

Deep brain stimulation applied at high frequency (HFS) to the subthalamic nucleus (STN) is used to ameliorate the symptoms of Parkinson's disease. The mechanism by which this is achieved remains controversial. In particular, it is uncertain whether HFS has a suppressive or excitatory action locally within the STN. Brief exposure of rats to ether anesthesia evokes pathological burst firing and associated expression of the immediate early gene c-Fos in STN neurons. We used this ether model of STN activation to test the effect of a range of HFS parameters on c-Fos expression evoked by the anesthetic. The elevated baseline of c-Fos expression afforded the possibility of detecting further excitatory, or suppressive effects of STN HFS. Four HFS protocols were examined; 130, 200 and 260 Hz with 60 µs, and 130 Hz with 90 µs pulse width (HFS intensity:150-300 µA). All HFS protocols were applied for 20 min while the animals were exposed to ether. Ether-evoked expression of c-Fos immunoreactivity was suppressed by HFS at 200 and 260 Hz with a pulse width of 60 µs, and by 130 Hz when the pulse width was increased to 90 µs. HFS at 130 Hz with the 60 µs pulse width had no significant effect and HFS alone caused negligible c-Fos expression in the STN. These findings suggest that HFS of the STN causes significant suppression of evoked neuronal activity. It remains to be determined whether this locally suppressive property of HFS is associated with the efficacy of STN deep brain stimulation to relieve the symptoms of Parkinson's disease.

Seizure epicenter depth and translaminar field potential synchrony underlie complex variations in tissue oxygenation during ictal initiation.

Whether functional hyperemia during epileptic activity is adequate to meet the heightened metabolic demand of such events is controversial. Whereas some studies have demonstrated hyperoxia during ictal onsets, other work has reported transient hypoxic episodes that are spatially dependent on local surface microvasculature. Crucially, how laminar differences in ictal evolution can affect subsequent cerebrovascular responses has not been thus far investigated, and is likely significant in view of possible laminar-dependent neurovascular mechanisms and angioarchitecture. We addressed this open question using a novel multi-modal methodology enabling concurrent measurement of cortical tissue oxygenation, blood flow and hemoglobin concentration, alongside laminar recordings of neural activity, in a urethane anesthetized rat model of recurrent seizures induced by 4-aminopyridine. We reveal there to be a close relationship between seizure epicenter depth, translaminar local field potential (LFP) synchrony and tissue oxygenation during the early stages of recurrent seizures, whereby deep layer seizures are associated with decreased cross laminar synchrony and prolonged periods of hypoxia, and middle layer seizures are accompanied by increased cross-laminar synchrony and hyperoxia. Through comparison with functional activation by somatosensory stimulation and graded hypercapnia, we show that these seizure-related cerebrovascular responses occur in the presence of conserved neural-hemodynamic and blood flow-volume coupling. Our data provide new insights into the laminar dependency of seizure-related neurovascular responses, which may reconcile inconsistent observations of seizure-related hypoxia in the literature, and highlight a potential layer-dependent vulnerability that may contribute to the harmful effects of clinical recurrent seizures. The relevance of our findings to perfusion-related functional neuroimaging techniques in epilepsy are also discussed.

Reinforcement determines the timing dependence of corticostriatal synaptic plasticity in vivo.

Plasticity at synapses between the cortex and striatum is considered critical for learning novel actions. However, investigations of spike-timing-dependent plasticity (STDP) at these synapses have been performed largely in brain slice preparations, without consideration of physiological reinforcement signals. This has led to conflicting findings, and hampered the ability to relate neural plasticity to behavior. Using intracellular striatal recordings in intact rats, we show here that pairing presynaptic and postsynaptic activity induces robust Hebbian bidirectional plasticity, dependent on dopamine and adenosine signaling. Such plasticity, however, requires the arrival of a reward-conditioned sensory reinforcement signal within 2 s of the STDP pairing, thus revealing a timing-dependent eligibility trace on which reinforcement operates. These observations are validated with both computational modeling and behavioral testing. Our results indicate that Hebbian corticostriatal plasticity can be induced by classical reinforcement learning mechanisms, and might be central to the acquisition of novel actions.Spike timing dependent plasticity (STDP) has been studied extensively in slices but whether such pairings can induce plasticity in vivo is not known. Here the authors report an experimental paradigm that achieves bidirectional corticostriatal STDP in vivo through modulation by behaviourally relevant reinforcement signals, mediated by dopamine and adenosine signaling.

Emergence of visually-evoked reward expectation signals in dopamine neurons via the superior colliculus in V1 lesioned monkeys.

Responses of midbrain dopamine (DA) neurons reflecting expected reward from sensory cues are critical for reward-based associative learning. However, critical pathways by which reward-related visual information is relayed to DA neurons remain unclear. To address this question, we investigated Pavlovian conditioning in macaque monkeys with unilateral primary visual cortex (V1) lesions (an animal model of 'blindsight'). Anticipatory licking responses to obtain juice drops were elicited in response to visual conditioned stimuli (CS) in the affected visual field. Subsequent pharmacological inactivation of the superior colliculus (SC) suppressed the anticipatory licking. Concurrent single unit recordings indicated that DA responses reflecting the reward expectation could be recorded in the absence of V1, and that these responses were also suppressed by SC inactivation. These results indicate that the subcortical visual circuit can relay reward-predicting visual information to DA neurons and integrity of the SC is necessary for visually-elicited classically conditioned responses after V1 lesion.