The Neural Basis of Escape Behavior in Vertebrates.

Escape is one of the most studied animal behaviors, and there is a rich normative theory that links threat properties to evasive actions and their timing. The behavioral principles of escape are evolutionarily conserved and rely on elementary computational steps such as classifying sensory stimuli and executing appropriate movements. These are common building blocks of general adaptive behaviors. Here we consider the computational challenges required for escape behaviors to be implemented, discuss possible algorithmic solutions, and review some of the underlying neural circuits and mechanisms. We outline shared neural principles that can be implemented by evolutionarily ancient neural systems to generate escape behavior, to which cortical encephalization has been added to allow for increased sophistication and flexibility in responding to threat.

The Impact of Emotions on Habitual Inhibition.

Emotional information prioritizes human behavior. How much emotions influence ongoing behavior critically depends on the extent of executive control functions in a given context. One form of executive control is based on stimulus-stop associations (i.e., habitual inhibition) that rapidly and effortlessly elicits control over the interruption of ongoing behavior. So far, no behavioral accounts have explored the emotional impact on habitual inhibition. We aimed to examine the emotional modulation on habitual inhibition and associated psycho-physiological changes. A go/no-go association task asked participants to learn stimulus-stop and stimulus-response associations during 10-day training to form habitual inhibition (without emotional interference). Probabilistic feedback guided learning with varying probabilities of congruent feedback, generating stronger versus weaker pairings. A reversal test measured habitual inhibition strength counteracted by emotional cues (high-arousal positive and negative stimuli compared with neutral ones). Our training protocol induced stable behavioral and psycho-physiological responses compatible with habitual behavior. At reversal, habitual inhibition was evident as marked by significant speed costs of reversed no-go trials for strongly associated stimuli. Positive and negative emotional cues produced larger impact on habitual inhibition. We report first evidence on a cognitive control mechanism that is vulnerable to emotional stimuli and suggest alternative explanations on how emotions may boost or counteract certain behavioral abnormalities mediated by habitual inhibition.

Selective activation of striatal indirect pathway suppresses levodopa induced-dyskinesias.

Levodopa (L-DOPA) administration remains the gold standard therapy for Parkinson's disease (PD). Despite several pharmacological advances in the use of L-DOPA, a high proportion of chronically treated patients continues to suffer disabling involuntary movements, namely, L-DOPA-induced dyskinesias (LIDs). As part of the effort to stop these unwanted side effects, the present study used a rodent model to identify and manipulate the striatal outflow circuitry responsible for LIDs. To do so, optogenetic technology was used to activate separately the striatal direct (D1R- expressing) and indirect (D2R- expressing) pathways in a mouse model of PD. Firstly, D1-cre or A2a-cre animals received unilateral injections of neurotoxin 6-hydroxydopamine (6-OHDA) to simulate the loss of dopamine observed in PD patients. The effects of independently stimulating each pathway were tested to see if experimental dyskinesias could be induced. Secondly, dopamine depleted A2a-cre animals received systemic L-DOPA to evoke dyskinetic movements. The ability of indirect pathway optogenetic stimulation to suppress pre-established LIDs was then tested. Selective manipulation of direct pathway evoked optodyskinesias both in dopamine depleted and intact animals, but optical inhibition of these neurons failed to suppress LIDs. On the other hand, selective activation of indirect striatal projection neurons produced an immediate and reliable suppression of LIDs. Thus, a functional dissociation has been found here whereby activation of D1R- and D2R-expressing projection neurons evokes and inhibits LIDs respectively, supporting the notion of tight interaction between the two striatal efferent systems in both normal and pathological conditions. This points to the importance of maintaining an equilibrium in the activity of both striatal pathways to produce normal movement. Finally, the ability of selective indirect pathway optogenetic activation to block the expression of LIDs in an animal model of PD sheds light on intrinsic mechanisms responsible for striatal-based dyskinesias and identifies a potential therapeutic target for suppressing LIDs in PD patients.

Slowed Luminance Reaction Times in Cervical Dystonia: Disordered Superior Colliculus Processing.

BACKGROUND: Abnormal temporal discrimination in cervical dystonia is hypothesized to be attributable to disrupted processing in the superior colliculus. The fast, luminance-based, retinotectal pathway, projects to the superior colliculus; chromatic stimuli responses, by the retino-geniculo-calcarine pathway, are up to 30 ms longer. OBJECTIVES: We sought to interrogate visual processing and reaction times in patients with cervical dystonia compared with healthy controls. We hypothesized that cervical dystonia patients would have impaired reaction times to luminance based stimuli accessing the retino-tectal pathway in comparison to healthy control participants. METHODS: In 20 cervical dystonia and 20 age-matched control participants, we compared reaction times to two flashing visual stimuli: (1) a chromatic annulus and (2) a luminant, noncolored annulus. Participants pressed a joystick control when they perceived the annulus flashing. RESULTS: Reaction times in control participants were 20 ms significantly faster in the luminant condition than the chromatic (P = 0.017). Patients with cervical dystonia had no reaction time advantage in response to the luminant stimulus. CONCLUSION: Cervical dystonia patients (compared to control participants) demonstrated no reduction in their reaction time to luminant stimuli, processed through the retinotectal pathway. This finding is consistent with superior colliculus dysfunction in cervical dystonia. © 2020 International Parkinson and Movement Disorder Society.

Seizure epicenter depth and translaminar field potential synchrony underlie complex variations in tissue oxygenation during ictal initiation.

Whether functional hyperemia during epileptic activity is adequate to meet the heightened metabolic demand of such events is controversial. Whereas some studies have demonstrated hyperoxia during ictal onsets, other work has reported transient hypoxic episodes that are spatially dependent on local surface microvasculature. Crucially, how laminar differences in ictal evolution can affect subsequent cerebrovascular responses has not been thus far investigated, and is likely significant in view of possible laminar-dependent neurovascular mechanisms and angioarchitecture. We addressed this open question using a novel multi-modal methodology enabling concurrent measurement of cortical tissue oxygenation, blood flow and hemoglobin concentration, alongside laminar recordings of neural activity, in a urethane anesthetized rat model of recurrent seizures induced by 4-aminopyridine. We reveal there to be a close relationship between seizure epicenter depth, translaminar local field potential (LFP) synchrony and tissue oxygenation during the early stages of recurrent seizures, whereby deep layer seizures are associated with decreased cross laminar synchrony and prolonged periods of hypoxia, and middle layer seizures are accompanied by increased cross-laminar synchrony and hyperoxia. Through comparison with functional activation by somatosensory stimulation and graded hypercapnia, we show that these seizure-related cerebrovascular responses occur in the presence of conserved neural-hemodynamic and blood flow-volume coupling. Our data provide new insights into the laminar dependency of seizure-related neurovascular responses, which may reconcile inconsistent observations of seizure-related hypoxia in the literature, and highlight a potential layer-dependent vulnerability that may contribute to the harmful effects of clinical recurrent seizures. The relevance of our findings to perfusion-related functional neuroimaging techniques in epilepsy are also discussed.

A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface.

Operant learning requires that reinforcement signals interact with action representations at a suitable neural interface. Much evidence suggests that this occurs when phasic dopamine, acting as a reinforcement prediction error, gates plasticity at cortico-striatal synapses, and thereby changes the future likelihood of selecting the action(s) coded by striatal neurons. But this hypothesis faces serious challenges. First, cortico-striatal plasticity is inexplicably complex, depending on spike timing, dopamine level, and dopamine receptor type. Second, there is a credit assignment problem-action selection signals occur long before the consequent dopamine reinforcement signal. Third, the two types of striatal output neuron have apparently opposite effects on action selection. Whether these factors rule out the interface hypothesis and how they interact to produce reinforcement learning is unknown. We present a computational framework that addresses these challenges. We first predict the expected activity changes over an operant task for both types of action-coding striatal neuron, and show they co-operate to promote action selection in learning and compete to promote action suppression in extinction. Separately, we derive a complete model of dopamine and spike-timing dependent cortico-striatal plasticity from in vitro data. We then show this model produces the predicted activity changes necessary for learning and extinction in an operant task, a remarkable convergence of a bottom-up data-driven plasticity model with the top-down behavioural requirements of learning theory. Moreover, we show the complex dependencies of cortico-striatal plasticity are not only sufficient but necessary for learning and extinction. Validating the model, we show it can account for behavioural data describing extinction, renewal, and reacquisition, and replicate in vitro experimental data on cortico-striatal plasticity. By bridging the levels between the single synapse and behaviour, our model shows how striatum acts as the action-reinforcement interface.

Long-latency reductions in gamma power predict hemodynamic changes that underlie the negative BOLD signal.

Studies that use prolonged periods of sensory stimulation report associations between regional reductions in neural activity and negative blood oxygenation level-dependent (BOLD) signaling. However, the neural generators of the negative BOLD response remain to be characterized. Here, we use single-impulse electrical stimulation of the whisker pad in the anesthetized rat to identify components of the neural response that are related to "negative" hemodynamic changes in the brain. Laminar multiunit activity and local field potential recordings of neural activity were performed concurrently with two-dimensional optical imaging spectroscopy measuring hemodynamic changes. Repeated measurements over multiple stimulation trials revealed significant variations in neural responses across session and animal datasets. Within this variation, we found robust long-latency decreases (300 and 2000 ms after stimulus presentation) in gamma-band power (30-80 Hz) in the middle-superficial cortical layers in regions surrounding the activated whisker barrel cortex. This reduction in gamma frequency activity was associated with corresponding decreases in the hemodynamic responses that drive the negative BOLD signal. These findings suggest a close relationship between BOLD responses and neural events that operate over time scales that outlast the initiating sensory stimulus, and provide important insights into the neurophysiological basis of negative neuroimaging signals.

Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease.

Progressive loss of the ascending dopaminergic projection in the basal ganglia is a fundamental pathological feature of Parkinson's disease. Studies in animals and humans have identified spatially segregated functional territories in the basal ganglia for the control of goal-directed and habitual actions. In patients with Parkinson's disease the loss of dopamine is predominantly in the posterior putamen, a region of the basal ganglia associated with the control of habitual behaviour. These patients may therefore be forced into a progressive reliance on the goal-directed mode of action control that is mediated by comparatively preserved processing in the rostromedial striatum. Thus, many of their behavioural difficulties may reflect a loss of normal automatic control owing to distorting output signals from habitual control circuits, which impede the expression of goal-directed action.

Simulated Dopamine Modulation of a Neurorobotic Model of the Basal Ganglia.

The vertebrate basal ganglia play an important role in action selection-the resolution of conflicts between alternative motor programs. The effective operation of basal ganglia circuitry is also known to rely on appropriate levels of the neurotransmitter dopamine. We investigated reducing or increasing the tonic level of simulated dopamine in a prior model of the basal ganglia integrated into a robot control architecture engaged in a foraging task inspired by animal behaviour. The main findings were that progressive reductions in the levels of simulated dopamine caused slowed behaviour and, at low levels, an inability to initiate movement. These states were partially relieved by increased salience levels (stronger sensory/motivational input). Conversely, increased simulated dopamine caused distortion of the robot's motor acts through partially expressed motor activity relating to losing actions. This could also lead to an increased frequency of behaviour switching. Levels of simulated dopamine that were either significantly lower or higher than baseline could cause a loss of behavioural integration, sometimes leaving the robot in a 'behavioral trap'. That some analogous traits are observed in animals and humans affected by dopamine dysregulation suggests that robotic models could prove useful in understanding the role of dopamine neurotransmission in basal ganglia function and dysfunction.

Sensory Reinforced Corticostriatal Plasticity.

BACKGROUND: Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions. OBJECTIVE: While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity. METHODS: We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation. RESULTS: We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission. CONCLUSION: This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Thalamic contributions to Basal Ganglia-related behavioral switching and reinforcement.

Although the existence of prominent connections between the intralaminar thalamic nuclei and the basal ganglia has long been established, the limited knowledge of the functional relevance of this network has considerably hampered progress in our understanding of the neural mechanisms by which the thalamostriatal system integrates and regulates the basal ganglia circuitry. In this brief commentary, we will address this gap of knowledge through a discussion of the key points of a symposium entitled "Thalamic Contributions to Basal Ganglia-Related Behavioral Switching and Reinforcement" that will be presented at the 2011 Society for Neuroscience meeting. Recent anatomical and physiological data that support the role of the thalamostriatal system in action selection, attentional shifting, and reinforcement will be discussed. We will also address the possibility that degeneration of the thalamostriatal system could underlie some of the deficits in redirection of attention in response to salient stimuli seen in Parkinson's disease.

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits.

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Negative blood oxygen level dependence in the rat: a model for investigating the role of suppression in neurovascular coupling.

Modern neuroimaging techniques rely on neurovascular coupling to show regions of increased brain activation. However, little is known of the neurovascular coupling relationships that exist for inhibitory signals. To address this issue directly we developed a preparation to investigate the signal sources of one of these proposed inhibitory neurovascular signals, the negative blood oxygen level-dependent (BOLD) response (NBR), in rat somatosensory cortex. We found a reliable NBR measured in rat somatosensory cortex in response to unilateral electrical whisker stimulation, which was located in deeper cortical layers relative to the positive BOLD response. Separate optical measurements (two-dimensional optical imaging spectroscopy and laser Doppler flowmetry) revealed that the NBR was a result of decreased blood volume and flow and increased levels of deoxyhemoglobin. Neural activity in the NBR region, measured by multichannel electrodes, varied considerably as a function of cortical depth. There was a decrease in neuronal activity in deep cortical laminae. After cessation of whisker stimulation there was a large increase in neural activity above baseline. Both the decrease in neuronal activity and increase above baseline after stimulation cessation correlated well with the simultaneous measurement of blood flow suggesting that the NBR is related to decreases in neural activity in deep cortical layers. Interestingly, the magnitude of the neural decrease was largest in regions showing stimulus-evoked positive BOLD responses. Since a similar type of neural suppression in surround regions was associated with a negative BOLD signal, the increased levels of suppression in positive BOLD regions could importantly moderate the size of the observed BOLD response.

Visual instrumental learning in blindsight monkeys.

Blindsight is the residual visuo-motor ability without subjective awareness observed after lesions of the primary visual cortex (V1). Various visual functions are retained, however, instrumental visual associative learning remains to be investigated. Here we examined the secondary reinforcing properties of visual cues presented to the hemianopic field of macaque monkeys with unilateral V1 lesions. Our aim was to test the potential role of visual pathways bypassing V1 in reinforcing visual instrumental learning. When learning the location of a hidden area in an oculomotor search task, conditioned visual cues presented to the lesion-affected hemifield operated as an effective secondary reinforcer. We noted that not only the hidden area location, but also the vector of the saccade entering the target area was reinforced. Importantly, when the visual reinforcement signal was presented in the lesion-affected field, the monkeys continued searching, as opposed to stopping when the cue was presented in the intact field. This suggests the monkeys were less confident that the target location had been discovered when the reinforcement cue was presented in the affected field. These results indicate that the visual signals mediated by the residual visual pathways after V1 lesions can access fundamental reinforcement mechanisms but with impaired visual awareness.

Neuropsychological spectrum in early PD: Insights from controlled and automatic behavioural regulation.

Initial changes in Parkinson's disease (PD) are marked by loss of automatic movements and decline of some cognitive functions. Yet, the exact profile and extent of cognitive impairments in early stages of PD as well as their mechanisms related to automatic motor dysfunction remain unclear. Our objective was to examine the neuropsychological changes in early PD and their association to automatic and controlled modes of behavioural control. Significant relationships between early PD and cognitive dysfunction in set-shifting, abstraction ability/concept formation, processing speed, visuospatial/constructional abilities and verbal-visual memory was found. We also noted that tests with a strong effortful and controlled component were similarly affected as automatic tests by early PD, particularly those testing verbal memory, processing speed and visuospatial/constructional functions. Our findings indicate that initial stages of PD sets constraints over most of the cognitive domains normally assessed and are not easily explained in terms of either automatic or controlled mechanisms, as both appear similarly altered in early PD.

Short-latency visual input to the subthalamic nucleus is provided by the midbrain superior colliculus.

The subthalamic nucleus (STN) is one of the principal input nuclei of the basal ganglia. Using electrophysiological techniques in anesthetized rats, we show that the STN becomes responsive to visual stimuli at short latencies when local disinhibitory injections are made into the midbrain superior colliculus (SC), an important subcortical visual structure. Significantly, only injections into the lateral, but not medial, deep layers of the SC were effective. Corresponding disinhibition of primary visual cortex also was ineffective. Complementary anatomical analyses revealed a strong, regionally specific projection from the deep layers of the lateral SC to neurons in rostral and dorsal sectors of the STN. Given the retinocentric organization of the SC, these results suggest that lower-field stimuli represented in the lateral colliculus have a direct means of communicating with the basal ganglia via the STN that is not afforded to visual events occurring in the upper visual field.

Short-latency activation of striatal spiny neurons via subcortical visual pathways.

The striatum is a site of integration of neural pathways involved in reinforcement learning. Traditionally, inputs from cerebral cortex are thought to be reinforced by dopaminergic afferents signaling the occurrence of biologically salient sensory events. Here, we detail an alternative route for short-latency sensory-evoked input to the striatum requiring neither dopamine nor the cortex. Using intracellular recording techniques, we measured subthreshold inputs to spiny projection neurons (SPNs) in urethane-anesthetized rats. Contralateral whole-field light flashes evoked weak membrane potential responses in approximately two-thirds of neurons. However, after local disinhibitory injections of the GABA(A) antagonist bicuculline into the deep layers of the superior colliculus (SC), but not the overlying visual cortex, strong, light-evoked, depolarizations to the up state emerged at short latency (115 +/- 14 ms) in all neurons tested. Dopamine depletion using alpha-methyl-para-tyrosine had no detectable effect on striatal visual responses during SC disinhibition. In contrast, local inhibitory injections of GABA agonists, muscimol and baclofen, into the parafascicular nucleus of the thalamus blocked the early, visual-evoked up-state transitions in SPNs. Comparable muscimol-induced inhibition of the visual cortex failed to suppress the visual responsiveness of SPNs induced by SC disinhibition. Together, these results suggest that short-latency, preattentive visual input can reach the striatum not only via the tecto-nigro-striatal route but also through tecto-thalamo-striatal projections. Thus, after the onset of a biologically significant visual event, closely timed short-latency thalamostriatal (glutamate) and nigrostriatal (dopamine) inputs are likely to converge on striatal SPNs, providing depolarizing and neuromodulator signals necessary for synaptic plasticity mechanisms.

Dissecting the Tectal Output Channels for Orienting and Defense Responses.

Electrical stimulation and lesion experiments in 1980's suggested that the crossed descending pathway from the deeper layers of superior colliculus (SCd) controls orienting responses, while the uncrossed pathway mediates defense-like behavior. To overcome the limitation of these classical studies and explicitly dissect the structure and function of these two pathways, we performed selective optogenetic activation of each pathway in male mice with channelrhodopsin 2 (ChR2) expression by Cre driver using double viral vector techniques. Brief photostimulation of the crossed pathway evoked short latency contraversive orienting-like head turns, while extended stimulation induced body turn responses. In contrast, stimulation of the uncrossed pathway induced short-latency upward head movements followed by longer-latency defense-like behaviors including retreat and flight. The novel discovery was that while the evoked orienting responses were stereotyped, the defense-like responses varied considerably depending on the environment, suggesting that uncrossed output can be influenced by top-down modification of the SC or its target areas. This further suggests that the connection of the SCd-defense system with non-motor, affective and cognitive structures. Tracing the whole axonal trajectories of these two pathways revealed existence of both ascending and descending branches targeting different areas in the thalamus, midbrain, pons, medulla, and/or spinal cord, including projections which could not be detected in the classical studies; the crossed pathway has some ipsilaterally descending collaterals and the uncrossed pathway has some contralaterally descending collaterals. Some of the connections might explain the context-dependent modulation of the defense-like responses. Thus, the classical views on the tectal output systems are updated.

Neurovascular coupling preserved in a chronic mouse model of Alzheimer's disease: Methodology is critical.

Impaired neurovascular coupling has been suggested as an early pathogenic factor in Alzheimer's disease (AD), which could serve as an early biomarker of cerebral pathology. We have established an anaesthetic regime to allow repeated measurements of neurovascular function over three months in the J20 mouse model of AD (J20-AD) and wild-type (WT) controls. Animals were 9-12 months old at the start of the experiment. Mice were chronically prepared with a cranial window through which 2-Dimensional optical imaging spectroscopy (2D-OIS) was used to generate functional maps of the cerebral blood volume and saturation changes evoked by whisker stimulation and vascular reactivity challenges. Unexpectedly, the hemodynamic responses were largely preserved in the J20-AD group. This result failed to confirm previous investigations using the J20-AD model. However, a final acute electrophysiology and 2D-OIS experiment was performed to measure both neural and hemodynamic responses concurrently. In this experiment, previously reported deficits in neurovascular coupling in the J20-AD model were observed. This suggests that J20-AD mice may be more susceptible to the physiologically stressing conditions of an acute experimental procedure compared to WT animals. These results therefore highlight the importance of experimental procedure when determining the characteristics of animal models of human disease.