Sensory Reinforced Corticostriatal Plasticity.

BACKGROUND: Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions. OBJECTIVE: While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity. METHODS: We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation. RESULTS: We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission. CONCLUSION: This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Throwing open the doors of perception: The role of dopamine in visual processing.

Animals form associations between visual cues and behaviours. Although dopamine is known to be critical in many areas of the brain to bind sensory information with appropriate responses, dopamine's role in the visual system is less well understood. Visual signals, which indicate the likely occurrence of a rewarding or aversive stimulus or indicate the context within which such stimuli may arrive, modulate activity in the superior colliculus and alter behaviour. However, such signals primarily originate in cortical and basal ganglia circuits, and evidence of direct signalling from midbrain dopamine neurons to superior colliculus is lacking. Instead, hypothalamic A13 dopamine neurons innervate the superior colliculus, and dopamine receptors are differentially expressed in the superior colliculus, with D1 receptors in superficial layers and D2 receptors in deep layers. However, it remains unknown if A13 dopamine neurons control behaviours through their effect on afferents within the superior colliculus. We propose that A13 dopamine neurons may play a critical role in processing information in the superior colliculus, modifying behavioural responses to visual cues, and propose some testable hypotheses regarding dopamine's effect on visual perception.

The neurogenesis of P1 and N1: A concurrent EEG/LFP study.

It is generally recognised that event related potentials (ERPs) of electroencephalogram (EEG) primarily reflect summed post-synaptic activity of the local pyramidal neural population(s). However, it is still not understood how the positive and negative deflections (e.g. P1, N1 etc) observed in ERP recordings are related to the underlying excitatory and inhibitory post-synaptic activity. We investigated the neurogenesis of P1 and N1 in ERPs by pharmacologically manipulating inhibitory post-synaptic activity in the somatosensory cortex of rodent, and concurrently recording EEG and local field potentials (LFPs). We found that the P1 wave in the ERP and LFP of the supragranular layers is determined solely by the excitatory post-synaptic activity of the local pyramidal neural population, as is the initial segment of the N1 wave across cortical depth. The later part of the N1 wave was modulated by inhibitory post-synaptic activity, with its peak and the pulse width increasing as inhibition was reduced. These findings suggest that the temporal delay of inhibition with respect to excitation observed in intracellular recordings is also reflected in extracellular field potentials (FPs), resulting in a temporal window during which only excitatory post-synaptic activity and leak channel activity are recorded in the ERP and evoked LFP time series. Based on these findings, we provide clarification on the interpretation of P1 and N1 in terms of the excitatory and inhibitory post-synaptic activities of the local pyramidal neural population(s).

Mutual Control of Cholinergic and Low-Threshold Spike Interneurons in the Striatum.

The striatum is the largest nucleus of the basal ganglia and is crucially involved in action selection and reward processing. Cortical and thalamic inputs to the striatum are processed by local networks in which several classes of interneurons play an important, but still poorly understood role. Here we investigated the interactions between cholinergic and low-threshold spike (LTS) interneurons. LTS interneurons were hyperpolarized by co-application of muscarinic and nicotinic receptor antagonists (atropine and mecamylamine, respectively). Mecamylamine alone also caused hyperpolarizations, while atropine alone caused depolarizations and increased firing. LTS interneurons were also under control of tonic GABA, as application of the GABAA receptor antagonist picrotoxin caused depolarizations and increased firing. Frequency of spontaneous GABAergic events in LTS interneurons was increased by co-application of atropine and mecamylamine or by atropine alone, but reduced by mecamylamine alone. In the presence of picrotoxin and tetrodotoxin (TTX), atropine and mecamylamine depolarized the LTS interneurons. We concluded that part of the excitatory effects of tonic acetylcholine (ACh) on LTS interneurons were due to cholinergic modulation of tonic GABA. We then studied the influence of LTS interneurons on cholinergic interneurons. Application of antagonists of somatostatin or neuropeptide Y (NPY) receptors or of an inhibitor of nitric oxide synthase (L-NAME) did not cause detectable effects in cholinergic interneurons. However, prolonged synchronized depolarizations of LTS interneurons (elicited with optogenetics tools) caused slow-onset depolarizations in cholinergic interneurons, which were often accompanied by strong action potential firing and were fully abolished by L-NAME. Thus, a mutual excitatory influence exists between LTS and cholinergic interneurons in the striatum, providing an opportunity for sustained activation of the two cell types. This activation may endow the striatal microcircuits with the ability to enter a high ACh/high nitric oxide regime when adequately triggered by external excitatory stimuli to these interneurons.

A novel task for the investigation of action acquisition.

We present a behavioural task designed for the investigation of how novel instrumental actions are discovered and learnt. The task consists of free movement with a manipulandum, during which the full range of possible movements can be explored by the participant and recorded. A subset of these movements, the 'target', is set to trigger a reinforcing signal. The task is to discover what movements of the manipulandum evoke the reinforcement signal. Targets can be defined in spatial, temporal, or kinematic terms, can be a combination of these aspects, or can represent the concatenation of actions into a larger gesture. The task allows the study of how the specific elements of behaviour which cause the reinforcing signal are identified, refined and stored by the participant. The task provides a paradigm where the exploratory motive drives learning and as such we view it as in the tradition of Thorndike [1]. Most importantly it allows for repeated measures, since when a novel action is acquired the criterion for triggering reinforcement can be changed requiring a new action to be discovered. Here, we present data using both humans and rats as subjects, showing that our task is easily scalable in difficulty, adaptable across species, and produces a rich set of behavioural measures offering new and valuable insight into the action learning process.

Segregated anatomical input to sub-regions of the rodent superior colliculus associated with approach and defense.

The superior colliculus (SC) is responsible for sensorimotor transformations required to direct gaze toward or away from unexpected, biologically salient events. Significant changes in the external world are signaled to SC through primary multisensory afferents, spatially organized according to a retinotopic topography. For animals, where an unexpected event could indicate the presence of either predator or prey, early decisions to approach or avoid are particularly important. Rodents' ecology dictates predators are most often detected initially as movements in upper visual field (mapped in medial SC), while appetitive stimuli are normally found in lower visual field (mapped in lateral SC). Our purpose was to exploit this functional segregation to reveal neural sites that can bias or modulate initial approach or avoidance responses. Small injections of Fluoro-Gold were made into medial or lateral sub-regions of intermediate and deep layers of SC (SCm/SCl). A remarkable segregation of input to these two functionally defined areas was found. (i) There were structures that projected only to SCm (e.g., specific cortical areas, lateral geniculate and suprageniculate thalamic nuclei, ventromedial and premammillary hypothalamic nuclei, and several brainstem areas) or SCl (e.g., primary somatosensory cortex representing upper body parts and vibrissae and parvicellular reticular nucleus in the brainstem). (ii) Other structures projected to both SCm and SCl but from topographically segregated populations of neurons (e.g., zona incerta and substantia nigra pars reticulata). (iii) There were a few brainstem areas in which retrogradely labeled neurons were spatially overlapping (e.g., pedunculopontine nucleus and locus coeruleus). These results indicate significantly more structures across the rat neuraxis are in a position to modulate defense responses evoked from SCm, and that neural mechanisms modulating SC-mediated defense or appetitive behavior are almost entirely segregated.

Interactions between the Midbrain Superior Colliculus and the Basal Ganglia.

An important component of the architecture of cortico-basal ganglia connections is the parallel, re-entrant looped projections that originate and return to specific regions of the cerebral cortex. However, such loops are unlikely to have been the first evolutionary example of a closed-loop architecture involving the basal ganglia. A phylogenetically older, series of subcortical loops can be shown to link the basal ganglia with many brainstem sensorimotor structures. While the characteristics of individual components of potential subcortical re-entrant loops have been documented, the full extent to which they represent functionally segregated parallel projecting channels remains to be determined. However, for one midbrain structure, the superior colliculus (SC), anatomical evidence for closed-loop connectivity with the basal ganglia is robust, and can serve as an example against which the loop hypothesis can be evaluated for other subcortical structures. Examination of ascending projections from the SC to the thalamus suggests there may be multiple functionally segregated systems. The SC also provides afferent signals to the other principal input nuclei of the basal ganglia, the dopaminergic neurones in substantia nigra and to the subthalamic nucleus. Recent electrophysiological investigations show that the afferent signals originating in the SC carry important information concerning the onset of biologically significant events to each of the basal ganglia input nuclei. Such signals are widely regarded as crucial for the proposed functions of selection and reinforcement learning with which the basal ganglia have so often been associated.

Muscarinic enhancement of persistent sodium current synchronizes striatal medium spiny neurons.

Network dynamics denoted by synchronous firing of neuronal pools rely on synaptic interactions and intrinsic properties. In striatal medium spiny neurons, N-methyl-d-aspartate (NMDA) receptor activation endows neurons with nonlinear capabilities by inducing a negative-slope conductance region (NSCR) in the current-voltage relationship. Nonlinearities underlie associative learning, procedural memory, and the sequential organization of behavior in basal ganglia nuclei. The cholinergic system modulates the function of medium spiny projection neurons through the activation of muscarinic receptors, increasing the NMDA-induced NSCR. This enhancement is reflected as a change in the NMDA-induced network dynamics, making it more synchronous. Nevertheless, little is known about the contribution of intrinsic properties that promote this activity. To investigate the mechanisms underlying the cholinergic modulation of bistable behavior in the striatum, we used whole cell and calcium-imaging techniques. A persistent sodium current modulated by muscarinic receptor activation participated in the enhancement of the NSCR and the increased network synchrony. These experiments provide evidence that persistent sodium current generates bistable behavior in striatal neurons and contributes to the regulation of synchronous network activity. The neuromodulation of bistable properties could represent a cellular and network mechanism for cholinergic actions in the striatum.

Prominent burst firing of dopaminergic neurons in the ventral tegmental area during paradoxical sleep.

Dopamine is involved in motivation, memory, and reward processing. However, it is not clear whether the activity of dopamine neurons is related or not to vigilance states. Using unit recordings in unanesthetized head restrained rats we measured the firing pattern of dopamine neurons of the ventral tegmental area across the sleep-wake cycle. We found these cells were activated during paradoxical sleep (PS) via a clear switch to a prominent bursting pattern, which is known to induce large synaptic dopamine release. This activation during PS was similar to the activity measured during the consumption of palatable food. Thus, as it does during waking in response to novelty and reward, dopamine could modulate brain plasticity and thus participate in memory consolidation during PS. By challenging the traditional view that dopamine is the only aminergic group not involved in sleep physiology, this study provides an alternative perspective that may be crucial for understanding the physiological function of PS and dream mentation.

Distinct patterns of striatal medium spiny neuron activity during the natural sleep-wake cycle.

Striatal medium-sized spiny neurons (MSNs) integrate and convey information from the cerebral cortex to the output nuclei of the basal ganglia. Intracellular recordings from anesthetized animals show that MSNs undergo spontaneous transitions between hyperpolarized and depolarized states. State transitions, regarded as necessary for eliciting action potential firing in MSNs, are thought to control basal ganglia function by shaping striatal output. Here, we use an anesthetic-free rat preparation to show that the intracellular activity of MSNs is not stereotyped and depends critically on vigilance state. During slow-wave sleep, much as during anesthesia, MSNs displayed rhythmic step-like membrane potential shifts, correlated with cortical field potentials. However, wakefulness was associated with a completely different pattern of temporally disorganized depolarizing synaptic events of variable amplitude. Transitions from slow-wave sleep to wakefulness converted striatal discharge from a cyclic brisk firing to an irregular pattern of action potentials. These findings illuminate different capabilities of information processing in basal ganglia networks, suggesting in particular that a novel style of striatal computation is associated with the waking state.

Glutamatergic-receptors blockade does not regularize the slow wave sleep bursty pattern of subthalamic neurons.

The subthalamic nucleus (STN) has been implicated in movement disorders observed in Parkinson's disease because of its pathological mixed burst firing mode and hyperactivity. In physiological conditions, STN bursty pattern has been shown to be dependent on slow wave cortical activity. Indeed, cortical ablation abolished STN bursting activity in urethane-anaesthetized intact or dopamine depleted rats. Thus, glutamate afferents might be involved in STN bursting activity during slow wave sleep (SWS) when thalamic and cortical cells oscillate in a low-frequency range. The present work was aimed to test, on non-anaesthetized rats, if it was possible to regularize the SWS STN bursty pattern by microiontophoresis of kynurenate, a broad-spectrum glutamate ionotropic receptors antagonist. As glutamatergic effects might be masked by GABAergic inputs arriving tonically and during the entire sleep-wake cycle on STN neurons, kynurenate was also co-iontophoresed with bicuculline, a GABA(A) receptors antagonist. Kynurenate iontophoretic applications had a weak inhibitory effect on the discharge rate of STN neurons whatever the vigilance state, and did not regularize the SWS STN bursty pattern. But, the robust bursty bicuculline-induced pattern was impaired by kynurenate, which elicited the emergence of single spikes between remaining bursts. These data indicate that the bursty pattern exhibited by STN neurons specifically in SWS, does not seem to exclusively depend on glutamatergic inputs to STN cells. Furthermore, GABA(A) receptors may play a critical role in regulating the influence of excitatory inputs on STN cells.