Beta Oscillations in Monkey Striatum Encode Reward Prediction Error Signals.

Reward prediction error (RPE) signals are crucial for reinforcement learning and decision-making as they quantify the mismatch between predicted and obtained rewards. RPE signals are encoded in the neural activity of multiple brain areas, such as midbrain dopaminergic neurons, prefrontal cortex, and striatum. However, it remains unclear how these signals are expressed through anatomically and functionally distinct subregions of the striatum. In the current study, we examined to which extent RPE signals are represented across different striatal regions. To do so, we recorded local field potentials (LFPs) in sensorimotor, associative, and limbic striatal territories of two male rhesus monkeys performing a free-choice probabilistic learning task. The trial-by-trial evolution of RPE during task performance was estimated using a reinforcement learning model fitted on monkeys' choice behavior. Overall, we found that changes in beta band oscillations (15-35 Hz), after the outcome of the animal's choice, are consistent with RPE encoding. Moreover, we provide evidence that the signals related to RPE are more strongly represented in the ventral (limbic) than dorsal (sensorimotor and associative) part of the striatum. To conclude, our results suggest a relationship between striatal beta oscillations and the evaluation of outcomes based on RPE signals and highlight a major contribution of the ventral striatum to the updating of learning processes.SIGNIFICANCE STATEMENT Reward prediction error (RPE) signals are crucial for reinforcement learning and decision-making as they quantify the mismatch between predicted and obtained rewards. Current models suggest that RPE signals are encoded in the neural activity of multiple brain areas, including the midbrain dopaminergic neurons, prefrontal cortex and striatum. However, it remains elusive whether RPEs recruit anatomically and functionally distinct subregions of the striatum. Our study provides evidence that RPE-related modulations in local field potential (LFP) power are dominant in the striatum. In particular, they are stronger in the rostro-ventral rather than the caudo-dorsal striatum. Our findings contribute to a better understanding of the role of striatal territories in reward-based learning and may be relevant for neuropsychiatric and neurologic diseases that affect striatal circuits.

Differential functional connectivity underlying asymmetric reward-related activity in human and nonhuman primates.

The orbitofrontal cortex (OFC) is a key brain region involved in complex cognitive functions such as reward processing and decision making. Neuroimaging studies have reported unilateral OFC response to reward-related variables; however, those studies rarely discussed this observation. Nevertheless, some lesion studies suggest that the left and right OFC contribute differently to cognitive processes. We hypothesized that the OFC asymmetrical response to reward could reflect underlying hemispherical difference in OFC functional connectivity. Using resting-state and reward-related functional MRI data from humans and from rhesus macaques, we first identified an asymmetrical response of the lateral OFC to reward in both species. Crucially, the subregion showing the highest reward-related asymmetry (RRA) overlapped with the region showing the highest functional connectivity asymmetry (FCA). Furthermore, the two types of asymmetries were found to be significantly correlated across individuals. In both species, the right lateral OFC was more connected to the default mode network compared to the left lateral OFC. Altogether, our results suggest a functional specialization of the left and right lateral OFC in primates.

Activity of fast-spiking interneurons in the monkey striatum during reaching movements guided by external cues or by a free choice.

Parvalbumin-containing GABAergic interneurons in the striatum, electrophysiologically identified as fast-spiking interneurons (FSIs), exert inhibitory control over striatal output to drive appropriate behavior. While a number of studies have emphasized their importance in motor control, it is unknown how these putative interneurons adapt their functional properties to different modes of movement selection. Here, we tested whether FSIs are sensitive to externally versus internally selected movements by recording their activity while two male rhesus monkeys performed reaching movements to visual targets. Two variants were used: an external condition, in which movements were instructed via external cues, and an internal condition, in which movements were guided by an internal representation of the target location. These conditions allowed to contrast the FSI activity associated with either externally cued or internally driven movement selection. After extensive training, reaching performance was only marginally affected by the type of movement, albeit with some differences between the monkeys. Over two-thirds of the FSIs were modulated around movement onset, regardless of the condition, and consisting mostly of increased activity. We found that a subset of FSIs showed stronger activation related to the initiation of movements in the external condition than in the internal condition, suggesting a dependence on movement selection mode. Moreover, this difference in the strength of FSI activation was predominant in the motor striatum. These data indicate that changes in FSI activity carry information that is scaled by constraints on action selection reflecting the involvement of local striatal inhibitory circuits in adaptation of behavior according to task demands.

Changes in activity of fast-spiking interneurons of the monkey striatum during reaching at a visual target.

Recent works highlight the importance of local inhibitory interneurons in regulating the function of the striatum. In particular, fast-spiking interneurons (FSIs), which likely correspond to a subgroup of GABAergic interneurons, have been involved in the control of movement by exerting strong inhibition on striatal output pathways. However, little is known about the exact contribution of these presumed interneurons in movement preparation, initiation, and execution. We recorded the activity of FSIs in the striatum of monkeys as they performed reaching movements to a visual target under two task conditions: one in which the movement target was presented at unsignaled left or right locations, and another in which advance information about target location was available, thus allowing monkeys to react faster. Modulations of FSI activity around the initiation of movement (53% of 55 neurons) consisted mostly of increases reaching maximal firing immediately before or, less frequently, after movement onset. Another subset of FSIs showed decreases in activity during movement execution. Rarely did movement-related changes in FSI firing depend on response direction and movement speed. Modulations of FSI activity occurring relatively early in relation to movement initiation were more influenced by the preparation for movement, compared with those occurring later. Conversely, FSI activity remained unaffected, as monkeys were preparing a movement toward a specific location and instead moved to the opposite direction when the trigger occurred. These results provide evidence that changes in activity of presumed GABAergic interneurons of the primate striatum could make distinct contributions to processes involved in movement generation. NEW & NOTEWORTHY: We explored the functional contributions of striatal fast-spiking interneurons (FSIs), presumed GABAergic interneurons, to distinct steps of movement generation in monkeys performing a reaching task. The activity of individual FSIs was modulated before and during the movement, consisting mostly of increased in firing rates. Changes in activity also occurred during movement preparation. We interpret this variety of modulation types at different moments of task performance as reflecting differential FSI control over distinct phases of movement.

Social prediction modulates activity of macaque superior temporal cortex.

The ability to attribute thoughts to others, also called theory of mind (TOM), has been extensively studied in humans; however, its evolutionary origins have been challenged. Computationally, the basis of TOM has been interpreted within the predictive coding framework and associated with activity in the temporoparietal junction (TPJ). Here, we revealed, using a nonlinguistic task and functional magnetic resonance imaging, that activity in a region of the macaque middle superior temporal cortex was specifically modulated by the predictability of social situations. As in human TPJ, this region could be distinguished from other temporal regions involved in face processing. Our result suggests the existence of a precursor for the TOM ability in the last common ancestor of human and Old World monkeys.

Intra-CSF AAV9 and AAVrh10 Administration in Nonhuman Primates: Promising Routes and Vectors for Which Neurological Diseases?

The identification of the most efficient method for whole central nervous system targeting that is translatable to humans and the safest route of adeno-associated virus (AAV) administration is a major concern for future applications in clinics. Additionally, as many AAV serotypes were identified for gene introduction into the brain and the spinal cord, another key to human gene-therapy success is to determine the most efficient serotype. In this study, we compared lumbar intrathecal administration through catheter implantation and intracerebroventricular administration in the cynomolgus macaque. We also evaluated and compared two AAV serotypes that are currently used in clinical trials: AAV9 and AAVrh10. We demonstrated that AAV9 lumbar intrathecal delivery using a catheter achieved consistent transgene expression in the motor neurons of the spinal cord and in the neurons/glial cells of several brain regions, whereas AAV9 intracerebroventricular delivery led to a consistent transgene expression in the brain. In contrast, AAVrh10 lumbar intrathecal delivery led to rare motor neuron targeting. Finally, we found that AAV9 efficiently targets respiratory and skeletal muscles after injection into the cerebrospinal fluid (CSF), which represents an outstanding new property that can be useful for the treatment of diseases affecting both the central nervous system and muscle.

Differences between Dorsal and Ventral Striatum in the Sensitivity of Tonically Active Neurons to Rewarding Events.

Within the striatum, cholinergic interneurons, electrophysiologically identified as tonically active neurons (TANs), represent a relatively homogeneous group in terms of their functional properties. They display typical pause in tonic firing in response to rewarding events which are of crucial importance for reinforcement learning. These responses are uniformly distributed throughout the dorsal striatum (i.e., motor and associative striatum), but it is unknown, at least in monkeys, whether differences in the modulation of TAN activity exist in the ventral striatum (i.e., limbic striatum), a region specialized for processing of motivational information. To address this issue, we examined the activity of dorsal and ventral TANs in two monkeys trained on a Pavlovian conditioning task in which a visual stimulus preceded the delivery of liquid reward by a fixed time interval. We found that the proportion of TANs responding to the stimulus predictive of reward did not vary significantly across regions (58%-80%), whereas the fraction of TANs responding to reward was higher in the limbic striatum (100%) compared to the motor (65%) and associative striatum (52%). By examining TAN modulation at the level of both the population and the individual neurons, we showed that the duration of pause responses to the stimulus and reward was longer in the ventral than in the dorsal striatal regions. Also, the magnitude of the pause was greater in ventral than dorsal striatum for the stimulus predictive of reward but not for the reward itself. We found similar region-specific differences in pause response duration to the stimulus when the timing of reward was less predictable (fixed replaced by variable time interval). Regional variations in the duration and magnitude of the pause response were transferred from the stimulus to reward when reward was delivered in the absence of any predictive stimulus. It therefore appears that ventral TANs exhibit stronger responses to rewarding stimuli, compared to dorsal TANs. The high proportion of responsive neurons, combined with particular response features, support the notion that the ventral TAN system can be driven by specific synaptic inputs arising from afferent sources distinct from those targeting the dorsal TAN system.

The PPARα Agonist Fenofibrate Reduces Prepulse Inhibition Disruption in a Neurodevelopmental Model of Schizophrenia.

Oxidative stress has been implicated in neurodevelopmental theories of schizophrenia. Antioxidant Peroxysome Proliferator-Activated Receptors α (PPARα) agonist fenofibrate has neuroprotective properties and could reverse early preclinical infringements that could trigger the illness. We have evaluated the neuroprotective interest of fenofibrate in a neurodevelopmental rat model of schizophrenia. The oxidative lesion induced by Kainic Acid (KA) injection at postnatal day (PND) 7 has previously been reported to disrupt Prepulse Inhibition (PPI) at PND56 but not at PND35. In 4 groups of 15 male rats each, KN (KA-PND7 + normal postweaning food), KF (KA-PND7 + fenofibrate 0.2% food), ON (saline-PND7 + normal food), and OF (saline + fenofibrate food), PPI was recorded at PND35 and PND56. Three levels of prepulse were used: 73 dB, 76 dB, and 82 dB for a pulse at 120 dB. Four PPI scores were analyzed: PPI73, PPI76, PPI82, and mean PPI (PPIm). Two-way ANOVAs were used to evaluate the effects of both factors (KA + fenofibrate), and, in case of significant results, intergroup Student's t-tests were performed. We notably found a significant difference (P < 0.05) in PPIm between groups KN and KF at PND56, which supposes that fenofibrate could be worthy of interest for early neuroprotection in schizophrenia.

Fetal alcohol-induced hyperactivity is reversed by treatment with the PPARα agonist fenofibrate in a rat model.

INTRODUCTION: Exposure to alcohol in utero is linked to the development of a wide range of psychobehavioral changes, notably hyperactivity and attention deficit, with complex underlying pathological and functional mechanisms. Although the currently available treatments for hyperactivity have been studied in children exposed to alcohol in utero, the efficacy of these compounds is subject to debate and has prompted efforts to identify new pharmacological targets. METHOD: In a rat model of early alcohol exposure (i.e., in utero and during lactation), we studied the effect of the lipid-lowering peroxisome proliferator-activated receptor (PPAR) alpha activator fenofibrate on psychobehavioral impairments. RESULTS: In the young rat, early exposure to alcohol perturbs locomotor behavior and induces prepubertal hyperactivity and postpubertal hypoactivity. The hyperactivity, usually observed at the end of the fifth week of life, was prevented by the administration of fenofibrate, which also had a beneficial effect on the accompanying attention deficit by reinforcing sustained attention. CONCLUSION: Our results with fenofibrate suggest that the pharmacological modulation of nuclear receptors such as PPAR-alpha may constitute a new therapeutic approach to managing the psychobehavioral disorders associated with early alcohol exposure.