Deterioration in cognitive control related mPFC function underlying development of treatment resistance in early psychosis.

One third of people with psychosis become antipsychotic treatment-resistant and the underlying mechanisms remain unclear. We investigated whether altered cognitive control function is a factor underlying development of treatment resistance. We studied 50 people with early psychosis at a baseline visit (mean < 2 years illness duration) and follow-up visit (1 year later), when 35 were categorized at treatment-responsive and 15 as treatment-resistant. Participants completed an emotion-yoked reward learning task that requires cognitive control whilst undergoing fMRI and MR spectroscopy to measure glutamate levels from Anterior Cingulate Cortex (ACC). Changes in cognitive control related activity (in prefrontal cortex and ACC) over time were compared between treatment-resistant and treatment-responsive groups and related to glutamate. Compared to treatment-responsive, treatment-resistant participants showed blunted activity in right amygdala (decision phase) and left pallidum (feedback phase) at baseline which increased over time and was accompanied by a decrease in medial Prefrontal Cortex (mPFC) activity (feedback phase) over time. Treatment-responsive participants showed a negative relationship between mPFC activity and glutamate levels at follow-up, no such relationship existed in treatment-resistant participants. Reduced activity in right amygdala and left pallidum at baseline was predictive of treatment resistance at follow-up (67% sensitivity, 94% specificity). The findings suggest that deterioration in mPFC function over time, a key cognitive control region needed to compensate for an initial dysfunction within a social-emotional network, is a factor underlying development of treatment resistance in early psychosis. An uncoupling between glutamate and cognitive control related mPFC function requires further investigation that may present a future target for interventions.

Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses.

Reinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens. We then recorded simultaneously from the orbitofrontal cortex (OFC), ventral striatum (VS), amygdala (AMY), and the mediodorsal thalamus (MDt). We found that the OFC played a dominant role in coding token outcomes and token prediction errors. The other areas contributed complementary functions with the VS coding appetitive outcomes and the AMY coding the salience of outcomes. The MDt coded actions and relayed information about tokens between the OFC and VS. Thus, OFC leads the process of symbolic reinforcement learning in the ventral frontostriatal circuitry.

Computational Mechanisms Underlying Motivation to Earn Symbolic Reinforcers.

Reinforcement learning is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g., money, points) that are later exchanged for primary reinforcers (e.g., food, drink). Although symbolic reinforcers are ubiquitous in our daily lives, widely used in laboratory tasks because they can be motivating, mechanisms by which they become motivating are less understood. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g., the current number of accumulated tokens, choice options, task epoch, trials since the last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to then correlate with the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task (n = 5 monkeys, three males and two females). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in the state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement.

Divergent opioid-mediated suppression of inhibition between hippocampus and neocortex across species and development.

Opioid receptors within the CNS regulate pain sensation and mood and are key targets for drugs of abuse. Within the adult rodent hippocampus (HPC), µ-opioid receptor agonists suppress inhibitory parvalbumin-expressing interneurons (PV-INs), thus disinhibiting the circuit. However, it is uncertain if this disinhibitory motif is conserved in other cortical regions, species, or across development. We observed that PV-IN mediated inhibition is robustly suppressed by opioids in HPC but not neocortex in mice and nonhuman primates, with spontaneous inhibitory tone in resected human tissue also following a consistent dichotomy. This hippocampal disinhibitory motif was established in early development when immature PV-INs and opioids already influence primordial network rhythmogenesis. Acute opioid-mediated modulation was partially occluded with morphine pretreatment, with implications for the effects of opioids on hippocampal network activity during circuit maturation as well as learning and memory. Together, these findings demonstrate that PV-INs exhibit a divergence in opioid sensitivity across brain regions that is remarkably conserved across evolution and highlights the underappreciated role of opioids acting through immature PV-INs in shaping hippocampal development.

Motor System-Dependent Effects of Amygdala and Ventral Striatum Lesions on Explore-Exploit Behaviors.

Deciding whether to forego immediate rewards or explore new opportunities is a key component of flexible behavior and is critical for the survival of the species. Although previous studies have shown that different cortical and subcortical areas, including the amygdala and ventral striatum (VS), are implicated in representing the immediate (exploitative) and future (explorative) value of choices, the effect of the motor system used to make choices has not been examined. Here, we tested male rhesus macaques with amygdala or VS lesions on two versions of a three-arm bandit task where choices were registered with either a saccade or an arm movement. In both tasks we presented the monkeys with explore-exploit tradeoffs by periodically replacing familiar options with novel options that had unknown reward probabilities. We found that monkeys explored more with saccades but showed better learning with arm movements. VS lesions caused the monkeys to be more explorative with arm movements and less explorative with saccades, although this may have been due to an overall decrease in performance. VS lesions affected the monkeys' ability to learn novel stimulus-reward associations in both tasks, while after amygdala lesions this effect was stronger when choices were made with saccades. Further, on average, VS and amygdala lesions reduced the monkeys' ability to choose better options only when choices were made with a saccade. These results show that learning reward value associations to manage explore-exploit behaviors is motor system dependent and they further define the contributions of amygdala and VS to reinforcement learning.

Computational mechanisms underlying motivation to earn symbolic reinforcers.

Reinforcement learning (RL) is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g. money, points) that can later be exchanged for primary reinforcers (e.g. food, drink). Although symbolic reinforcers are motivating, little is understood about the neural or computational mechanisms underlying the motivation to earn them. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g. current number of accumulated tokens, choice options, task epoch, trials since last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to capture the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task (n=5 monkeys). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement.

Attractor dynamics reflect decision confidence in macaque prefrontal cortex.

Decisions are made with different degrees of consistency, and this consistency can be linked to the confidence that the best choice has been made. Theoretical work suggests that attractor dynamics in networks can account for choice consistency, but how this is implemented in the brain remains unclear. Here we provide evidence that the energy landscape around attractor basins in population neural activity in the prefrontal cortex reflects choice consistency. We trained two rhesus monkeys to make accept/reject decisions based on pretrained visual cues that signaled reward offers with different magnitudes and delays to reward. Monkeys made consistent decisions for very good and very bad offers, but decisions were less consistent for intermediate offers. Analysis of neural data showed that the attractor basins around patterns of activity reflecting decisions had steeper landscapes for offers that led to consistent decisions. Therefore, we provide neural evidence that energy landscapes predict decision consistency, which reflects decision confidence.

Changes in Behavior and Neural Dynamics across Adolescent Development.

Adolescence is an important developmental period, during which substantial changes occur in brain function and behavior. Several aspects of executive function, including response inhibition, improve during this period. Correspondingly, structural imaging studies have documented consistent decreases in cortical and subcortical gray matter volume, and postmortem histologic studies have found substantial (∼40%) decreases in excitatory synapses in prefrontal cortex. Recent computational modeling work suggests that the change in synaptic density underlie improvements in task performance. These models also predict changes in neural dynamics related to the depth of attractor basins, where deeper basins can underlie better task performance. In this study, we analyzed task-related neural dynamics in a large cohort of longitudinally followed subjects (male and female) spanning early to late adolescence. We found that age correlated positively with behavioral performance in the Eriksen Flanker task. Older subjects were also characterized by deeper attractor basins around task related evoked EEG potentials during specific cognitive operations. Thus, consistent with computational models examining the effects of excitatory synaptic pruning, older adolescents showed stronger attractor dynamics during task performance.SIGNIFICANCE STATEMENT There are well-documented changes in brain and behavior during adolescent development. However, there are few mechanistic theories that link changes in the brain to changes in behavior. Here, we tested a hypothesis, put forward on the basis of computational modeling, that pruning of excitatory synapses in cortex during adolescence changes neural dynamics. We found, consistent with the hypothesis, that variability around event-related potentials shows faster decay dynamics in older adolescent subjects. The faster decay dynamics are consistent with the hypothesis that synaptic pruning during adolescent development leads to stronger attractor basins in task-related neural activity.

Attractor dynamics reflect decision confidence in macaque prefrontal cortex.

Decisions are made with different degrees of consistency, and this consistency can be linked to the confidence that the best choice has been made. Theoretical work suggests that attractor dynamics in networks can account for choice consistency, but how this is implemented in the brain remains unclear. Here, we provide evidence that the energy landscape around attractor basins in population neural activity in prefrontal cortex reflects choice consistency. We trained two rhesus monkeys to make accept/reject decisions based on pretrained visual cues that signaled reward offers with different magnitudes and delays-to-reward. Monkeys made consistent decisions for very good and very bad offers, but decisions were less consistent for intermediate offers. Analysis of neural data showed that the attractor basins around patterns of activity reflecting decisions had steeper landscapes for offers that led to consistent decisions. Therefore, we provide neural evidence that energy landscapes predict decision consistency, which reflects decision confidence.

Evolutionary conservation of hippocampal mossy fiber synapse properties.

Various specialized structural/functional properties are considered essential for contextual memory encoding by hippocampal mossy fiber (MF) synapses. Although investigated to exquisite detail in model organisms, synapses, including MFs, have undergone minimal functional interrogation in humans. To determine the translational relevance of rodent findings, we evaluated MF properties within human tissue resected to treat epilepsy. Human MFs exhibit remarkably similar hallmark features to rodents, including AMPA receptor-dominated synapses with small contributions from NMDA and kainate receptors, large dynamic range with strong frequency facilitation, NMDA receptor-independent presynaptic long-term potentiation, and strong cyclic AMP (cAMP) sensitivity of release. Array tomography confirmed the evolutionary conservation of MF ultrastructure. The astonishing congruence of rodent and human MF core features argues that the basic MF properties delineated in animal models remain critical to human MF function. Finally, a selective deficit in GABAergic inhibitory tone onto human MF postsynaptic targets suggests that unrestrained detonator excitatory drive contributes to epileptic circuit hyperexcitability.

Efficient viral expression of a chemogenetic receptor in the old-world monkey amygdala.

Genetically encoded synthetic receptors, such as the chemogenetic and optogenetic proteins, are powerful tools for functional brain studies in animals. In the primate brain, with its comparatively large, intricate anatomical structures, it can be challenging to express transgenes, such as the hM4Di chemogenetic receptor, in a defined anatomical structure with high penetrance. Here, we compare parameters for lentivirus vector injections in the rhesus monkey amygdala. We find that four injections of 20 µl, infused at 0.5 µl/min, can achieve neuronal hM4Di expression in 50-100% of neurons within a 60 mm3 volume, without observable damage from overexpression. Increasing the number of hM4Di_CFP lentivirus injections to up to 12 sites per hemisphere, resulted in 30%-40% neuronal coverage of the overall amygdala volume, with coverage reaching 60% in some subnuclei. Manganese Chloride was mixed with lentivirus and used as an MRI marker to verify targeting accuracy and correct unsuccessful injections in these experiments. In a separate monkey we visualized, in vivo, viral expression of the hM4Di receptor protein in the amygdala, using Positron Emission Tomography. Together, these data show efficient and verifiable expression of a chemogenetic receptor in old-world monkey amygdala.

The motivational role of the ventral striatum and amygdala in learning from gains and losses.

The ventral striatum (VS) and amygdala are two structures often implicated as essential structures for learning. The literature addressing the contribution of these areas to learning, however, is not entirely consistent. We propose that these inconsistencies are due to learning environments and the effect they have on motivation. To differentiate aspects of learning from environmental factors that affect motivation, we ran a series of experiments with varying task factors. We compared monkeys (Macaca mulatta) with VS lesions, amygdala lesions, and unoperated controls on reinforcement learning (RL) tasks that involve learning from both gains and losses as well as from deterministic and stochastic schedules of reinforcement. We found that for all three groups, performance varied by experiment. All three groups modulated their behavior in the same directions, to varying degrees, across the three experiments. This behavioral modulation is why we find deficits in some experiments, but not others. The amount of effort animals exhibited differed depending on the learning environment. Our results suggest that the VS is important for the amount of effort animals will give in rich deterministic and relatively leaner stochastic learning enivornments. We also showed that monkeys with amygdala lesions can learn stimulus-based RL in stochastic environments and environments with loss and conditioned reinforcers. These results show that learning environments shape motivation and that the VS is essential for distinct aspects of motivated behavior. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The Difference an Explanation Makes: Verbal Debrief Effects When Children Cope with Uncertainty.

Previous research showed that uncertain, stochastic feedback drastically reduces children's performance. Here, 145 children from 7 to 11 years learned sets of sequences of four left-right button presses, each press followed by a red/green signal. After each of the 15% randomly false feedback trials, children received a verbal debrief that it was either (1) a mistake, or (2) a lie, or (3) received a reassuring comment for 85% correct trials. The control group received no verbal debrief. In the stochastic condition children reflected more on previous trials than with 100% correct feedback. Verbal debriefs helped children to overcome the deterioration of the first two repetitions. Mistakes were discarded and therefore the most helpful comment. Lie debriefs yielded the most reflection on previous experience. Reassurance comments were not quite as efficient.

Functional network properties of the auditory cortex.

The auditory system transforms auditory stimuli from the external environment into perceptual auditory objects. Recent studies have focused on the contribution of the auditory cortex to this transformation. Other studies have yielded important insights into the contributions of neural activity in the auditory cortex to cognition and decision-making. However, despite this important work, the relationship between auditory-cortex activity and behavior/perception has not been fully elucidated. Two of the more important gaps in our understanding are (1) the specific and differential contributions of different fields of the auditory cortex to auditory perception and behavior and (2) the way networks of auditory neurons impact and facilitate auditory information processing. Here, we focus on recent work from non-human-primate models of hearing and review work related to these gaps and put forth challenges to further our understanding of how single-unit activity and network activity in different cortical fields contribution to behavior and perception.

Environmental uncertainty and the advantage of impulsive choice strategies.

Choice impulsivity is characterized by the choice of immediate, smaller reward options over future, larger reward options, and is often thought to be associated with negative life outcomes. However, some environments make future rewards more uncertain, and in these environments impulsive choices can be beneficial. Here we examined the conditions under which impulsive vs. non-impulsive decision strategies would be advantageous. We used Markov Decision Processes (MDPs) to model three common decision-making tasks: Temporal Discounting, Information Sampling, and an Explore-Exploit task. We manipulated environmental variables to create circumstances where future outcomes were relatively uncertain. We then manipulated the discount factor of an MDP agent, which affects the value of immediate versus future rewards, to model impulsive and non-impulsive behavior. This allowed us to examine the performance of impulsive and non-impulsive agents in more or less predictable environments. In Temporal Discounting, we manipulated the transition probability to delayed rewards and found that the agent with the lower discount factor (i.e. the impulsive agent) collected more average reward than the agent with a higher discount factor (the non-impulsive agent) by selecting immediate reward options when the probability of receiving the future reward was low. In the Information Sampling task, we manipulated the amount of information obtained with each sample. When sampling led to small information gains, the impulsive MDP agent collected more average reward than the non-impulsive agent. Third, in the Explore-Exploit task, we manipulated the substitution rate for novel options. When the substitution rate was high, the impulsive agent again performed better than the non-impulsive agent, as it explored the novel options less and instead exploited options with known reward values. The results of these analyses show that impulsivity can be advantageous in environments that are unexpectedly uncertain.

Anatomical organization of forebrain circuits in the primate.

The primate forebrain is a complex structure. Thousands of connections have been identified between cortical areas, and between cortical and sub-cortical areas. Previous work, however, has suggested that a number of principles can be used to reduce this complexity. Here, we integrate four principles that have been put forth previously, including a nested model of neocortical connectivity, gradients of connectivity between frontal cortical areas and the striatum and thalamus, shared patterns of sub-cortical connectivity between connected posterior and frontal cortical areas, and topographic organization of cortical-striatal-pallidal-thalamocortical circuits. We integrate these principles into a single model that accounts for a substantial amount of connectivity in the forebrain. We then suggest that studies in evolution and development can account for these four principles, by assuming that the ancestral vertebrate pallium was dominated by medial, hippocampal and ventral-lateral, pyriform areas, and at most a small dorsal pallium. The small dorsal pallium expanded massively in the lineage leading to primates. During this expansion, topological, adjacency relationships were maintained between pallial and sub-pallial areas. This maintained topology led to the connectivity gradients seen between cortex, striatum, pallidum, and thalamus.

Synaptic-like axo-axonal transmission from striatal cholinergic interneurons onto dopaminergic fibers.

Transmission from striatal cholinergic interneurons (CINs) controls dopamine release through nicotinic acetylcholine receptors (nAChRs) on dopaminergic axons. Anatomical studies suggest that cholinergic terminals signal predominantly through non-synaptic volume transmission. However, the influence of cholinergic transmission on electrical signaling in axons remains unclear. We examined axo-axonal transmission from CINs onto dopaminergic axons using perforated-patch recordings, which revealed rapid spontaneous EPSPs with properties characteristic of fast synapses. Pharmacology showed that axonal EPSPs (axEPSPs) were mediated primarily by high-affinity α6-containing receptors. Remarkably, axEPSPs triggered spontaneous action potentials, suggesting that these axons perform integration to convert synaptic input into spiking, a function associated with somatodendritic compartments. We investigated the cross-species validity of cholinergic axo-axonal transmission by recording dopaminergic axons in macaque putamen and found similar axEPSPs. Thus, we reveal that synaptic-like neurotransmission underlies cholinergic signaling onto dopaminergic axons, supporting the idea that striatal dopamine release can occur independently of somatic firing to provide distinct signaling.

Neural correlates of risky decision making in Parkinson's disease patients with impulse control disorders.

Some patients with Parkinson's disease (PD) experience impulse control disorders (ICDs), characterized by deficient voluntary control over impulses, drives, or temptations regarding excessive hedonic behavior. The present study aimed to better understand the neural basis of impulsive, risky decision making in PD patients with ICDs by disentangling potential dysfunctions in decision and outcome mechanisms. We collected fMRI data from 20 patients with ICDs and 28 without ICDs performing an information gathering task. Patients viewed sequences of bead colors drawn from hidden urns and were instructed to infer the majority bead color in each urn. With each new bead, they could choose to either seek more evidence by drawing another bead (draw choice) or make an urn-inference (urn choice followed by feedback). We manipulated risk via the probability of bead color splits (80/20 vs. 60/40) and potential loss following an incorrect inference ($10 vs. $0). Patients also completed the Barratt Impulsiveness Scale (BIS) to assess impulsivity. Patients with ICDs showed greater urn choice-specific activation in the right middle frontal gyrus, overlapping the dorsal premotor cortex. Across all patients, fewer draw choices (i.e., more impulsivity) were associated with greater activation during both decision making and outcome processing in a variety of frontal and parietal areas, cerebellum, and bilateral striatum. Our findings demonstrate that ICDs in PD are associated with differences in neural processing of risk-related information and outcomes, implicating both reward and sensorimotor dopaminergic pathways.

Shared mechanisms mediate the explore-exploit tradeoff in macaques and humans.

Ancestors of macaques and humans separated into distinct lineages 25 million years ago. Despite this long separation, Hogeveen et al. (2022) show, in this issue of Neuron, that they mediate the explore-exploit tradeoff, which must be managed by any agent adapting to a dynamic environment, using similar computational and neural mechanisms.