Subjective feelings associated with expectations and rewards during risky decision-making in impulse control disorder.

Impulse Control Disorder (ICD) in Parkinson's disease is a behavioral addiction induced by dopaminergic therapies, but otherwise unclear etiology. The current study investigates the interaction of reward processing variables, dopaminergic therapy, and risky decision-making and subjective feelings in patients with versus without ICD. Patients with (n = 18) and without (n = 12) ICD performed a risky decision-making task both 'on' and 'off' standard-of-care dopaminergic therapies (the task was performed on 2 different days with the order of on and off visits randomized for each patient). During each trial of the task, participants choose between two options, a gamble or a certain reward, and reported how they felt about decision outcomes. Subjective feelings of 'pleasure' are differentially driven by expectations of possible outcomes in patients with, versus without ICD. While off medication, the influence of expectations about risky-decisions on subjective feelings is reduced in patients with ICD versus without ICD. While on medication, the influence of expected outcomes in patients with ICD versus without ICD becomes similar. Computational modeling of behavior supports the idea that latent decision-making factors drive subjective feelings in patients with Parkinson's disease and that ICD status is associated with a change in the relationship between factors associated with risky behavior and subjective feelings about the experienced outcomes. Our results also suggest that dopaminergic medications modulate the impact expectations have on the participants' subjective reports. Altogether our results suggest that expectations about risky decisions may be decoupled from subjective feelings in patients with ICD, and that dopaminergic medications may reengage these circuits and increase emotional reactivity in patients with ICD.

Use of Quantitative Electroencephalography to Inform Age- and Sex-Related Differences in NMDA Receptor Function Following MK-801 Administration.

Sex- and age-related differences in symptom prevalence and severity have been widely reported in patients with schizophrenia, yet the underlying mechanisms contributing to these differences are not well understood. N-methyl-D-aspartate (NMDA) receptor hypofunction contributes to schizophrenia pathology, and preclinical models often use NMDA receptor antagonists, including MK-801, to model all symptom clusters. Quantitative electroencephalography (qEEG) represents a translational approach to measure neuronal activity, identify targetable biomarkers in neuropsychiatric disorders and evaluate possible treatments. Abnormalities in gamma power have been reported in patients with schizophrenia and correspond to psychosis and cognitive impairment. Further, as gamma power reflects cortical glutamate and GABA signaling, it is highly sensitive to changes in NMDA receptor function, and NMDA receptor antagonists aberrantly increase gamma power in rodents and humans. To evaluate the role of sex and age on NMDA receptor function, MK-801 (0.03-0.3 mg/kg, SC) was administered to 3- and 9-month-old male and female Sprague-Dawley rats that were implanted with wireless EEG transmitters to measure cortical brain function. MK-801-induced elevations in gamma power were observed in 3-month-old male and female and 9-month-old male rats. In contrast, 9-month-old female rats demonstrated blunted maximal elevations across a wide dose range. Importantly, MK-801-induced hyperlocomotor effects, a common behavioral screen used to examine antipsychotic-like activity, were similar across all groups. Overall, sex-by-age-related differences in gamma power support using qEEG as a translational tool to evaluate pathological progression and predict treatment response across a heterogeneous population.

Subsecond fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans.

In the mammalian brain, midbrain dopamine neuron activity is hypothesized to encode reward prediction errors that promote learning and guide behavior by causing rapid changes in dopamine levels in target brain regions. This hypothesis (and alternatives regarding dopamine's role in punishment-learning) has limited direct evidence in humans. We report intracranial, subsecond measurements of dopamine release in human striatum measured, while volunteers (i.e., patients undergoing deep brain stimulation surgery) performed a probabilistic reward and punishment learning choice task designed to test whether dopamine release encodes only reward prediction errors or whether dopamine release may also encode adaptive punishment learning signals. Results demonstrate that extracellular dopamine levels can encode both reward and punishment prediction errors within distinct time intervals via independent valence-specific pathways in the human brain.

Valence-partitioned learning signals drive choice behavior and phenomenal subjective experience in humans.

How the human brain generates conscious phenomenal experience is a fundamental problem. In particular, it is unknown how variable and dynamic changes in subjective affect are driven by interactions with objective phenomena. We hypothesize a neurocomputational mechanism that generates valence-specific learning signals associated with 'what it is like' to be rewarded or punished. Our hypothesized model maintains a partition between appetitive and aversive information while generating independent and parallel reward and punishment learning signals. This valence-partitioned reinforcement learning (VPRL) model and its associated learning signals are shown to predict dynamic changes in 1) human choice behavior, 2) phenomenal subjective experience, and 3) BOLD-imaging responses that implicate a network of regions that process appetitive and aversive information that converge on the ventral striatum and ventromedial prefrontal cortex during moments of introspection. Our results demonstrate the utility of valence-partitioned reinforcement learning as a neurocomputational basis for investigating mechanisms that may drive conscious experience.

Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders.

In the DSM-5, psychiatric diagnoses are made based on self-reported symptoms and clinician-identified signs. Though helpful in choosing potential interventions based on the available regimens, this conceptualization of psychiatric diseases can limit basic science investigation into their underlying causes. The reward prediction error (RPE) hypothesis of dopamine neuron function posits that phasic dopamine signals encode the difference between the rewards a person expects and experiences. The computational framework from which this hypothesis was derived, temporal difference reinforcement learning (TDRL), is largely focused on reward processing rather than punishment learning. Many psychiatric disorders are characterized by aberrant behaviors, expectations, reward processing, and hypothesized dopaminergic signaling, but also characterized by suffering and the inability to change one's behavior despite negative consequences. In this review, we provide an overview of the RPE theory of phasic dopamine neuron activity and review the gains that have been made through the use of computational reinforcement learning theory as a framework for understanding changes in reward processing. The relative dearth of explicit accounts of punishment learning in computational reinforcement learning theory and its application in neuroscience is highlighted as a significant gap in current computational psychiatric research. Four disorders comprise the main focus of this review: two disorders of traditionally hypothesized hyperdopaminergic function, addiction and schizophrenia, followed by two disorders of traditionally hypothesized hypodopaminergic function, depression and post-traumatic stress disorder (PTSD). Insights gained from a reward processing based reinforcement learning framework about underlying dopaminergic mechanisms and the role of punishment learning (when available) are explored in each disorder. Concluding remarks focus on the future directions required to characterize neuropsychiatric disorders with a hypothesized cause of underlying dopaminergic transmission.

Pregestational oxycodone exposure does not impact future maternal care or drug preference in the postpartum mouse.

Females are uniquely sensitive to drugs of abuse at specific points in their reproductive cycle. Females' endogenous opioid system contributes to both reward-related processes and maternally relevant physiological functions, yet less is known about how adolescent opioid exposure impacts females' future behavior, ranging from parental caregiving to opioid preference. The present study explores 2 questions: (a) are there sex differences in response to adolescent oxycodone exposure, spontaneous withdrawal, and oxycodone preference in adulthood, and (b) to what extent does this pregestational opioid exposure alter females' future maternal caregiving behavior? Female and male mice received 12d of oxycodone or saline injections during mid/late adolescence, and drug was then withheld. Some females were then mated and experienced a drug-free pregnancy. Following parturition, females' maternal behavior and motivation were assessed. All mice then underwent a place conditioning procedure to assess the incentive value of oxycodone during adulthood. Mice displayed similar behavioral responses to oxycodone (e.g., sensitization) and patterns of withdrawal behaviors, independent of sex. Mice showed strong group preferences for the oxycodone-paired chamber, and the strength of these preferences did not differ by sex or maternal status. Postpartum females' maternal behavior and motivation were also similar despite adolescent drug history. Together, results did not suggest overt sex differences in response to adolescent oxycodone exposure and that, in females, a range of motivated behaviors may be relatively resilient to such perturbations during adolescence. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Partial mGlu5 Negative Allosteric Modulator M-5MPEP Demonstrates Antidepressant-Like Effects on Sleep Without Affecting Cognition or Quantitative EEG.

Selective negative allosteric modulators (NAMs) targeting the metabotropic glutamate receptor subtype 5 (mGlu5) demonstrate anxiolytic-like and antidepressant-like effects yet concern regarding adverse effect liability remains. Functional coupling of mGlu5 with ionotropic N-methyl-D-aspartate receptors (NMDARs) represents a potential mechanism through which full inhibition leads to adverse effects, as NMDAR inhibition can induce cognitive impairments and psychotomimetic-like effects. Recent development of "partial" mGlu5 NAMs, characterized by submaximal but saturable levels of blockade, may represent a novel development approach to broaden the therapeutic index of mGlu5 NAMs. This study compared the partial mGlu5 NAM, M-5MPEP, with the full mGlu5 NAM, VU0424238 on sleep, cognition, and brain function alone and in combination with a subthreshold dose of the NMDAR antagonist, MK-801, using a paired-associates learning (PAL) cognition task and electroencephalography (EEG) in rats. M-5MPEP and VU0424238 decreased rapid eye movement (REM) sleep and increased REM sleep latency, both putative biomarkers of antidepressant-like activity. Neither compound alone affected accuracy, but 30 mg/kg VU0424238 combined with MK-801 decreased accuracy on the PAL task. Using quantitative EEG, VU0424238, but not M-5MPEP, prolonged arousal-related elevations in high gamma power, and, in combination, VU0424238 potentiated effects of MK-801 on high gamma power. Together, these studies further support a functional interaction between mGlu5 and NMDARs that may correspond with cognitive impairments. Present data support further development of partial mGlu5 NAMs given their potentially broader therapeutic index than full mGlu5 NAMs and use of EEG as a translational biomarker to titrate doses aligning with therapeutic versus adverse effects.

Cues play a critical role in estrous cycle-dependent enhancement of cocaine reinforcement.

While preclinical work has aimed to outline the neural mechanisms of drug addiction, it has overwhelmingly focused on male subjects. There has been a push in recent years to incorporate females into existing addiction models; however, males and females often have different behavioral strategies, making it important to not only include females, but to develop models that assess the factors that comprise female drug addiction. Traditional self-administration models often include light or tone cues that serve as discriminative stimuli and/or consequent stimuli, making it nearly impossible to disentangle the effects of cue learning, the cues themselves, and acute effects of psychostimulant drugs. To disentangle the interaction between drug-associated cues and the consummatory and appetitive responding driven by cocaine, we have developed a new behavioral procedure that combines Pavlovian-instrumental transfer with behavioral economic analysis. This task can be completed within a single session, allowing for studies looking at estrous cycle stage-dependent effects in intact cycling females, something that has been difficult in the past. In this study, we found no differences in self-administration across the estrous cycle in the absence of cues; however, when cues were introduced, the cues that acquired value during estrus-but not during diestrus or in males-increased motivation. Cues paired during estrus also increased c-fos expression to a greater extent in striatal regions, an effect that may underlie the observed increases in seeking induced by these cues, even weeks later. Together, these data suggest that fundamental differences in the motivational properties of psychostimulant drugs between males and females are complex and are driven primarily by the interaction between drug-associated stimuli and drug effects.

A new Caenorhabditis elegans model of human huntingtin 513 aggregation and toxicity in body wall muscles.

Expanded polyglutamine repeats in different proteins are the known determinants of at least nine progressive neurodegenerative disorders whose symptoms include cognitive and motor impairment that worsen as patients age. One such disorder is Huntington's Disease (HD) that is caused by a polyglutamine expansion in the human huntingtin protein (htt). The polyglutamine expansion destabilizes htt leading to protein misfolding, which in turn triggers neurodegeneration and the disruption of energy metabolism in muscle cells. However, the molecular mechanisms that underlie htt proteotoxicity have been somewhat elusive, and the muscle phenotypes have not been well studied. To generate tools to elucidate the basis for muscle dysfunction, we engineered Caenorhabditis elegans to express a disease-associated 513 amino acid fragment of human htt in body wall muscle cells. We show that this htt fragment aggregates in C. elegans in a polyglutamine length-dependent manner and is toxic. Toxicity manifests as motor impairment and a shortened lifespan. Compared to previous models, the data suggest that the protein context in which a polyglutamine tract is embedded alters aggregation propensity and toxicity, likely by affecting interactions with the muscle cell environment.