The role of midbrain dopamine cells projecting to the insular cortex in mediated performance: Implications for animal models of reality testing.

A growing body of literature indicates that mediated learning techniques have specific utility for tapping into reality testing in animal models of neuropsychiatric illness. In particular, recent work has shown that animal models that recapitulate various endophenotypes of schizophrenia are particularly vulnerable to impairments in reality testing when undergoing mediated learning. Multiple studies have indicated that these effects are dopamine receptor 2-dependent and correlated with aberrant insular cortex (IC) activity. However, until now, the connection between dopamine and the IC had not been investigated. Here, we utilized a novel intersectional approach to label mesencephalic dopamine cells that specifically project to the insular cortex in both wild-type controls and transgenic mice expressing the dominant-negative form of the Disrupted-in-Schizophrenia-1 (DISC-1) gene. Using these techniques, we identified a population of cells that project from the ventral tegmental area (VTA) to the IC. Afterward, we conducted multiple studies to test the necessity of this circuit in behaviors ranging from gustatory detection to the maintenance of effort and, finally, mediated performance. Our results indicate that perturbations of the DISC-1 genetic locus lead to a reduction in the number of cells in the VTA → IC circuit. Behaviorally, VTA → IC circuitry does not influence gustatory detection or motivation to acquire sucrose reward; however, inactivation of this circuit differentially suppresses Pavlovian approach behavior in wild-type and DISC-1 transgenic mice during mediated performance testing. Moreover, under these testing conditions, inactivation of this circuit predisposes wild-type (but not DISC-1) mice to display impaired reality testing. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Temporal discounting predicts procrastination in the real world.

People procrastinate, but why? One long-standing hypothesis is that temporal discounting drives procrastination: in a task with a distant future reward, the discounted future reward fails to provide sufficient motivation to initiate work early. However, empirical evidence for this hypothesis has been lacking. Here, we used a long-term real-world task and a novel measure of procrastination to examine the association between temporal discounting and real-world procrastination. To measure procrastination, we critically measured the entire time course of the work progress instead of a single endpoint, such as task completion day. This approach allowed us to compute a fine-grained metric of procrastination. We found a positive correlation between individuals' degree of future reward discounting and their level of procrastination, suggesting that temporal discounting is a cognitive mechanism underlying procrastination. We found no evidence of a correlation when we, instead, measured procrastination by task completion day or by survey. This association between temporal discounting and procrastination offers empirical support for targeted interventions that could mitigate procrastination, such as modifying incentive systems to reduce the delay to a reward and lowering discount rates.

The caloric value of food intake structurally adjusts a neuronal mushroom body circuit mediating olfactory learning in Drosophila.

Associative learning enables the adaptive adjustment of behavioral decisions based on acquired, predicted outcomes. The valence of what is learned is influenced not only by the learned stimuli and their temporal relations, but also by prior experiences and internal states. In this study, we used the fruit fly Drosophila melanogaster to demonstrate that neuronal circuits involved in associative olfactory learning undergo restructuring during extended periods of low-caloric food intake. Specifically, we observed a decrease in the connections between specific dopaminergic neurons (DANs) and Kenyon cells at distinct compartments of the mushroom body. This structural synaptic plasticity was contingent upon the presence of allatostatin A receptors in specific DANs and could be mimicked optogenetically by expressing a light-activated adenylate cyclase in exactly these DANs. Importantly, we found that this rearrangement in synaptic connections influenced aversive, punishment-induced olfactory learning but did not impact appetitive, reward-based learning. Whether induced by prolonged low-caloric conditions or optogenetic manipulation of cAMP levels, this synaptic rearrangement resulted in a reduction of aversive associative learning. Consequently, the balance between positive and negative reinforcing signals shifted, diminishing the ability to learn to avoid odor cues signaling negative outcomes. These results exemplify how a neuronal circuit required for learning and memory undergoes structural plasticity dependent on prior experiences of the nutritional value of food.

Reconfigurations of cortical manifold structure during reward-based motor learning.

Adaptive motor behavior depends on the coordinated activity of multiple neural systems distributed across the brain. While the role of sensorimotor cortex in motor learning has been well established, how higher-order brain systems interact with sensorimotor cortex to guide learning is less well understood. Using functional MRI, we examined human brain activity during a reward-based motor task where subjects learned to shape their hand trajectories through reinforcement feedback. We projected patterns of cortical and striatal functional connectivity onto a low-dimensional manifold space and examined how regions expanded and contracted along the manifold during learning. During early learning, we found that several sensorimotor areas in the dorsal attention network exhibited increased covariance with areas of the salience/ventral attention network and reduced covariance with areas of the default mode network (DMN). During late learning, these effects reversed, with sensorimotor areas now exhibiting increased covariance with DMN areas. However, areas in posteromedial cortex showed the opposite pattern across learning phases, with its connectivity suggesting a role in coordinating activity across different networks over time. Our results establish the neural changes that support reward-based motor learning and identify distinct transitions in the functional coupling of sensorimotor to transmodal cortex when adapting behavior.

The Affective Bias Test and Reward Learning Assay: Neuropsychological Models for Depression Research and Investigating Antidepressant Treatments in Rodents.

The Affective Bias Test (ABT) quantifies acute changes in affective state based on the affective biases they generate in an associative reward learning task. The Reward Learning Assay (RLA) provides a control assay for the ABT and reward-induced biases generated in this model are sensitive to changes in core affective state. Both tasks involve training animals to associate a specific digging substrate with a food reward. Animals learn to discriminate between two digging substrates placed in ceramic bowls, one rewarded and one unrewarded. In the ABT, the animal learns two independent substrate-reward associations with a fixed reward value following either an affective state or drug manipulation, or under control conditions. Affective biases generated are quantified in a choice test where the animals exhibit a bias (make more choices) for one of the substrates which is specifically related to affective state at the time of learning. The ABT is used to investigate biases generated during learning as well as modulation of biases associated with past experiences. The RLA follows a similar protocol, but the animal remains in the same affective state throughout and a reward-induced bias is generated by pairing one substrate with a higher value reward. The RLA provides a control to determine if drug treatments affect memory retrieval more generally. Studies in depression models and following environmental enrichment suggest that reward-induced biases are sensitive to core changes in affective state. Each task offers different insights into affective processing mechanisms and may help improve the translational validity of animal studies and benefit pre-clinical drug development. © 2024 The Authors. Current Protocols published by Wiley Periodicals LLC. Basic Protocol 1: Bowl digging and discrimination training Basic Protocol 2: The reward learning assay Basic Protocol 3: The affective bias test - new learning Basic Protocol 4: The affective bias test - modulation of affective biases associated with past experiences.

Uncertainty of treatment efficacy moderates placebo effects on reinforcement learning.

The placebo-reward hypothesis postulates that positive effects of treatment expectations on health (i.e., placebo effects) and reward processing share common neural underpinnings. Moreover, experiments in humans and animals indicate that reward uncertainty increases striatal dopamine, which is presumably involved in placebo responses and reward learning. Therefore, treatment uncertainty analogously to reward uncertainty may affect updating from rewards after placebo treatment. Here, we address whether different degrees of uncertainty regarding the efficacy of a sham treatment affect reward sensitivity. In an online between-subjects experiment with N = 141 participants, we systematically varied the provided efficacy instructions before participants first received a sham treatment that consisted of listening to binaural beats and then performed a probabilistic reinforcement learning task. We fitted a Q-learning model including two different learning rates for positive (gain) and negative (loss) reward prediction errors and an inverse gain parameter to behavioral decision data in the reinforcement learning task. Our results yielded an inverted-U-relationship between provided treatment efficacy probability and learning rates for gain, such that higher levels of treatment uncertainty, rather than of expected net efficacy, affect presumably dopamine-related reward learning. These findings support the placebo-reward hypothesis and suggest harnessing uncertainty in placebo treatment for recovering reward learning capabilities.

General mechanisms of task engagement in the primate frontal cortex.

Staying engaged is necessary to maintain goal-directed behaviors. Despite this, engagement exhibits continuous, intrinsic fluctuations. Even in experimental settings, animals, unlike most humans, repeatedly and spontaneously move between periods of complete task engagement and disengagement. We, therefore, looked at behavior in male macaques (macaca mulatta) in four tasks while recording fMRI signals. We identified consistent autocorrelation in task disengagement. This made it possible to build models capturing task-independent engagement. We identified task general patterns of neural activity linked to impending sudden task disengagement in mid-cingulate gyrus. By contrast, activity centered in perigenual anterior cingulate cortex (pgACC) was associated with maintenance of performance across tasks. Importantly, we carefully controlled for task-specific factors such as the reward history and other motivational effects, such as response vigor, in our analyses. Moreover, we showed pgACC activity had a causal link to task engagement: transcranial ultrasound stimulation of pgACC changed task engagement patterns.

Two Distinct Neuronal Populations in the Rat Parafascicular Nucleus Oppositely Encode the Engagement in Stimulus-driven Reward-seeking.

BACKGROUND: The thalamus is a phylogenetically well-preserved structure. Known to densely contact cortical regions, its role in the transmission of sensory information to the striatal complex has been widely reconsidered in recent years. METHODS: The parafascicular nucleus of the thalamus (Pf) has been implicated in the orientation of attention toward salient sensory stimuli. In a stimulus-driven reward-seeking task, we sought to characterize the electrophysiological activity of Pf neurons in rats. RESULTS: We observed a predominance of excitatory over inhibitory responses for all events in the task. Neurons responded more strongly to the stimulus compared to lever-pressing and reward collecting, confirming the strong involvement of the Pf in sensory information processing. The use of long sessions allowed us to compare neuronal responses to stimuli between trials when animals were engaged in action and those when they were not. We distinguished two populations of neurons with opposite responses: MOTIV+ neurons responded more intensely to stimuli followed by a behavioral response than those that were not. Conversely, MOTIV- neurons responded more strongly when the animal did not respond to the stimulus. In addition, the latency of excitation of MOTIV- neurons was shorter than that of MOTIV+ neurons. CONCLUSION: Through this encoding, the Pf could perform an early selection of environmental stimuli transmitted to the striatum according to motivational level.

Are lateralized and bold fish optimistic or pessimistic?

Cognitive bias is defined as the influence of emotions on cognitive processes. The concept of the cognitive judgement bias has its origins in human psychology but has been applied to animals over the past 2 decades. In this study we were interested in determining if laterality and personality traits, which are known to influence learning style, might also be correlated with a cognitive bias in the three-spined sticklebacks (Gasterosteus aculeatus). We used the judgement bias test with the go/no-go procedure where fish were first trained to discriminate between a black and white card and, after reaching a minimum learning criterion, tested their response to an ambiguous card (grey). Optimistic subjects were expected to have a high expectation of reward associated with an ambiguous stimulus, whereas pessimistic subjects a high expectation of non-reward. We used an emergence and a mirror test to quantify boldness and laterality, respectively. We hypothesised that male, bolder and more strongly lateralized fish would be more optimistic than female, shy and less strongly lateralised fish. We found that males and more strongly lateralized fish were more optimistic than females and less strongly lateralized fish. In addition, bold males were more optimistic than shy males as we predicted, but females showed the opposite pattern. Finally, fish trained on the black colour card learned the training task faster than those trained on a white card. Our results indicate that both laterality and personality traits are linked to animals' internal states (pessimistic or optimistic outlooks) which likely has broad implications for understanding animal behaviour particularly in a welfare context.

Anticipatory and consummatory neural correlates of monetary and music rewarding stimuli.

Most of the literature on the neural bases of human reward and punishment processing has used monetary gains and losses, but less is known about the neurophysiological mechanisms underlying the anticipation and consumption of other types of rewarding stimuli. In the present study, EEG was recorded from 19 participants who completed a modified version of the Monetary Incentive Delay (MID) task. During the task, cues providing information about potential future outcomes were presented to the participants. Then, they had to respond rapidly to a target stimulus to win money or listening to pleasant music, or to avoid losing money or listening to unpleasant music. Results revealed similar responses for monetary and music cues, with increased activity for cues indicating potential gains compared to losses. However, differences emerged in the outcome phase between money and music. Monetary outcomes showed an interaction between the type of the cue and the outcome in the Feedback Related Negativity and Fb-P3 ERPs and increased theta activity increased for negative feedbacks. In contrast, music outcomes showed significant interactions in the Fb-P3 and theta activities. These findings suggest similar neurophysiological mechanisms in processing cues for potential positive or negative outcomes in these two types of stimuli.

Task-induced deactivation dysfunction during reward processing is associated with low self-esteem in a possible subtype of major depression.

INTRODUCTION: Low self-esteem is a frequent symptom in major depressive disorder (MDD). This functional magnetic resonance imaging study investigated whether MDD patients with low self-esteem show a distinct neural pathophysiology. Previous studies linked low self-esteem to reduced task-induced deactivation of the pregenual anterior cingulate cortex (pgACC) as a part of the default mode network, and to reduced connectivity between pgACC and reward system. Goya-Maldonado et al. identified an MDD subtype with pgACC and ventral striatal overactivations during reward processing. We hypothesized that this subtype might be characterized by low self-esteem. METHODS: Eighty-three MDD patients performed the desire-reason dilemma task and completed the Rosenberg Self-Esteem Scale (RSES). Brain activity during bottom-up reward processing was regressed upon the RSES scores, controlling for depression severity measured by the Montgomery-Åsberg Depression Rating Scale. To corroborate the findings, we compared self-esteem scores between patient subgroups with impaired task-induced deactivation (n = 31) and with preserved task-induced deactivation (n = 31) of the pgACC. RESULTS: Consistent with our a priori hypothesis, activity in a bilateral fronto-striatal network including pgACC and ventral striatum correlated negatively with RSES scores, also when controlling for depression severity. In the additional analysis, patients with impaired task-induced pgACC deactivation showed lower self-esteem (t (52.82) = -2.27; p = .027, d = 0.58) compared to those with preserved task-induced pgACC deactivation. CONCLUSIONS: We conclude that low self-esteem in MDD patients is linked to a task-induced deactivation dysfunction of the pgACC. Our findings suggest that a previously described possible subtype of MDD with pgACC and ventral striatal overactivations during reward processing is clinically characterized by low self-esteem.

Difficulty sensitivity replaces reward sensitivity during adolescence: Task-related fMRI and functional connectivity during self-regulative learning choices.

AIM: We examined age-related differences in valuation and cognitive control circuits during value-based decision-making. METHODS: 13-year-olds (N = 25) and 17-year-olds (N = 22) made a metacognitive choice to be tested or not on an upcoming learning task, based on reward and difficulty associated with word-pairs. To investigate whether these determinants of subjective value are differently processed at different ages, we performed region-of-interest(ROI)-based analyses of task-related and functional connectivity data. RESULTS: We observed age-related differences in responsiveness of valuation structures (amygdala, ventral striatum, ventromedial prefrontal cortex) and caudate nucleus, with activity modulated by reward in 13-year-olds, while in 17-year-olds activity being responsive to difficulty. These accompanied age-related differences in functional connectivity between medial prefrontal and striatal/amygdala seeds. DISCUSSION: These results are in line with current views that sensitivity changes for reward and difficulty during adolescence are the result of a maturational switch in effort-related signalling in the cognitive control circuit, which increasingly regulates value-signalling structures.

A master regulator of opioid reward in the ventral prefrontal cortex.

In addition to their intrinsic rewarding properties, opioids can also evoke aversive reactions that protect against misuse. Cellular mechanisms that govern the interplay between opioid reward and aversion are poorly understood. We used whole-brain activity mapping in mice to show that neurons in the dorsal peduncular nucleus (DPn) are highly responsive to the opioid oxycodone. Connectomic profiling revealed that DPn neurons innervate the parabrachial nucleus (PBn). Spatial and single-nuclei transcriptomics resolved a population of PBn-projecting pyramidal neurons in the DPn that express µ-opioid receptors (µORs). Disrupting µOR signaling in the DPn switched oxycodone from rewarding to aversive and exacerbated the severity of opioid withdrawal. These findings identify the DPn as a key substrate for the abuse liability of opioids.

Inferential reasoning abilities in wild-caught bumblebees.

The ability to make a decision by excluding alternatives (i.e. inferential reasoning) is a type of logical reasoning that allows organisms to solve problems with incomplete information. Several species of vertebrates have been shown to find hidden food using inferential reasoning abilities. Yet little is known about invertebrates' logical reasoning capabilities. In three experiments, I examined wild-caught bumblebees' abilities to locate a 'rewarded' stimulus using direct information or incomplete information-the latter requiring bees to use inferential reasoning. To do so, I adapted three paradigms previously used with primates-the two-cup, three-cup and double two-cup tasks. Bumblebees saw either two paper strips (experiment 1), three paper strips (experiment 2) or two pairs of paper strips (experiment 3) and experienced one of them being rewarded or unrewarded. At the test, they could choose between two (experiment 1), three (experiment 2) or four paper strips (experiment 3). Bumblebees succeeded in the three tasks and their performance was consistent with inferential reasoning. These findings highlight the importance of comparative studies with invertebrates to comprehensively track the evolution of reasoning abilities, in particular, and cognition, in general.

Chimpanzees (Pan troglodytes) recognize that their guesses could be wrong and can pass a two-cup disjunctive syllogism task.

When chimpanzees search for hidden food, do they realize that their guesses may not be correct? We applied a post-decision wagering paradigm to a simple two-cup search task, varying whether we gave participants visual access to the baiting and then asking after they had chosen one of the cups whether they would prefer a smaller but certain reward instead of their original choice (experiment 1). Results showed that chimpanzees were more likely to accept the smaller reward in occluded than visible conditions. Experiment 2 found the same effect when we blocked visual access but manipulated the number of hiding locations for the food piece, showing that the effect is not owing to representation type. Experiments 3 and 4 showed that when given information about the contents of the unchosen cup, chimpanzees were able to flexibly update their choice behaviour accordingly. These results suggest that language is not a pre-requisite to solving the disjunctive syllogism and provides a valuable contribution to the debate on logical reasoning in non-human animals.

The paradigm of tax-reward and tax-punishment strategies in the advancement of public resource management dynamics.

In contemporary society, the effective utilization of public resources remains a subject of significant concern. A common issue arises from defectors seeking to obtain an excessive share of these resources for personal gain, potentially leading to resource depletion. To mitigate this tragedy and ensure sustainable development of resources, implementing mechanisms to either reward those who adhere to distribution rules or penalize those who do not, appears advantageous. We introduce two models: a tax-reward model and a tax-punishment model, to address this issue. Our analysis reveals that in the tax-reward model, the evolutionary trajectory of the system is influenced not only by the tax revenue collected but also by the natural growth rate of the resources. Conversely, the tax-punishment model exhibits distinct characteristics when compared with the tax-reward model, notably the potential for bistability. In such scenarios, the selection of initial conditions is critical, as it can determine the system's path. Furthermore, our study identifies instances where the system lacks stable points, exemplified by a limit cycle phenomenon, underscoring the complexity and dynamism inherent in managing public resources using these models.

Oxytocin attenuates cocaine-associated place preference via the dorsal hippocampus in male and female rats.

Cocaine addiction is the third largest cause of overdose-related deaths in the United States. Research investigating therapeutic targets for cocaine reward processes is key to combating this issue. The neuropeptide oxytocin (OXT) has been shown to reduce cocaine reward processes, though specific mechanisms are not understood. This study examines the effect of intra-dorsal hippocampal (DH) OXT on the expression of cocaine context associations using a conditioned place preference (CPP) paradigm. In this paradigm, one of two visually distinct chambers is paired with a drug. With repeated pairings, control animals display preference for the drug-associated context by spending more time in that context at test. In the present study, four conditioning days took place where male and female rats were injected with either cocaine or saline and placed into the corresponding chamber. On test day, rats received infusions of OXT or saline (VEH) into the DH and were allowed access to both chambers. The results show that while VEH-infused rats displayed cocaine CPP, OXT-infused rats did not prefer the cocaine-paired chamber. These findings implicate the DH as necessary in the mechanism by which OXT acts to block the expression of cocaine-context associations, providing insight into how OXT may exert its therapeutic effect in cocaine reward processes.

Effects of the Synthetic Cathinone α-Pyrrolidinobutiothiophenone (α-PBT) on Discriminative Stimulus Effects and Intracranial Self-Stimulation Thresholds in Male Rats.

Recently, the abuse of synthetic cathinones is increasing among young people. α-Pyrrolidinobutiothiophenone (α-PBT), a synthetic cathinone, is a designer drug that is freely traded online with no legal restrictions. Moreover, there is currently no scientific basis for legal regulation. Here, we examined the addictive properties of α-PBT using a drug discrimination (DD) task. We also investigated the role of α-PBT in brain stimulation reward (BSR) using an intracranial self-stimulation (ICSS) paradigm in rats. Initially, the rats were trained to discriminate between cocaine and saline. After the discrimination training criteria were met, we determined the dose-effect curves of cocaine and conducted generalization tests with α-PBT and α-pyrrolidinopentiothiophenone (α-PVT) using a cumulative dosing protocol. In a separate set of studies, we examined the dopaminergic mechanisms underlying the function of α-PBT as an interoceptive stimulus (17.8 mg/kg) by intraperitoneally injecting either the dopamine (DA) D1 antagonist SCH23390 (0.06 and 0.12 mg/kg) or the D2 antagonist eticlopride (0.05 and 0.1 mg/kg) 15 min before DD testing. Brain reward function was measured using an ICSS procedure to examine the effects of α-PBT on ICSS threshold under the frequency-rate procedure. Our results showed that α-PBT functioned as a discriminative cue similar to cocaine in rats. More importantly, SCH23390 abolished the effects of α-PBT as an interoceptive stimulus in a dose-dependent manner in rats trained to press a lever to receive cocaine. Similarly, eticlopride dose-dependently attenuated the effect of α-PBT used as a discriminative cue. Additionally, cumulative α-PBT administration dose-dependently lowered ICSS thresholds compared with those in saline-treated rats. Furthermore, α-PBT-induced potentiation of BSR was abolished by pretreatment with both SCH23390 and eticlopride. Taken together, our results suggest that α-PBT can function as a cocaine-like discriminative cue via the activation of D1 and D2 receptors. α-PBT also appears to influence BSR by reducing the brain reward threshold via changes in D1 and D2 receptors. The present study suggests that α-PBT could have addictive properties through DA D1 and D2 receptors and thus poses a threat to humans.

Repetition suppression between monetary loss and social pain.

The relationship between monetary loss and pain has been a recent research focus. Prior studies found similarities in the network representation patterns of monetary loss and pain, particularly social pain. However, the neural level evidence was lacking. To address this, we conducted an ERP experiment to investigate whether there is a repetitive suppression effect of monetary loss on the neural activity of social pain, aiming to understand if they engage overlapping neuronal populations. The results revealed that FRN amplitudes showed repetitive suppression effects of monetary loss on the neural activity of social pain. Our study suggests that monetary loss and social pain share common neural bases, indicating that they might involve shared neural modules related to cognitive conflict and affective appraisal.

The associations between autistic characteristics and microtransaction spending.

Microtransactions provide optional, virtual, video game goods that, for an additional cost to the player, provide additional game content and alter the gameplay experience. Loot boxes-a specific form of microtransaction-offer randomised rewards in exchange for payment, and are argued to be structurally and psychologically similar to gambling. Nascent research suggests that a link exists between autism and both problematic gaming and problematic gambling. Here, we investigated the relationships between autistic characteristics and experiences, and excessive video gaming and microtransaction expenditure. A sample of 1178 adults from Australia, Aotearoa, and The United States were recruited from Prolific Academic, and completed a survey measuring in-game expenditure, autistic characteristics and experiences, problematic gaming, problematic gambling, and risky loot box use. Analyses showed positive associations between autistic characteristics and experiences with problematic gaming and problem gambling symptomatology. However, results also showed a small, negative association between autistic characteristics and experiences and spending on loot boxes when problem gambling symptoms, problematic gaming, and risky loot box use were statistically controlled for. These results suggest that autistic gamers may be vulnerable to problematic gaming and gambling, but that this effect does not extend to the purchasing of microtransactions.