Goal-directed behavior in Tenebrio molitor larvae.

Can signs of intentional behavior be traced in an insect larva, traditionally thought to be driven only by mere reflexes? We trained Tenebrio molitor coleoptera larvae in a uniform Y-maze to prefer one target branch to get access to food, observing their ability to learn and retain access to the reward-associated side for up to 24 h. During reward devaluation, the reward food (experimental group) and a different food (control group) were paired with an aversive stimulus in a new environment. When tested again in the Y-maze, mealworms of the experimental group significantly reduced their visits to the target branch, whereas mealworms of the control group did not. Importantly, we found that the larvae did not have to experience the unpleasant consequences directly in the target branch to halt their behavior, as the exposure to the aversive taste occurred in a separate unfamiliar context. This is evidence that the mealworms formed a mental representation of action-consequence relationships, demonstrating flexible control of their actions to achieve desired outcomes at an early stage of their development.

Does bumblebee preference of continuous over interrupted strings in string-pulling tasks indicate means-end comprehension?

Bumblebees (Bombus terrestris) have been shown to engage in string-pulling behavior to access rewards. The objective of this study was to elucidate whether bumblebees display means-end comprehension in a string-pulling task. We presented bumblebees with two options: one where a string was connected to an artificial flower containing a reward and the other presenting an interrupted string. Bumblebees displayed a consistent preference for pulling connected strings over interrupted ones after training with a stepwise pulling technique. When exposed to novel string colors, bees continued to exhibit a bias towards pulling the connected string. This suggests that bumblebees engage in featural generalization of the visual display of the string connected to the flower in this task. If the view of the string connected to the flower was restricted during the training phase, the proportion of bumblebees choosing the connected strings significantly decreased. Similarly, when the bumblebees were confronted with coiled connected strings during the testing phase, they failed to identify and reject the interrupted strings. This finding underscores the significance of visual consistency in enabling the bumblebees to perform the task successfully. Our results suggest that bumblebees' ability to distinguish between continuous strings and interrupted strings relies on a combination of image matching and associative learning, rather than means-end understanding. These insights contribute to a deeper understanding of the cognitive processes employed by bumblebees when tackling complex spatial tasks.

Distractor effects in decision making are related to the individual's style of integrating choice attributes.

Humans make irrational decisions in the presence of irrelevant distractor options. There is little consensus on whether decision making is facilitated or impaired by the presence of a highly rewarding distractor, or whether the distractor effect operates at the level of options' component attributes rather than at the level of their overall value. To reconcile different claims, we argue that it is important to consider the diversity of people's styles of decision making and whether choice attributes are combined in an additive or multiplicative way. Employing a multi-laboratory dataset investigating the same experimental paradigm, we demonstrated that people used a mix of both approaches and the extent to which approach was used varied across individuals. Critically, we identified that this variability was correlated with the distractor effect during decision making. Individuals who tended to use a multiplicative approach to compute value, showed a positive distractor effect. In contrast, a negative distractor effect (divisive normalisation) was prominent in individuals tending towards an additive approach. Findings suggest that the distractor effect is related to how value is constructed, which in turn may be influenced by task and subject specificities. This concurs with recent behavioural and neuroscience findings that multiple distractor effects co-exist.

High overcommitment and low reward as potential predictors for increased depressive symptoms, suicidal ideation, and suicide risk in German veterinarians.

Higher rates of depression, suicidal ideation and suicide risk have been reported for veterinarians in Germany. In this study, several demographic and job-related factors were examined to determine whether they could be considered possible predictors of depression, suicidal ideation, and suicide risk. For this purpose, a survey was conducted among veterinarians in Germany. The demographic factors surveyed were gender, age, working status (employed/self-employed), income, field of work (practicing/non-practicing veterinarian), weekly working hours and community size. For assessing job-related factors, the Effort-Reward-Imbalance questionnaire (effort, reward, overcommitment), several subscales of the Copenhagen Psychosocial Questionnaire (quantitative demands, emotional demands, demands for hiding emotions, meaning of work, work-privacy-conflict, thoughts of leaving the job) and the Copenhagen Burnout Inventory were used. A hierarchical logistic regression analysis was performed with the demographic and job-related factors as independent variables and depressive symptoms, suicidal ideation, and suicide risk as dependent variables, respectively. A total of 3.118 veterinarians (78.8% female) between 22 and 69 years (mean age 41.3 years) were included in the study. The factors used resulted in the highest variance explanation for depressive symptoms (57%), followed by suicidal ideation (34%) and suicide risk (23%). Low reward and high overcommitment were found to be the most important predictors of depressive symptoms, suicidal ideation, and suicide risk. Significant relationships with depressive symptoms, suicidal ideation, and suicide risk were also found for burnout, demands for hiding emotions, and thoughts of leaving the job. The results of this study point to opportunities for changes in the veterinary working environment, for the development of prevention and intervention programs for veterinarians, and for the further development of the veterinary curriculum to strengthen the mental health of veterinarians in Germany.

Humans flexibly integrate social information despite interindividual differences in reward.

There has been much progress in understanding human social learning, including recent studies integrating social information into the reinforcement learning framework. Yet previous studies often assume identical payoffs between observer and demonstrator, overlooking the diversity of social information in real-world interactions. We address this gap by introducing a socially correlated bandit task that accommodates payoff differences among participants, allowing for the study of social learning under more realistic conditions. Our Social Generalization (SG) model, tested through evolutionary simulations and two online experiments, outperforms existing models by incorporating social information into the generalization process, but treating it as noisier than individual observations. Our findings suggest that human social learning is more flexible than previously believed, with the SG model indicating a potential resource-rational trade-off where social learning partially replaces individual exploration. This research highlights the flexibility of humans' social learning, allowing us to integrate social information from others with different preferences, skills, or goals.

Neural adaptation of the reward system in primary dysmenorrhea.

Introduction: The brain's reward system (RS) reacts differently to pain and its alleviation. This study examined the correlation between RS activity and behavior during both painful and pain-free periods in individuals with primary dysmenorrhea (PDM) to elucidate their varying responses throughout the menstrual cycle. Methods: Ninety-two individuals with PDM and 90 control participants underwent resting-state functional magnetic resonance imaging (rsfMRI) scans during their menstrual and peri-ovulatory phases. Regional homogeneity (ReHo) and amplitude of low-frequency fluctuation (ALFF) analyses were used to evaluate RS responses. Psychological evaluations were conducted using the McGill Pain Questionnaire and the Pain Catastrophizing Scale. Results: ReHo analysis showed higher values in the left putamen and right amygdala of the PDM group during the peri-ovulatory phase compared to the menstrual phase. ALFF analysis revealed lower values in the putamen of the PDM group compared to controls, regardless of phase. ReHo and ALFF values in the putamen, amygdala, and nucleus accumbens were positively correlated with pain scales during menstruation, while ALFF values in the ventral tegmental area inversely correlated with pain intensity. Those with severe PDM (pain intensity ≥7) displayed distinct amygdala ALFF patterns between pain and pain-free phases. PDM participants also had lower ReHo values in the left insula during menstruation, with no direct correlation to pain compared to controls. Discussion: Our study highlights the pivotal role of the RS in dysmenorrhea management, exhibiting varied responses between menstrual discomfort and non-painful periods among individuals with PDM. During menstruation, the RS triggers mechanisms for pain avoidance and cognitive coping strategies, while it transitions to processing rewards during the peri-ovulatory phase. This demonstrates the flexibility of the RS in adapting to the recurring pain experienced by those with PDM.

Aberrant high-beta band functional connectivity during reward processing in melancholic major depressive disorder: An MEG study.

OBJECTIVE: To identify the spatial-temporal pattern variation of whole-brain functional connectivity (FC) during reward processing in melancholic major depressive disorder (MDD) patients, and to determine the clinical correlates of connectomic differences. METHODS: 61 MDD patients and 32 healthy controls were enrolled into the study. During magnetoencephalography (MEG) scanning, all participants completed the facial emotion recognition task. The MDD patients were further divided into two groups: melancholic (n = 31) and non-melancholic (n = 30), based on the Mini International Neuropsychiatric Interview (M.I.N.I.) assessment. Melancholic symptoms were examined by using the 6-item melancholia subscale from the Hamilton Depression Rating Scale (HAM-D6). The whole-brain orthogonalized power envelope connections in the high-beta band (20-35 Hz) were constructed in each period after the happy emotional stimuli (0-200 ms, 100-300 ms, 200-400 ms, 300-500 ms, and 400-600 ms). Then, the network-based statistic (NBS) was used to determine the specific abnormal connection patterns in melancholic MDD patients. RESULTS: The NBS identified a sub-network difference at the mid-late period (300-500 ms) in response to happy faces among the three groups (corrected P = 0.035). Then, the post hoc and correlation analyses found five FCs were decreased in melancholic MDD patients and were related to HAM-D6 score, including FCs of left fusiform gyrus-right orbital inferior frontal gyrus (r = -0.52, P < 0.001), left fusiform gyrus-left amygdala (r = -0.26, P = 0.049), left posterior cingulate gyrus-right precuneus (r = -0.32, P = 0.025), left precuneus-right precuneus (r = -0.27, P = 0.049), and left precuneus-left inferior occipital gyrus (r = -0.32, P = 0.025). CONCLUSION: In response to happy faces, melancholic MDD patients demonstrated a disrupted functional connective pattern (20-35 Hz, 300-500 ms), which involved brain regions in visual information processing and the limbic system. The aberrant functional connective pattern in reward processing might be a biomarker of melancholic MDD.

Reward-modulated attention deployment is driven by suppression, not attentional capture.

One driving factor for attention deployment towards a stimulus is its associated value due to previous experience and learning history. Previous visual search studies found that when looking for a target, distractors associated with higher reward produce more interference (e.g., longer response times). The present study investigated the neural mechanism of such value-driven attention deployment. Specifically, we were interested in which of the three attention sub-processes are responsible for the interference that was repeatedly observed behaviorally: enhancement of relevant information, attentional capture by irrelevant information, or suppression of irrelevant information. We replicated earlier findings showing longer response times and lower accuracy when a target competed with a high-reward compared to a low-reward distractor. We also found a spatial gradient of interference: behavioral performance dropped with increasing proximity to the target. This gradient was steeper for high- than low-reward distractors. Event-related potentials of the EEG signal showed the reason for the reward-induced attentional bias: High-reward distractors required more suppression than low-reward distractors as evident in larger Pd components. This effect was only found for distractors near targets, showing the additional filtering needs required for competing stimuli in close proximity. As a result, fewer attentional resources can be distributed to the target when it competes with a high-reward distractor, as evident in a smaller target-N2pc amplitude. The distractor-N2pc, indicative of attentional capture, was neither affected by distance nor reward, showing that attentional capture alone cannot explain interference by stimuli of high value. In sum our results show that the higher need for suppression of high-value stimuli contributes to reward-modulated attention deployment and increased suppression can prevent attentional capture of high-value stimuli.

Pre-supplementary motor area strengthens reward sensitivity in intertemporal choice.

Previous investigations on the causal neural mechanisms underlying intertemporal decision making focused on the dorsolateral prefrontal cortex as neural substrate of cognitive control. However, little is known, about the causal contributions of further parts of the frontoparietal control network to delaying gratification, including the pre-supplementary motor area (pre-SMA) and posterior parietal cortex (PPC). Conflicting previous evidence related pre-SMA and PPC either to evidence accumulation processes, choice biases, or response caution. To disentangle between these alternatives, we combined drift diffusion models of decision making with online transcranial magnetic stimulation (TMS) over pre-SMA and PPC during an intertemporal decision task. While we observed no robust effects of PPC TMS, perturbation of pre-SMA activity reduced preferences for larger over smaller rewards. A drift diffusion model of decision making suggests that pre-SMA increases the weight assigned to reward magnitudes during the evidence accumulation process without affecting choice biases or response caution. Taken together, the current findings reveal the computational role of the pre-SMA in value-based decision making, showing that pre-SMA promotes choices of larger, costly rewards by strengthening the sensitivity to reward magnitudes.

The association between social rewards and anxiety: Links from neurophysiological analysis in virtual reality and social interaction game.

Individuals' affective experience can be intricate, influenced by various factors including monetary rewards and social factors during social interaction. However, within this array of factors, divergent evidence has been considered as potential contributors to social anxiety. To gain a better understanding of the specific factors associated with anxiety during social interaction, we combined a social interaction task with neurophysiological recordings obtained through an anxiety-elicitation task conducted in a Virtual Reality (VR) environment. Employing inter-subject representational similarity analysis (ISRSA), we explored the potential linkage between individuals' anxiety neural patterns and their affective experiences during social interaction. Our findings suggest that, after controlling for other factors, the influence of the partner's emotional cues on individuals' affective experiences is specifically linked to their neural pattern of anxiety. This indicates that the emergence of anxiety during social interaction may be particularly associated with the emotional cues provided by the social partner, rather than individuals' own reward or prediction errors during social interaction. These results provide further support for the cognitive theory of social anxiety and extend the application of VR in future cognitive and affective studies.

Monitoring and enhancing the co-operation of IoT network rhrough scheduling function based punishment reward strategy.

The Internet of Things (IoT) has revolutionized the connectivity of physical devices, leading to an exponential increase in multimedia wireless traffic and creating substantial demand for radio spectrum. Given the inherent scarcity of available spectrum, Cognitive Radio (CR)-assisted IoT emerges as a promising solution to optimize spectrum utilization through cooperation between cognitive and IoT nodes. Unlicensed IoT nodes can opportunistically access licensed spectrum bands without causing interference to licensed users. However, energy constraints may lead to reduced cooperation from IoT nodes during the search for vacant channels, as they aim to conserve battery life. To address this issue, we propose a Punishment-reward-based Cooperative Sensing and Data Forwarding (PR-CSDF) approach for IoT data transmission. Our method involves two key steps: (1) distributing sensing tasks among IoT nodes and (2) enhancing cooperation through a reward and punishment strategy. Evaluation results demonstrate that both secondary users (SUs) and IoT nodes achieve significant utility gains with the proposed mechanism, providing strong incentives for cooperative behaviour.

Economic foraging in a floral marketplace: asymmetrically dominated decoy effects in bumblebees.

While most models of decision-making assume that individuals assign options absolute values, animals often assess options comparatively, violating principles of economic rationality. Such 'irrational' preferences are especially common when two rewards vary along multiple dimensions of quality and a third, 'decoy' option is available. Bumblebees are models of decision-making, yet whether they are subject to decoy effects is unknown. We addressed this question using bumblebees (Bombus impatiens) choosing between flowers that varied in their nectar concentration and reward rate. We first gave bees a choice between two flower types, one higher in concentration and the other higher in reward rate. Bees were then given a choice between these flowers and either a 'concentration' or 'rate' decoy, designed to be asymmetrically dominated on each axis. The rate decoy increased bees' preference in the expected direction, while the concentration decoy did not. In a second experiment, we manipulated choices along two single reward dimensions to test whether this discrepancy was explained by differences in how concentration versus reward rate were evaluated. We found that low-concentration decoys increased bees' preference for the medium option as predicted, whereas low-rate decoys had no effect. Our results suggest that both low- and high-value flowers can influence pollinator preferences in ways previously unconsidered.

Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task.

The dopamine reward prediction error signal is known to be subjective but has so far only been assessed in aggregate choices. However, personal choices fluctuate across trials and thus reflect the instantaneous subjective reward value. In the well-established Becker-DeGroot-Marschak (BDM) auction-like mechanism, participants are encouraged to place bids that accurately reveal their instantaneous subjective reward value; inaccurate bidding results in suboptimal reward ("incentive compatibility"). In our experiment, male rhesus monkeys became experienced over several years to place accurate BDM bids for juice rewards without specific external constraints. Their bids for physically identical rewards varied trial by trial and increased overall for larger rewards. In these highly experienced animals, responses of midbrain dopamine neurons followed the trial-by-trial variations of bids despite constant, explicitly predicted reward amounts. Inversely, dopamine responses were similar with similar bids for different physical reward amounts. Support Vector Regression demonstrated accurate prediction of the animals' bids by as few as twenty dopamine neurons. Thus, the phasic dopamine reward signal reflects instantaneous subjective reward value.

Year-Long Cannabis Use for Medical Symptoms and Brain Activation During Cognitive Processes.

Importance: Cannabis is increasingly being used to treat medical symptoms, but the effects on brain function in those using cannabis for these symptoms are not known. Objective: To test whether 1 year of cannabis use for medical symptoms after obtaining a medical cannabis card was associated with increased brain activation during working memory, reward, and inhibitory control tasks, areas of cognition affected by cannabis. Design, Setting, and Participants: This cohort study was conducted from July 2017 to July 2020 among participants from the greater Boston area who were recruited as part of a clinical trial of individuals seeking medical cannabis cards for anxiety, depression, pain, or insomnia symptoms. Participants were aged between 18 and 65 years. Exclusion criteria were daily cannabis use and cannabis use disorder at baseline. Data analysis was conducted from August 2021 to April 2024. Main Outcomes and Measures: Outcomes were whole brain functional activation during tasks involving working memory, reward, and inhibitory control at baseline and after 1 year of medical cannabis card ownership. Results: Imaging was collected from participants before and 1 year after obtaining medical cannabis cards, with 57 participants at baseline (38 female [66.7%]; 6 [10.5%] Black and 45 [78.9%] White participants; 1 [1.8%] Hispanic participant; median [IQR] age, 34.0 [24.0-51.0] years) and 54 participants at 1 year (37 female [68.5%]; 4 [7.4%] Black and 48 [88.9%] White participants; 1 [1.9%] Hispanic participant, median [IQR] age, 36.5 [25.0-51.0] years). Imaging was also collected in 32 healthy control participants at baseline (22 female [68.8%]; 2 [6.2%] Black and 27 [84.4%] White participants; 3 [9.4%] Hispanic participants; median [IQR] age, 33.0 [24.8-38.2] years). In all groups and at both time points, functional imaging revealed canonical activations of the probed cognitive processes. No statistically significant difference in brain activation between the 2 time points (baseline and 1 year) in those with medical cannabis cards and no associations between changes in cannabis use frequency and brain activation after 1 year were found. Conclusions and Relevance: In this cohort study of adults obtaining medical cannabis cards for medical symptoms, no significant association between brain activation in the areas of cognition of working memory, reward, and inhibitory control and 1 year of cannabis use was observed. The results warrant further studies that probe the association of cannabis at higher doses, with greater frequency, in younger age groups, and with larger, more diverse cohorts.

Modulating reward and aversion: Insights into addiction from the paraventricular nucleus.

BACKGROUND: Drug addiction, characterized by compulsive drug use and high relapse rates, arises from complex interactions between reward and aversion systems in the brain. The paraventricular nucleus (PVN), located in the anterior hypothalamus, serves as a neuroendocrine center and is a key component of the hypothalamic-pituitary-adrenal axis. OBJECTIVE: This review aimed to explore how the PVN impacts reward and aversion in drug addiction through stress responses and emotional regulation and to evaluate the potential of PVN as a therapeutic target for drug addiction. METHODS: We review the current literature, focusing on three main neuron types in the PVN-corticotropin-releasing factor, oxytocin, and arginine vasopressin neurons-as well as other related neurons, to understand their roles in modulating addiction. RESULTS: Existing studies highlight the PVN as a key mediator in addiction, playing a dual role in reward and aversion systems. These findings are crucial for understanding addiction mechanisms and developing targeted therapies. CONCLUSION: The role of PVN in stress response and emotional regulation suggests its potential as a therapeutic target in drug addiction, offering new insights for addiction treatment.

Learning depends on the information conveyed by temporal relationships between events and is reflected in the dopamine response to cues.

Contemporary theories guiding the search for neural mechanisms of learning and memory assume that associative learning results from the temporal pairing of cues and reinforcers resulting in coincident activation of associated neurons, strengthening their synaptic connection. While enduring, this framework has limitations: Temporal pairing-based models of learning do not fit with many experimental observations and cannot be used to make quantitative predictions about behavior. Here, we present behavioral data that support an alternative, information-theoretic conception: The amount of information that cues provide about the timing of reward delivery predicts behavior. Furthermore, this approach accounts for the rate and depth of both inhibitory and excitatory learning across paradigms and species. We also show that dopamine release in the ventral striatum reflects cue-predicted changes in reinforcement rates consistent with subjects understanding temporal relationships between task events. Our results reshape the conceptual and biological framework for understanding associative learning.

Dogs with prior experience of a task still overimitate their caregiver.

Domestic dogs have been shown to copy their caregiver's actions, including ones which are causally-irrelevant to a physical goal-a behaviour called "overimitation". In a new overimitation task with a non-food reward, this study investigated "causal misunderstanding"-falsely assuming causally-irrelevant actions to have functional relevancy-as an explanation for dog overimitation (N = 81). By providing dogs with prior experience of the task to learn about the consequences of its irrelevant box-stepping and relevant bucket-opening action to obtain a toy-ball, we tested whether and when dogs would copy their caregiver's irrelevant-action demonstrations. Dogs with and without prior experience were compared to a third (control) group of dogs, who had neither prior experience nor caregiver demonstrations of the task. Results revealed that the timing of overimitation, rather than its frequency, was closely related to dogs' prior experience: dogs with prior experience attended to their reward first, then interacted with the irrelevant box later ("post-goal overimitation"), while dogs without prior experience first interacted with the irrelevant box ("pre-goal overimitation"). Our results suggest that, when action consequences are understood, dogs are overimitating for a secondary social goal that is clearly distinct from the task goal of obtaining a physical reward.

Fins, feathers, fingers, and finding an explanation for the puzzle of ephemeral rewards.

This article discusses the ephemeral reward task and how it is not always a clear and concise choice. This is demonstrated through some animal studies involving birds and primates. This article also shows that when compared to human studies, that there are positive correlations between the BART and optimal choice in the ephemeral reward task, meaning that those who took more risks also were more inclined to be optimal. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Network state changes in sensory thalamus represent learned outcomes.

Thalamic brain areas play an important role in adaptive behaviors. Nevertheless, the population dynamics of thalamic relays during learning across sensory modalities remain unknown. Using a cross-modal sensory reward-associative learning paradigm combined with deep brain two-photon calcium imaging of large populations of auditory thalamus (medial geniculate body, MGB) neurons in male mice, we identified that MGB neurons are biased towards reward predictors independent of modality. Additionally, functional classes of MGB neurons aligned with distinct task periods and behavioral outcomes, both dependent and independent of sensory modality. During non-sensory delay periods, MGB ensembles developed coherent neuronal representation as well as distinct co-activity network states reflecting predicted task outcome. These results demonstrate flexible cross-modal ensemble coding in auditory thalamus during adaptive learning and highlight its importance in brain-wide cross-modal computations during complex behavior.

Insights into the interaction between time and reward prediction on the activity of striatal tonically active neurons: A pilot study in rhesus monkeys.

Prior studies have documented the role of the striatum and its dopaminergic input in time processing, but the contribution of local striatal cholinergic innervation has not been specifically investigated. To address this issue, we recorded the activity of tonically active neurons (TANs), thought to be cholinergic interneurons in the striatum, in two male macaques performing self-initiated movements after specified intervals in the seconds range have elapsed. The behavioral data showed that movement timing was adjusted according to the temporal requirements. About one-third of all recorded TANs displayed brief depressions in firing in response to the cue that indicates the interval duration, and the strength of these modulations was, in some instances, related to the timing of movement. The rewarding outcome of actions also impacted TAN activity, as reflected by stronger responses to the cue paralleled by weaker responses to reward when monkeys performed correctly timed movements over consecutive trials. It therefore appears that TAN responses may act as a start signal for keeping track of time and reward prediction could be incorporated in this signaling function. We conclude that the role of the striatal cholinergic TAN system in time processing is embedded in predicting rewarding outcomes during timing behavior.