The Human Centromedial Amygdala Contributes to Negative Prediction Error Signaling during Appetitive and Aversive Pavlovian Gustatory Learning.

Prediction error (PE) is the mismatch between a prior expectation and reality, and it lies at the core of associative learning about aversive and appetitive stimuli. Human studies on fear learning have linked the amygdala to aversive PEs. In contrast, the relationship between the amygdala and PE in appetitive settings and stimuli, unlike those that induce fear, has received less research attention. Animal studies show that the amygdala is a functionally heterogeneous structure. Nevertheless, the role of the amygdala nuclei in PE signaling remains unknown in humans. To clarify the role of two subdivisions of the human amygdala, the centromedial amygdala (CMA) and basolateral amygdala (BLA), in appetitive and aversive PE signaling, we used gustatory pavlovian learning involving eating-related naturalistic outcomes. Thirty-eight right-handed individuals (19 females) participated in the study. We found that surprise with neutral feedback when a reward is expected triggers activity within the left and right CMA. When an aversive outcome is expected, surprise with neutral feedback triggers activity only within the left CMA. Notably, the BLA was not activated by those conditions. Thus, the CMA engages in negative PE signaling during appetitive and aversive gustatory pavlovian learning, whereas the BLA is not critical for this process. In addition, PE-related activity within the left CMA during aversive learning is negatively correlated with neuroticism and positively correlated with extraversion. The findings indicate the importance of the CMA in gustatory learning when the value of outcomes changes and have implications for understanding psychological conditions that manifest perturbed processing of negative PEs.SIGNIFICANCE STATEMENT A discrepancy between a prediction and an actual outcome (PE) plays a crucial role in learning. Learning improves when an outcome is more significant than expected (positive PE) and worsens when it is smaller than expected (negative PE). We found that the negative PE during appetitive and aversive taste learning is associated with increased activity of the CMA, which suggests that the CMA controls taste learning. Our findings may have implications for understanding psychological states associated with deficient learning from negative PEs, such as obesity and addictive behaviors.

Modulation of aversive value coding in the vertebrate and invertebrate brain.

Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.

The relationship between sleep and appetitive conditioning: A systematic review and meta-analysis.

This systematic review and meta-analysis (PROSPERO registration animal/human studies: CRD42021234793/CRD42021234790) examined the relationship between sleep and appetitive conditioning. Inclusion criteria included: a) appetitive conditioning paradigm; b) measure of conditioning; c) sleep measurement and/or sleep loss; d) human and/etor non-human animal samples; and e) written in English. Searches of seven databases returned 3777 publications. The final sample consisted of 42 studies using primarily animal samples and involving food- and drug-related conditioning tasks. We found sleep loss disrupted appetitive conditioning of food rewards (p < 0.001) but potentiated appetitive conditioning of drug rewards (p < 0.001). Furthermore, sleep loss negatively impacted extinction learning irrespective of the reward type. Post-learning sleep was associated with increases in REM sleep (p = 0.02). Findings suggest sleep loss potentiates the impact of psychoactive substances in a manner likely to produce an increased risk of problematic substance use. In obese/overweight populations, sleep loss may be associated with deficits in the conditioning and extinction of reward-related behaviours. Further research should assess the relationship between sleep and appetitive conditioning in humans.

Stress effects on memory retrieval of aversive and appetitive instrumental counterconditioning in men.

Extinction training creates a second inhibitory memory trace and effectively reduces conditioned responding. However, acute stress inhibits the retrieval of this extinction memory trace. It is not known whether this also applies to other forms of associative learning such as instrumental counterconditioning, where previously learned associations are reversed and paired with the opposite valence. Therefore, the current preregistered study investigates whether stress decreases the retrieval of instrumental counterconditioning memories with aversive and appetitive consequences. Fifty-two healthy men were randomly assigned to either a stress or control group and took part in a two-day instrumental learning paradigm. During a first phase, participants learned that pressing specific buttons in response to the presentation of four neutral stimuli either leads to gaining or losing money. During a second phase, two stimuli reversed their contingencies (counterconditioning). One day later, participants were exposed to acute stress or a control condition prior to the same task, which no longer included feedback about gains or losses. Stressed participants showed more approach behavior towards appetitive and less avoidance behavior towards aversive stimuli as compared to non-stressed participants. Our findings indicate that stress effects on memory retrieval differ depending on the associative learning approach in men. These differences might be related to stress effects on decision making and different motivational systems involved.

Gap in the conditioned stimulus: Differential impacts on temporal expectancy in appetitive and aversive conditions in rats.

We analyzed, through a Pavlovian conditioning procedure in rats, the temporal pattern of behavior in appetitive and aversive conditions within subjects, and the difference in inferred temporal working memory functioning with the Gap paradigm. For both conditions, we paired a 60-s conditioned stimulus (CS: tone1 or tone2) with an unconditioned stimulus (US: shock or chocolate pellet) delivered 20s after CS onset. The analyses of mean response rate and individual-trial data were performed during Probe trials, consisting of CS alone, and trials in which gaps of different position or duration were inserted, to assess the effect of the temporal manipulation on behavior. The results showed: (1) An anticipatory peak time in the aversive condition but better accuracy in the appetitive condition, (2) constancy in the Weber fraction suggesting that the difference in peak time was under clock control, (3) a graded effect of gap parameters only in the aversive condition and (4) different gap effects between conditions when a gap was inserted early in the CS. These results highlight behavioral differences between aversive and appetitive conditions and suggest that the temporal working memory mechanism was not engaged in the same manner in each condition.

The potential and realized foraging movements of bees are differentially determined by body size and sociality.

Reversing biodiversity declines requires a better understanding of organismal mobility, as movement processes dictate the scale at which species interact with the environment. Previous studies have demonstrated that species foraging ranges, and therefore, habitat use increases with body size. Yet, foraging ranges are also affected by other life-history traits, such as sociality, which influence the need of and ability to detect resources. We evaluated the effect of body size and sociality on potential and realized foraging ranges using a compiled dataset of 383 measurements for 81 bee species. Potential ranges were larger than realized ranges and increased more steeply with body size. Highly eusocial species had larger realized foraging ranges than primitively eusocial or solitary taxa. We contend that potential ranges describe species movement capabilities, whereas realized ranges depict how foraging movements result from interactions between species traits and environmental conditions. Furthermore, the complex communication strategies and large colony sizes in highly eusocial species may facilitate foraging over wider areas in response to resource depletion. Our findings should contribute to a greater understanding of landscape ecology and conservation, as traits that influence movement mediate species vulnerability to habitat loss and fragmentation.

Flower sharing and pollinator health: a behavioural perspective.

Disease is an integral part of any organisms' life, and bees have evolved immune responses and a suite of hygienic behaviours to keep them at bay in the nest. It is now evident that flowers are another transmission hub for pathogens and parasites, raising questions about adaptations that help pollinating insects stay healthy while visiting hundreds of plants over their lifetime. Drawing on recent advances in our understanding of how bees of varying size, dietary specialization and sociality differ in their foraging ranges, navigational strategies and floral resource preferences, we explore the behavioural mechanisms and strategies that may enable foraging bees to reduce disease exposure and transmission risks at flowers by partitioning overlapping resources in space and in time. By taking a novel behavioural perspective, we highlight the missing links between disease biology and the ecology of plant-pollinator relationships, critical for improving the understanding of disease transmission risks and the better design and management of habitat for pollinator conservation. This article is part of the theme issue 'Natural processes influencing pollinator health: from chemistry to landscapes'.

Harmonics of the social brain: How diverse brain regions coordinate appetitive social behavior.

Socioemotional behaviors rely on the integration of information across multiple systems in the brain. In this issue of Neuron, Mague et al. (2022) characterize a multi-regional functional network that coordinates positively valenced social interactions in mice.

Role of the foraging gene in worker behavioral transition in the red imported fire ant, Solenopsis invicta (Hymenoptera: Formicidae).

BACKGROUND: Worker division of labor is predominant in social insects. The foraging (for) gene, which encodes cGMP-dependent protein kinase (PKG), has been implicated in the regulation of behavioral transitions in honeybees, but information regarding its function in other social insects is scarce. RESULTS: We investigated the role of the for (Sifor) gene in the red imported fire ant, Solenopsis invicta, and found that Sifor and PKG exhibited different expression patterns in different castes, body sizes, ages and tissues of fire ants, especially in foragers and nurses. Foragers displayed greater locomotor activity but showed no preference for larval or adult odors, whereas nurses showed lesser locomotor activity but had a strong preference for larval odors. We found that the expression of Sifor was significantly higher in the heads of foragers (compared to nurses). RNA interference-mediated Sifor knockdown in foraging workers induced behavioral transition of foragers toward the nurse phenotype characterized by reduced locomotor activity and a stronger preference for larval odors. By contrast, treating nurses with 8-Br-cGMP, an activator of PKG, resulted in behavioral transition toward the forager phenotype characterized by higher locomotor activity but reduced preference for larval odors. CONCLUSION: Our results suggest that Sifor plays a critical role in the behavioral transition between foragers and nurses of workers, which may be a promising target for RNAi-based management of worker caste organization in S. invicta. © 2022 Society of Chemical Industry.

Suboptimal foraging theory: How inaccurate predictions and approximations can make better models of adaptive behavior.

Optimal foraging theory (OFT) is based on the ecological concept that organisms select behaviors that convey future fitness, and on the mathematical concept of optimization: finding the alternative that provides the best value of a fitness measure. As implemented in, for example, state-based dynamic modeling, OFT is powerful for one key problem of modern ecology: modeling behavior as a tradeoff among competing fitness elements such as growth, risk avoidance, and reproductive output. However, OFT is not useful for other modern problems such as representing feedbacks within systems of interacting, unique individuals: When we need to model foraging by each of many individuals that interact competitively or synergistically, optimization is impractical or impossible-there are no optimal behaviors. For such problems we can, however, still use the concept of future fitness to model behavior by replacing optimization with less precise (but perhaps more realistic) techniques for ranking alternatives. Instead of simplifying the systems we model until we can find optimal behavior, we can use theory based on inaccurate predictions, coarse approximations, and updating to produce good behavior in more complex and realistic contexts. This so-called state- and prediction-based theory (SPT) can, for example, produce realistic foraging decisions by each of many unique, interacting individuals when growth rates and predation risks vary over space and time. Because SPT lets us address more natural complexity and more realistic problems, it is more easily tested against more kinds of observation and more useful in management ecology. A simple foraging model illustrates how SPT readily accommodates complexities that make optimization intractable. Other models use SPT to represent contingent decisions (whether to feed or hide, in what patch) that are tradeoffs between growth and predation risk, when both growth and risk vary among hundreds of patches, vary unpredictably over time, depend on characteristics of the individuals, are subject to feedbacks from competition, and change over the daily light cycle. Modern ecology demands theory for tradeoff behaviors in complex contexts that produce feedbacks; when optimization is infeasible, we should not be afraid to use approximate fitness-seeking methods instead.

Serotonergic modulation of appetitive and ingestive behavior in crayfish.

Serotonin is an important modulator of feeding behavior across animal species. In invertebrates, much is known about the regulation of feeding in several model organisms, but comparative data are limited. We examined the modulation of feeding behavior in crayfish by administering serotonin and two serotonin receptor ligands, mianserin and 5-carboxamidotryptamine. We found that, compared to control injections, exogenous serotonin significantly reduced appetitive behaviors in response to a chemical food stimulant and reduced consumption when food was present. The two ligands also significantly reduced the amount of food consumed. However, they had no significant effects on appetitive feeding movements, suggesting that appetitive and consummatory feeding phases may be regulated by different serotonergic mechanisms. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

A bottom-up reward pathway mediated by somatostatin neurons in the medial septum complex underlying appetitive learning.

Valence detection and processing are essential for the survival of animals and their life quality in complex environments. Neural circuits underlying the transformation of external sensory signals into positive valence coding to generate appropriate behavioral responses remain not well-studied. Here, we report that somatostatin (SOM) subtype of GABAergic neurons in the mouse medial septum complex (MS), but not parvalbumin subtype or glutamatergic neurons, specifically encode reward signals and positive valence. Through an ascending pathway from the nucleus of solitary tract and then parabrachial nucleus, the MS SOM neurons receive rewarding taste signals and suppress the lateral habenula. They contribute essentially to appetitive associative learning via their projections to the lateral habenula: learning enhances their responses to reward-predictive sensory cues, and suppressing their responses to either conditioned or unconditioned stimulus impairs acquisition of reward learning. Thus, MS serves as a critical hub for transforming bottom-up sensory signals to mediate appetitive behaviors.

Brain-wide electrical dynamics encode individual appetitive social behavior.

The architecture whereby activity across many brain regions integrates to encode individual appetitive social behavior remains unknown. Here we measure electrical activity from eight brain regions as mice engage in a social preference assay. We then use machine learning to discover a network that encodes the extent to which individual mice engage another mouse. This network is organized by theta oscillations leading from prelimbic cortex and amygdala that converge on the ventral tegmental area. Network activity is synchronized with cellular firing, and frequency-specific activation of a circuit within this network increases social behavior. Finally, the network generalizes, on a mouse-by-mouse basis, to encode individual differences in social behavior in healthy animals but fails to encode individual behavior in a 'high confidence' genetic model of autism. Thus, our findings reveal the architecture whereby the brain integrates distributed activity across timescales to encode an appetitive brain state underlying individual differences in social behavior.

Octopaminergic neurons function in appetitive but not aversive olfactory learning and memory in Bactrocera dorsalis.

The biogenic amine octopamine (OA, invertebrate counterpart of noradrenaline) plays critical roles in the regulation of olfactory behavior. Historically, OA has been thought to mediate appetitive but not aversive learning in honeybees, fruit flies (Drosophila), and crickets. However, this viewpoint has recently been challenged because OA activity through a ß-adrenergic-like receptor drives both appetitive and aversive learning. Here, we explored the roles of OA neurons in olfactory learning and memory retrieval in Bactrocera dorsalis. We trained flies to associate an orange odor with a sucrose reward or to associate methyl eugenol, a male lure, with N,N-diethyl-3-methyl benzoyl amide (DEET) punishment. We then treated flies with OA receptor antagonists before appetitive or aversive conditioning and a memory retention test. Injection of OA receptor antagonist mianserin or epinastine into the abdomen of flies led to impaired of appetitive learning and memory retention with a sucrose reward, while aversive learning and memory retention with DEET punishment remained intact. Our results suggest that the OA signaling participates in appetitive but not aversive learning and memory retrieval in B. dorsalis through OA receptors.

Honey Bees (Hymenoptera: Apidae) Decrease Foraging But Not Recruitment After Neonicotinoid Exposure.

Honey bees (Linnaeus, Hymenoptera: Apidae) are widely used as commercial pollinators and commonly forage in agricultural and urban landscapes containing neonicotinoid-treated plants. Previous research has demonstrated that honey bees display adverse behavioral and cognitive effects after treatment with sublethal doses of neonicotinoids. In laboratory studies, honey bees simultaneously increase their proportional intake of neonicotinoid-treated solutions and decrease their total solution consumption to some concentrations of certain neonicotinoids. These findings suggest that neonicotinoids might elicit a suboptimal response in honey bees, in which they forage preferentially on foods containing pesticides, effectively increasing their exposure, while also decreasing their total food intake; however, behavioral responses in semifield and field conditions are less understood. Here we conducted a feeder experiment with freely flying bees to determine the effects of a sublethal, field-realistic concentration of imidacloprid (IMD) on the foraging and recruitment behaviors of honey bees visiting either a control feeder containing a sucrose solution or a treatment feeder containing the same sucrose solution with IMD. We report that IMD-treated honey bees foraged less frequently (-28%) and persistently (-66%) than control foragers. Recruitment behaviors (dance frequency and dance propensity) also decreased with IMD, but nonsignificantly. Our results suggest that neonicotinoids inhibit honey bee foraging, which could potentially decrease food intake and adversely affect colony health.

Foraging as sampling without replacement: A Bayesian statistical model for estimating biases in target selection.

Foraging entails finding multiple targets sequentially. In humans and other animals, a key observation has been a tendency to forage in 'runs' of the same target type. This tendency is context-sensitive, and in humans, it is strongest when the targets are difficult to distinguish from the distractors. Many important questions have yet to be addressed about this and other tendencies in human foraging, and a key limitation is a lack of precise measures of foraging behaviour. The standard measures tend to be run statistics, such as the maximum run length and the number of runs. But these measures are not only interdependent, they are also constrained by the number and distribution of targets, making it difficult to make inferences about the effects of these aspects of the environment on foraging. Moreover, run statistics are underspecified about the underlying cognitive processes determining foraging behaviour. We present an alternative approach: modelling foraging as a procedure of generative sampling without replacement, implemented in a Bayesian multilevel model. This allows us to break behaviour down into a number of biases that influence target selection, such as the proximity of targets and a bias for selecting targets in runs, in a way that is not dependent on the number of targets present. Our method thereby facilitates direct comparison of specific foraging tendencies between search environments that differ in theoretically important dimensions. We demonstrate the use of our model with simulation examples and re-analysis of existing data. We believe our model will provide deeper insights into visual foraging and provide a foundation for further modelling work in this area.

The evolutionary maintenance of Lévy flight foraging.

Lévy flight is a type of random walk that characterizes the behaviour of many natural phenomena studied across a multiplicity of academic disciplines; within biology specifically, the behaviour of fish, birds, insects, mollusks, bacteria, plants, slime molds, t-cells, and human populations. The Lévy flight foraging hypothesis states that because Lévy flights can maximize an organism's search efficiency, natural selection should result in Lévy-like behaviour. Empirical and theoretical research has provided ample evidence of Lévy walks in both extinct and extant species, and its efficiency across models with a diversity of resource distributions. However, no model has addressed the maintenance of Lévy flight foraging through evolutionary processes, and existing models lack ecological breadth. We use numerical simulations, including lineage-based models of evolution with a distribution of move lengths as a variable and heritable trait, to test the Lévy flight foraging hypothesis. We include biological and ecological contexts such as population size, searching costs, lifespan, resource distribution, speed, and consider both energy accumulated at the end of a lifespan and averaged over a lifespan. We demonstrate that selection often results in Lévy-like behaviour, although conditional; smaller populations, longer searches, and low searching costs increase the fitness of Lévy-like behaviour relative to Brownian behaviour. Interestingly, our results also evidence a bet-hedging strategy; Lévy-like behaviour reduces fitness variance, thus maximizing geometric mean fitness over multiple generations.

Appetitive Behavior in the Social Transmission of Food Preference Paradigm Predicts Activation of Orexin-A producing Neurons in a Sex-Dependent Manner.

Orexin-producing cells in the lateral hypothalamic area have been shown to be involved in a wide variety of behavioral and cognitive functions, including the recall of appetitive associations and a variety of social behaviors. Here, we investigated the role of orexin in the acquisition and recall of socially transmitted food preferences in the rat. Rats were euthanized following either acquisition, short-term recall, or long-term recall of a socially transmitted food preference and their brains were processed for orexin-A and c-Fos expression. We found that while there were no significant differences in c-Fos expression between control and experimental subjects at any of the tested timepoints, females displayed significantly more activity in both orexinergic and non-orexinergic cells in the lateral hypothalamus. In the infralimbic cortex, we found that social behavior was significantly predictive of c-Fos expression, with social behaviors related to olfactory exploration appearing to be particularly influential. We additionally found that appetitive behavior was significantly predictive of orexin-A activity in a sex-dependent matter, with the total amount eaten correlating negatively with orexin-A/c-Fos colocalization in male rats but not female rats. These findings suggest a potential sex-specific role for the orexin system in balancing the stimulation of feeding behavior with the sleep/wake cycle.