Reinforcement expectation in the honeybee (Apis mellifera): Can downshifts in reinforcement show conditioned inhibition?

When animals learn the association of a conditioned stimulus (CS) with an unconditioned stimulus (US), later presentation of the CS invokes a representation of the US. When the expected US fails to occur, theoretical accounts predict that conditioned inhibition can accrue to any other stimuli that are associated with this change in the US. Empirical work with mammals has confirmed the existence of conditioned inhibition. But the way it is manifested, the conditions that produce it, and determining whether it is the opposite of excitatory conditioning are important considerations. Invertebrates can make valuable contributions to this literature because of the well-established conditioning protocols and access to the central nervous system (CNS) for studying neural underpinnings of behavior. Nevertheless, although conditioned inhibition has been reported, it has yet to be thoroughly investigated in invertebrates. Here, we evaluate the role of the US in producing conditioned inhibition by using proboscis extension response conditioning of the honeybee (Apis mellifera). Specifically, using variations of a "feature-negative" experimental design, we use downshifts in US intensity relative to US intensity used during initial excitatory conditioning to show that an odorant in an odor-odor mixture can become a conditioned inhibitor. We argue that some alternative interpretations to conditioned inhibition are unlikely. However, we show variation across individuals in how strongly they show conditioned inhibition, with some individuals possibly revealing a different means of learning about changes in reinforcement. We discuss how the resolution of these differences is needed to fully understand whether and how conditioned inhibition is manifested in the honeybee, and whether it can be extended to investigate how it is encoded in the CNS. It is also important for extension to other insect models. In particular, work like this will be important as more is revealed of the complexity of the insect brain from connectome projects.

Synergistic negative effects between a fungicide and high temperatures on homing behaviours in honeybees.

Interactions between environmental stressors may contribute to ongoing pollinator declines, but have not been extensively studied. Here, we examined the interaction between the agricultural fungicide Pristine (active ingredients: 25.2% boscalid, 12.8% pyraclostrobin) and high temperatures on critical honeybee behaviours. We have previously shown that consumption of field-realistic levels of this fungicide shortens worker lifespan in the field and impairs associative learning performance in a laboratory-based assay. We hypothesized that Pristine would also impair homing and foraging behaviours in the field, and that an interaction with hot weather would exacerbate this effect. Both field-relevant Pristine exposure and higher air temperatures reduced the probability of successful return on their own. Together, the two factors synergistically reduced the probability of return and increased the time required for bees to return to the hive. Pristine did not affect the masses of pollen or volumes of nectar or water brought back to the hive by foragers, and it did not affect the ratio of forager types in a colony. However, Pristine-fed bees brought more concentrated nectar back to the hive. As both agrochemical usage and heat waves increase, additive and synergistic negative effects may pose major threats to pollinators and sustainable agriculture.

Using electric fields to control insects: current applications and future directions.

Chemical-based interventions are mostly used to control insects that are harmful to human health and agriculture or that simply cause a nuisance. An overreliance on these insecticides however raises concerns for the environment, human health, and the development of resistance, not only in the target species. As such, there is a critical need for the development of novel nonchemical technologies to control insects. Electrocution traps using UV light as an attractant are one classical nonchemical approach to insect control but lack the specificity necessary to target only pest insects and to avoid harmless or beneficial species. Here we review the fundamental physics behind electric fields (EFs) and place them in context with electromagnetic fields more broadly. We then focus on how novel uses of strong EFs, some of which are being piloted in the field and laboratory, have the potential to repel, capture, or kill (electrocute) insects without the negative side effects of other classical approaches. As EF-insect science remains in its infancy, we provide recommendations for future areas of research in EF-insect science.

Individual learning phenotypes drive collective behavior.

Individual differences in learning can influence how animals respond to and communicate about their environment, which may nonlinearly shape how a social group accomplishes a collective task. There are few empirical examples of how differences in collective dynamics emerge from variation among individuals in cognition. Here, we use a naturally variable and heritable learning behavior called latent inhibition (LI) to show that interactions among individuals that differ in this cognitive ability drive collective foraging behavior in honey bee colonies. We artificially selected two distinct phenotypes: high-LI bees that ignore previously familiar stimuli in favor of novel ones and low-LI bees that learn familiar and novel stimuli equally well. We then provided colonies differentially composed of different ratios of these phenotypes with a choice between familiar and novel feeders. Colonies of predominantly high-LI individuals preferred to visit familiar food locations, while low-LI colonies visited novel and familiar food locations equally. Interestingly, in colonies of mixed learning phenotypes, the low-LI individuals showed a preference to visiting familiar feeders, which contrasts with their behavior when in a uniform low-LI group. We show that the shift in feeder preference of low-LI bees is driven by foragers of the high-LI phenotype dancing more intensely and attracting more followers. Our results reveal that cognitive abilities of individuals and their social interactions, which we argue relate to differences in attention, drive emergent collective outcomes.

Unbalanced fatty acid diets impair discrimination ability of honey bee workers to damaged and healthy brood odors.

Nutrition supports social insect colonies by regulating both individual performance and colony growth. In honey bee colonies, task-related behaviors such as nursing and foraging are partially mediated by nutrition. Young workers (nurses) consume almost all of the pollen in the hive, while foragers consume mostly nectar. Pollen provides vital proteins and lipids, consumed by nurse bees for approximately 1 week post-eclosion. The role that lipids play in the physiology and behavior of adult bees is gaining significant attention. Recent research suggests that diets with balanced ratios of fatty acids increase olfactory learning in honey bees. Olfaction is crucial for young worker bees to perform brood care and cell cleaning behaviors, which is important for hive health and disease control. Thus, we targeted the early adult, pollen-feeding stage to examine how fatty acids affect cognition to hive-relevant odors. We fed young workers (days 0-9) diets balanced or unbalanced in their ratio of essential fatty acids (ω-6:3) sourced from pollen or cooking oils. We then measured their ability to learn healthy and damaged brood odors, as well as their ability to discriminate between the two. Workers fed balanced diets could learn and discriminate between brood odors better than workers fed unbalanced diets. Consumption of both diet types decreased with age, but their cognitive effects remained. These results suggest that diet affects young worker cognitive development, which may affect task-related behaviors and colony hygiene.

Early olfactory, but not gustatory processing, is affected by the selection of heritable cognitive phenotypes in honey bee.

Associative learning enables animals to predict rewards or punishments by their associations with predictive stimuli, while non-associative learning occurs without reinforcement. The latter includes latent inhibition (LI), whereby animals learn to ignore an inconsequential 'familiar' stimulus. Individual honey bees display heritable differences in expression of LI. We examined the behavioral and neuronal responses between honey bee genetic lines exhibiting high and low LI. We observed, as in previous studies, that high LI lines learned a familiar odor more slowly than low LI bees. By measuring gustatory responses to sucrose, we determined that perception of sucrose reward was similar between both lines, thereby not contributing to the LI phenotype. We then used extracellular electrophysiology to determine differences in neural responses of the antennal lobe (AL) to familiar and novel odors between the lines. Low LI bees responded significantly more strongly to both familiar and novel odors than the high LI bees, but the lines showed equivalent differences in response to the novel and familiar odors. This work suggests that some effects of genotype are present in early olfactory processing, and those effects could complement how LI is manifested at later stages of processing in brains of bees in the different lines.

The active ingredients of a mitotoxic fungicide negatively affect pollen consumption and worker survival in laboratory-reared honey bees (Apis mellifera).

Recent observations of many sublethal effects of pesticides on pollinators have raised questions about whether standard short-term laboratory tests of pesticide effects on survival are sufficient for pollinator protection. The fungicide Pristine® and its active ingredients (25.2% boscalid, 12.8% pyraclostrobin) have been reported to have low acute toxicity to caged honey bee workers, but many sublethal effects at field-relevant doses have been reported and Pristine® was recently found to increase worker pollen consumption, reduce worker longevity and colony populations at field relevant concentrations (Fisher et al. 2021). To directly compare these whole-colony field results to more standard laboratory toxicology tests, the effects of Pristine®, at a range of field-relevant concentrations, were assessed on the survival and pollen consumption of honey bee workers 0-14 days of age. Also, to separate the effects of the inert and two active ingredients, bees were fed pollen containing boscalid, pyraclostrobin, or pyraclostrobin plus boscalid, at concentrations matching those in the Pristine® treatments. Pyraclostrobin significantly reduced pollen consumption across the duration of the experiment, and dose-dependently reduced pollen consumption on days 12-14. Pristine® and boscalid significantly reduced pollen feeding rate on days 12-14. Boscalid reduced survival in a dose-dependent manner. Consumption of Pristine® or pyraclostrobin plus boscalid did not affect survival, providing evidence against strong negative effects of the inert ingredients in Pristine® and against negative synergistic effects of boscalid and pyraclostrobin. The stronger toxic effects of Pristine® observed in field colonies compared to this laboratory test, and the opposite responses of pollen consumption in the laboratory and field to Pristine®, show that standard laboratory toxicology tests can fail to predict responses of pollinators to pesticides and to provide protection.

Field cross-fostering and in vitro rearing demonstrate negative effects of both larval and adult exposure to a widely used fungicide in honey bees (Apis mellifera).

Pollinators and other insects are experiencing an ongoing worldwide decline. While various environmental stressors have been implicated, including pesticide exposure, the causes of these declines are complex and highly debated. Fungicides may constitute a particularly prevalent threat to pollinator health due to their application on many crops during bloom, and because pollinators such as bees may consume fungicide-tainted pollen or nectar. In a previous study, consumption of pollen containing the fungicide Pristine® at field-relevant concentrations by honey bee colonies increased pollen foraging, caused earlier foraging, lowered worker survival, and reduced colony population size. Because most pollen is consumed by young adults, we hypothesized that Pristine® (25.2% boscalid, 12.8% pyraclostrobin) in pollen exerts its negative effects on honey bee colonies primarily on the adult stage. To rigorously test this hypothesis, we used a cross-fostering experimental design, with bees reared in colonies provided Pristine® incorporated into pollen patties at a supra-field concentration (230 mg/kg), only in the larvae, only in the adult, or both stages. In contrast to our predictions, exposure to Pristine® in either the larval or adult stage reduced survival relative to control bees not exposed to Pristine®, and exposure to the fungicide at both larval and adult stages further reduced survival. Adult exposure caused precocious foraging, while larval exposure increased the tendency to forage for pollen. These results demonstrate that pollen containing Pristine® can induce significant negative effects on both larvae and adults in a hive, though the magnitude of such effects may be smaller at field-realistic doses. To further test the potential negative effects of direct consumption of Pristine® on larvae, we reared them in vitro on food containing Pristine® at a range of concentrations. Consumption of Pristine® reduced survival rates of larvae at all concentrations tested. Larval and adult weights were only reduced at a supra-field concentration. We conclude that consumption of pollen containing Pristine® by field honey bee colonies likely exerts impacts on colony population size and foraging behavior by affecting both larvae and adults.

Heritable Cognitive Phenotypes Influence Appetitive Learning but not Extinction in Honey Bees.

Learning and attention allow animals to better navigate complex environments. While foraging, honey bees (Apis mellifera L.) learn several aspects of their foraging environment, such as color and odor of flowers, which likely begins to happen before they evaluate the quality of the food. If bees begin to evaluate quality before they taste food, and then learn the food is depleted, this may create a conflict in what the bee learns and remembers. Individual honey bees differ in their sensitivity to information, thus creating variation in how they learn or do not learn certain environmental stimuli. For example, foraging honey bees exhibit differences in latent inhibition (LI), a learning process through which regular encounter with a stimulus without a consequence such as food can later reduce conditioning to that stimulus. Here, we test whether bees from distinct selected LI genotypes learn differently if reinforced via just antennae or via both antennae + proboscis. We also evaluate whether learned information goes extinct at different rates in these distinct LI genetic lines. We find that high LI bees learned significantly better when they were reinforced both antenna + proboscis, while low LI and control bees learned similarly with the two reinforcement pathways. We also find no differences in the acquisition and extinction of learned information in high LI and low LI bees. Our work provides insight into how underlying cognition may influence how honey bees learn and value information, which may lead to differences in how individuals and colonies make foraging decisions.

Experimental psychology meets behavioral ecology: what laboratory studies of learning polymorphisms mean for learning under natural conditions, and vice versa.

Behavior genetics, and specifically the study of learning and memory, has benefitted immensely from the development of powerful forward- and reverse-genetic methods for investigating the relationships between genes and behavior. Application of these methods in controlled laboratory settings has led to insights into gene-behavior relationships. In this perspective article, we argue that the field is now poised to make significant inroads into understanding the adaptive value of heritable variation in behavior in natural populations. Studies of natural variation with several species, in particular, are now in a position to complement laboratory studies of mechanisms, and sometimes this work can lead to counterintuitive insights into the mechanism of gene action on behavior. We make this case using a recent example from work with the honey bee, Apis mellifera.

Experience-dependent tuning of early olfactory processing in the adult honey bee, Apis mellifera.

Experience-dependent plasticity in the central nervous system allows an animal to adapt its responses to stimuli over different time scales. In this study, we explored the impacts of adult foraging experience on early olfactory processing by comparing naturally foraging honey bees, Apis mellifera, with those that experienced a chronic reduction in adult foraging experience. We placed age-matched sets of sister honey bees into two different olfactory conditions, in which animals were allowed to forage ad libitum In one condition, we restricted foraging experience by placing honey bees in a tent in which both sucrose and pollen resources were associated with a single odor. In the second condition, honey bees were allowed to forage freely and therefore encounter a diversity of naturally occurring resource-associated olfactory experiences. We found that honey bees with restricted foraging experiences had altered antennal lobe development. We measured the glomerular responses to odors using calcium imaging in the antennal lobe, and found that natural olfactory experience also enhanced the inter-individual variation in glomerular response profiles to odors. Additionally, we found that honey bees with adult restricted foraging experience did not distinguish relevant components of an odor mixture in a behavioral assay as did their freely foraging siblings. This study highlights the impacts of individual experience on early olfactory processing at multiple levels.

Odorant mixtures elicit less variable and faster responses than pure odorants.

In natural environments, odors are typically mixtures of several different chemical compounds. However, the implications of mixtures for odor processing have not been fully investigated. We have extended a standard olfactory receptor model to mixtures and found through its mathematical analysis that odorant-evoked activity patterns are more stable across concentrations and first-spike latencies of receptor neurons are shorter for mixtures than for pure odorants. Shorter first-spike latencies arise from the nonlinear dependence of binding rate on odorant concentration, commonly described by the Hill coefficient, while the more stable activity patterns result from the competition between different ligands for receptor sites. These results are consistent with observations from numerical simulations and physiological recordings in the olfactory system of insects. Our results suggest that mixtures allow faster and more reliable olfactory coding, which could be one of the reasons why animals often use mixtures in chemical signaling.

Individual differences in learning and biogenic amine levels influence the behavioural division between foraging honeybee scouts and recruits.

Animals must effectively balance the time they spend exploring the environment for new resources and exploiting them. One way that social animals accomplish this balance is by allocating these two tasks to different individuals. In honeybees, foraging is divided between scouts, which tend to explore the landscape for novel resources, and recruits, which tend to exploit these resources. Exploring the variation in cognitive and physiological mechanisms of foraging behaviour will provide a deeper understanding of how the division of labour is regulated in social insect societies. Here, we uncover how honeybee foraging behaviour may be shaped by predispositions in performance of latent inhibition (LI), which is a form of non-associative learning by which individuals learn to ignore familiar information. We compared LI between scouts and recruits, hypothesizing that differences in learning would correlate with differences in foraging behaviour. Scouts seek out and encounter many new odours while locating novel resources, while recruits continuously forage from the same resource, even as its quality degrades. We found that scouts show stronger LI than recruits, possibly reflecting their need to discriminate forage quality. We also found that scouts have significantly elevated tyramine compared to recruits. Furthermore, after associative odour training, recruits have significantly diminished octopamine in their brains compared to scouts. These results suggest that individual variation in learning behaviour shapes the phenotypic behavioural differences between different types of honeybee foragers. These differences in turn have important consequences for how honeybee colonies interact with their environment. Uncovering the proximate mechanisms that influence individual variation in foraging behaviour is crucial for understanding the ecological context in which societies evolve.

Comparative study of chemical neuroanatomy of the olfactory neuropil in mouse, honey bee, and human.

Despite divergent evolutionary origins, the organization of olfactory systems is remarkably similar across phyla. In both insects and mammals, sensory input from receptor cells is initially processed in synaptically dense regions of neuropil called glomeruli, where neural activity is shaped by local inhibition and centrifugal neuromodulation prior to being sent to higher-order brain areas by projection neurons. Here we review both similarities and several key differences in the neuroanatomy of the olfactory system in honey bees, mice, and humans, using a combination of literature review and new primary data. We have focused on the chemical identity and the innervation patterns of neuromodulatory inputs in the primary olfactory system. Our findings show that serotonergic fibers are similarly distributed across glomeruli in all three species. Octopaminergic/tyraminergic fibers in the honey bee also have a similar distribution, and possibly a similar function, to noradrenergic fibers in the mammalian OBs. However, preliminary evidence suggests that human OB may be relatively less organized than its counterparts in honey bee and mouse.

High-speed odor transduction and pulse tracking by insect olfactory receptor neurons.

Sensory systems encode both the static quality of a stimulus (e.g., color or shape) and its kinetics (e.g., speed and direction). The limits with which stimulus kinetics can be resolved are well understood in vision, audition, and somatosensation. However, the maximum temporal resolution of olfactory systems has not been accurately determined. Here, we probe the limits of temporal resolution in insect olfaction by delivering high frequency odor pulses and measuring sensory responses in the antennae. We show that transduction times and pulse tracking capabilities of olfactory receptor neurons are faster than previously reported. Once an odorant arrives at the boundary layer of the antenna, odor transduction can occur within less than 2 ms and fluctuating odor stimuli can be resolved at frequencies more than 100 Hz. Thus, insect olfactory receptor neurons can track stimuli of very short duration, as occur when their antennae encounter narrow filaments in an odor plume. These results provide a new upper bound to the kinetics of odor tracking in insect olfactory receptor neurons and to the latency of initial transduction events in olfaction.

SwarmSight: Measuring the temporal progression of animal group activity levels from natural-scene and laboratory videos.

We describe SwarmSight (available at https://github.com/justasb/SwarmSight ), a novel, open-source, Microsoft Windows software tool for quantitative assessment of the temporal progression of animal group activity levels from recorded videos. The tool utilizes a background subtraction machine vision algorithm and provides an activity metric that can be used to quantitatively assess and compare animal group behavior. Here we demonstrate the tool's utility by analyzing defensive bee behavior as modulated by alarm pheromones, wild-bird feeding onset and interruption, and cockroach nest-finding activity. Although more sophisticated, commercial software packages are available, SwarmSight provides a low-cost, open-source, and easy-to-use alternative that is suitable for a wide range of users, including minimally trained research technicians and behavioral science undergraduate students in classroom laboratory settings.

Learning modifies odor mixture processing to improve detection of relevant components.

Honey bees have a rich repertoire of olfactory learning behaviors, and they therefore are an excellent model to study plasticity in olfactory circuits. Recent behavioral, physiological, and molecular evidence suggested that the antennal lobe, the first relay of the olfactory system in insects and analog to the olfactory bulb in vertebrates, is involved in associative and nonassociative olfactory learning. Here we use calcium imaging to reveal how responses across antennal lobe projection neurons change after association of an input odor with appetitive reinforcement. After appetitive conditioning to 1-hexanol, the representation of an odor mixture containing 1-hexanol becomes more similar to this odor and less similar to the background odor acetophenone. We then apply computational modeling to investigate how changes in synaptic connectivity can account for the observed plasticity. Our study suggests that experience-dependent modulation of inhibitory interactions in the antennal lobe aids perception of salient odor components mixed with behaviorally irrelevant background odors.

Learning about natural variation of odor mixtures enhances categorization in early olfactory processing.

Natural odors are typically mixtures of several chemical components. Mixtures vary in composition among odor objects that have the same meaning. Therefore a central 'categorization' problem for an animal as it makes decisions about odors in natural contexts is to correctly identify odor variants that have the same meaning and avoid variants that have a different meaning. We propose that identified mechanisms of associative and non-associative plasticity in early sensory processing in the insect antennal lobe and mammalian olfactory bulb are central to solving this problem. Accordingly, this plasticity should work to improve categorization of odors that have the opposite meanings in relation to important events. Using synthetic mixtures designed to mimic natural odor variation among flowers, we studied how honey bees learn about and generalize among floral odors associated with food. We behaviorally conditioned honey bees on a difficult odor discrimination problem using synthetic mixtures that mimic natural variation among snapdragon flowers. We then used calcium imaging to measure responses of projection neurons of the antennal lobe, which is the first synaptic relay of olfactory sensory information in the brain, to study how ensembles of projection neurons change as a result of behavioral conditioning. We show how these ensembles become 'tuned' through plasticity to improve categorization of odors that have the different meanings. We argue that this tuning allows more efficient use of the immense coding space of the antennal lobe and olfactory bulb to solve the categorization problem. Our data point to the need for a better understanding of the 'statistics' of the odor space.