RESUMEN
Retrieving and acting on memories of food-predicting environments are fundamental processes for animal survival. Hippocampal pyramidal cells (PYRs) of the mammalian brain provide mnemonic representations of space. Yet the substrates by which these hippocampal representations support memory-guided behavior remain unknown. Here, we uncover a direct connection from dorsal CA1 (dCA1) hippocampus to nucleus accumbens (NAc) that enables the behavioral manifestation of place-reward memories. By monitoring neuronal ensembles in mouse dCA1âNAc pathway, combined with cell-type selective optogenetic manipulations of input-defined postsynaptic neurons, we show that dCA1 PYRs drive NAc medium spiny neurons and orchestrate their spiking activity using feedforward inhibition mediated by dCA1-connected parvalbumin-expressing fast-spiking interneurons. This tripartite cross-circuit motif supports spatial appetitive memory and associated NAc assemblies, being independent of dorsal subiculum and dispensable for both spatial novelty detection and reward seeking. Our findings demonstrate that the dCA1âNAc pathway instantiates a limbic-motor interface for neuronal representations of space to promote effective appetitive behavior.
Asunto(s)
Conducta Apetitiva/fisiología , Memoria/fisiología , Núcleo Accumbens/fisiología , Animales , Región CA1 Hipocampal/fisiología , Células HEK293 , Hipocampo/fisiología , Humanos , Interneuronas/fisiología , Masculino , Ratones , Ratones Endogámicos C57BL , Ratones Transgénicos , Neuronas/fisiología , Células Piramidales/fisiología , Recompensa , Lóbulo Temporal/fisiologíaRESUMEN
Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.
Asunto(s)
Condicionamiento Clásico , Neuronas , Corteza Prefrontal , Humanos , Condicionamiento Clásico/fisiología , Masculino , Femenino , Corteza Prefrontal/fisiología , Neuronas/fisiología , Adulto , Lóbulo Temporal/fisiología , Adulto Joven , Conducta Apetitiva/fisiología , Aprendizaje por Asociación/fisiologíaRESUMEN
Plants produce complex mixtures of primary and secondary metabolites. Herbivores use these metabolites as behavioral cues to increase their fitness. However, how herbivores combine and integrate different metabolite classes into fitness-relevant foraging decisions in planta is poorly understood. We developed a molecular manipulative approach to modulate the availability of sugars and benzoxazinoid secondary metabolites as foraging cues for a specialist maize herbivore, the western corn rootworm. By disrupting sugar perception in the western corn rootworm and benzoxazinoid production in maize, we show that sugars and benzoxazinoids act as distinct and dynamically combined mediators of short-distance host finding and acceptance. While sugars improve the capacity of rootworm larvae to find a host plant and to distinguish postembryonic from less nutritious embryonic roots, benzoxazinoids are specifically required for the latter. Host acceptance in the form of root damage is increased by benzoxazinoids and sugars in an additive manner. This pattern is driven by increasing damage to postembryonic roots in the presence of benzoxazinoids and sugars. Benzoxazinoid- and sugar-mediated foraging directly improves western corn rootworm growth and survival. Interestingly, western corn rootworm larvae retain a substantial fraction of their capacity to feed and survive on maize plants even when both classes of chemical cues are almost completely absent. This study unravels fine-grained differentiation and combination of primary and secondary metabolites into herbivore foraging and documents how the capacity to compensate for the lack of important chemical cues enables a specialist herbivore to survive within unpredictable metabolic landscapes.
Asunto(s)
Benzoxazinas/metabolismo , Escarabajos/fisiología , Azúcares/metabolismo , Zea mays/metabolismo , Animales , Conducta Apetitiva/fisiología , Escarabajos/crecimiento & desarrollo , Herbivoria , Larva/crecimiento & desarrollo , Larva/fisiología , Metaboloma , Raíces de Plantas/metabolismo , Zea mays/genéticaRESUMEN
The ability of the taste system to identify a tastant (what it tastes like) enables animals to recognize and discriminate between the different basic taste qualities1,2. The valence of a tastant (whether it is appetitive or aversive) specifies its hedonic value and elicits the execution of selective behaviours. Here we examine how sweet and bitter are afforded valence versus identity in mice. We show that neurons in the sweet-responsive and bitter-responsive cortex project to topographically distinct areas of the amygdala, with strong segregation of neural projections conveying appetitive versus aversive taste signals. By manipulating selective taste inputs to the amygdala, we show that it is possible to impose positive or negative valence on a neutral water stimulus, and even to reverse the hedonic value of a sweet or bitter tastant. Remarkably, mice with silenced neurons in the amygdala no longer exhibit behaviour that reflects the valence associated with direct stimulation of the taste cortex, or with delivery of sweet and bitter chemicals. Nonetheless, these mice can still identify and discriminate between tastants, just as wild-type controls do. These results help to explain how the taste system generates stereotypic and predetermined attractive and aversive taste behaviours, and support the existence of distinct neural substrates for the discrimination of taste identity and the assignment of valence.
Asunto(s)
Amígdala del Cerebelo/citología , Amígdala del Cerebelo/fisiología , Conducta Apetitiva/fisiología , Reacción de Prevención/fisiología , Discriminación en Psicología/fisiología , Gusto/fisiología , Amígdala del Cerebelo/efectos de los fármacos , Animales , Conducta Apetitiva/efectos de los fármacos , Reacción de Prevención/efectos de los fármacos , Clozapina/análogos & derivados , Clozapina/farmacología , Discriminación en Psicología/efectos de los fármacos , Masculino , Ratones , Ratones Endogámicos C57BL , Modelos Neurológicos , Neuronas/efectos de los fármacos , Neuronas/fisiología , Gusto/efectos de los fármacos , Agua/farmacologíaRESUMEN
The capacity to suppress learned responses is essential for animals to adapt in dynamic environments. Extinction is a process by which animals learn to suppress conditioned responding when an expected outcome is omitted. The infralimbic (IL) cortex to nucleus accumbens shell (NAcS) neural circuit is implicated in suppressing conditioned responding after extinction, especially in the context of operant cocaine-seeking behavior. However, the role of the IL-to-NAcS neural circuit in the extinction of responding to appetitive Pavlovian cues is unknown, and the psychological mechanisms involved in response suppression following extinction are unclear. We trained male Long Evans rats to associate a 10 s auditory conditioned stimulus (CS; 14 trials per session) with a sucrose unconditioned stimulus (US; 0.2 ml per CS) in a specific context, and then following extinction in a different context, precipitated a renewal of CS responding by presenting the CS alone in the original Pavlovian conditioning context. Unilateral, optogenetic stimulation of the IL-to-NAcS circuit selectively during CS trials suppressed renewal. In a separate experiment, IL-to-NAcS stimulation suppressed CS responding regardless of prior extinction and impaired extinction retrieval. Finally, IL-to-NAcS stimulation during the CS did not suppress the acquisition of Pavlovian conditioning but was required for the subsequent expression of CS responding. These results are consistent with multiple studies showing that the IL-to-NAcS neural circuit is involved in the suppression of operant cocaine-seeking, extending these findings to appetitive Pavlovian cues. The suppression of appetitive Pavlovian responding following IL-to-NAcS circuit stimulation, however, does not appear to be an extinction-dependent process.SIGNIFICANCE STATEMENT Extinction is a form of inhibitory learning through which animals learn to suppress conditioned responding in the face of nonreinforcement. We investigated the role of the IL cortex inputs to the NAcS in the extinction of responding to appetitive Pavlovian cues and the psychological mechanisms involved in response suppression following extinction. Using in vivo optogenetics, we found that stimulating the IL-to-NAcS neural circuit suppressed context-induced renewal of conditioned responding after extinction. In a separate experiment, stimulating the IL-to-NAcS circuit suppressed conditioned responding in an extinction-independent manner. These findings can be used by future research aimed at understanding how corticostriatal circuits contribute to behavioral flexibility and mental disorders that involve the suppression of learned behaviors.
Asunto(s)
Conducta Apetitiva/fisiología , Condicionamiento Clásico/fisiología , Cuerpo Estriado/fisiología , Red Nerviosa/fisiología , Corteza Prefrontal/fisiología , Animales , Cuerpo Estriado/química , Extinción Psicológica/fisiología , Masculino , Red Nerviosa/química , Optogenética/métodos , Corteza Prefrontal/química , Ratas , Ratas Long-EvansRESUMEN
Inhibitory associative learning counters the effects of excitatory learning, whether appetitively or aversively motivated. Moreover, the affective responses accompanying the inhibitory associations are of opponent valence to the excitatory conditioned responses. Inhibitors for negative aversive outcomes (e.g. shock) signal safety, while inhibitors for appetitive outcomes (e.g. food reward) elicit frustration and/or disappointment. This raises the question as to whether studies using appetitive and aversive conditioning procedures should demonstrate the same neural substrates for inhibitory learning. We review the neural substrates of appetitive and aversive inhibitory learning as measured in different procedural variants and in the context of the underpinning excitatory conditioning on which it depends. The mesocorticolimbic dopamine pathways, retrosplenial cortex and hippocampus are consistently implicated in inhibitory learning. Further neural substrates identified in some procedural variants may be related to the specific motivation of the learning task and modalities of the learning cues. Finally, we consider the translational implications of our understanding of the neural substrates of inhibitory learning, for obesity and addictions as well as for anxiety disorders.
Asunto(s)
Condicionamiento Psicológico , Frustación , Animales , Condicionamiento Psicológico/fisiología , Condicionamiento Clásico/fisiología , Reacción de Prevención/fisiología , Motivación , Recompensa , Conducta Apetitiva/fisiologíaRESUMEN
Foraging entails finding multiple targets sequentially. In humans and other animals, a key observation has been a tendency to forage in 'runs' of the same target type. This tendency is context-sensitive, and in humans, it is strongest when the targets are difficult to distinguish from the distractors. Many important questions have yet to be addressed about this and other tendencies in human foraging, and a key limitation is a lack of precise measures of foraging behaviour. The standard measures tend to be run statistics, such as the maximum run length and the number of runs. But these measures are not only interdependent, they are also constrained by the number and distribution of targets, making it difficult to make inferences about the effects of these aspects of the environment on foraging. Moreover, run statistics are underspecified about the underlying cognitive processes determining foraging behaviour. We present an alternative approach: modelling foraging as a procedure of generative sampling without replacement, implemented in a Bayesian multilevel model. This allows us to break behaviour down into a number of biases that influence target selection, such as the proximity of targets and a bias for selecting targets in runs, in a way that is not dependent on the number of targets present. Our method thereby facilitates direct comparison of specific foraging tendencies between search environments that differ in theoretically important dimensions. We demonstrate the use of our model with simulation examples and re-analysis of existing data. We believe our model will provide deeper insights into visual foraging and provide a foundation for further modelling work in this area.
Asunto(s)
Conducta Apetitiva/fisiología , Teorema de Bayes , Biología Computacional/métodos , Modelos Estadísticos , Sesgo , HumanosRESUMEN
Lévy flight is a type of random walk that characterizes the behaviour of many natural phenomena studied across a multiplicity of academic disciplines; within biology specifically, the behaviour of fish, birds, insects, mollusks, bacteria, plants, slime molds, t-cells, and human populations. The Lévy flight foraging hypothesis states that because Lévy flights can maximize an organism's search efficiency, natural selection should result in Lévy-like behaviour. Empirical and theoretical research has provided ample evidence of Lévy walks in both extinct and extant species, and its efficiency across models with a diversity of resource distributions. However, no model has addressed the maintenance of Lévy flight foraging through evolutionary processes, and existing models lack ecological breadth. We use numerical simulations, including lineage-based models of evolution with a distribution of move lengths as a variable and heritable trait, to test the Lévy flight foraging hypothesis. We include biological and ecological contexts such as population size, searching costs, lifespan, resource distribution, speed, and consider both energy accumulated at the end of a lifespan and averaged over a lifespan. We demonstrate that selection often results in Lévy-like behaviour, although conditional; smaller populations, longer searches, and low searching costs increase the fitness of Lévy-like behaviour relative to Brownian behaviour. Interestingly, our results also evidence a bet-hedging strategy; Lévy-like behaviour reduces fitness variance, thus maximizing geometric mean fitness over multiple generations.
Asunto(s)
Conducta Apetitiva/fisiología , Evolución Molecular , Aptitud Genética , Modelos Biológicos , Modelos Estadísticos , Algoritmos , Animales , Biología Computacional , Aptitud Genética/genética , Aptitud Genética/fisiología , Dinámica Poblacional , Selección Genética/genética , Selección Genética/fisiologíaRESUMEN
The prefrontal cortex is a critical neuroanatomical hub for controlling motivated behaviours across mammalian species. In addition to intra-cortical connectivity, prefrontal projection neurons innervate subcortical structures that contribute to reward-seeking behaviours, such as the ventral striatum and midline thalamus. While connectivity among these structures contributes to appetitive behaviours, how projection-specific prefrontal neurons encode reward-relevant information to guide reward seeking is unknown. Here we use in vivo two-photon calcium imaging to monitor the activity of dorsomedial prefrontal neurons in mice during an appetitive Pavlovian conditioning task. At the population level, these neurons display diverse activity patterns during the presentation of reward-predictive cues. However, recordings from prefrontal neurons with resolved projection targets reveal that individual corticostriatal neurons show response tuning to reward-predictive cues, such that excitatory cue responses are amplified across learning. By contrast, corticothalamic neurons gradually develop new, primarily inhibitory responses to reward-predictive cues across learning. Furthermore, bidirectional optogenetic manipulation of these neurons reveals that stimulation of corticostriatal neurons promotes conditioned reward-seeking behaviour after learning, while activity in corticothalamic neurons suppresses both the acquisition and expression of conditioned reward seeking. These data show how prefrontal circuitry can dynamically control reward-seeking behaviour through the opposing activities of projection-specific cell populations.
Asunto(s)
Conducta Apetitiva/fisiología , Señales (Psicología) , Vías Nerviosas , Neuronas/fisiología , Corteza Prefrontal/citología , Corteza Prefrontal/fisiología , Recompensa , Animales , Calcio/análisis , Condicionamiento Clásico/fisiología , Masculino , Ratones , Ratones Endogámicos C57BL , Microscopía de Fluorescencia por Excitación Multifotónica , Imagen Molecular , Plasticidad Neuronal , Núcleo Accumbens/citología , Núcleo Accumbens/fisiología , Tálamo/citología , Tálamo/fisiologíaRESUMEN
Optimal foraging theory provides a framework to understand how organisms balance the benefits of harvesting resources within a patch with the sum of the metabolic, predation, and missed opportunity costs of foraging. Here, we show that, after accounting for the limited environmental information available to microorganisms, optimal foraging theory and, in particular, patch use theory also applies to the behavior of marine bacteria in particle seascapes. Combining modeling and experiments, we find that the marine bacterium Vibrio ordalii optimizes nutrient uptake by rapidly switching between attached and planktonic lifestyles, departing particles when their nutrient concentration is more than hundredfold higher than background. In accordance with predictions from patch use theory, single-cell tracking reveals that bacteria spend less time on nutrient-poor particles and on particles within environments that are rich or in which the travel time between particles is smaller, indicating that bacteria tune the nutrient concentration at detachment to increase their fitness. A mathematical model shows that the observed behavioral switching between exploitation and dispersal is consistent with foraging optimality under limited information, namely, the ability to assess the harvest rate of nutrients leaking from particles by molecular diffusion. This work demonstrates how fundamental principles in behavioral ecology traditionally applied to animals can hold right down to the scale of microorganisms and highlights the exquisite adaptations of marine bacterial foraging. The present study thus provides a blueprint for a mechanistic understanding of bacterial uptake of dissolved organic matter and bacterial production in the ocean-processes that are fundamental to the global carbon cycle.
Asunto(s)
Conducta Apetitiva/fisiología , Modelos Biológicos , Compuestos Orgánicos/metabolismo , Plancton/fisiología , Vibrio/fisiología , GMP Cíclico , Sedimentos Geológicos , Material ParticuladoRESUMEN
Pathogens pose significant threats to pollinator health and food security. Pollinators can transmit diseases during foraging, but the consequences of plant species composition for infection is unknown. In agroecosystems, flowering strips or hedgerows are often used to augment pollinator habitat. We used canola as a focal crop in tents and manipulated flowering strip composition using plant species we had previously shown to result in higher or lower bee infection in short-term trials. We also manipulated initial colony infection to assess impacts on foraging behavior. Flowering strips using high-infection plant species nearly doubled bumble bee colony infection intensity compared to low-infection plant species, with intermediate infection in canola-only tents. Both infection treatment and flowering strips reduced visits to canola, but we saw no evidence that infection treatment shifted foraging preferences. Although high-infection flowering strips increased colony infection intensity, colony reproduction was improved with any flowering strips compared to canola alone. Effects of flowering strips on colony reproduction were explained by nectar availability, but effects of flowering strips on infection intensity were not. Thus, flowering strips benefited colony reproduction by adding floral resources, but certain plant species also come with a risk of increased pathogen infection intensity.
Asunto(s)
Abejas , Brassica napus , Flores , Infecciones Protozoarias en Animales , Animales , Conducta Apetitiva/fisiología , Abejas/parasitología , Abejas/fisiología , Brassica napus/microbiología , Brassica napus/parasitología , Crithidia/patogenicidad , Ecosistema , Flores/parasitología , Flores/fisiología , Larva/fisiología , Polinización/fisiología , Infecciones Protozoarias en Animales/fisiopatología , Infecciones Protozoarias en Animales/transmisiónRESUMEN
Mosquitoes are important vectors of disease and require sources of carbohydrates for reproduction and survival. Unlike host-related behaviors of mosquitoes, comparatively less is understood about the mechanisms involved in nectar-feeding decisions, or how this sensory information is processed in the mosquito brain. Here we show that Aedes spp. mosquitoes, including Aedes aegypti, are effective pollinators of the Platanthera obtusata orchid, and demonstrate this mutualism is mediated by the orchid's scent and the balance of excitation and inhibition in the mosquito's antennal lobe (AL). The P. obtusata orchid emits an attractive, nonanal-rich scent, whereas related Platanthera species-not visited by mosquitoes-emit scents dominated by lilac aldehyde. Calcium imaging experiments in the mosquito AL revealed that nonanal and lilac aldehyde each respectively activate the LC2 and AM2 glomerulus, and remarkably, the AM2 glomerulus is also sensitive to N,N-diethyl-meta-toluamide (DEET), a mosquito repellent. Lateral inhibition between these 2 glomeruli reflects the level of attraction to the orchid scents. Whereas the enriched nonanal scent of P. obtusata activates the LC2 and suppresses AM2, the high level of lilac aldehyde in the other orchid scents inverts this pattern of glomerular activity, and behavioral attraction is lost. These results demonstrate the ecological importance of mosquitoes beyond operating as disease vectors and open the door toward understanding the neural basis of mosquito nectar-seeking behaviors.
Asunto(s)
Aedes/fisiología , Conducta Apetitiva/fisiología , Percepción Olfatoria/fisiología , Orchidaceae/fisiología , Polinización/fisiología , Animales , Conducta Apetitiva/efectos de los fármacos , Antenas de Artrópodos/citología , Antenas de Artrópodos/fisiología , Encéfalo/fisiología , DEET/farmacología , Femenino , Repelentes de Insectos/farmacología , Masculino , Mosquitos Vectores/efectos de los fármacos , Mosquitos Vectores/fisiología , Odorantes , Percepción Olfatoria/efectos de los fármacos , Neuronas Receptoras Olfatorias/fisiología , Polinización/efectos de los fármacosRESUMEN
Control of protein intake is essential for numerous biological processes as several amino acids cannot be synthesized de novo, however, its neurobiological substrates are still poorly understood. In the present study, we combined in vivo fiber photometry with nutrient-conditioned flavor in a rat model of protein appetite to record neuronal activity in the VTA, a central brain region for the control of food-related processes. In adult male rats, protein restriction increased preference for casein (protein) over maltodextrin (carbohydrate). Moreover, protein consumption was associated with a greater VTA response, relative to carbohydrate. After initial nutrient preference, a switch from a normal balanced diet to protein restriction induced rapid development of protein preference but required extensive exposure to macronutrient solutions to induce elevated VTA responses to casein. Furthermore, prior protein restriction induced long-lasting food preference and VTA responses. This study reveals that VTA circuits are involved in protein appetite in times of need, a crucial process for animals to acquire an adequate amount of protein in their diet.SIGNIFICANCE STATEMENT Acquiring insufficient protein in one's diet has severe consequences for health and ultimately will lead to death. In addition, a low level of dietary protein has been proposed as a driver of obesity as it can leverage up intake of fat and carbohydrate. However, much remains unknown about the role of the brain in ensuring adequate intake of protein. Here, we show that in a state of protein restriction a key node in brain reward circuitry, the VTA, is activated more strongly during consumption of protein than carbohydrate. Moreover, although rats' behavior changed to reflect new protein status, patterns of neural activity were more persistent and only loosely linked to protein status.
Asunto(s)
Apetito/fisiología , Conducta Apetitiva/fisiología , Proteínas en la Dieta , Nutrientes , Área Tegmental Ventral/fisiología , Animales , Masculino , Ratas , Ratas Sprague-DawleyRESUMEN
Extinction training creates a second inhibitory memory trace and effectively reduces conditioned responding. However, acute stress inhibits the retrieval of this extinction memory trace. It is not known whether this also applies to other forms of associative learning such as instrumental counterconditioning, where previously learned associations are reversed and paired with the opposite valence. Therefore, the current preregistered study investigates whether stress decreases the retrieval of instrumental counterconditioning memories with aversive and appetitive consequences. Fifty-two healthy men were randomly assigned to either a stress or control group and took part in a two-day instrumental learning paradigm. During a first phase, participants learned that pressing specific buttons in response to the presentation of four neutral stimuli either leads to gaining or losing money. During a second phase, two stimuli reversed their contingencies (counterconditioning). One day later, participants were exposed to acute stress or a control condition prior to the same task, which no longer included feedback about gains or losses. Stressed participants showed more approach behavior towards appetitive and less avoidance behavior towards aversive stimuli as compared to non-stressed participants. Our findings indicate that stress effects on memory retrieval differ depending on the associative learning approach in men. These differences might be related to stress effects on decision making and different motivational systems involved.
Asunto(s)
Terapia Implosiva , Memoria , Masculino , Humanos , Animales , Memoria/fisiología , Condicionamiento Clásico/fisiología , Reacción de Prevención/fisiología , Afecto , Conducta Apetitiva/fisiologíaRESUMEN
Locusts are short horned grasshoppers that exhibit two behaviour types depending on their local population density. These are: solitarious, where they will actively avoid other locusts, and gregarious where they will seek them out. It is in this gregarious state that locusts can form massive and destructive flying swarms or plagues. However, these swarms are usually preceded by the aggregation of juvenile wingless locust nymphs. In this paper we attempt to understand how the distribution of food resources affect the group formation process. We do this by introducing a multi-population partial differential equation model that includes non-local locust interactions, local locust and food interactions, and gregarisation. Our results suggest that, food acts to increase the maximum density of locust groups, lowers the percentage of the population that needs to be gregarious for group formation, and decreases both the required density of locusts and time for group formation around an optimal food width. Finally, by looking at foraging efficiency within the numerical experiments we find that there exists a foraging advantage to being gregarious.
Asunto(s)
Conducta Apetitiva/fisiología , Conducta Alimentaria/fisiología , Saltamontes/fisiología , Modelos Biológicos , Animales , Biología Computacional , Aglomeración , Ninfa/fisiologíaRESUMEN
Choice history effects describe how future choices depend on the history of past choices. In experimental tasks this is typically framed as a bias because it often diminishes the experienced reward rates. However, in natural habitats, choices made in the past constrain choices that can be made in the future. For foraging animals, the probability of earning a reward in a given patch depends on the degree to which the animals have exploited the patch in the past. One problem with many experimental tasks that show choice history effects is that such tasks artificially decouple choice history from its consequences on reward availability over time. To circumvent this, we use a variable interval (VI) reward schedule that reinstates a more natural contingency between past choices and future reward availability. By examining the behavior of optimal agents in the VI task we discover that choice history effects observed in animals serve to maximize reward harvesting efficiency. We further distil the function of choice history effects by manipulating first- and second-order statistics of the environment. We find that choice history effects primarily reflect the growth rate of the reward probability of the unchosen option, whereas reward history effects primarily reflect environmental volatility. Based on observed choice history effects in animals, we develop a reinforcement learning model that explicitly incorporates choice history over multiple time scales into the decision process, and we assess its predictive adequacy in accounting for the associated behavior. We show that this new variant, known as the double trace model, has a higher performance in predicting choice data, and shows near optimal reward harvesting efficiency in simulated environments. These results suggests that choice history effects may be adaptive for natural contingencies between consumption and reward availability. This concept lends credence to a normative account of choice history effects that extends beyond its description as a bias.
Asunto(s)
Toma de Decisiones/fisiología , Modelos Neurológicos , Refuerzo en Psicología , Recompensa , Adolescente , Adulto , Animales , Conducta Apetitiva/fisiología , Biología Computacional , Femenino , Humanos , Masculino , Ratones , Ratones Endogámicos C57BL , Persona de Mediana Edad , Neuronas/fisiología , Adulto JovenRESUMEN
Classic foraging theory predicts that humans and animals aim to gain maximum reward per unit time. However, in standard instrumental conditioning tasks individuals adopt an apparently suboptimal strategy: they respond slowly when the expected value is low. This reward-related bias is often explained as reduced motivation in response to low rewards. Here we present evidence this behavior is associated with a complementary increased motivation to search the environment for alternatives. We trained monkeys to search for reward-related visual targets in environments with different values. We found that the reward-related bias scaled with environment value, was consistent with persistent searching after the target was already found, and was associated with increased exploratory gaze to objects in the environment. A novel computational model of foraging suggests that this search strategy could be adaptive in naturalistic settings where both environments and the objects within them provide partial information about hidden, uncertain rewards.
Asunto(s)
Conducta Apetitiva/fisiología , Conducta de Elección/fisiología , Ambiente , Recompensa , Campos Visuales/fisiología , Animales , Biología Computacional , Condicionamiento Operante/fisiología , Macaca mulatta , Masculino , Modelos Psicológicos , MotivaciónRESUMEN
In Drosophila, dopamine signaling to the mushroom body intrinsic neurons, Kenyon cells (KCs), is critical to stabilize olfactory memory. Little is known about the downstream intracellular molecular signaling underlying memory stabilization. Here we address this question in the context of sugar-rewarded olfactory long-term memory (LTM). We show that associative training increases the phosphorylation of MAPK in KCs, via Dop1R2 signaling. Consistently, the attenuation of Dop1R2, Raf, or MAPK expression in KCs selectively impairs LTM, but not short-term memory. Moreover, we show that the LTM deficit caused by the knockdown of Dop1R2 can be rescued by expressing active Raf in KCs. Thus, the Dop1R2/Raf/MAPK pathway is a pivotal downstream effector of dopamine signaling for stabilizing appetitive olfactory memory.SIGNIFICANCE STATEMENT Dopaminergic input to the Kenyon cells (KCs) is pivotal to stabilize memory in Drosophila This process is mediated by dopamine receptors like Dop1R2. Nevertheless, little is known for its underlying molecular mechanism. Here we show that the Raf/MAPK pathway is specifically engaged in appetitive long-term memory in KCs. With combined biochemical and behavioral experiments, we reveal that activation of the Raf/MAPK pathway is regulated through Dop1R2, shedding light on how dopamine modulates intracellular signaling for memory stabilization.
Asunto(s)
Conducta Apetitiva/fisiología , Proteínas de Drosophila/metabolismo , Memoria a Largo Plazo/fisiología , Neuronas/metabolismo , Receptores de Dopamina D1/metabolismo , Transducción de Señal/fisiología , Animales , Drosophila , Quinasas MAP Reguladas por Señal Extracelular/metabolismo , Femenino , Masculino , Cuerpos Pedunculados/fisiología , Quinasas raf/metabolismoRESUMEN
Animals selectively respond to environmental cues associated with food reward to optimize nutrient intake. Such appetitive conditioned stimulus-unconditioned stimulus (CS-US) associations are thought to be encoded in select, stable neuronal populations or neuronal ensembles, which undergo physiological modifications during appetitive conditioning. These ensembles in the medial prefrontal cortex (mPFC) control well-established, cue-evoked food seeking, but the mechanisms involved in the genesis of these ensembles are unclear. Here, we used male Fos-GFP mice that express green fluorescent protein (GFP) in recently behaviorally activated neurons, to reveal how dorsal mPFC neurons are recruited and modified to encode CS-US memory representations using an appetitive conditioning task. In the initial conditioning session, animals did not exhibit discriminated, cue-selective food seeking, but did so in later sessions indicating that a CS-US association was established. Using microprism-based in vivo 2-Photon imaging, we revealed that only a minority of neurons activated during the initial session was consistently activated throughout subsequent conditioning sessions and during cue-evoked memory recall. Notably, using ex vivo electrophysiology, we found that neurons activated following the initial session exhibited transient hyperexcitability. Chemogenetically enhancing the excitability of these neurons throughout subsequent conditioning sessions interfered with the development of reliable cue-selective food seeking, indicated by persistent, nondiscriminated performance. We demonstrate how appetitive learning consistently activates a subset of neurons to form a stable neuronal ensemble during the formation of a CS-US association. This ensemble may arise from a pool of hyperexcitable neurons activated during the initial conditioning session.SIGNIFICANCE STATEMENT Appetitive conditioning endows cues associated with food with the ability to guide food-seeking, through the formation of a food-cue association. Neuronal ensembles in the mPFC control established cue-evoked food-seeking. However, how neurons undergo physiological modifications and become part of an ensemble during conditioning remain unclear. We found that only a minority of dorsal mPFC neurons activated on the initial conditioning session became consistently activated during conditioning and memory recall. These initially activated neurons were also transiently hyperexcitable. We demonstrate the following: (1) how stable neuronal ensemble formation in the dorsal mPFC underlies appetitive conditioning; and (2) how this ensemble may arise from hyperexcitable neurons activated before the establishment of cue-evoked food seeking.
Asunto(s)
Conducta Apetitiva/fisiología , Recuerdo Mental/fisiología , Neuronas/fisiología , Corteza Prefrontal/fisiología , Animales , Condicionamiento Clásico , Señales (Psicología) , Masculino , Ratones , Ratones Transgénicos , Plasticidad Neuronal/fisiologíaRESUMEN
Distinct components of working memory are coordinated by different classes of inhibitory interneurons in the PFC, but the role of cholecystokinin (CCK)-positive interneurons remains enigmatic. In humans, this major population of interneurons shows histological abnormalities in schizophrenia, an illness in which deficient working memory is a core defining symptom and the best predictor of long-term functional outcome. Yet, CCK interneurons as a molecularly distinct class have proved intractable to examination by typical molecular methods due to widespread expression of CCK in the pyramidal neuron population. Using an intersectional approach in mice of both sexes, we have succeeded in labeling, interrogating, and manipulating CCK interneurons in the mPFC. Here, we describe the anatomical distribution, electrophysiological properties, and postsynaptic connectivity of CCK interneurons, and evaluate their role in cognition. We found that CCK interneurons comprise a larger proportion of the mPFC interneurons compared with parvalbumin interneurons, targeting a wide range of neuronal subtypes with a distinct connectivity pattern. Phase-specific optogenetic inhibition revealed that CCK, but not parvalbumin, interneurons play a critical role in the retrieval of working memory. These findings shine new light on the relationship between cortical CCK interneurons and cognition and offer a new set of tools to investigate interneuron dysfunction and cognitive impairments associated with schizophrenia.SIGNIFICANCE STATEMENT Cholecystokinin-expressing interneurons outnumber other interneuron populations in key brain areas involved in cognition and memory, including the mPFC. However, they have proved intractable to examination as experimental techniques have lacked the necessary selectivity. To the best of our knowledge, the present study is the first to report detailed properties of cortical cholecystokinin interneurons, revealing their anatomical organization, electrophysiological properties, postsynaptic connectivity, and behavioral function in working memory.