Context evoked morphine conditioned effects can be equivalent to morphine induced drug effects in terms of behavioral response and ERK activation in reward associated subcortical brain structures.

Conditioned drug cues can evoke brief drug-like responses. In this report we show that using brief test sessions, contextual cues can induce conditioned hyperlocomotion and ERK responses equivalent to morphine induced responses. To assess acute unconditioned effects, rats that received morphine (MOR-1) or vehicle (VEH-1) were immediately placed onto an arena for a 5-min locomotion recording session after which ERK was measured in the ventral tegmental area (VTA) and nucleus accumbens (NAc). There were no differences in locomotion between the groups. However, the MOR-1 group had strong ERK activation in VTA and NAc. To assess MOR-conditioned effects, a chronic phase was carried out according to a Pavlovian conditioning protocol. There were two MOR paired groups (MORP), one MOR unpaired (MOR-UP) group and two VEH groups. The treatments were administered over 5 daily five minute test sessions. The final conditioning test was on day 6, in which one of the MOR-P groups and one of the VEH groups received VEH (MOR-P/VEH-6 and VEH/VEH-6, respectively). The other MOR-P group and VEH group received MOR (MOR-P/MOR; VEH/MOR-6, respectively). The MOR-UP group received VEH (MOR-UP/VEH-6). Rats received the treatments immediately prior to a 5-minute arena test, and after the session ERK was measured. No morphine induced locomotor stimulation was observed on day 1 but on days 2 to 5, hyperlocomotion in both MOR-P groups occurred. On test day 6, the MOR-P/VEH-6 and the MOR-P/MOR-6 groups had comparable locomotor stimulant responses and similar ERK activity in the VTA and NAc. The MOR-UP group did not differ from the VEH group. We suggest that ERK activation evoked by acute morphine served as a Pavlovian unconditioned stimulus to enable the contextual cues to acquire morphine conditioned stimulus properties and increase the incentive value of the contextual cues.

Dairy Heifer Motivation for Access to a Shaded Area.

We used an operant conditioning paradigm to test the motivation of non-pregnant dairy heifers to access shade during the summer and autumn months (January to June) in southern Brazil. Dairy heifers (n = 18) were trained to push a weighted gate to access either an experimental area containing both a shaded (simple tree shade and shade cloth) and unshaded area (WITH SHADE) or an experimental area with no shade (BARREN). The latency to push the weighted gate, and the maximum weight pushed by each heifer, were recorded in both the summer and the autumn. Temperature and humidity were recorded continuously for the duration of the study and were used to calculate the heat index. The maximum weight pushed to enter the WITH SHADE area was greater in summer than in autumn, and was inversely related to the latency to push the weighted gate. Heifers refused to work for access to the BARREN environment. As expected, both the maximum ambient temperatures and heat index were higher in summer than in autumn, and also higher in the non-shaded areas than under the shade in both seasons. Heifers of higher social rank displaced other heifers more often, and spent more time in the shaded areas, particularly in the area with trees plus a shade cloth, than the intermediate and subordinate heifers. We conclude that shade is an important and valued resource for heifers reared on pasture-based systems in sub-tropical environments, particularly during the hot summer months.

Low-cost open hardware system for behavioural experiments simultaneously with electrophysiological recordings.

A major frontier in neuroscience is to find neural correlates of perception, learning, decision making, and a variety of other types of behavior. In the last decades, modern devices allow simultaneous recordings of different operant responses and the electrical activity of large neuronal populations. However, the commercially available instruments for studying operant conditioning are expensive, and the design of low-cost chambers has emerged as an appealing alternative to resource-limited laboratories engaged in animal behavior. In this article, we provide a full description of a platform that records the operant behavior and synchronizes it with the electrophysiological activity. The programming of this platform is open source, flexible, and adaptable to a wide range of operant conditioning tasks. We also show results of operant conditioning experiments with freely moving rats with simultaneous electrophysiological recordings.

OBAT: An open-source and low-cost operant box for auditory discriminative tasks.

Operant-conditioning boxes are widely used in animal training, allowing researchers to shape specific behaviors through reinforcements and/or punishments. Commercially available devices are expensive and run with proprietary software and hardware, hampering adaptations for the specific needs of an experiment. Therefore, many low-cost and open-source devices have recently been developed, but there are still few options for studying auditory behaviors. To overcome this problem, we developed a device based on a computer and an Arduino Mega 2560 board, named OBAT (Operant Box for Auditory Tasks), designed to present two different auditory stimuli to small primates. It has three modules: sound delivery, response bars, and reward system. We estimate that OBAT is at least 4-10 times cheaper than commercially available operant-conditioning boxes. Data from a behavioral pilot test ensured that the device can be used to train a marmoset in an auditory discrimination task. In addition, despite its low cost, accuracy tests showed that the OBAT operates with a high temporal precision. All schematics and software source code are available so that other groups can easily replicate the experiment or adapt the device to their own needs.

Context-dependent extinction of an appetitive operant conditioned response in infant rats.

The present study evaluated context-dependent learning under an operant conditioning procedure in infant rats. Preweanling rats were trained in context A during postnatal days (PDs) 16 and 17 to learn an appetitive operant conditioning task, employing milk chocolate as appetitive reinforcer. On PD18 the operant response was extinguished in context A, or in an alternative context B. The change from context A to B between acquisition and extinction did not affect the number of responses during extinction, but slightly modified the shape of the extinction curve. On PD19, a renewal test conducted in context A clearly showed ABA-renewal of the extinguished operant response. These results add to the body of evidence indicating that infants are able to acquire and retain contextual information, and support the notion that extinction during this ontogenetic period involves new learning.

Time in the central area of the elevated plus-maze correlates with impulsivity-related measures during an operant task / El tiempo en el área central del laberinto en cruz elevado correlaciona con medidas relacionadas a impulsividad durante una tarea operante

Impulsivity-related measures have been obtained using operantconditioning tasks. Although it has been suggested that impulsivity indices can also be obtained using the elevated plus-maze (EPM), an anxiety-related animal test, no studies have examined the relationship between anxiety-related variables in EPM and impulsivity-related indices obtained during operant conditioning. Correlations between EPM measures and performance in a 60-s fixed-interval schedule of reinforcement (FI 60-s) were established in this study. Seventeen female rats were exposed to the EPM before starting training in the FI 60-s schedule. A positive correlation was found between the percentage of time spent in the central area of the EPM and both the FI efficiency index and the inter-response times. In addition, these three measures were positively correlated within Factor 1 of a factor analysis. No correlations were observed between open-arms measures in EPM and operant performance. These results suggest that time in the central area of the EPM may be a useful index of impulsivity in rodents without a pre-determined trait of impulsivity.

Medidas relacionadas a impulsividad se han obtenido mediante tareas de condicionamiento operante. Aunque se ha sugerido que índices de impulsividad pueden ser también obtenidos usando el laberinto en cruz elevado (LCE), una prueba animal relacionada con ansiedad, ningún estudio ha examinado la relación entre las variables de ansiedad en el LCE e índices de impulsividad obtenidos durante condicionamiento operante. En este estudio se establecieron correlaciones entre medidas del LCE y el desempeño en un programa de reforzamiento de intervalo fijo 60-s (IF 60-s). Diecisiete ratas hembras fueron expuestas la LCE antes de iniciar el entrenamiento en el programa de IF 60-s. Se encontró una correlación positiva entre el porcentaje de tiempo de permanencia en el área central del LCE y tanto el índice de eficiencia como los tiempos entre respuestas en IF. Adicionalmente, estas tres medidas correlacionaron de forma positiva dentro del Factor 1 del análisis factorial. No se observaron correlaciones entre las medidas de los brazos abiertos del LCE y la ejecución operante. Los resultados sugieren que el tiempo en el área central del LCE podría ser un índice útil de impulsividad en roedores sin un perfil predeterminado de impulsividad.

Operant self-administration of ethanol in infant rats.

The review focuses on operant self-administration of ethanol in immature, infant rats. Several methods for the analysis of ethanol intake in infants are available, yet only oral self-administration models the typical pattern of ethanol consumption found in humans. The study of ethanol intake in infants is important for our understanding of how early alcohol experiences facilitate subsequent engagement with alcohol. It seems that sensitivity to ethanol-induced operant reinforcement is found very early in life, a few hours after birth, and throughout the first three weeks of life. Most of the studies reviewed complied with most, albeit not all, of the criteria for operant behavior (e.g., greater responding than yoked controls and persistence of this difference after withholding the reinforcer). Operant self-administration of ethanol in infant rats seems to be, at least partially, mediated by endogenous opioid transmission and can be enhanced by prior exposure to ethanol. Furthermore, acquisition of ethanol-mediated operant learning seems to facilitate drug self-administration during adolescence. Relative to older subjects, infants exhibit lower sensitivity to ethanol's sedative, hypnotic and motor impairing effects. On the other hand, they exhibit increased sensitivity to the motor stimulant and rewarding effects of ethanol. We suggest that this pattern of response to ethanol may favor the rapid acquisition of operant self-administration in infant rats.

Dual role of serotonin in the acquisition and extinction of reward-driven learning: involvement of 5-HT1A, 5-HT2A and 5-HT3 receptors.

Serotonin (5-HT) has been proposed as a possible encoder of reward. Nevertheless, the role of this neurotransmitter in reward-based tasks is not well understood. Given that the major serotonergic circuit in the rat brain comprises the dorsal raphe nuclei and the medial prefrontal cortex (mPFC), and because the latter structure is involved in the control of complex behaviors and expresses 1A (5-HT1A), 2A (5-HT2A), and 3 (5-HT3) receptors, the aim was to study the role of 5-HT and of these receptors in the acquisition and extinction of a reward-dependent operant conditioning task. Long Evans rats were trained in an operant conditioning task while receiving fluoxetine (serotonin reuptake inhibitor, 10mg/kg), tianeptine (serotonin reuptake enhancer, 10mg/kg), buspirone (5-HT1A partial agonist, 10mg/kg), risperidone (5-HT2A antagonist, 1mg/kg), ondansetron (5-HT3 antagonist, 2mg/kg) or vehicle. Then, animals that acquired the operant conditioning without any treatment were trained to extinct the task in the presence of the pharmacological agents. Fluoxetine impaired acquisition but improved extinction. Tianeptine administration induced the opposite effects. Buspirone induced a mild deficit in acquisition and had no effects during the extinction phase. Risperidone administration resulted in learning deficits during the acquisition phase, although it promoted improved extinction. Ondansetron treatment showed a deleterious effect in the acquisition phase and an overall improvement in the extinction phase. These data showed a differential role of 5-HT in the acquisition and extinction of an operant conditioning task, suggesting that it may have a dual function in reward encoding.

Role of the amygdala in the reinforcement omission effect

The reinforcement omission effect (ROE) has been attributed to both motivational and attentional consequences of surprising reinforcement omission. Recent evidence suggests that the basolateral complex of the amygdala is involved in motivational components related to reinforcement value, whereas the central nucleus of the amygdala is involved in the processing of the attentional consequences of surprise. This study was designed to verify whether the mechanisms involved in the ROE depend on the integrity of either the basolateral amygdala complex or central nucleus of the amygdala. The ROE was evaluated in rats with lesions of either the central nucleus or basolateral complex of the amygdala and trained on a fixed-interval schedule procedure (Experiment 1) and fixed-interval with limited hold signaled schedule procedure (Experiment 2). The results of Experiment 1 showed that sham-operated rats and rats with lesions of either the central nucleus or basolateral area displayed the ROE. In contrast, in Experiment 2, subjects with lesions of the central nucleus or basolateral complex of the amygdala exhibited a smaller ROE compared with sham-operated subjects. Thus, the effects of selective lesions of amygdala subregions on the ROE in rats depended on the training procedure. Furthermore, the absence of differences between the lesioned groups in either experiment did not allow the dissociation of attentional or motivational components of the ROE with functions of specific areas of the amygdala. Thus, results did not show a functional double-dissociation between the central nucleus and basolateral area in the ROE.

Role of the amygdala in the reinforcement omission effect

The reinforcement omission effect (ROE) has been attributed to both motivational and attentional consequences of surprising reinforcement omission. Recent evidence suggests that the basolateral complex of the amygdala is involved in motivational components related to reinforcement value, whereas the central nucleus of the amygdala is involved in the processing of the attentional consequences of surprise. This study was designed to verify whether the mechanisms involved in the ROE depend on the integrity of either the basolateral amygdala complex or central nucleus of the amygdala. The ROE was evaluated in rats with lesions of either the central nucleus or basolateral complex of the amygdala and trained on a fixed-interval schedule procedure (Experiment 1) and fixed-interval with limited hold signaled schedule procedure (Experiment 2). The results of Experiment 1 showed that sham-operated rats and rats with lesions of either the central nucleus or basolateral area displayed the ROE. In contrast, in Experiment 2, subjects with lesions of the central nucleus or basolateral complex of the amygdala exhibited a smaller ROE compared with sham-operated subjects. Thus, the effects of selective lesions of amygdala subregions on the ROE in rats depended on the training procedure. Furthermore, the absence of differences between the lesioned groups in either experiment did not allow the dissociation of attentional or motivational components of the ROE with functions of specific areas of the amygdala. Thus, results did not show a functional double-dissociation between the central nucleus and basolateral area in the ROE.(AU)

Psychosocial correlates of peripheral vegetative activity and coordination / Aspectos psicossociais relacionados à atividade vegetativa periférica e coordenação

O presente estudo examinou a relação entre aspectos psicossociais e padrões de reação fisiológica (frequência cardíaca, pressão arterial, condução cutânea e medidas respiratórias) para quatro tipos de contingências operantes (recompensa, extinção, punição e evitação) registrados durante um teste de computador em uma amostra de 32 calouros universitários holandeses. Práticas educativas parentais (cuidado, controle e proteção), variáveis familiares, sociodemográficas e o significado emocional foram utilizados como preditores de reações fisiológicas. Como medidas de coordenação vegetativa foram comparados os coeficientes entre medidas fisiológicas com máxima correlação. Os resultados confirmam a relevância de práticas educativas parentais no desenvolvimento da ativação autônoma do adulto, em especial o papel do cuidado. Dentre os preditores sociodemográficos, a renda familiar foi o mais relevante. As atitudes dos sujeitos em relação às emoções positivas e negativas também aparecem relacionadas a índices fisiológicos de coordenação cardiovascular. Os sujeitos classificam-se em dois tipos de coordenação vegetativos ligados a características psicossociais

The present study examines psychosocial correlates of physiological reaction patterns (heart rate, blood pressure, skin conductance, and respiratory measures) to four types of operant contingencies (reward, extinction, punishment, and avoidance) recorded during a computer test to a sample of 32 Dutch university freshmen. Child-rearing factors (Warmth, Control, and Protection), family and demographic variables, and affective meanings of emotions were used as predictors of physiological reactions. As measures of vegetative coordination, maximum cross-correlation coefficients between physiological measures were used and compared. Results support the relevance of child-rearing practices in the development of adult autonomic activation, in particular the role of parental Warmth. Among socio-demographic predictors, family income was most relevant. Subjects´ attitudes towards negative and positive emotions also appear related to physiological indices of cardiovascular coordination. Subjects fell into two vegetative coordination types linked to psychosocial characteristics

Psychosocial correlates of peripheral vegetative activity and coordination / Aspectos psicossociais relacionados à atividade vegetativa periférica e coordenação

O presente estudo examinou a relação entre aspectos psicossociais e padrões de reação fisiológica (frequência cardíaca, pressão arterial, condução cutânea e medidas respiratórias) para quatro tipos de contingências operantes (recompensa, extinção, punição e evitação) registrados durante um teste de computador em uma amostra de 32 calouros universitários holandeses. Práticas educativas parentais (cuidado, controle e proteção), variáveis familiares, sociodemográficas e o significado emocional foram utilizados como preditores de reações fisiológicas. Como medidas de coordenação vegetativa foram comparados os coeficientes entre medidas fisiológicas com máxima correlação. Os resultados confirmam a relevância de práticas educativas parentais no desenvolvimento da ativação autônoma do adulto, em especial o papel do cuidado. Dentre os preditores sociodemográficos, a renda familiar foi o mais relevante. As atitudes dos sujeitos em relação às emoções positivas e negativas também aparecem relacionadas a índices fisiológicos de coordenação cardiovascular. Os sujeitos classificam-se em dois tipos de coordenação vegetativos ligados a características psicossociais.(AU)

The present study examines psychosocial correlates of physiological reaction patterns (heart rate, blood pressure, skin conductance, and respiratory measures) to four types of operant contingencies (reward, extinction, punishment, and avoidance) recorded during a computer test to a sample of 32 Dutch university freshmen. Child-rearing factors (Warmth, Control, and Protection), family and demographic variables, and affective meanings of emotions were used as predictors of physiological reactions. As measures of vegetative coordination, maximum cross-correlation coefficients between physiological measures were used and compared. Results support the relevance of child-rearing practices in the development of adult autonomic activation, in particular the role of parental Warmth. Among socio-demographic predictors, family income was most relevant. Subjects´ attitudes towards negative and positive emotions also appear related to physiological indices of cardiovascular coordination. Subjects fell into two vegetative coordination types linked to psychosocial characteristics.(AU)

Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement

Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.(AU)