Theta oscillations in anterior cingulate cortex and orbitofrontal cortex differentially modulate accuracy and speed in flexible reward learning.

Flexible reward learning relies on frontal cortex, with substantial evidence indicating that anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC) subregions play important roles. Recent studies in both rat and macaque suggest theta oscillations (5-10 Hz) may be a spectral signature that coordinates this learning. However, network-level interactions between ACC and OFC in flexible learning remain unclear. We investigated the learning of stimulus-reward associations using a combination of simultaneous in vivo electrophysiology in dorsal ACC and ventral OFC, partnered with bilateral inhibitory DREADDs in ACC. In freely behaving male and female rats and using a within-subject design, we examined accuracy and speed of response across distinct and precisely defined trial epochs during initial visual discrimination learning and subsequent reversal of stimulus-reward contingencies. Following ACC inhibition, there was a propensity for random responding in early reversal learning, with correct vs. incorrect trials distinguished only from OFC, not ACC, theta power differences in the reversal phase. ACC inhibition also hastened incorrect choices during reversal. This same pattern of change in accuracy and speed was not observed in viral control animals. Thus, characteristics of impaired reversal learning following ACC inhibition are poor deliberation and weak theta signaling of accuracy in this region. The present results also point to OFC theta oscillations as a prominent feature of reversal learning, unperturbed by ACC inhibition.

Dissociable contributions of basolateral amygdala and ventrolateral orbitofrontal cortex to flexible learning under uncertainty.

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach and particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory DREADDs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-post reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of vlOFC, but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys.

Despite being unpredictable and uncertain, reward environments often exhibit certain regularities, and animals navigating these environments try to detect and utilize such regularities to adapt their behavior. However, successful learning requires that animals also adjust to uncertainty associated with those regularities. Here, we analyzed choice data from two comparable dynamic foraging tasks in mice and monkeys to investigate mechanisms underlying adjustments to different types of uncertainty. In these tasks, animals selected between two choice options that delivered reward probabilistically, while baseline reward probabilities changed after a variable number (block) of trials without any cues to the animals. To measure adjustments in behavior, we applied multiple metrics based on information theory that quantify consistency in behavior, and fit choice data using reinforcement learning models. We found that in both species, learning and choice were affected by uncertainty about reward outcomes (in terms of determining the better option) and by expectation about when the environment may change. However, these effects were mediated through different mechanisms. First, more uncertainty about the better option resulted in slower learning and forgetting in mice, whereas it had no significant effect in monkeys. Second, expectation of block switches accompanied slower learning, faster forgetting, and increased stochasticity in choice in mice, whereas it only reduced learning rates in monkeys. Overall, while demonstrating the usefulness of metrics based on information theory in examining adaptive behavior, our study provides evidence for multiple types of adjustments in learning and choice behavior according to uncertainty in the reward environment.

Translational opportunities in animal and human models to study alcohol use disorder.

Animal and human laboratory paradigms offer invaluable approaches to study the complex etiologies and mechanisms of alcohol use disorder (AUD). We contend that human laboratory models provide a "bridge" between preclinical and clinical studies of AUD by allowing for well-controlled experimental manipulations in humans with AUD. As such, examining the consilience between experimental models in animals and humans in the laboratory provides unique opportunities to refine the translational utility of such models. The overall goal of the present review is to provide a systematic description and contrast of commonly used animal paradigms for the study of AUD, as well as their human laboratory analogs if applicable. While there is a wide breadth of animal species in AUD research, the paradigms discussed in this review rely predominately on rodent research. The overarching goal of this effort is to provide critical analysis of these animal models and to link them to human laboratory models of AUD. By systematically contrasting preclinical and controlled human laboratory models, we seek to identify opportunities to enhance their translational value through forward and reverse translation. We provide future directions to reconcile differences between animal and human work and to improve translational research for AUD.

Sex-dependent effects of chronic intermittent voluntary alcohol consumption on attentional, not motivational, measures during probabilistic learning and reversal.

BACKGROUND: Forced alcohol (ethanol, EtOH) exposure has been shown to cause significant impairments on reversal learning, a widely-used assay of cognitive flexibility, specifically on fully-predictive, deterministic versions of this task. However, previous studies have not adequately considered voluntary EtOH consumption and sex effects on probabilistic reversal learning. The present study aimed to fill this gap in the literature. METHODS: Male and female Long-Evans rats underwent either 10 weeks of voluntary intermittent 20% EtOH access or water only (H2O) access. Rats were then pretrained to initiate trials and learn stimulus-reward associations via touchscreen response, and subsequently required to select between two visual stimuli, rewarded with probability 0.70 or 0.30. In the final phase, reinforcement contingencies were reversed. RESULTS: We found significant sex differences on several EtOH-drinking variables, with females reaching a higher maximum EtOH consumption, exhibiting more high-drinking days, and escalating their EtOH at a quicker rate compared to males. During early abstinence, EtOH drinkers (and particularly EtOH-drinking females) made more initiation omissions and were slower to initiate trials than H2O drinking controls, especially during pretraining. A similar pattern in trial initiations was also observed in discrimination, but not in reversal learning. EtOH drinking rats were unaffected in their reward collection and stimulus response times, indicating intact motivation and motor responding. Although there were sex differences in discrimination and reversal phases, performance improved over time. We also observed sex-independent drinking group differences in win-stay and lose-shift strategies specific to the reversal phase. CONCLUSIONS: Females exhibit increased vulnerability to EtOH effects in early learning: there were sex-dependent EtOH effects on attentional measures during pretraining and discrimination phases. We also found sex-independent EtOH effects on exploration strategies during reversal. Future studies should aim to uncover the neural mechanisms for changes in attention and exploration in both acute and prolonged EtOH withdrawal.

Initial application of a human laboratory model for estimating the motivational substitutability of e-cigarettes for combustible cigarettes.

This pilot study tested a novel human laboratory model for estimating the extent to which electronic cigarettes (e-cigarettes) serve as motivational substitutes for combustible cigarettes. The model assesses 3 parameters of substitutability, including the: (a) increase in motivational reward value of e-cigarettes after tobacco deprivation; (b) reduction in the reward value of combustible cigarettes after e-cigarette administration; and (c) comparability of the withdrawal-suppressing effects of e-cigarettes versus combustible cigarettes. Dual users (daily smokers, vaped 4+ days/week, M age = 35.3) attended 4 visits after 16-h tobacco product abstinence. For 2 visits, participants completed withdrawal measures and a task assessing smoking's reward value preceded by either: satiation by vaping or sustained tobacco product deprivation. For 2 other visits, participants completed withdrawal measures and a task assessing vaping's reward value preceded by either: continued deprivation versus satiation by smoking. Tobacco product deprivation (vs. satiation by smoking) increased vaping's reward value, indicated by nonsignificantly greater likelihood of initiating vaping versus abstaining for money (d = -.26; adjusted p [padj] = .08) and more vaping episodes purchased (ß = .22; padj = .08). Satiation by vaping (vs. deprivation) nonsignificantly reduced smoking initiation (d = .46; padj = .09) and significantly decreased number of cigarettes purchased (ß = -.29; padj = .04). Relative to deprivation, vaping suppressed withdrawal-related negative affect, smoking and vape urge, and anhedonia (ds ≥ .54). The magnitude of vaping-induced and smoking-induced withdrawal suppression did not significantly differ for all outcomes other than smoking urge, which was more strongly reduced by smoking (d = -1.57) than vaping (d = -.64). Future application and extension of this model may advance tobacco regulatory science and policy addressing e-cigarette use among smokers. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Negative Urgency Is Associated With Heightened Negative Affect and Urge During Tobacco Abstinence in Regular Smokers.

OBJECTIVE: Negative urgency-the tendency to act rashly during negative affective states-is a risk factor for regular cigarette smoking. This human laboratory study tested a novel theoretical model of the underlying mechanisms linking negative urgency and smoking motivation, which purports that smokers with high negative urgency are at increased susceptibility to abstinence-induced increases in negative affect, which, in turn, provokes the urge to smoke to suppress negative affect. METHOD: Smokers (N = 180, >10 cigarettes/day) attended a baseline session at which they completed self-report measures of negative urgency and other co-factors and subsequently attended two counterbalanced within-subject experimental sessions (i.e., 16 hours of smoking abstinence or smoking as usual). At both experimental sessions, self-reported tobacco withdrawal symptoms, affect, and smoking urge were assessed. RESULTS: Negative urgency was associated with larger abstinence-induced increases in tobacco withdrawal symptoms, negative affect, and urge to smoke to alleviate negative affect, both with and without controlling for anxiety, depression, tobacco dependence, and sensation seeking (ßs > .18, ps < .05). The association between negative urgency and abstinence-induced increases in urge to smoke to alleviate negative affect was mediated by greater abstinence-induced increases in negative affect (ßs > .062, ps = .01). CONCLUSIONS: These results provide initial support of this model by providing evidence that smokers with higher (vs. lower) negative urgency may be more prone to greater negative affect during withdrawal, which in turn may promote urge to smoke to suppress negative emotion. Research extending this model to other settings, measures, and methodological approaches may be fruitful.

Gender, Ethnicity, and Their Intersectionality in the Prediction of Smoking Outcome Expectancies in Regular Cigarette Smokers.

The current study utilized the intersectionality framework to explore whether smoking outcome expectancies (i.e., cognitions about the anticipated effects of smoking) were predicted by gender and ethnicity, and the gender-by-ethnicity interaction. In a cross-sectional design, daily smokers from the general community (32.2% women; non-Hispanic African American [n = 175], non-Hispanic White [n = 109], or Hispanic [n = 26]) completed self-report measures on smoking expectancies and other co-factors. Results showed that women reported greater negative reinforcement (i.e., anticipated smoking-induced negative affect reduction) and weight control (i.e., anticipated smoking-induced appetite/weight suppression) expectancies than men. Hispanic (vs. African American or White) smokers endorsed greater negative reinforcement expectancies. A gender-by-ethnicity interaction was found for weight control expectancies, such that White women reported greater weight control expectancies than White men, but no gender differences among African American and Hispanic smokers were found. These findings suggest that gender, ethnicity, and their intersectionality should be considered in research on cognitive mechanisms that may contribute to tobacco-related health disparities.

Tobacco withdrawal symptoms mediate motivation to reinstate smoking during abstinence.

Withdrawal-based theories of addiction hypothesize that motivation to reinstate drug use following acute abstinence is mediated by withdrawal symptoms. Experimental tests of this hypothesis in the tobacco literature are scant and may be subject to methodological limitations. This study utilized a robust within-subject laboratory experimental design to investigate the extent to which composite tobacco withdrawal symptomatology level and 3 unique withdrawal components (i.e., low positive affect, negative affect, and urge to smoke) mediated the effect of smoking abstinence on motivation to reinstate smoking. Smokers (≥10 cigarettes per day; N = 286) attended 2 counterbalanced sessions at which abstinence duration was differentially manipulated (1 hr vs. 17 hr). At both sessions, participants reported current withdrawal symptoms and subsequently completed a task in which they were monetarily rewarded proportional to the length of time they delayed initiating smoking, with shorter latency reflecting stronger motivation to reinstate smoking. Abstinence reduced latency to smoking initiation and positive affect and increased composite withdrawal symptom level, urge, and negative affect. Abstinence-induced reductions in latency to initiating smoking were mediated by each withdrawal component, with stronger effects operating through urge. Combined analyses suggested that urge, negative affect, and low positive affect operate through empirically unique mediational pathways. Secondary analyses suggested similar effects on smoking quantity, few differences among specific urge and affect subtypes, and that dependence amplifies some abstinence effects. This study provides the first experimental evidence that within-person variation in abstinence impacts motivation to reinstate drug use through withdrawal. Urge, negative affect, and low positive affect may reflect unique withdrawal-mediated mechanisms underlying tobacco addiction.