Neuronal Ensembles in the Amygdala Allow Social Information to Motivate Later Decisions.

Social experiences carry tremendous weight in our decision-making, even when social partners are not present. To determine mechanisms, we trained female mice to respond for two food reinforcers. Then, one food was paired with a novel conspecific. Mice later favored the conspecific-associated food, even in the absence of the conspecific. Chemogenetically silencing projections from the prelimbic subregion (PL) of the medial prefrontal cortex to the basolateral amygdala (BLA) obstructed this preference while leaving social discrimination intact, indicating that these projections are necessary for socially driven choice. Further, mice that performed the task had greater densities of dendritic spines on excitatory BLA neurons relative to mice that did not. We next induced chemogenetic receptors in cells active during social interactions-when mice were encoding information that impacted later behavior. BLA neurons stimulated by social experience were necessary for mice to later favor rewards associated with social conspecifics but not make other choices. This profile contrasted with that of PL neurons stimulated by social experience, which were necessary for choice behavior in social and nonsocial contexts alike. The PL may convey a generalized signal allowing mice to favor particular rewards, while units in the BLA process more specialized information, together supporting choice motivated by social information.

Social experience in adolescence shapes prefrontal cortex structure and function in adulthood.

During adolescence, the prefrontal cortex (PFC) undergoes dramatic reorganization. PFC development is profoundly influenced by the social environment, disruptions to which may prime the emergence of psychopathology across the lifespan. We investigated the neurobehavioral consequences of isolation experienced in adolescence in mice, and in particular, the long-term consequences that were detectable even despite normalization of the social milieu. Isolation produced biases toward habit-like behavior at the expense of flexible goal seeking, plus anhedonic-like reward deficits. Behavioral phenomena were accompanied by neuronal dendritic spine over-abundance and hyper-excitability in the ventromedial PFC (vmPFC), which was necessary for the expression of isolation-induced habits and sufficient to trigger behavioral inflexibility in socially reared controls. Isolation activated cytoskeletal regulatory pathways otherwise suppressed during adolescence, such that repression of constituent elements prevented long-term isolation-induced neurosequelae. Altogether, our findings unveil an adolescent critical period and multi-model mechanism by which social experiences facilitate prefrontal cortical maturation.

LRcell: detecting the source of differential expression at the sub-cell-type level from bulk RNA-seq data.

Given most tissues are consist of abundant and diverse (sub-)cell types, an important yet unaddressed problem in bulk RNA-seq analysis is to identify at which (sub-)cell type(s) the differential expression occurs. Single-cell RNA-sequencing (scRNA-seq) technologies can answer the question, but they are often labor-intensive and cost-prohibitive. Here, we present LRcell, a computational method aiming to identify specific (sub-)cell type(s) that drives the changes observed in a bulk RNA-seq experiment. In addition, LRcell provides pre-embedded marker genes computed from putative scRNA-seq experiments as options to execute the analyses. We conduct a simulation study to demonstrate the effectiveness and reliability of LRcell. Using three different real datasets, we show that LRcell successfully identifies known cell types involved in psychiatric disorders. Applying LRcell to bulk RNA-seq results can produce a hypothesis on which (sub-)cell type(s) contributes to the differential expression. LRcell is complementary to cell type deconvolution methods.

Persistent behavioral and neurobiological consequences of social isolation during adolescence.

Meaningful social interactions are a fundamental human need, the lack of which can pose serious risks to an individual's physical and mental health. Across species, peer-oriented social behaviors are dramatically reshaped during adolescence, a developmental period characterized by dynamic changes in brain structure and function as individuals transition into adulthood. Thus, the experience of social isolation during this critical developmental stage may be especially pernicious, as it could permanently derail typical neurobiological processes that are necessary for establishing adaptive adult behaviors. The purpose of this review is to summarize investigations in which rodents were isolated during adolescence, then re-housed in typical social groups prior to testing, thus allowing the investigators to resolve the long-term consequences of social adversity experienced during adolescent sensitive periods, despite subsequent normalization of the social environment. Here, we discuss alterations in social, anxiety-like, cognitive, and decision-making behaviors in previously isolated adult rodents. We then explore corresponding neurobiological findings, focusing on the prefrontal cortex, including changes in synaptic densities and protein levels, white matter and oligodendrocyte function, and neuronal physiology. Made more urgent by the recent wave of social deprivation resulting from the COVID-19 pandemic, especially amongst school-aged adolescents, understanding the mechanisms by which even transient social adversity can negatively impact brain function across the lifespan is of paramount importance.

Subunit-selective PI3-kinase control of action strategies in the medial prefrontal cortex.

PI3-kinase (PI3K) is an intracellular signaling complex that is stimulated upon cocaine exposure and linked with the behavioral consequences of cocaine. We recently genetically silenced the PI3K p110ß subunit in the medial prefrontal cortex following repeated cocaine in mice, reinstating the capacity of these mice to engage in prospective goal-seeking behavior. In the present short report, we address two follow-up hypotheses: 1) The control of decision-making behavior by PI3K p110ß is attributable to neuronal signaling, and 2) PI3K p110ß in the healthy (i.e., drug-naïve) medial prefrontal cortex has functional consequences in the control of reward-related decision-making strategies. In Experiment 1, we found that silencing neuronal p110ß improved action flexibility following cocaine. In Experiment 2, we reduced PI3K p110ß in drug-naïve mice that were extensively trained to respond for food reinforcers. Gene silencing caused mice to abandon goal-seeking strategies, unmasking habit-based behaviors that were propelled by interactions with the nucleus accumbens. Thus, PI3K control of goal-directed action strategies appears to act in accordance with an inverted U-shaped function, with "too much" (following cocaine) or "too little" (following p110ß subunit silencing) obstructing goal seeking and causing mice to defer to habit-like response sequences.

Cell adhesion factors in the orbitofrontal cortex control cue-induced reinstatement of cocaine seeking and amygdala-dependent goal seeking.

Repeated cocaine exposure causes dendritic spine loss in the orbitofrontal cortex, which might contribute to poor orbitofrontal cortical function following drug exposure. One challenge, however, has been verifying links between neuronal structural plasticity and behavior, if any. Here we report that cocaine self-administration triggers the loss of dendritic spines on excitatory neurons in the orbitofrontal cortex of male and female mice (as has been reported in rats). To understand functional consequences, we locally ablated neuronal ß1-integrins, cell adhesion receptors that adhere cells to the extracellular matrix and thus support dendritic spine stability. Degradation of ß1-integrin tone: 1) caused dendritic spine loss; 2) exaggerated cocaine-seeking responses in a cue-induced reinstatement test; and 3) impaired the ability of mice to integrate new learning into familiar routines - a key function of the orbitofrontal cortex. Stimulating Abl-related gene (Arg) kinase, over-expressing Proline-rich tyrosine kinase (Pyk2), and inhibiting Rho-associated coiled-coil containing kinase (ROCK) corrected response strategies, uncovering a ß1-integrin-mediated signaling axis that controls orbitofrontal cortical function. Finally, use of a combinatorial gene silencing/chemogenetic strategy revealed that ß1-integrins support the ability of mice to integrate new information into established behaviors by sustaining orbitofrontal cortical connections with the basolateral amygdala.SIGNIFICANCE STATEMENTCocaine degenerates dendritic spines in the orbitofrontal cortex, a region of the brain involved in interlacing new information into established behaviors. One challenge has been verifying links between cellular structural stability and behavior, if any. In this second of two related investigations, we study integrin family receptors, which adhere cells to the extracellular matrix and thereby stabilize dendritic spines (see also DePoy et al., 2019, Journal of Neuroscience). We reveal that ß1-integrins in the orbitofrontal cortex control food- and cocaine-seeking behaviors. For instance, ß1-integrin loss amplifies cocaine-seeking behavior and impairs the ability of mice to integrate new learning into familiar routines. We identify likely intracellular signaling partners by which ß1-integrins support orbitofrontal cortical function and connectivity with the basolateral amygdala.

Cocaine Elevates Calcium-Dependent Activator Protein for Secretion 2 in the Mouse Orbitofrontal Cortex.

Calcium-dependent activator protein for secretion 2 (CAPS2; also referred to as CADPS2) is a dense core vesicle-associated protein that promotes the activity-dependent release of neuropeptides including neurotrophins. Addictive drugs appear to prime neurotrophin release in multiple brain regions, but mechanistic factors are still being elucidated. Here, experimenters administered cocaine to adolescent mice at doses that potentiated later cocaine self-administration. Experimenter-administered cocaine elevated the CAPS2 protein content in the orbitofrontal cortex (OFC; but not striatum) multiple weeks after drug exposure. Meanwhile, proteins that are sensitive to brain-derived neurotrophic factor (BDNF) release and binding (phosphorylated protein kinase B and phosphoinositide 3-kinase, and GABAAα1 levels) did not differ between cocaine-exposed and naive mice in the OFC. This pattern is consistent with evidence that CAPS2 primes stimulated release of neurotrophins like BDNF, rather than basal levels. Thus, cocaine administered at behaviorally relevant doses elevates CAPS2 protein content in the OFC, and the effects are detected long after cocaine exposure.

ß1-Integrins in the Developing Orbitofrontal Cortex Are Necessary for Expectancy Updating in Mice.

Navigating a changing environment requires associating stimuli and actions with their likely outcomes and modifying these associations when they change. These processes involve the orbitofrontal cortex (OFC). Although some molecular mediators have been identified, developmental factors are virtually unknown. We hypothesized that the cell adhesion factor ß1-integrin is essential to OFC function, anticipating developmental windows during which ß1-integrins might be more influential than others. We discovered that OFC-selective ß1-integrin silencing before adolescence, but not later, impaired the ability of mice to extinguish conditioned fear and select actions based on their likely outcomes. Early-life knock-down also reduced the densities of dendritic spines, the primary sites of excitatory plasticity in the brain, and weakened sensitivity to cortical inputs. Notwithstanding these defects in male mice, females were resilient to OFC (but not hippocampal) ß1-integrin loss. Existing literature suggests that resilience may be explained by estradiol-mediated transactivation of ß1-integrins and tropomyosin receptor kinase B (trkB). Accordingly, we discovered that a trkB agonist administered during adolescence corrected reward-related decision making in ß1-integrin-deficient males. In sum, developmental ß1-integrins are indispensable for OFC function later in life.SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is a subregion of the frontal cortex that allows organisms to link behaviors and stimuli with anticipated outcomes, and to make predictions about the consequences of one's behavior. Aspects of OFC development are particularly prolonged, extending well into adolescence, likely optimizing organisms' abilities to prospectively calculate the consequences of their actions and select behaviors appropriately; these decision making strategies improve as young individuals mature into adulthood. Molecular factors are not, however, well understood. Our experiments reveal that a cell adhesion protein termed "ß1-integrin" is necessary for OFC neuronal maturation and function. Importantly, ß1-integrins operate during a critical period equivalent to early adolescence in humans to optimize the ability of organisms to update expectancies later in life.

Reward-Related Expectations Trigger Dendritic Spine Plasticity in the Mouse Ventrolateral Orbitofrontal Cortex.

An essential aspect of goal-directed decision-making is selecting actions based on anticipated consequences, a process that involves the orbitofrontal cortex (OFC) and potentially, the plasticity of dendritic spines in this region. To investigate this possibility, we trained male and female mice to nose poke for food reinforcers, or we delivered the same number of food reinforcers non-contingently to separate mice. We then decreased the likelihood of reinforcement for trained mice, requiring them to modify action-outcome expectations. In a separate experiment, we blocked action-outcome updating via chemogenetic inactivation of the OFC. In both cases, successfully selecting actions based on their likely consequences was associated with fewer immature, thin-shaped dendritic spines and a greater proportion of mature, mushroom-shaped spines in the ventrolateral OFC. This pattern was distinct from spine loss associated with aging, and we identified no effects on hippocampal CA1 neurons. Given that the OFC is involved in prospective calculations of likely outcomes, even when they are not observable, constraining spinogenesis while preserving mature spines may be important for solidifying durable expectations. To investigate causal relationships, we inhibited the RNA-binding protein fragile X mental retardation protein (encoded by Fmr1), which constrains dendritic spine turnover. Ventrolateral OFC-selective Fmr1 knockdown recapitulated the behavioral effects of inducible OFC inactivation (and lesions; also shown here), impairing action-outcome conditioning, and caused dendritic spine excess. Our findings suggest that a proper balance of dendritic spine plasticity within the OFC is necessary for one's ability to select actions based on anticipated consequences.SIGNIFICANCE STATEMENT Navigating a changing environment requires associating actions with their likely outcomes and updating these associations when they change. Dendritic spine plasticity is likely involved, yet relationships are unconfirmed. Using behavioral, chemogenetic, and viral-mediated gene silencing strategies and high-resolution microscopy, we find that modifying action-outcome expectations is associated with fewer immature spines and a greater proportion of mature spines in the ventrolateral orbitofrontal cortex (OFC). Given that the OFC is involved in prospectively calculating the likely outcomes of one's behavior, even when they are not observable, constraining spinogenesis while preserving mature spines may be important for maintaining durable expectations.

Involvement of the rodent prelimbic and medial orbitofrontal cortices in goal-directed action: A brief review.

Goal-directed action refers to selecting behaviors based on the expectation that they will be reinforced with desirable outcomes. It is typically conceptualized as opposing habit-based behaviors, which are instead supported by stimulus-response associations and insensitive to consequences. The prelimbic prefrontal cortex (PL) is positioned along the medial wall of the rodent prefrontal cortex. It is indispensable for action-outcome-driven (goal-directed) behavior, consolidating action-outcome relationships and linking contextual information with instrumental behavior. In this brief review, we will discuss the growing list of molecular factors involved in PL function. Ventral to the PL is the medial orbitofrontal cortex (mOFC). We will also summarize emerging evidence from rodents (complementing existing literature describing humans) that it too is involved in action-outcome conditioning. We describe experiments using procedures that quantify responding based on reward value, the likelihood of reinforcement, or effort requirements, touching also on experiments assessing food consumption more generally. We synthesize these findings with the argument that the mOFC is essential to goal-directed action when outcome value information is not immediately observable and must be recalled and inferred.

Regulation of actions and habits by ventral hippocampal trkB and adolescent corticosteroid exposure.

In humans and rodents, stress promotes habit-based behaviors that can interfere with action-outcome decision-making. Further, developmental stressor exposure confers long-term habit biases across rodent-primate species. Despite these homologies, mechanisms remain unclear. We first report that exposure to the primary glucocorticoid corticosterone (CORT) in adolescent mice recapitulates multiple neurobehavioral consequences of stressor exposure, including long-lasting biases towards habit-based responding in a food-reinforced operant conditioning task. In both adolescents and adults, CORT also caused a shift in the balance between full-length tyrosine kinase receptor B (trkB) and a truncated form of this neurotrophin receptor, favoring the inactive form throughout multiple corticolimbic brain regions. In adolescents, phosphorylation of the trkB substrate extracellular signal-regulated kinase 42/44 (ERK42/44) in the ventral hippocampus was also diminished, a long-term effect that persisted for at least 12 wk. Administration of the trkB agonist 7,8-dihydroxyflavone (7,8-DHF) during adolescence at doses that stimulated ERK42/44 corrected long-lasting corticosterone-induced behavioral abnormalities. Meanwhile, viral-mediated overexpression of truncated trkB in the ventral hippocampus reduced local ERK42/44 phosphorylation and was sufficient to induce habit-based and depression-like behaviors. Together, our findings indicate that ventral hippocampal trkB is essential to goal-directed action selection, countering habit-based behavior otherwise facilitated by developmental stress hormone exposure. They also reveal an early-life sensitive period during which trkB-ERK42/44 tone determines long-term behavioral outcomes.

Rho-kinase inhibition has antidepressant-like efficacy and expedites dendritic spine pruning in adolescent mice.

Adolescence represents a critical period of neurodevelopment, defined by structural and synaptic pruning within the prefrontal cortex. While characteristic of typical development, this structural instability may open a window of vulnerability to developing neuropsychiatric disorders, including depression. Thus, therapeutic interventions that support or expedite neural remodeling in adolescence may be advantageous. Here, we inhibited the neuronally-expressed cytoskeletal regulatory factor Rho-kinase (ROCK), focusing primarily on the clinically-viable ROCK inhibitor fasudil. ROCK inhibition had rapid antidepressant-like effects in adolescent mice, and its efficacy was comparable to ketamine and fluoxetine. It also modified levels of the antidepressant-related signaling factors, tropomyosin/tyrosine receptor kinase B and Akt, as well as the postsynaptic marker PSD-95, in the ventromedial prefrontal cortex (vmPFC). Meanwhile, adolescent-typical dendritic spine pruning on excitatory pyramidal neurons in the vmPFC was expedited. Further, vmPFC-specific shRNA-mediated reduction of ROCK2, the dominant ROCK isoform in the brain, had antidepressant-like consequences. We cautiously suggest that ROCK inhibitors may have therapeutic potential for adolescent-onset depression.

Corticosteroid-induced dendrite loss and behavioral deficiencies can be blocked by activation of Abl2/Arg kinase.

Stressor exposure induces neuronal remodeling in specific brain regions. Given the persistence of stress-related illnesses, key next steps in determining the contributions of neural structure to mental health are to identify cell types that fail to recover from stressor exposure and to identify "trigger points" and molecular underpinnings of stress-related neural degeneration. We evaluated dendrite arbor structure on hippocampal CA1 pyramidal neurons before, during, and following prolonged exposure to one key mediator of the stress response - corticosterone (cortisol in humans). Basal dendrite arbors progressively simplified during a 3-week exposure period, and failed to recover when corticosterone was withdrawn. Corticosterone exposure decreased levels of the dendrite stabilization factor Abl2/Arg nonreceptor tyrosine kinase and phosphorylation of its substrates p190RhoGAP and cortactin within 11days, suggesting that disruption of Arg-mediated signaling may trigger dendrite arbor atrophy and, potentially, behavioral abnormalities resulting from corticosterone exposure. To test this, we administered the novel, bioactive Arg kinase activator, 5-(1,3-diaryl-1H-pyrazol-4-yl)hydantoin, 5-[3-(4-fluorophenyl)-1-phenyl-1H-pyrazol-4-yl]-2,4-imidazolidinedione (DPH), in conjunction with corticosterone. We found that repeated treatment corrected CA1 arbor structure, otherwise simplified by corticosterone. DPH also corrected corticosterone-induced errors in a hippocampal-dependent reversal learning task and anhedonic-like behavior. Thus, pharmacological compounds that target cytoskeletal regulators, rather than classical neurotransmitter systems, may interfere with stress-associated cognitive decline and mental health concerns.

Synaptic Cytoskeletal Plasticity in the Prefrontal Cortex Following Psychostimulant Exposure.

Addiction is characterized by maladaptive decision-making, a loss of control over drug consumption and habit-like drug seeking despite adverse consequences. These cognitive changes may reflect the effects of drugs of abuse on prefrontal cortical neurobiology. Here, we review evidence that amphetamine and cocaine fundamentally remodel the structure of excitatory neurons in the prefrontal cortex. We summarize evidence in particular that these psychostimulants have opposing effects in the medial and orbital prefrontal cortices ('mPFC' and 'oPFC', respectively). For example, amphetamine and cocaine increase dendrite length and spine density in the mPFC, while dendrites are impoverished and dendritic spines are eliminated in the oPFC. We will discuss evidence that certain cytoskeletal regulatory proteins expressed in the oPFC and implicated in postnatal (adolescent) neural development also regulate behavioral sensitivity to cocaine. These findings potentially open a window of opportunity for the identification of novel pharmacotherapeutic targets in the treatment of drug abuse disorders in adults, as well as in drug-vulnerable adolescent populations. Finally, we will discuss the behavioral implications of drug-related dendritic spine elimination in the oPFC, with regard to reversal learning tasks and tasks that assess the development of reward-seeking habits, both used to model aspects of addiction in rodents.

The Medial Orbitofrontal Cortex Regulates Sensitivity to Outcome Value.

An essential component of goal-directed decision-making is the ability to maintain flexible responding based on the value of a given reward, or "reinforcer." The medial orbitofrontal cortex (mOFC), a subregion of the ventromedial prefrontal cortex, is uniquely positioned to regulate this process. We trained mice to nose poke for food reinforcers and then stimulated this region using CaMKII-driven Gs-coupled designer receptors exclusively activated by designer drugs (DREADDs). In other mice, we silenced the neuroplasticity-associated neurotrophin brain-derived neurotrophic factor (BDNF). Activation of Gs-DREADDs increased behavioral sensitivity to reinforcer devaluation, whereas Bdnf knockdown blocked sensitivity. These changes were accompanied by modifications in breakpoint ratios in a progressive ratio task, and they were recapitulated in Bdnf(+/-)mice. Replacement of BDNF selectively in the mOFC in Bdnf(+/-)mice rescued behavioral deficiencies, as well as phosphorylation of extracellular-signal regulated kinase 1/2 (ERK1/2). Thus, BDNF expression in the mOFC is both necessary and sufficient for the expression of typical effort allocation relative to an anticipated reinforcer. Additional experiments indicated that expression of the immediate-early gene c-fos was aberrantly elevated in the Bdnf(+/-)dorsal striatum, and BDNF replacement in the mOFC normalized expression. Also, systemic administration of an MAP kinase kinase inhibitor increased breakpoint ratios, whereas the addition of discrete cues bridging the response-outcome contingency rescued breakpoints in Bdnf(+/-)mice. We argue that BDNF-ERK1/2 in the mOFC is a key regulator of "online" goal-directed action selection. SIGNIFICANCE STATEMENT: Goal-directed response selection often involves predicting the consequences of one's actions and the value of potential payoffs. Lesions or chemogenetic inactivation of the medial orbitofrontal cortex (mOFC) in rats induces failures in retrieving outcome identity memories (Bradfield et al., 2015), suggesting that the healthy mOFC serves to access outcome value information when it is not immediately observable and thereby guide goal-directed decision-making. Our findings suggest that the mOFC also bidirectionally regulates effort allocation for a given reward and that expression of the neurotrophin BDNF in the mOFC is both necessary and sufficient for mice to sustain stable representations of reinforcer value.

Differential expression of cytoskeletal regulatory factors in the adolescent prefrontal cortex: Implications for cortical development.

The prevalence of depression, anxiety, schizophrenia, and drug and alcohol use disorders peaks during adolescence. Further, up to 50% of "adult" mental health disorders emerge in adolescence. During adolescence, the prefrontal cortex (PFC) undergoes dramatic structural reorganization, in which dendritic spines and synapses are refined, pruned, and stabilized. Understanding the molecular mechanisms that underlie these processes should help to identify factors that influence the development of psychiatric illness. Here we briefly discuss the anatomical connections of the medial and orbital prefrontal cortex (mPFC and OFC, respectively). We then present original findings suggesting that dendritic spines on deep-layer excitatory neurons in the mouse mPFC and OFC prune at different adolescent ages, with later pruning in the OFC. In parallel, we used Western blotting to define levels of several cytoskeletal regulatory proteins during early, mid-, and late adolescence, focusing on tropomyosin-related kinase receptor B (TrkB) and ß1-integrin-containing receptors and select signaling partners. We identified regional differences in the levels of several proteins in early and midadolescence that then converged in early adulthood. We also observed age-related differences in TrkB levels, both full-length and truncated isoforms, Rho-kinase 2, and synaptophysin in both PFC subregions. Finally, we identified changes in protein levels in the dorsal and ventral hippocampus that were distinct from those in the PFC. We conclude with a general review of the manner in which TrkB- and ß1-integrin-mediated signaling influences neuronal structure in the postnatal brain. Elucidating the role of cytoskeletal regulatory factors throughout adolescence may identify critical mechanisms of PFC development. © 2016 Wiley Periodicals, Inc.

Prefrontal cortical BDNF: A regulatory key in cocaine- and food-reinforced behaviors.

Brain-derived neurotrophic factor (BDNF) affects synaptic plasticity and neural structure and plays key roles in learning and memory processes. Recent evidence also points to important, yet complex, roles for BDNF in rodent models of cocaine abuse and addiction. Here we examine the role of prefrontal cortical (PFC) BDNF in reward-related decision making and behavioral sensitivity to, and responding for, cocaine. We focus on BDNF within the medial and orbital PFC, its regulation by cocaine during early postnatal development and in adulthood, and how BDNF in turn influences responding for drug reinforcement, including in reinstatement models. When relevant, we draw comparisons and contrasts with experiments using natural (food) reinforcers. We also summarize findings supporting, or refuting, the possibility that BDNF in the medial and orbital PFC regulate the development and maintenance of stimulus-response habits. Further investigation could assist in the development of novel treatment approaches for cocaine use disorders.

Strain commonalities and differences in response-outcome decision making in mice.

The ability to select between actions that are more vs. less likely to be reinforced is necessary for survival and navigation of a changing environment. A task termed "response-outcome contingency degradation" can be used in the laboratory to determine whether rodents behave according to such goal-directed response strategies. In one iteration of this task, rodents are trained to perform two food-reinforced behaviors, then the predictive relationship between one instrumental response and the associated outcome is modified by providing the reinforcer associated with that response non-contingently. During a subsequent probe test, animals can select between the two trained responses. Preferential engagement of the behavior most likely to be reinforced is considered goal-directed, while non-selective responding is considered a failure in response-outcome conditioning, or "habitual." This test has largely been used with rats, and less so with mice. Here we compiled data collected from several cohorts of mice tested in our lab between 2012 and 2015. Mice were bred on either a C57BL/6 or predominantly BALB/c strain background. We report that both strains of mice can use information acquired as a result of instrumental contingency degradation training to select amongst multiple response options the response most likely to be reinforced. Mice differ, however, during the training sessions when the familiar response-outcome contingency is being violated. BALB/c mice readily generate perseverative or habit-like response strategies when the only available response is unlikely to be reinforced, while C57BL/6 mice more readily inhibit responding. These findings provide evidence of strain differences in response strategies when an anticipated reinforcer is unlikely to be delivered.

Adolescent-onset GABAA α1 silencing regulates reward-related decision making.

The GABAA receptor mediates fast, inhibitory signaling, and cortical expression of the α1 subunit increases during postnatal development. Certain pathological stimuli such as stressors or prenatal cocaine exposure can interfere with this process, but causal relationships between GABAA α1 deficiency and complex behavioral outcomes remain unconfirmed. We chronically reduced GABAA α1 expression selectively in the medial prefrontal cortex (prelimbic subregion) of mice using viral-mediated gene silencing of Gabra1. Adolescent-onset Gabra1 knockdown delayed the acquisition of a cocaine-reinforced instrumental response but spared cocaine seeking in extinction and in a cue-induced reinstatement procedure. To determine whether response acquisition deficits could be associated with impairments in action-outcome associative learning and memory, we next assessed behavioral sensitivity to instrumental contingency degradation. In this case, the predictive relationship between familiar actions and their outcomes is violated. Adolescent-onset knockdown, although not adult-onset knockdown, delayed the expression of goal-directed response strategies in this task, resulting instead in inflexible habit-like modes of response. Thus, the maturation of medial prefrontal cortex GABAA α1 systems during adolescence appears necessary for goal-directed reward-related decision making in adulthood. These findings are discussed in the light of evidence that prolonged Gabra1 deficiency may impair synaptic plasticity.

Action control is mediated by prefrontal BDNF and glucocorticoid receptor binding.

Stressor exposure biases decision-making strategies from those based on the relationship between actions and their consequences to others restricted by stimulus-response associations. Chronic stressor exposure also desensitizes glucocorticoid receptors (GR) and diminishes motivation to acquire food reinforcement, although causal relationships are largely not established. We show that a history of chronic exposure to the GR ligand corticosterone or acute posttraining GR blockade with RU38486 makes rodents less able to perform actions based on their consequences. Thus, optimal GR binding is necessary for the consolidation of new response-outcome learning. In contrast, medial prefrontal (but not striatal) BDNF can account for stress-related amotivation, in that selective medial prefrontal cortical Bdnf knockdown decreases break-point ratios in a progressive-ratio task. Knockdown also increases vulnerability to RU38486. Despite the role of BDNF in dendritic spine reorganization, deep-layer spine remodeling does not obviously parallel progressive-ratio response patterns, but treatment with the Na(+)-channel inhibitor riluzole reverses corticosteroid-induced motivational deficits and restores prefrontal BDNF expression after corticosterone. We argue that when prefrontal neurotrophin systems are compromised, and GR-mediated hypothalamic-pituitary-adrenal axis feedback is desensitized (as in the case of chronic stress hormone exposure), amotivation and inflexible maladaptive response strategies that contribute to stress-related mood disorders result.