Cerebellar Neurodynamics Predict Decision Timing and Outcome on the Single-Trial Level.

Goal-directed behavior requires the interaction of multiple brain regions. How these regions and their interactions with brain-wide activity drive action selection is less understood. We have investigated this question by combining whole-brain volumetric calcium imaging using light-field microscopy and an operant-conditioning task in larval zebrafish. We find global, recurring dynamics of brain states to exhibit pre-motor bifurcations toward mutually exclusive decision outcomes. These dynamics arise from a distributed network displaying trial-by-trial functional connectivity changes, especially between cerebellum and habenula, which correlate with decision outcome. Within this network the cerebellum shows particularly strong and predictive pre-motor activity (>10 s before movement initiation), mainly within the granule cells. Turn directions are determined by the difference neuroactivity between the ipsilateral and contralateral hemispheres, while the rate of bi-hemispheric population ramping quantitatively predicts decision time on the trial-by-trial level. Our results highlight a cognitive role of the cerebellum and its importance in motor planning.

Time-scale invariant contingency yields one-shot reinforcement learning despite extremely long delays to reinforcement.

Reinforcement learning inspires much theorizing in neuroscience, cognitive science, machine learning, and AI. A central question concerns the conditions that produce the perception of a contingency between an action and reinforcement-the assignment-of-credit problem. Contemporary models of associative and reinforcement learning do not leverage the temporal metrics (measured intervals). Our information-theoretic approach formalizes contingency by time-scale invariant temporal mutual information. It predicts that learning may proceed rapidly even with extremely long action-reinforcer delays. We show that rats can learn an action after a single reinforcement, even with a 16-min delay between the action and reinforcement (15-fold longer than any delay previously shown to support such learning). By leveraging metric temporal information, our solution obviates the need for windows of associability, exponentially decaying eligibility traces, microstimuli, or distributions over Bayesian belief states. Its three equations have no free parameters; they predict one-shot learning without iterative simulation.

Different Effects of Peer Sex on Operant Responding for Social Interaction and Striatal Dopamine Activity.

When rats are given discrete choices between social interactions with a peer and opioid or psychostimulant drugs, they choose social interaction, even after extensive drug self-administration experience. Studies show that like drug and nondrug food reinforcers, social interaction is an operant reinforcer and induces dopamine release. However, these studies were conducted with same-sex peers. We examined if peer sex influences operant social interaction and the role of estrous cycle and striatal dopamine in same- versus opposite-sex social interaction. We trained male and female rats (n = 13 responders/12 peers) to lever-press (fixed-ratio 1 [FR1] schedule) for 15 s access to a same- or opposite-sex peer for 16 d (8 d/sex) while tracking females' estrous cycle. Next, we transfected GRAB-DA2m and implanted optic fibers into nucleus accumbens (NAc) core and dorsomedial striatum (DMS). We then retrained the rats for 15 s social interaction (FR1 schedule) for 16 d (8 d/sex) and recorded striatal dopamine during operant responding for a peer for 8 d (4 d/sex). Finally, we assessed economic demand by manipulating FR requirements for a peer (10 d/sex). In male, but not female rats, operant responding was higher for the opposite-sex peer. Female's estrous cycle fluctuations had no effect on operant social interaction. Striatal dopamine signals for operant social interaction were dependent on the peer's sex and striatal region (NAc core vs DMS). Results indicate that estrous cycle fluctuations did not influence operant social interaction and that NAc core and DMS dopamine activity reflect sex-dependent features of volitional social interaction.

Neuronal Ensembles in the Amygdala Allow Social Information to Motivate Later Decisions.

Social experiences carry tremendous weight in our decision-making, even when social partners are not present. To determine mechanisms, we trained female mice to respond for two food reinforcers. Then, one food was paired with a novel conspecific. Mice later favored the conspecific-associated food, even in the absence of the conspecific. Chemogenetically silencing projections from the prelimbic subregion (PL) of the medial prefrontal cortex to the basolateral amygdala (BLA) obstructed this preference while leaving social discrimination intact, indicating that these projections are necessary for socially driven choice. Further, mice that performed the task had greater densities of dendritic spines on excitatory BLA neurons relative to mice that did not. We next induced chemogenetic receptors in cells active during social interactions-when mice were encoding information that impacted later behavior. BLA neurons stimulated by social experience were necessary for mice to later favor rewards associated with social conspecifics but not make other choices. This profile contrasted with that of PL neurons stimulated by social experience, which were necessary for choice behavior in social and nonsocial contexts alike. The PL may convey a generalized signal allowing mice to favor particular rewards, while units in the BLA process more specialized information, together supporting choice motivated by social information.

From Prediction to Action: Dissociable Roles of Ventral Tegmental Area and Substantia Nigra Dopamine Neurons in Instrumental Reinforcement.

Reward seeking requires the coordination of motor programs to achieve goals. Midbrain dopamine neurons are critical for reinforcement, and their activation is sufficient for learning about cues, actions, and outcomes. Here we examine in detail the mechanisms underlying the ability of ventral tegmental area (VTA) and substantia nigra (SNc) dopamine neurons to support instrumental learning. By exploiting numerous behavioral tasks in combination with time-limited optogenetic manipulations in male and female rats, we reveal that VTA and SNc dopamine neurons generate reinforcement through separable psychological processes. VTA dopamine neurons imbue actions and their associated cues with motivational value that allows flexible and persistent pursuit, whereas SNc dopamine neurons support time-limited, precise, action-specific learning that is nonscalable and inflexible. This architecture is reminiscent of actor-critic reinforcement learning models with VTA and SNc instructing the critic and actor, respectively. Our findings indicate that heterogeneous dopamine systems support unique forms of instrumental learning that ultimately result in disparate reward-seeking strategies.SIGNIFICANCE STATEMENT Dopamine neurons in the midbrain are essential for learning, motivation, and movement. Here we describe in detail the ability of VTA and SNc dopamine neurons to generate instrumental reinforcement, a process where an agent learns about actions they can emit to earn reward. While rats will avidly work and learn to respond for activation of VTA and SNc dopamine neurons, we find that only VTA dopamine neurons imbue actions and their associated cues with motivational value that spur continued pursuit of reward. Our data support a hypothesis that VTA and SNc dopamine neurons engage distinct psychological processes that have consequences for our understanding of these neurons in health and disease.

Anticipation of Appetitive Operant Action Induces Sustained Dopamine Release in the Nucleus Accumbens.

The mesolimbic dopamine system is implicated in signaling reward-related information as well as in actions that generate rewarding outcomes. These implications are commonly investigated in either pavlovian or operant reinforcement paradigms, where only the latter requires instrumental action. To parse contributions of reward- and action-related information to dopamine signals, we directly compared the two paradigms: male rats underwent either pavlovian or operant conditioning while dopamine release was measured in the nucleus accumbens, a brain region central for processing this information. Task conditions were identical with the exception of the operant-lever response requirement. Rats in both groups released the same quantity of dopamine at the onset of the reward-predictive cue. However, only the operant-conditioning group showed a subsequent, sustained plateau in dopamine concentration throughout the entire 5 s cue presentation (preceding the required action). This dopamine ramp was unaffected by probabilistic reward delivery, occurred exclusively before operant actions, and was not related to task performance or task acquisition as it persisted throughout the 2 week daily behavioral training. Instead, the ramp flexibly increased in duration with longer cue presentation, seemingly modulating the initial cue-onset-triggered dopamine release, that is, the reward prediction error (RPE) signal, as both signal amplitude and sustainment diminished when reward timing was made more predictable. Thus, our findings suggest that RPE and action components of dopamine release can be differentiated temporally into phasic and ramping/sustained signals, respectively, where the latter depends on the former and presumably reflects the anticipation or incentivization of appetitive action, conceptually akin to motivation.SIGNIFICANCE STATEMENT It is unclear whether the components of dopamine signals that are related to reward-associated information and reward-driven approach behavior can be separated. Most studies investigating the dopamine system use either pavlovian or operant conditioning, which both involve the delivery of reward and necessitate appetitive approach behavior. Thus, used exclusively, neither paradigm can disentangle the contributions of these components to dopamine release. However, by combining both paradigms in the same study, we find that anticipation of a reward-driven operant action induces a modulation of reward-prediction-associated dopamine release, producing so-called dopamine ramps. Therefore, our findings provide new insight into dopamine ramps and suggest that dopamine signals integrate reward and appetitive action in a temporally distinguishable, yet dependent, manner.

Motor learning changes the axon initial segment of the spinal motoneuron.

We are studying the mechanisms of H-reflex operant conditioning, a simple form of learning. Modelling studies in the literature and our previous data suggested that changes in the axon initial segment (AIS) might contribute. To explore this, we used blinded quantitative histological and immunohistochemical methods to study in adult rats the impact of H-reflex conditioning on the AIS of the spinal motoneuron that produces the reflex. Successful, but not unsuccessful, H-reflex up-conditioning was associated with greater AIS length and distance from soma; greater length correlated with greater H-reflex increase. Modelling studies in the literature suggest that these increases may increase motoneuron excitability, supporting the hypothesis that they may contribute to H-reflex increase. Up-conditioning did not affect AIS ankyrin G (AnkG) immunoreactivity (IR), p-p38 protein kinase IR, or GABAergic terminals. Successful, but not unsuccessful, H-reflex down-conditioning was associated with more GABAergic terminals on the AIS, weaker AnkG-IR, and stronger p-p38-IR. More GABAergic terminals and weaker AnkG-IR correlated with greater H-reflex decrease. These changes might potentially contribute to the positive shift in motoneuron firing threshold underlying H-reflex decrease; they are consistent with modelling suggesting that sodium channel change may be responsible. H-reflex down-conditioning did not affect AIS dimensions. This evidence that AIS plasticity is associated with and might contribute to H-reflex conditioning adds to evidence that motor learning involves both spinal and brain plasticity, and both neuronal and synaptic plasticity. AIS properties of spinal motoneurons are likely to reflect the combined influence of all the motor skills that share these motoneurons. KEY POINTS: Neuronal action potentials normally begin in the axon initial segment (AIS). AIS plasticity affects neuronal excitability in development and disease. Whether it does so in learning is unknown. Operant conditioning of a spinal reflex, a simple learning model, changes the rat spinal motoneuron AIS. Successful, but not unsuccessful, H-reflex up-conditioning is associated with greater AIS length and distance from soma. Successful, but not unsuccessful, down-conditioning is associated with more AIS GABAergic terminals, less ankyrin G, and more p-p38 protein kinase. The associations between AIS plasticity and successful H-reflex conditioning are consistent with those between AIS plasticity and functional changes in development and disease, and with those predicted by modelling studies in the literature. Motor learning changes neurons and synapses in spinal cord and brain. Because spinal motoneurons are the final common pathway for behaviour, their AIS properties probably reflect the combined impact of all the behaviours that use these motoneurons.

Does phasic dopamine release cause policy updates?

Phasic dopamine activity is believed to both encode reward-prediction errors (RPEs) and to cause the adaptations that these errors engender. If so, a rat working for optogenetic stimulation of dopamine neurons will repeatedly update its policy and/or action values, thus iteratively increasing its work rate. Here, we challenge this view by demonstrating stable, non-maximal work rates in the face of repeated optogenetic stimulation of midbrain dopamine neurons. Furthermore, we show that rats learn to discriminate between world states distinguished only by their history of dopamine activation. Comparison of these results to reinforcement learning simulations suggests that the induced dopamine transients acted more as rewards than RPEs. However, pursuit of dopaminergic stimulation drifted upwards over a time scale of days and weeks, despite its stability within trials. To reconcile the results with prior findings, we consider multiple roles for dopamine signalling.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance.

Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.

Hearing in helmeted guineafowl (Numida meleagris): audiogram from 2 Hz to 10 kHz and localization acuity for brief noise bursts.

Behavioral hearing thresholds and noise localization acuity were determined using a conditioned avoidance/suppression procedure for three Helmeted guineafowl (Numida meleagris). The guineafowl responded to frequencies as low as 2 Hz at 82.5 dB SPL, and as high as 8 kHz at 84.5 dB SPL. At a level of 60 dB SPL, their hearing range spanned 8.12 octaves (24.6 Hz-6.86 kHz). Like most birds, they do not hear sounds above 8 kHz. However, the guineafowl demonstrated good low-frequency hearing (frequencies below 32 Hz), showing thresholds that are more sensitive than both the peafowl and pigeon, both of which hear infrasound. It thus appears that infrasound perception may be more common than previously thought and may have implications for species that inhabit areas with wind energy facilities. The guineafowls' minimum audible angle for a 100-ms broadband noise burst was 13.8 °, at the median for birds and near the mean for mammals. Unlike in mammals, the small sample of bird species and limited representation of lifestyles do not yet allow for meaningful interpretations of the selective pressures or mechanisms that underlie their abilities to locate sound sources.

Investigating the interactions between multiple memory stores in the pond snail Lymnaea stagnalis.

The pond snail Lymnaea stagnalis exhibits various forms of associative learning including (1) operant conditioning of aerial respiration where snails are trained not to open their pneumostome in a hypoxic pond water environment using a weak tactile stimulus to their pneumostome as they attempt to open it; and (2) a 24 h-lasting taste-specific learned avoidance known as the Garcia effect utilizing a lipopolysaccharide (LPS) injection just after snails eat a novel food substance (carrot). Typically, lab-inbred snails require two 0.5 h training sessions to form long-term memory (LTM) for operant conditioning of aerial respiration. However, some stressors (e.g., heat shock or predator scent) act as memory enhancers and thus a single 0.5 h training session is sufficient to enhance LTM formation lasting at least 24 h. Here, we found that snails forming a food-aversion LTM following Garcia-effect training exhibited enhanced LTM following operant condition of aerial respiration if trained in the presence of the food substance (carrot) they became averse to. Control experiments led us to conclude that carrot becomes a 'sickness' risk signal and acts as a stressor, sufficient to enhance LTM formation for another conditioning procedure.

Repeated exposure to physiologically effective doses of contraceptive hormones ethinyl estradiol or levonorgestrel do not alter the reinforcing effects of a brief visual stimulus in ovary-intact rats.

Estradiol and progesterone potentiate and attenuate reward processes, respectively. Despite these well-characterized effects, there is minimal research on the effects of synthetic estrogens (e.g., ethinyl estradiol, or EE) and progestins (e.g., levonorgestrel, or LEVO) contained in clinically-utilized hormonal contraceptives. The present study characterized the separate effects of repeated exposure to EE or LEVO on responding maintained by a reinforcing visual stimulus. Forty ovary-intact female Sprague-Dawley rats received either sesame oil vehicle (n = 16), 0.18 µg/day EE (n = 16), or 0.6 µg/day LEVO (n = 8) subcutaneous injections 30-min before daily one-hour sessions. Rats' responding was maintained by a 30-sec visual stimulus on a Variable Ratio-3 schedule of reinforcement. The day after rats' last session, we determined rats estrous cycle phase via vaginal cytology before sacrifice and subsequently weighing each rat's uterus to further verify the contraceptive hormone manipulation. The visual stimulus functioned as a reinforcer, but neither EE nor LEVO enhanced visual stimulus maintained responding. Estrous cytology was consistent with normal cycling in vehicle rats and halting of normal cycling in EE and LEVO rats. EE increased uterine weights consistent with typical uterotrophic effects observed with estrogens, further confirming the physiological impacts of our EE and LEVO doses. In conclusion, a physiologically effective dose of neither EE nor LEVO did not alter the reinforcing efficacy of a visual stimulus reinforcer. Future research should characterize the effects of hormonal contraceptives on responding maintained by other reinforcer types to determine the generality of the present findings.

Levonorgestrel maintains goal-directed behavior in habit-trained intact female rats.

Hormonal contraceptives are utilized by millions of women worldwide. However, it remains unclear if these powerful endocrine modulators may alter cognitive function. Habit formation involves the progression of instrumental learning as it goes from being a conscious goal-directed process to a cue-driven automatic habitual motor response. Dysregulated goal and/or habit is implicated in numerous psychopathologies, underscoring the relevance of examining the effect of hormonal contraceptives on goal-directed and habitual behavior. This study examined the effect of levonorgestrel (LNG), a widely used progestin-type contraceptive, on the development of habit in intact female rats. Rats were implanted with subcutaneous capsules that slowly released LNG over the course of the experiment or cholesterol-filled capsules. All female rats underwent operant training followed by reward devaluation to test for habit. One group of females was trained at a level that is sub-threshold to habit, while another group of females was trained to a level well over the habit threshold observed in intact females. The results reveal that all sub-threshold trained rats remained goal-directed irrespective of LGN treatment, suggesting LNG is not advancing habit formation in female rats at this level of reinforcement. However, in rats that were overtrained well above the threshold, cholesterol females showed habitual behavior, thus replicating a portion of our original studies. In contrast, LNG-treated habit-trained rats remained goal-directed, indicating that LNG impedes the development and/or expression of habit following this level of supra-threshold to habit training. Thus, LNG may offset habit formation by sustaining attentional or motivational processes during learning in intact female rats. These results may be clinically relevant to women using this type of hormonal contraceptive as well as in other progestin-based hormone therapies.

Ventral pallidum regulates the default mode network, controlling transitions between internally and externally guided behavior.

Daily life requires transitions between performance of well-practiced, automatized behaviors reliant upon internalized representations and behaviors requiring external focus. Such transitions involve differential activation of the default mode network (DMN), a group of brain areas associated with inward focus. We asked how optogenetic modulation of the ventral pallidum (VP), a subcortical DMN node, impacts task switching between internally to externally guided lever-pressing behavior in the rat. Excitation of the VP dramatically compromised acquisition of an auditory discrimination task, trapping animals in a DMN state of automatized internally focused behavior and impairing their ability to direct attention to external sensory stimuli. VP inhibition, on the other hand, facilitated task acquisition, expediting escape from the DMN brain state, thereby allowing rats to incorporate the contingency changes associated with the auditory stimuli. We suggest that VP, instant by instant, regulates the DMN and plays a deterministic role in transitions between internally and externally guided behaviors.

Developmental trajectory of social reward motivation from early adolescence into adulthood in female and male Long-Evans rats.

Most studies of adolescent and adult behavior involved one age group of each, whereas the dynamic changes in brain development suggest that there may be behavioral flux in adolescence. In two studies, we investigated developmental changes in social reward motivation in female and male Long-Evans rats from prepuberty to early adulthood in a social operant conditioning task. Given the earlier onset of puberty in females than in males, we predicted the course of social reward development would differ between the sexes. Overall, the pattern of results from both studies suggests that the trajectory of social motivation across adolescence is characterized by upward and downward shifts that do not depend on the sex of the rats. During training, in both studies, the mean number of social gate openings and percentage of social gate openings was higher at P30 (prepubertal, early adolescence) and P50 (late adolescence) than at P40 (mid adolescence) and P70 (adulthood) irrespective of sex. Nevertheless, the specific age comparisons that were significant depended on the study. In both studies, P30 rats had greater levels of social motivation than did adults in accessing a social reward when increased effort was required (progressive ratio tests). In an extinction test, only P30 and P50 rats continued to show more nose-pokes at the previously social gate than at the nonsocial gate, suggesting resistance to extinction. The results highlight the importance of characterizing behavior at several timepoints in adolescence to understand the neural mechanisms, many of which show similar discontinuities as they develop across adolescence.

Two roads leading to the same evaluative conditioning effect? Stimulus-response binding versus operant conditioning.

Evaluative Conditioning (EC) refers to changes in our liking or disliking of a stimulus due to its pairing with other positive or negative stimuli. In addition to stimulus-based mechanisms, recent research has shown that action-based mechanisms can also lead to EC effects. Research, based on action control theories, has shown that pairing a positive or negative action with a neutral stimulus results in EC effects (Stimulus-Response binding). Similarly, research studies using Operant Conditioning (OC) approaches have also observed EC effects. The aim of the present study is to directly compare EC effects elicited by two different response-based approaches - S-R bindings and OC. To this end, participants were randomly assigned to an S-R binding procedure and an OC procedure. EC effects were measured in conditions and compared. Implications for EC theory are discussed.

Specific Plasticity Loci and Their Synergism Mediate Operant Conditioning.

Despite numerous studies examining the mechanisms of operant conditioning (OC), the diversity of OC plasticity loci and their synergism have not been examined sufficiently. In the well-characterized feeding neural circuit of Aplysia, in vivo and in vitro appetitive OC increases neuronal excitability and electrical coupling among several neurons leading to an increase in expression of ingestive behavior. Here, we used the in vitro analog of OC to investigate whether OC reduces the excitability of a neuron, B4, whose inhibitory connections decrease expression of ingestive behavior. We found OC decreased the excitability of B4. This change appeared intrinsic to B4 because it could be replicated with an analog of OC in isolated cultures of B4 neurons. In addition to changes in B4 excitability, OC decreased the strength of B4's inhibitory connection to a key decision-making neuron, B51. The OC-induced changes were specific without affecting the excitability of another neuron critical for feeding behavior, B8, or the B4-to-B8 inhibitory connection. A conductance-based circuit model indicated that reducing the B4-to-B51 synapse, or increasing B51 excitability, mediated the OC phenotype more effectively than did decreasing B4 excitability. We combined these modifications to examine whether they could act synergistically. Combinations including B51 synergistically enhanced feeding. Taken together, these results suggest modifications of diverse loci work synergistically to mediate OC and that some neurons are well suited to work synergistically with plasticity in other loci.SIGNIFICANCE STATEMENT The ways in which synergism of diverse plasticity loci mediate the change in motor patterns in operant conditioning (OC) are poorly understood. Here, we found that OC was in part mediated by decreasing the intrinsic excitability of a critical neuron of Aplysia feeding behavior, and specifically reducing the strength of one of its inhibitory connections that targets a key decision-making neuron. A conductance-based computational model indicated that the known plasticity loci showed a surprising level of synergism to mediate the behavioral changes associated with OC. These results highlight the importance of understanding the diversity, specificity and synergy among different types of plasticity that encode memory. Also, because OC in Aplysia is mediated by dopamine (DA), the present study provides insights into specific and synergistic mechanisms of DA-mediated reinforcement of behaviors.

CPT1C is required for synaptic plasticity and oscillatory activity that supports motor, associative and non-associative learning.

Carnitine palmitoyltransferase 1c (CPT1C) is a neuron-specific protein widely distributed throughout the CNS and highly expressed in discrete brain areas including the hypothalamus, hippocampus, amygdala and different motor regions. Its deficiency has recently been shown to disrupt dendritic spine maturation and AMPA receptor synthesis and trafficking in the hippocampus, but its contribution to synaptic plasticity and cognitive learning and memory processes remains mostly unknown. Here, we aimed to explore the molecular, synaptic, neural network and behavioural role of CPT1C in cognition-related functions by using CPT1C knockout (KO) mice. CPT1C-deficient mice showed extensive learning and memory deficits. The CPT1C KO animals exhibited impaired motor and instrumental learning that seemed to be related, in part, to locomotor deficits and muscle weakness but not to mood alterations. In addition, CPT1C KO mice showed detrimental hippocampus-dependent spatial and habituation memory, most probably attributable to inefficient dendritic spine maturation, impairments in long-term plasticity at the CA3-CA1 synapse and aberrant cortical oscillatory activity. In conclusion, our results reveal that CPT1C is not only crucial for motor function, coordination and energy homeostasis, but also has a crucial role in the maintenance of learning and memory cognitive functions. KEY POINTS: CPT1C, a neuron-specific interactor protein involved in AMPA receptor synthesis and trafficking, was found to be highly expressed in the hippocampus, amygdala and various motor regions. CPT1C-deficient animals exhibited energy deficits and impaired locomotion, but no mood changes were found. CPT1C deficiency disrupts hippocampal dendritic spine maturation and long-term synaptic plasticity and reduces cortical γ oscillations. CPT1C was found to be crucial for motor, associative and non-associative learning and memory.

Biomarkers for rapid H-reflex operant conditioning among females.

Operant conditioning of a spinal monosynaptic pathway using the Hoffman reflex (H-reflex) is well established in animal and human studies. There is a subset within the human population (∼20% nonresponders) who are unable to up train this pathway suggesting some distinct or unique identifying characteristics. Importantly, females, who have a nine times higher rate of injury during human performance activities than men, have been understudied in areas of CNS neuroplasticity. Our long-term goal is to understand if innate ability to rapidly up train the H-reflex is predictive of future performance-based injury among females. In this study, we primarily determined whether healthy, young females could rapidly increase the H-reflex within a single session of operant conditioning and secondarily determined if electro-physiological, humoral, cognitive, anthropometric, or anxiety biomarkers distinguished the responders from nonresponders. Eighteen females (mean age: 24) participated in the study. Overall, females showed a group main effect for up training the H-reflex (P < 0.05). Of the cohort, 10 of 18 females met the criteria for up training the H-reflex (responders). The responders showed lower levels of estradiol (P < 0.05). A multivariate stepwise regression model supported that extracellular to intracellular water ratio (ECW/ICW) and H-max/M-max ratio explained 60% of the variation in up training among females. These findings support that females can acutely upregulate the H-reflex with training and that electro-physiological and hormonal factors may be associated with the up training.NEW & NOTEWORTHY Young females who acutely increase their H-reflexes with operant conditioning had lower levels of estradiol. However, the best predictors of those who could up-train the H-reflex were baseline H-reflex excitability (H-max/M-max) and extracellular to intracellular water ratio (ECW/ICW). Future studies are warranted to understand the complex relationship between operant conditioning, human performance, and injury among active young females.

Disruptions in network plasticity precede deficits in memory following inhibition of retinoid signaling.

Retinoic acid, the active metabolite of vitamin A, is important for vertebrate cognition and hippocampal plasticity, but few studies have examined its role in invertebrate learning and memory, and its actions in the invertebrate central nervous system are currently unknown. Using the mollusc Lymnaea stagnalis, we examined operant conditioning of the respiratory behavior, controlled by a well-defined central pattern generator (CPG), and used citral to inhibit retinoic acid signaling. Both citral- and vehicle-treated animals showed normal learning, but citral-treated animals failed to exhibit long-term memory at 24 h. Cohorts of citral- or vehicle-treated animals were dissected into semi-intact preparations, either 1 h after training, or after the memory test 24 h later. Simultaneous electrophysiological recordings from the CPG pacemaker cell (right pedal dorsal 1; RPeD1) and an identified motorneuron (VI) were made while monitoring respiratory activity (pneumostome opening). Activity of the CPG pneumostome opener interneuron (input 3 interneuron; IP3) was also monitored indirectly. Vehicle-treated conditioned preparations showed significant changes in network parameters immediately after learning, such as reduced motorneuron bursting activity (from IP3 input), delayed pneumostome opening, and decoupling of coincident IP3 input within the network. However, citral-treated preparations failed to exhibit these network changes and more closely resembled naïve preparations. Importantly, these citral-induced differences were manifested immediately after training and before any overt changes in the behavioral response (memory impairment). These studies shed light on where and when retinoid signaling might affect a central pattern-generating network to promote memory formation during conditioning of a homeostatic behavior.NEW & NOTEWORTHY We provide novel evidence for how conditioning-induced changes in a CPG network are disrupted when retinoid signaling is inhibited. Inhibition of retinoic acid signaling prevents long-term memory formation following operant conditioning, but has no effect on learning. Simultaneous electrophysiological and behavioral analyses indicate network changes immediately following learning, but these changes are prevented with inhibition of retinoid signaling, before any overt changes in behavior. These data suggest sites for retinoid actions during memory formation.