Neural Signals in Red Nucleus during Reactive and Proactive Adjustments in Behavior.

The ability to adjust behavior is an essential component of cognitive control. Much is known about frontal and striatal processes that support cognitive control, but few studies have investigated how motor signals change during reactive and proactive adjustments in motor output. To address this, we characterized neural signals in red nucleus (RN), a brain region linked to motor control, as male and female rats performed a novel variant of the stop-signal task. We found that activity in RN represented the direction of movement and was strongly correlated with movement speed. Additionally, we found that directional movement signals were amplified on STOP trials before completion of the response and that the strength of RN signals was modulated when rats exhibited cognitive control. These results provide the first evidence that neural signals in RN integrate cognitive control signals to reshape motor outcomes reactively within trials and proactivity across them.SIGNIFICANCE STATEMENT Healthy human behavior requires the suppression or inhibition of errant or maladaptive motor responses, often called cognitive control. While much is known about how frontal brain regions facilitate cognitive control, less is known about how motor regions respond to rapid and unexpected changes in action selection. To address this, we recorded from neurons in the red nucleus, a motor region thought to be important for initiating movement in rats performing a cognitive control task. We show that red nucleus tracks motor plans and that selectivity was modulated on trials that required shifting from one motor response to another. Collectively, these findings suggest that red nucleus contributes to modulating motor behavior during cognitive control.

Manipulating the revision of reward value during the intertrial interval increases sign tracking and dopamine release.

Recent computational models of sign tracking (ST) and goal tracking (GT) have accounted for observations that dopamine (DA) is not necessary for all forms of learning and have provided a set of predictions to further their validity. Among these, a central prediction is that manipulating the intertrial interval (ITI) during autoshaping should change the relative ST-GT proportion as well as DA phasic responses. Here, we tested these predictions and found that lengthening the ITI increased ST, i.e., behavioral engagement with conditioned stimuli (CS) and cue-induced phasic DA release. Importantly, DA release was also present at the time of reward delivery, even after learning, and DA release was correlated with time spent in the food cup during the ITI. During conditioning with shorter ITIs, GT was prominent (i.e., engagement with food cup), and DA release responded to the CS while being absent at the time of reward delivery after learning. Hence, shorter ITIs restored the classical DA reward prediction error (RPE) pattern. These results validate the computational hypotheses, opening new perspectives on the understanding of individual differences in Pavlovian conditioning and DA signaling.

Single Neurons in Anterior Cingulate Cortex Signal the Need to Change Action During Performance of a Stop-change Task that Induces Response Competition.

Several human imaging studies have suggested that anterior cingulate cortex (ACC) is highly active when participants receive competing inputs, and that these signals may be important for influencing the downstream planning of actions. Despite increasing evidence from several neuroimaging studies, no study has examined ACC activity at the level of the single neuron in rodents performing similar tasks. To fill this gap, we recorded from single neurons in ACC while rats performed a stop-change task. We found higher firing on trials with competing inputs (STOP trials), and that firing rates were positively correlated with accuracy and movement speed, suggesting that when ACC was engaged, rats tended to slow down and perform better. Finally, firing was the strongest when STOP trials were preceded by GO trials and was reduced when rats adapted their behavior on trials subsequent to a STOP trial. These data provide the first evidence that activity of single neurons in ACC is elevated when 2 responses are in competition with each other when there is a need to change the course of action to obtain reward.

Visual Deficits and Dysfunctions Associated with Traumatic Brain Injury: A Systematic Review and Meta-analysis.

SIGNIFICANCE: This study reports prevalence data combined independently for accommodative dysfunction, convergence insufficiency, visual field loss, and visual acuity loss in patients with traumatic brain injury in the absence of eye injury. OBJECTIVE: The objective of this study was to conduct a systematic review and meta-analysis to determine the prevalence rates of accommodative dysfunction, convergence insufficiency, visual field loss, and visual acuity loss in TBI patients without concomitant eye injury. DATA SOURCES: The data sources used in this study were PubMed, EMBASE, EBSCO, and Cochrane Library. STUDY APPRAISAL AND SYNTHESIS METHODS: Publications reporting the prevalence of diagnosed accommodative dysfunction, convergence insufficiency, visual field loss, or visual acuity loss to the level of legal blindness in TBI patients of any age were included. Univariate metaregression analyses and subgroup analyses were performed to account for statistical heterogeneity. RESULTS: Twenty-two eligible publications were identified across the four visual conditions. Random-effects models yielded combined prevalence estimates: accommodative dysfunction (42.8; 95% confidence interval [CI], 31.3 to 54.7), convergence insufficiency (36.3%; 95% CI, 28.2 to 44.9%), visual field loss (18.2%; 95% CI, 10.6 to 27.1%), and visual acuity loss (0.0%; 95% CI, 0.0 to 1.1%). Metaregression and subgroup analyses revealed that visual field loss was significantly more prevalent in moderate to severe (39.8%; 95% CI, 29.8 to 50.3%) compared with mild TBI (6.6%; 95% CI, 0 to 19.5%). CONCLUSIONS AND IMPLICATIONS OF KEY FINDINGS: This study demonstrates that accommodative dysfunction, convergence insufficiency, and visual field loss are common sequelae of TBI. Prospective longitudinal research with rigorous and uniform methodology is needed to better understand short- and long-term effects of TBI on the vision system.

Executive control signals in orbitofrontal cortex during response inhibition.

Orbitofrontal cortex (OFC) lesions produce deficits in response inhibition and imaging studies suggest that activity in OFC is stronger on trials that require suppression of behavior, yet few studies have examined neural correlates at the single-unit level in a behavioral task that probes response inhibition without varying other factors, such as anticipated outcomes. Here we recorded from single neurons in lateral OFC in a task that required animals in the minority of trials to STOP or inhibit an ongoing movement and respond in the opposite direction. We found that population and single-unit firing was modulated primarily by response direction and movement speed, and that very few OFC neurons exhibited a response independent inhibition signal. Remarkably, the strength of the directional signal was not diminished on STOP trials and was actually stronger on STOP trials during conflict adaptation. Finally, directional signals were stronger during sessions in which rats had the most difficulty inhibiting behavior. These results suggest that "inhibition" deficits observed with OFC interference studies reflect deficits unrelated to signaling the need to inhibit behavior, but instead support a role for OFC in executive functions related to dissociating between two perceptually similar actions during response conflict.

Increased firing to cues that predict low-value reward in the medial orbitofrontal cortex.

Anatomical, imaging, and lesion work have suggested that medial and lateral aspects of orbitofrontal cortex (OFC) play different roles in reward-guided decision-making, yet few single-neuron recording studies have examined activity in more medial parts of the OFC (mOFC) making it difficult to fully assess its involvement in motivated behavior. Previously, we have shown that neurons in lateral parts of the OFC (lOFC) selectively fire for rewards of different values. In that study, we trained rats to respond to different fluid wells for rewards of different sizes or delivered at different delays. Rats preferred large over small reward, and rewards delivered after short compared with long delays. Here, we recorded from single neurons in rat rostral mOFC as they performed the same task. Similar to the lOFC, activity was attenuated for rewards that were delivered after long delays and was enhanced for delivery of larger rewards. However, unlike lOFC, odor-responsive neurons in the mOFC were more active when cues predicted low-value outcomes. These data suggest that odor-responsive mOFC neurons signal the association between environmental cues and unfavorable outcomes during decision making.

Normal aging alters learning and attention-related teaching signals in basolateral amygdala.

Normal aging has been associated with an increased propensity to wait for rewards. When this is tested experimentally, rewards are typically offered at increasing delays. In this setting, persistent responding for delayed rewards in aged rats could reflect either changes in the evaluation of delayed rewards or diminished learning, perhaps due to the loss of subcortical teaching signals induced by changes in reward; the loss or diminution of such teaching signals would result in slower learning with progressive delay of reward, which would appear as persistent responding. Such teaching signals have commonly been reported in phasic firing of midbrain dopamine neurons; however, similar signals have also been found in reward-responsive neurons in the basolateral amygdala (ABL). Unlike dopaminergic teaching signals, those in ABL seem to reflect surprise, increasing when reward is either better or worse than expected. Accordingly, activity is correlated with attentional responses and with the speed of learning after surprising increases or decreases in reward. Here we examined whether these attention-related teaching signals might be altered in normal aging. Young (3-6 months) and aged (22-26 months) male Long-Evans rats were trained on a discounting task used previously to demonstrate these signals. As expected, aged rats were less sensitive to delays, and this change was associated with a loss of attentional changes in orienting behavior and neural activity. These results indicate that normal aging alters teaching signals in the ABL. Changes in these teaching signals may contribute to a host of age-related cognitive changes.

Willingness to wait and altered encoding of time-discounted reward in the orbitofrontal cortex with normal aging.

Normal aging has been associated with cognitive changes, including shifts in responding for time-discounted rewards. The orbitofrontal cortex, an area previously associated with aging-related cognitive changes, is critical for normal discounting. Previously we have shown in a choice task that rats prefer immediate over delayed reward and that neural representations of delayed reward in orbitofrontal cortex were attenuated, whereas immediate reward elicited strong responses. Changes in choice performance were correlated with changes in firing rate in orbitofrontal neurons, suggesting that these reward representations were critical to the rats' ability to wait for reward. Here we asked whether age-dependent changes in discounting behavior were related to changes in the representation of delayed reward in the orbitofrontal cortex. Young (3-6 months) and aged (22-26 months) rats were trained on the same discounting paradigm used previously. We found that aged rats showed less sensitivity to increasing delay preceding reward delivery, shifting behavior away from the delayed reward more slowly than younger rats. This sensitivity was specific to delay, since choice performance did not differ between the two groups when delay was held constant and reward size varied. Aged rats exhibited a corresponding increase in the prevalence of neurons that fired more strongly for delayed reward. Again this change was specific to delay; there was no change in encoding of different-sized rewards. These results suggest that natural aging results in altered representations of reward in orbitofrontal cortex. These changes may relate to the increased ability to delay gratification and reduced impulsivity associated with aging.

Ventral striatum encodes past and predicted value independent of motor contingencies.

The ventral striatum (VS) is thought to signal the predicted value of expected outcomes. However, it is still unclear whether VS can encode value independently from variables often yoked to value such as response direction and latency. Expectations of high value reward are often associated with a particular action and faster latencies. To address this issue we trained rats to perform a task in which the size of the predicted reward was signaled before the instrumental response was instructed. Instrumental directional cues were presented briefly at a variable onset to reduce accuracy and increase reaction time. Rats were more accurate and slower when a large versus small reward was at stake. We found that activity in VS was high during odors that predicted large reward even though reaction times were slower under these conditions. In addition to these effects, we found that activity before the reward predicting cue reflected past and predicted reward. These results demonstrate that VS can encode value independent of motor contingencies and that the role of VS in goal-directed behavior is not just to increase vigor of specific actions when more is at stake.

Attention for learning signals in anterior cingulate cortex.

Learning theory suggests that animals attend to pertinent environmental cues when reward contingencies unexpectedly change so that learning can occur. We have previously shown that activity in basolateral nucleus of amygdala (ABL) responds to unexpected changes in reward value, consistent with unsigned prediction error signals theorized by Pearce and Hall. However, changes in activity were present only at the time of unexpected reward delivery, not during the time when the animal needed to attend to conditioned stimuli that would come to predict the reward. This suggested that a different brain area must be signaling the need for attention necessary for learning. One likely candidate to fulfill this role is the anterior cingulate cortex (ACC). To test this hypothesis, we recorded from single neurons in ACC as rats performed the same behavioral task that we have used to dissociate signed from unsigned prediction errors in dopamine and ABL neurons. In this task, rats chose between two fluid wells that produced varying magnitudes of and delays to reward. Consistent with previous work, we found that ACC detected errors of commission and reward prediction errors. We also found that activity during cue sampling encoded reward size, but not expected delay to reward. Finally, activity in ACC was elevated during trials in which attention was increased following unexpected upshifts and downshifts in value. We conclude that ACC not only signals errors in reward prediction, as previously reported, but also signals the need for enhanced neural resources during learning on trials subsequent to those errors.

Basolateral amygdala encodes upcoming errors but not response conflict.

Adaptive behavior depends on the detection of potential errors so that ongoing behavior might be corrected. Here, we ask whether basolateral amygdala (ABL) might serve this function by examining activity in rats performing a task in which errors were induced by pitting two behavioral responses against each other. This response competition or conflict was created by forcing rats to respond away from the direction in which they were freely choosing on the majority of trials. Rats were slower and less accurate on these incongruent trial types. We found that activity in ABL fired more strongly prior to errant responses, but did not signal the potential for errors on correctly performed incongruent trials. These data support a role for ABL in processing errors prior to their occurrence and suggest that ABL is not involved in monitoring conflict so that ongoing behavior might be corrected.

Impact of expected value on neural activity in rat substantia nigra pars reticulata.

The substantia nigra pars reticulata (SNr) is thought to serve as the output of the basal ganglia, whereby associative information from striatum influences behavior via disinhibition of downstream motor areas to motivate behavior. Unfortunately, few studies have examined activity in SNr in rats making decisions based on the value of predicted reward similar to those conducted in primates. To fill this void, we recorded from single neurons in SNr while rats performed a choice task in which different odor cues indicated what reward was available on the left or on the right. The value of reward associated with a leftward or rightward movement was manipulated by varying the size of and delay to reward in separate blocks of trials. Rats were faster or slower depending on whether the expected reward value was high or low, respectively. The number of neurons that increased firing during performance of the task outnumbered those that decreased firing. Both increases and decreases were modulated by expected value and response direction. Neurons that fired more or less strongly for larger reward tended to fire, respectively, more or less strongly for immediate reward, reflecting their common motivational output. Finally, value selectivity was present prior to presentation of cues indicating the nature of the upcoming behavioral response for both increasing- and decreasing-type neurons, reflecting the internal bias or preparatory set of the rat. These results emphasize the importance of increasing-type neurons on behavioral output when animals are making decisions based on predicted reward value.

Blast-Related Traumatic Brain Injury: Current Concepts and Research Considerations.

Traumatic brain injury (TBI) is a well-known consequence of participation in activities such as military combat or collision sports. But the wide variability in eliciting circumstances and injury severities makes the study of TBI as a uniform disease state impossible. Military Service members are under additional, unique threats such as exposure to explosive blast and its unique effects on the body. This review is aimed toward TBI researchers, as it covers important concepts and considerations for studying blast-induced head trauma. These include the comparability of blast-induced head trauma to other mechanisms of TBI, whether blast overpressure induces measureable biomarkers, and whether a biodosimeter can link blast exposure to health outcomes, using acute radiation exposure as a corollary. This examination is contextualized by the understanding of concussive events and their psychological effects throughout the past century's wars, as well as the variables that predict sustaining a TBI and those that precipitate or exacerbate psychological conditions. Disclaimer: The views expressed in this article are solely the views of the authors and not those of the Department of Defense Blast Injury Research Coordinating Office, US Army Medical Research and Development Command, US Army Futures Command, US Army, or the Department of Defense.

Firing of Putative Dopamine Neurons in Ventral Tegmental Area Is Modulated by Probability of Success during Performance of a Stop-Change Task.

Response inhibition, the ability to refrain from unwanted actions, is an essential component of complex behavior and is often impaired across numerous neuropsychiatric disorders such as addiction, attention-deficit hyperactivity disorder (ADHD), schizophrenia, and obsessive-compulsive disorder. Accordingly, much research has been devoted to characterizing brain regions responsible for the regulation of response inhibition. The stop-signal task, a task in which animals are required to inhibit a prepotent response in the presence of a STOP cue, is one of the most well-studied tasks of response inhibition. While pharmacological evidence suggests that dopamine (DA) contributes to the regulation of response inhibition, what is exactly encoded by DA neurons during performance of response inhibition tasks is unknown. To address this issue, we recorded from single units in the ventral tegmental area (VTA), while rats performed a stop-change task. We found that putative DA neurons fired less and higher to cues and reward on STOP trials relative to GO trials, respectively, and that firing was reduced during errors. These results suggest that DA neurons in VTA encode the uncertainty associated with the probability of obtaining reward on difficult trials instead of the saliency associated with STOP cues or the need to resolve conflict between competing responses during response inhibition.

Prenatal Nicotine Exposure Impairs Executive Control Signals in Medial Prefrontal Cortex.

Prenatal nicotine exposure (PNE) is linked to numerous psychiatric disorders including attention deficit hyperactivity disorder (ADHD). Current literature suggests that core deficits observed in ADHD reflect abnormal inhibitory control governed by the prefrontal cortex. Yet, it is unclear how neural activity in the medial prefrontal cortex (mPFC) is modulated during tasks that assess response inhibition or if these neural correlates, along with behavior, are affected by PNE. To address this issue, we recorded from single mPFC neurons in control and PNE rats as they performed a stop-signal task. We found that PNE rats were faster for all trial-types, made more premature responses, and were less likely to inhibit behavior on 'STOP' trials during which rats had to inhibit an already initiated response. Activity in mPFC was modulated by response direction and was positively correlated with accuracy and movement time in control but not PNE rats. Although the number of single neurons correlated with response direction was significantly reduced by PNE, neural activity observed on general STOP trials was largely unaffected. However, dramatic behavioral deficits on STOP trials immediately following non-conflicting (GO) trials in the PNE group appear to be mediated by the loss of conflict monitoring signals in mPFC. We conclude that prenatal nicotine exposure makes rats impulsive and disrupts firing of mPFC neurons that carry signals related to response direction and conflict monitoring.

Response inhibition signals and miscoding of direction in dorsomedial striatum.

The ability to inhibit action is critical for everyday behavior and is affected by a variety of disorders. Behavioral control and response inhibition is thought to depend on a neural circuit that includes the dorsal striatum, yet the neural signals that lead to response inhibition and its failure are unclear. To address this issue, we recorded from neurons in rat dorsomedial striatum (mDS) in a novel task in which rats responded to a spatial cue that signaled that reward would be delivered either to the left or to the right. On 80% of trials rats were instructed to respond in the direction cued by the light (GO). On 20% of trials a second light illuminated instructing the rat to refrain from making the cued movement and move in the opposite direction (STOP). Many neurons in mDS encoded direction, firing more or less strongly for GO movements made ipsilateral or contralateral to the recording electrode. Neurons that fired more strongly for contralateral GO responses were more active when rats were faster, showed reduced activity on STOP trials, and miscoded direction on errors, suggesting that when these neurons were overly active, response inhibition failed. Neurons that decreased firing for contralateral movement were excited during trials in which the rat was required to stop the ipsilateral movement. For these neurons activity was reduced when errors were made and was negatively correlated with movement time suggesting that when these neurons were less active on STOP trials, response inhibition failed. Finally, the activity of a significant number of neurons represented a global inhibitory signal, firing more strongly during response inhibition regardless of response direction. Breakdown by cell type suggests that putative medium spiny neurons (MSNs) tended to fire more strongly under STOP trials, whereas putative interneurons exhibited both activity patterns.

Impact of size and delay on neural activity in the rat limbic corticostriatal system.

A number of factors influence an animal's economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short delay and big-reward conditions than under long delay and small reward conditions as measured by percent choice, accuracy, and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level.