Therapeutic doses of ketamine acutely attenuate the aversive effect of losses during decision-making.

The discovery of rapid-acting antidepressant, ketamine has opened a pathway to a new generation of treatments for depression, and inspired neuroscientific investigation based on a new perspective that non-adaptive changes in the intrinsic excitatory and inhibitory circuitry might underlie the pathophysiology of depression. Nevertheless, it still remains largely unknown how the hypothesized molecular and synaptic levels of changes in the circuitry might mediate behavioral and neuropsychological changes underlying depression, and how ketamine might restore adaptive behavior. Here, we used computational models to analyze behavioral changes induced by therapeutic doses of ketamine, while rhesus macaques were iteratively making decisions based on gains and losses of tokens. When administered intramuscularly or intranasally, ketamine reduced the aversiveness of undesirable outcomes such as losses of tokens without significantly affecting the evaluation of gains, behavioral perseveration, motivation, and other cognitive aspects of learning such as temporal credit assignment and time scales of choice and outcome memory. Ketamine's potentially antidepressant effect was separable from other side effects such as fixation errors, which unlike outcome evaluation, was readily countered with strong motivation to avoid errors. We discuss how the acute effect of ketamine to reduce the initial impact of negative events could potentially mediate longer-term antidepressant effects through mitigating the cumulative effect of those events produced by slowly decaying memory, and how the disruption-resistant affective memory might pose challenges in treating depression. Our study also invites future investigations on ketamine's antidepressant action over diverse mood states and with affective events exerting their impacts at diverse time scales.

Phase of firing coding of learning variables across the fronto-striatal network during feature-based learning.

The prefrontal cortex and striatum form a recurrent network whose spiking activity encodes multiple types of learning-relevant information. This spike-encoded information is evident in average firing rates, but finer temporal coding might allow multiplexing and enhanced readout across the connected network. We tested this hypothesis in the fronto-striatal network of nonhuman primates during reversal learning of feature values. We found that populations of neurons encoding choice outcomes, outcome prediction errors, and outcome history in their firing rates also carry significant information in their phase-of-firing at a 10-25 Hz band-limited beta frequency at which they synchronize across lateral prefrontal cortex, anterior cingulate cortex and anterior striatum when outcomes were processed. The phase-of-firing code exceeds information that can be obtained from firing rates alone and is evident for inter-areal connections between anterior cingulate cortex, lateral prefrontal cortex and anterior striatum. For the majority of connections, the phase-of-firing information gain is maximal at phases of the beta cycle that were offset from the preferred spiking phase of neurons. Taken together, these findings document enhanced information of three important learning variables at specific phases of firing in the beta cycle at an inter-areally shared beta oscillation frequency during goal-directed behavior.

Fast spiking interneuron activity in primate striatum tracks learning of attention cues.

Cognitive flexibility depends on a fast neural learning mechanism for enhancing momentary relevant over irrelevant information. A possible neural mechanism realizing this enhancement uses fast spiking interneurons (FSIs) in the striatum to train striatal projection neurons to gate relevant and suppress distracting cortical inputs. We found support for such a mechanism in nonhuman primates during the flexible adjustment of visual attention in a reversal learning task. FSI activity was modulated by visual attention cues during feature-based learning. One FSI subpopulation showed stronger activation during learning, while another FSI subpopulation showed response suppression after learning, which could indicate a disinhibitory effect on the local circuit. Additionally, FSIs that showed response suppression to learned attention cues were activated by salient distractor events, suggesting they contribute to suppressing bottom-up distraction. These findings suggest that striatal fast spiking interneurons play an important role when cues are learned that redirect attention away from previously relevant to newly relevant visual information. This cue-specific activity was independent of motor-related activity and thus tracked specifically the learning of reward predictive visual features.

Dissociation of nicotinic α7 and α4/ß2 sub-receptor agonists for enhancing learning and attentional filtering in nonhuman primates.

RATIONALE: Nicotinic acetylcholine receptors (nAChRs) modulate attention, memory, and higher executive functioning, but it is unclear how nACh sub-receptors mediate different mechanisms supporting these functions. OBJECTIVES: We investigated whether selective agonists for the alpha-7 nAChR versus the alpha-4/beta-2 nAChR have unique functional contributions for value learning and attentional filtering of distractors in the nonhuman primate. METHODS: Two adult rhesus macaque monkeys performed reversal learning following systemic administration of either the alpha-7 nAChR agonist PHA-543613 or the alpha-4/beta-2 nAChR agonist ABT-089 or a vehicle control. Behavioral analysis quantified performance accuracy, speed of processing, reversal learning speed, the control of distractor interference, perseveration tendencies, and motivation. RESULTS: We found that the alpha-7 nAChR agonist PHA-543613 enhanced the learning speed of feature values but did not modulate how salient distracting information was filtered from ongoing choice processes. In contrast, the selective alpha-4/beta-2 nAChR agonist ABT-089 did not affect learning speed but reduced distractibility. This dissociation was dose-dependent and evident in the absence of systematic changes in overall performance, reward intake, motivation to perform the task, perseveration tendencies, or reaction times. CONCLUSIONS: These results suggest nicotinic sub-receptor specific mechanisms consistent with (1) alpha-4/beta-2 nAChR specific amplification of cholinergic transients in prefrontal cortex linked to enhanced cue detection in light of interferences, and (2) alpha-7 nAChR specific activation prolonging cholinergic transients, which could facilitate subjects to follow-through with newly established attentional strategies when outcome contingencies change. These insights will be critical for developing function-specific drugs alleviating attention and learning deficits in neuro-psychiatric diseases.

Feature-specific prediction errors and surprise across macaque fronto-striatal circuits.

To adjust expectations efficiently, prediction errors need to be associated with the precise features that gave rise to the unexpected outcome, but this credit assignment may be problematic if stimuli differ on multiple dimensions and it is ambiguous which feature dimension caused the outcome. Here, we report a potential solution: neurons in four recorded areas of the anterior fronto-striatal networks encode prediction errors that are specific to feature values of different dimensions of attended multidimensional stimuli. The most ubiquitous prediction error occurred for the reward-relevant dimension. Feature-specific prediction error signals a) emerge on average shortly after non-specific prediction error signals, b) arise earliest in the anterior cingulate cortex and later in dorsolateral prefrontal cortex, caudate and ventral striatum, and c) contribute to feature-based stimulus selection after learning. Thus, a widely-distributed feature-specific eligibility trace may be used to update synaptic weights for improved feature-based attention.

Changes of Attention during Value-Based Reversal Learning Are Tracked by N2pc and Feedback-Related Negativity.

Previously learned reward values can have a pronounced impact, behaviorally and neurophysiologically, on the allocation of selective attention. All else constant, stimuli previously associated with a high value gain stronger attentional prioritization than stimuli previously associated with a low value. The N2pc, an ERP component indicative of attentional target selection, has been shown to reflect aspects of this prioritization, by changes of mean amplitudes closely corresponding to selective enhancement of high value target processing and suppression of high value distractor processing. What has remained unclear so far is whether the N2pc also reflects the flexible and repeated behavioral adjustments needed in a volatile task environment, in which the values of stimuli are reversed often and unannounced. Using a value-based reversal learning task, we found evidence that the N2pc amplitude flexibly and reversibly tracks value-based choices during the learning of reward associated stimulus colors. Specifically, successful learning of current value-contingencies was associated with reduced N2pc amplitudes, and this effect was more apparent for distractor processing, compared with target processing. In addition, following a value reversal the feedback related negativity(FRN), an ERP component that reflects feedback processing, was amplified and co-occurred with increased N2pc amplitudes in trials following low-value feedback. Importantly, participants that showed the greatest adjustment in N2pc amplitudes based on feedback were also the most efficient learners. These results allow further insight into how changes in attentional prioritization in an uncertain and volatile environment support flexible adjustments of behavior.

Methylphenidate does not enhance visual working memory but benefits motivation in macaque monkeys.

Working memory is a limited-capacity cognitive process that retains relevant information temporarily to guide thoughts and behavior. A large body of work has suggested that catecholamines exert a major modulatory influence on cognition, but there is only equivocal evidence of a direct influence on working memory ability, which would be reflected in a dependence on working memory load. Here we tested the contribution of catecholamines to working memory by administering a wide range of acute oral doses of the dopamine and norepinephrine reuptake inhibitor methylphenidate (MPH, 0.1-9 mg/kg) to three female macaque monkeys (Macaca mulatta), whose working memory ability was measured from their performance in a visual sequential comparison task. This task allows the systematic manipulation of working memory load, and we therefore tested the specific hypothesis that MPH modulates performance in a manner that depends on both dose and memory load. We found no evidence of a dose- or memory load-dependent effect of MPH on performance. In contrast, significant effects on measures of motivation were observed. These findings suggest that an acute increase in catecholamines does not seem to affect the retention of visual information per se. As such, these results help delimit the effects of MPH on cognition.

Interareal Spike-Train Correlations of Anterior Cingulate and Dorsal Prefrontal Cortex during Attention Shifts.

The anterior cingulate cortex (ACC) and prefrontal cortex (PFC) are believed to coactivate during goal-directed behavior to identify, select, and monitor relevant sensory information. Here, we tested whether coactivation of neurons across macaque ACC and PFC would be evident at the level of pairwise neuronal correlations during stimulus selection in a spatial attention task. We found that firing correlations emerged shortly after an attention cue, were evident for 50-200 ms time windows, were strongest for neuron pairs in area 24 (ACC) and areas 8 and 9 (dorsal PFC), and were independent of overall firing rate modulations. For a subset of cell pairs from ACC and dorsal PFC, the observed functional spike-train connectivity carried information about the direction of the attention shift. Reliable firing correlations were evident across area boundaries for neurons with broad spike waveforms (putative excitatory neurons) as well as for pairs of putative excitatory neurons and neurons with narrow spike waveforms (putative interneurons). These findings reveal that stimulus selection is accompanied by slow time scale firing correlations across those ACC/PFC subfields implicated to control and monitor attention. This functional coupling was informative about which stimulus was selected and thus indexed possibly the exchange of task-relevant information. We speculate that interareal, transient firing correlations reflect the transient coordination of larger, reciprocally interacting brain networks at a characteristic 50-200 ms time scale. Significance statement: Our manuscript identifies interareal spike-train correlations between primate anterior cingulate and dorsal prefrontal cortex during a period where attentional stimulus selection is likely controlled by these very same circuits. Interareal correlations emerged during the covert attention shift to one of two peripheral stimuli, proceeded on a slow 50-200 ms time scale, and occurred between putative pyramidal and putative interneurons. Spike-train correlations emerged particularly for cell pairs tuned to similar contralateral target locations, thus indexing the interareal coordination of attention-relevant information. These findings characterize a possible way by which prefrontal and anterior cingulate cortex circuits implement their control functions through coordinated firing when macaque monkeys select and monitor relevant stimuli for goal-directed behaviors.

Mind the gap: olfactory trace conditioning in honeybees.

Trace conditioning is a form of classical conditioning, where a neutral stimulus (conditioned stimulus, CS) is associated with a following appetitive or aversive stimulus (unconditioned stimulus, US). Unlike classical delay conditioning, in trace conditioning there is a stimulus-free gap between CS and US, and thus a poststimulus neural representation (trace) of the CS is required to bridge the gap until its association with the US. The properties of such stimulus traces are not well understood, nor are their underlying physiological mechanisms. Using behavioral and physiological approaches, we studied appetitive olfactory trace conditioning in honeybees. We found that single-odor presentation created a trace containing information about odor identity. This trace conveyed odor information about the initial stimulus and was robust against interference by other odors. Memory acquisition decreased with increasing CS-US gap length. The maximum learnable CS-US gap length could be extended by previous trace-conditioning experience. Furthermore, acquisition improved when an additional odor was presented during the CS-US gap. Using calcium imaging, we tested whether projection neurons in the primary olfactory brain area, the antennal lobe, contain a CS trace. We found odor-specific persistent responses after stimulus offset. These post-odor responses, however, did not encode the CS trace, and perceived odor quality could be predicted by the initial but not by the post-odor response. Our data suggest that olfactory trace conditioning is a less reflexive form of learning than classical delay conditioning, indicating that odor traces might involve higher-level cognitive processes.