Timescales of learning in prefrontal cortex.

The lateral prefrontal cortex (PFC) in humans and other primates is critical for immediate, goal-directed behaviour and working memory, which are classically considered distinct from the cognitive and neural circuits that support long-term learning and memory. Over the past few years, a reconsideration of this textbook perspective has emerged, in that different timescales of memory-guided behaviour are in constant interaction during the pursuit of immediate goals. Here, we will first detail how neural activity related to the shortest timescales of goal-directed behaviour (which requires maintenance of current states and goals in working memory) is sculpted by long-term knowledge and learning - that is, how the past informs present behaviour. Then, we will outline how learning across different timescales (from seconds to years) drives plasticity in the primate lateral PFC, from single neuron firing rates to mesoscale neuroimaging activity patterns. Finally, we will review how, over days and months of learning, dense local and long-range connectivity patterns in PFC facilitate longer-lasting changes in population activity by changing synaptic weights and recruiting additional neural resources to inform future behaviour. Our Review sheds light on how the machinery of plasticity in PFC circuits facilitates the integration of learned experiences across time to best guide adaptive behaviour.

Training-Dependent Gradients of Timescales of Neural Dynamics in the Primate Prefrontal Cortex and Their Contributions to Working Memory.

Cortical neurons exhibit multiple timescales related to dynamics of spontaneous fluctuations (intrinsic timescales) and response to task events (seasonal timescales) in addition to selectivity to task-relevant signals. These timescales increase systematically across the cortical hierarchy, for example, from parietal to prefrontal and cingulate cortex, pointing to their role in cortical computations. It is currently unknown whether these timescales are inherent properties of neurons and/or depend on training in a specific task and if the latter, how their modulations contribute to task performance. To address these questions, we analyzed single-cell recordings within five subregions of the prefrontal cortex (PFC) of male macaques before and after training on a working-memory task. We found fine-grained but opposite gradients of intrinsic and seasonal timescales that mainly appeared after training. Intrinsic timescales decreased whereas seasonal timescales increased from posterior to anterior subregions within both dorsal and ventral PFC. Moreover, training was accompanied by increases in proportions of neurons that exhibited intrinsic and seasonal timescales. These effects were comparable to the emergence of response selectivity due to training. Finally, task selectivity accompanied opposite neural dynamics such that neurons with task-relevant selectivity exhibited longer intrinsic and shorter seasonal timescales. Notably, neurons with longer intrinsic and shorter seasonal timescales exhibited superior population-level coding, but these advantages extended to the delay period mainly after training. Together, our results provide evidence for plastic, fine-grained gradients of timescales within PFC that can influence both single-cell and population coding, pointing to the importance of these timescales in understanding cognition.

Cholinergic Neuromodulation of Prefrontal Attractor Dynamics Controls Performance in Spatial Working Memory.

The behavioral and neural effects of the endogenous release of acetylcholine following stimulation of the nucleus basalis (NB) of Meynert have been recently examined in two male monkeys (Qi et al., 2021). Counterintuitively, NB stimulation enhanced behavioral performance while broadening neural tuning in the prefrontal cortex (PFC). The mechanism by which a weaker mnemonic neural code could lead to better performance remains unclear. Here, we show that increased neural excitability in a simple continuous bump attractor model can induce broader neural tuning and decrease bump diffusion, provided neural rates are saturated. Increased memory precision in the model overrides memory accuracy, improving overall task performance. Moreover, we show that bump attractor dynamics can account for the nonuniform impact of neuromodulation on distractibility, depending on distractor distance from the target. Finally, we delve into the conditions under which bump attractor tuning and diffusion balance in biologically plausible heterogeneous network models. In these discrete bump attractor networks, we show that reducing spatial correlations or enhancing excitatory transmission can improve memory precision. Altogether, we provide a mechanistic understanding of how cholinergic neuromodulation controls spatial working memory through perturbed attractor dynamics in the PFC.

Local organization of spatial and shape information in the primate prefrontal cortex.

The current understanding of sensory and motor cortical areas has been defined by the existence of topographical maps across the brain surface, however, higher cortical areas, such as the prefrontal cortex, seem to lack an equivalent organization, and only limited evidence of functional clustering of neurons with similar stimulus properties is evident in them. We thus sought to examine whether neurons that represent similar spatial and object information are clustered in the monkey prefrontal cortex and whether such an organization only emerges as a result of training. To this end, we analyzed neurophysiological recordings from male macaque monkeys before and after training in spatial and shape working memory tasks. Neurons with similar spatial or shape selectivity were more likely than chance to be encountered at short distances from each other. Some aspects of organization were present even in naïve animals, however other changes appeared after cognitive training. Our results reveal that prefrontal microstructure automatically supports orderly representations of spatial and object information.

Multilevel atlas comparisons reveal divergent evolution of the primate brain.

Whether the size of the prefrontal cortex (PFC) in humans is disproportionate when compared to other species is a persistent debate in evolutionary neuroscience. This question has left the study of over/under-expansion in other structures relatively unexplored. We therefore sought to address this gap by adapting anatomical areas from the digital atlases of 18 mammalian species, to create a common interspecies classification. Our approach used data-driven analysis based on phylogenetic generalized least squares to evaluate anatomical expansion covering the whole brain. Our main finding suggests a divergence in primate evolution, orienting the stereotypical mammalian cerebral proportion toward a frontal and parietal lobe expansion in catarrhini (primate parvorder comprising old world monkeys, apes, and humans). Cerebral lobe volumes slopes plotted for catarrhini species were ranked as parietal∼frontal > temporal > occipital, contrasting with the ranking of other mammalian species (occipital > temporal > frontal∼parietal). Frontal and parietal slopes were statistically different in catarrhini when compared to other species through bootstrap analysis. Within the catarrhini's frontal lobe, the prefrontal cortex was the principal driver of frontal expansion. Across all species, expansion of the frontal lobe appeared to be systematically linked to the parietal lobe. Our findings suggest that the human frontal and parietal lobes are not disproportionately enlarged when compared to other catarrhini. Nevertheless, humans remain unique in carrying the most relatively enlarged frontal and parietal lobes in an infraorder exhibiting a disproportionate expansion of these areas.

Common Mechanisms of Learning in Motor and Cognitive Systems.

Rapid progress in our understanding of the brain's learning mechanisms has been accomplished over the past decade, particularly with conceptual advances, including representing behavior as a dynamical system, large-scale neural population recordings, and new methods of analysis of neuronal populations. However, motor and cognitive systems have been traditionally studied with different methods and paradigms. Recently, some common principles, evident in both behavior and neural activity, that underlie these different types of learning have become to emerge. Here we review results from motor and cognitive learning, relying on different techniques and studying different systems to understand the mechanisms of learning. Movement is intertwined with cognitive operations, and its dynamics reflect cognitive variables. Training, in either motor or cognitive tasks, involves recruitment of previously unresponsive neurons and reorganization of neural activity in a low dimensional manifold. Mapping of new variables in neural activity can be very rapid, instantiating flexible learning of new tasks. Communication between areas is just as critical a part of learning as are patterns of activity within an area emerging with learning. Common principles across systems provide a map for future research.

Network signatures define consciousness state during focal seizures.

OBJECTIVE: Epilepsy is a common neurological disorder affecting 1% of the global population. Loss of consciousness in focal impaired awareness seizures (FIASs) and focal-to-bilateral tonic-clonic seizures (FBTCSs) can be devastating, but the mechanisms are not well understood. Although ictal activity and interictal connectivity changes have been noted, the network states of focal aware seizures (FASs), FIASs, and FBTCSs have not been thoroughly evaluated with network measures ictally. METHODS: We obtained electrographic data from 74 patients with stereoelectroencephalography (SEEG). Sliding window band power, functional connectivity, and segregation were computed on preictal, ictal, and postictal data. Five-minute epochs of wake, rapid eye movement sleep, and deep sleep were also extracted. Connectivity of subcortical arousal structures was analyzed in a cohort of patients with both SEEG and functional magnetic resonance imaging (fMRI). Given that custom neuromodulation of seizures is predicated on detection of seizure type, a convolutional neural network was used to classify seizure types. RESULTS: We found that in the frontoparietal association cortex, an area associated with consciousness, both consciousness-impairing seizures (FIASs and FBTCSs) and deep sleep had increases in slow wave delta (1-4 Hz) band power. However, when network measures were employed, we found that only FIASs and deep sleep exhibited an increase in delta segregation and a decrease in gamma segregation. Furthermore, we found that only patients with FIASs had reduced subcortical-to-neocortical functional connectivity with fMRI versus controls. Finally, our deep learning network demonstrated an area under the curve of .75 for detecting consciousness-impairing seizures. SIGNIFICANCE: This study provides novel insights into ictal network measures in FASs, FIASs, and FBTCSs. Importantly, although both FIASs and FBTCSs result in loss of consciousness, our results suggest that ictal network changes in FIASs uniquely resemble those that occur during deep sleep. Our results may inform novel neuromodulation strategies for preservation of consciousness in epilepsy.

Strong Gamma Frequency Oscillations in the Adolescent Prefrontal Cortex.

Working memory ability continues to mature into adulthood in humans and nonhuman primates. At the single-neuron level, adolescent development is characterized by increased prefrontal firing rate in the delay period, but less is known about how coordinated activity between neurons is altered. Local field potentials (LFPs) provide a window into the computations conducted by the local network. To address the effects of adolescent development on LFP activity, three male rhesus monkeys were trained to perform an oculomotor delayed response task and tested at both the adolescent and adult stages. Simultaneous single-unit and LFP signals were recorded from areas 8a and 46 of the dorsolateral prefrontal cortex. In both the cue and delay period, power relative to baseline in the gamma frequency range (32-128 Hz) was higher in the adolescent than the adult stage. The changes between developmental stages could not be accounted for by differences in performance and were observed in more posterior as well as more anterior recording sites. In the adult stage, high-firing neurons were also more likely to reside at sites with strong gamma power increase from baseline. For both stages, the gamma power increase in the delay was selective for sites with neuron-encoding stimulus information in their spiking. Our results establish gamma power decrease to be a feature of prefrontal cortical maturation.SIGNIFICANCE STATEMENT Gamma-frequency oscillations in extracellular field recordings (e.g., local field potential or EEG) are a marker of normal interactions between excitatory and inhibitory neurons in neural circuits. Abnormally low gamma power during working memory is seen in conditions such as schizophrenia. We sought to examine whether the immature prefrontal cortex similarly exhibits lower power in the gamma-frequency range during working memory, in a nonhuman primate model of adolescence. Contrary to this expectation, the adolescent PFC exhibited stronger gamma power during the maintenance of working memory. Our findings reveal an unknown developmental maturation trajectory of gamma-band oscillations, propose a refinement of information encoding during PFC maturation, and raise the possibility that schizophrenia represents an excessive state of prefrontal maturation.

Single-neuron and population measures of neuronal activity in working memory tasks.

Information represented in working memory is reflected in the firing rate of neurons in the prefrontal cortex and brain areas connected to it. In recent years, there has been an increased realization that population measures capture more accurately neural correlates of cognitive functions. We examined how single neuron firing in the prefrontal and posterior parietal cortex of two male monkeys compared with population measures in spatial working memory tasks. Persistent activity was observed in the dorsolateral prefrontal and posterior parietal cortex and firing rate predicted working memory behavior, particularly in the prefrontal cortex. These findings had equivalents in population measures, including trajectories in state space that became less separated in error trials. We additionally observed rotations of stimulus representations in the neuronal state space for different task conditions, which were not obvious in firing rate measures. These results suggest that population measures provide a richer view of how neuronal activity is associated with behavior, largely confirming that persistent activity is the core phenomenon that maintains visual-spatial information in working memory.NEW & NOTEWORTHY Recordings from large numbers of neurons led to a reevaluation of neural correlates of cognitive functions, which traditionally were defined based on responses of single neurons or averages of firing rates. Analysis of neuronal recordings from the dorsolateral prefrontal and posterior parietal cortex revealed that properties of neuronal firing captured in classical studies of persistent activity can account for population representations, though some population characteristics did not have clear correlates in single neuron activity.

Laminar pattern of adolescent development changes in working memory neuronal activity.

Adolescent development is characterized by an improvement in cognitive abilities, such as working memory. Neurophysiological recordings in a nonhuman primate model of adolescence have revealed changes in neural activity that mirror improvement in behavior, including higher firing rate during the delay intervals of working memory tasks. The laminar distribution of these changes is unknown. By some accounts, persistent activity is more pronounced in superficial layers, so we sought to determine whether changes are most pronounced there. We therefore analyzed neurophysiological recordings from the young and adult stage of male monkeys, at different cortical depths. Superficial layers exhibited an increased baseline firing rate in the adult stage. Unexpectedly, we also detected substantial increases in delay period activity in the middle layers after adolescence, which was confirmed even after excluding penetrations near sulci. Finally, improved discriminability around the saccade period was most evident in the deeper layers. These results reveal the laminar pattern of neural activity maturation that is associated with cognitive improvement.NEW & NOTEWORTHY Structural brain changes are evident during adolescent development particularly in the cortical thickness of the prefrontal cortex, at a time when working memory ability increases markedly. The depth distribution of neurophysiological changes during adolescence is not known. Here, we show that neurophysiological changes are not confined to superficial layers, which have most often been implicated in the maintenance of working memory. Contrary to expectations, substantial changes were evident in intermediate layers of the prefrontal cortex.

Decoding working memory information from neurons with and without persistent activity in the primate prefrontal cortex.

Persistent activity of neurons in the prefrontal cortex has been thought to represent the information maintained in working memory, though alternative models have challenged this idea. Theories that depend on the dynamic representation of information posit that stimulus information may be maintained by the activity pattern of neurons whose firing rate is not significantly elevated above their baseline during the delay period of working memory tasks. We thus tested the ability of neurons that do and do not generate persistent activity in the prefrontal cortex of monkeys to represent spatial and object information in working memory. Neurons that generated persistent activity represented more information about the stimuli in both spatial and object working memory tasks. The amount of information that could be decoded from neural activity depended on the choice of decoder and parameters used but neurons with persistent activity outperformed non-persistent neurons consistently. Averaged across all neurons and stimuli, the firing rate did not appear clearly elevated above baseline during the maintenance of neural activity particularly for object working memory; however, this grand average masked neurons that generated persistent activity selective for their preferred stimuli, which carried the majority of stimulus information. These results reveal that prefrontal neurons that generate persistent activity maintain information more reliably during working memory.NEW & NOTEWORTHY Competing theories suggest that neurons that generate persistent activity or do not are primarily responsible for the maintenance of information, particularly regarding object working memory. Although the two models have been debated on theoretical terms, direct comparison of empirical results has been lacking. Analysis of neural activity in a large database of prefrontal recordings revealed that neurons that generate persistent activity were primarily responsible for the maintenance of both spatial and object working memory.

Trial-to-Trial Variability of Spiking Delay Activity in Prefrontal Cortex Constrains Burst-Coding Models of Working Memory.

A hallmark neuronal correlate of working memory (WM) is stimulus-selective spiking activity of neurons in PFC during mnemonic delays. These observations have motivated an influential computational modeling framework in which WM is supported by persistent activity. Recently, this framework has been challenged by arguments that observed persistent activity may be an artifact of trial-averaging, which potentially masks high variability of delay activity at the single-trial level. In an alternative scenario, WM delay activity could be encoded in bursts of selective neuronal firing which occur intermittently across trials. However, this alternative proposal has not been tested on single-neuron spike-train data. Here, we developed a framework for addressing this issue by characterizing the trial-to-trial variability of neuronal spiking quantified by Fano factor (FF). By building a doubly stochastic Poisson spiking model, we first demonstrated that the burst-coding proposal implies a significant increase in FF positively correlated with firing rate, and thus loss of stability across trials during the delay. Simulation of spiking cortical circuit WM models further confirmed that FF is a sensitive measure that can well dissociate distinct WM mechanisms. We then tested these predictions on datasets of single-neuron recordings from macaque PFC during three WM tasks. In sharp contrast to the burst-coding model predictions, we only found a small fraction of neurons showing increased WM-dependent burstiness, and stability across trials during delay was strengthened in empirical data. Therefore, reduced trial-to-trial variability during delay provides strong constraints on the contribution of single-neuron intermittent bursting to WM maintenance.SIGNIFICANCE STATEMENT There are diverging classes of theoretical models explaining how information is maintained in working memory by cortical circuits. In an influential model class, neurons exhibit persistent elevated memorandum-selective firing, whereas a recently developed class of burst-coding models suggests that persistent activity is an artifact of trial-averaging, and spiking is sparse in each single trial, subserved by brief intermittent bursts. However, this alternative picture has not been characterized or tested on empirical spike-train data. Here we combine mathematical analysis, computational model simulation, and experimental data analysis to test empirically these two classes of models and show that the trial-to-trial variability of empirical spike trains is not consistent with burst coding. These findings provide constraints for theoretical models of working memory.

Emergence of Nonlinear Mixed Selectivity in Prefrontal Cortex after Training.

Neurons in the PFC are typically activated by different cognitive tasks, and also by different stimuli and abstract variables within these tasks. A single neuron's selectivity for a given stimulus dimension often changes depending on its context, a phenomenon known as nonlinear mixed selectivity (NMS). It has previously been hypothesized that NMS emerges as a result of training to perform tasks in different contexts. We tested this hypothesis directly by examining the neuronal responses of different PFC areas before and after male monkeys were trained to perform different working memory tasks involving visual stimulus locations and/or shapes. We found that training induces a modest increase in the proportion of PFC neurons with NMS exclusively for spatial working memory, but not for shape working memory tasks, with area 9/46 undergoing the most significant increase in NMS cell proportion. We also found that increased working memory task complexity, in the form of simultaneously storing location and shape combinations, does not increase the degree of NMS for stimulus shape with other task variables. Lastly, in contrast to the previous studies, we did not find evidence that NMS is predictive of task performance. Our results thus provide critical insights on the representation of stimuli and task information in neuronal populations, in working memory.SIGNIFICANCE STATEMENT How multiple types of information are represented in working memory remains a complex computational problem. It has been hypothesized that nonlinear mixed selectivity allows neurons to efficiently encode multiple stimuli in different contexts, after subjects have been trained in complex tasks. Our analysis of prefrontal recordings obtained before and after training monkeys to perform working memory tasks only partially agreed with this prediction, in that nonlinear mixed selectivity emerged for spatial but not shape information, and mostly in mid-dorsal PFC. Nonlinear mixed selectivity also displayed little modulation across either task complexity or correct performance. These results point to other mechanisms, in addition to nonlinear mixed selectivity, representing complex information about stimulus and task context in neuronal activity.

Drifts in Prefrontal and Parietal Neuronal Activity Influence Working Memory Judgments.

The dorsolateral prefrontal cortex (dlPFC) plays a critical role in spatial working memory and its activity predicts behavioral responses in delayed response tasks. Here, we addressed if this predictive ability extends to other working memory tasks and if it is present in other brain areas. We trained monkeys to remember the location of a stimulus and determine whether a second stimulus appeared at the same location or not. Neurophysiological recordings were performed in the dorsolateral prefrontal cortex and posterior parietal cortex (PPC). We hypothesized that random drifts causing the peak activity of the network to move away from the first stimulus location and toward the location of the second stimulus would result in categorical errors. Indeed, for both areas, in nonmatching trials, when the first stimulus appeared in a neuron's preferred location, the neuron showed significantly higher firing rates in correct than in error trials; and vice versa, when the first stimulus appeared at a nonpreferred location, activity in error trials was higher than in correct. The results indicate that the activity of both dlPFC and PPC neurons is predictive of categorical judgments of information maintained in working memory, and neuronal firing rate deviations are revealing of the contents of working memory.

Working memory capacity is enhanced by distributed prefrontal activation and invariant temporal dynamics.

The amount of information that can be stored in working memory is limited but may be improved with practice. The basis of improved efficiency at the level of neural activity is unknown. To investigate this question, we trained monkeys to perform a working memory task that required memory for multiple stimuli. Performance decreased as a function of number of stimuli to be remembered, but improved as the animals practiced the task. Neuronal recordings acquired during this training revealed two hitherto unknown mechanisms of working memory capacity improvement. First, more prefrontal neurons became active as working memory improved, but their baseline activity decreased. Second, improved working memory capacity was characterized by less variable temporal dynamics, resulting in a more consistent firing rate at each time point during the course of a trial. Our results reveal that improved performance of working memory tasks is achieved through more distributed activation and invariant neuronal dynamics.

The neuroscience of working memory capacity and training.

Working memory - the ability to maintain and manipulate information over a period of seconds - is a core component of higher cognitive functions. The storage capacity of working memory is limited but can be expanded by training, and evidence of the neural mechanisms underlying this effect is accumulating. Human imaging studies and neurophysiological recordings in non-human primates, together with computational modelling studies, reveal that training increases the activity of prefrontal neurons and the strength of connectivity in the prefrontal cortex and between the prefrontal and parietal cortex. Dopaminergic transmission could have a facilitatory role. These changes more generally inform us of the plasticity of higher cognitive functions.

Stable population coding for working memory coexists with heterogeneous neural dynamics in prefrontal cortex.

Working memory (WM) is a cognitive function for temporary maintenance and manipulation of information, which requires conversion of stimulus-driven signals into internal representations that are maintained across seconds-long mnemonic delays. Within primate prefrontal cortex (PFC), a critical node of the brain's WM network, neurons show stimulus-selective persistent activity during WM, but many of them exhibit strong temporal dynamics and heterogeneity, raising the questions of whether, and how, neuronal populations in PFC maintain stable mnemonic representations of stimuli during WM. Here we show that despite complex and heterogeneous temporal dynamics in single-neuron activity, PFC activity is endowed with a population-level coding of the mnemonic stimulus that is stable and robust throughout WM maintenance. We applied population-level analyses to hundreds of recorded single neurons from lateral PFC of monkeys performing two seminal tasks that demand parametric WM: oculomotor delayed response and vibrotactile delayed discrimination. We found that the high-dimensional state space of PFC population activity contains a low-dimensional subspace in which stimulus representations are stable across time during the cue and delay epochs, enabling robust and generalizable decoding compared with time-optimized subspaces. To explore potential mechanisms, we applied these same population-level analyses to theoretical neural circuit models of WM activity. Three previously proposed models failed to capture the key population-level features observed empirically. We propose network connectivity properties, implemented in a linear network model, which can underlie these features. This work uncovers stable population-level WM representations in PFC, despite strong temporal neural dynamics, thereby providing insights into neural circuit mechanisms supporting WM.

Persistent Spiking Activity Underlies Working Memory.

Persistent activity generated in the PFC during the delay period of working memory tasks represents information about stimuli held in memory and determines working memory performance. Alternative models of working memory, depending on the rhythmicity of discharges or exclusively on short-term synaptic plasticity, are inconsistent with the neurophysiological data.Dual Perspectives Companion Paper:Working Memory: Delay Activity, Yes! Persistent Activity? Maybe Not, by Mikael Lundqvist, Pawel Herman, and Earl K. Miller.

Differential Processing of Isolated Object and Multi-item Pop-Out Displays in LIP and PFC.

Objects that are highly distinct from their surroundings appear to visually "pop-out." This effect is present for displays in which: (1) a single cue object is shown on a blank background, and (2) a single cue object is highly distinct from surrounding objects; it is generally assumed that these 2 display types are processed in the same way. To directly examine this, we applied a decoding analysis to neural activity recorded from the lateral intraparietal (LIP) area and the dorsolateral prefrontal cortex (dlPFC). Our analyses showed that for the single-object displays, cue location information appeared earlier in LIP than in dlPFC. However, for the display with distractors, location information was substantially delayed in both brain regions, and information first appeared in dlPFC. Additionally, we see that pattern of neural activity is similar for both types of displays and across different color transformations of the stimuli, indicating that location information is being coded in the same way regardless of display type. These results lead us to hypothesize that 2 different pathways are involved processing these 2 types of pop-out displays.

Behavioral response inhibition and maturation of goal representation in prefrontal cortex after puberty.

Executive functions including behavioral response inhibition mature after puberty, in tandem with structural changes in the prefrontal cortex. Little is known about how activity of prefrontal neurons relates to this profound cognitive development. To examine this, we tracked neuronal responses of the prefrontal cortex in monkeys as they transitioned from puberty into adulthood and compared activity at different developmental stages. Performance of the antisaccade task greatly improved in this period. Among neural mechanisms that could facilitate it, reduction of stimulus-driven activity, increased saccadic activity, or enhanced representation of the opposing goal location, only the latter was evident in adulthood. Greatly accentuated in adults, this neural correlate of vector inversion may be a prerequisite to the formation of a motor plan to look away from the stimulus. Our results suggest that the prefrontal mechanisms that underlie mature performance on the antisaccade task are more strongly associated with forming an alternative plan of action than with suppressing the neural impact of the prepotent stimulus.