Population coding of strategic variables during foraging in freely moving macaques.

Until now, it has been difficult to examine the neural bases of foraging in naturalistic environments because previous approaches have relied on restrained animals performing trial-based foraging tasks. Here we allowed unrestrained monkeys to freely interact with concurrent reward options while we wirelessly recorded population activity in the dorsolateral prefrontal cortex. The animals decided when and where to forage based on whether their prediction of reward was fulfilled or violated. This prediction was not solely based on a history of reward delivery, but also on the understanding that waiting longer improves the chance of reward. The task variables were continuously represented in a subspace of the high-dimensional population activity, and this compressed representation predicted the animal's subsequent choices better than the true task variables and as well as the raw neural activity. Our results indicate that monkeys' foraging strategies are based on a cortical model of reward dynamics as animals freely explore their environment.

Visuo-frontal interactions during social learning in freely moving macaques.

Social interactions represent a ubiquitous aspect of our everyday life that we acquire by interpreting and responding to visual cues from conspecifics1. However, despite the general acceptance of this view, how visual information is used to guide the decision to cooperate is unknown. Here, we wirelessly recorded the spiking activity of populations of neurons in the visual and prefrontal cortex in conjunction with wireless recordings of oculomotor events while freely moving macaques engaged in social cooperation. As animals learned to cooperate, visual and executive areas refined the representation of social variables, such as the conspecific or reward, by distributing socially relevant information among neurons in each area. Decoding population activity showed that viewing social cues influences the decision to cooperate. Learning social events increased coordinated spiking between visual and prefrontal cortical neurons, which was associated with improved accuracy of neural populations to encode social cues and the decision to cooperate. These results indicate that the visual-frontal cortical network prioritizes relevant sensory information to facilitate learning social interactions while freely moving macaques interact in a naturalistic environment.

Rapid compensatory plasticity revealed by dynamic correlated activity in monkeys in vivo.

To produce adaptive behavior, neural networks must balance between plasticity and stability. Computational work has demonstrated that network stability requires plasticity mechanisms to be counterbalanced by rapid compensatory processes. However, such processes have yet to be experimentally observed. Here we demonstrate that repeated optogenetic activation of excitatory neurons in monkey visual cortex (area V1) induces a population-wide dynamic reduction in the strength of neuronal interactions over the timescale of minutes during the awake state, but not during rest. This new form of rapid plasticity was observed only in the correlation structure, with firing rates remaining stable across trials. A computational network model operating in the balanced regime confirmed experimental findings and revealed that inhibitory plasticity is responsible for the decrease in correlated activity in response to repeated light stimulation. These results provide the first experimental evidence for rapid homeostatic plasticity that primarily operates during wakefulness, which stabilizes neuronal interactions during strong network co-activation.

Endogenous fluctuations in cortical state selectively enhance different modes of sensory processing in human temporal lobe.

The degree of synchronized fluctuations in neocortical network activity can vary widely during alertness. One influential idea that has emerged over the past few decades is that perceptual decisions are more accurate when the state of population activity is desynchronized. This suggests that optimal task performance may occur during a particular cortical state - the desynchronized state. Here we show that, contrary to this view, cortical state can both facilitate and suppress perceptual performance in a task-dependent manner. We performed electrical recordings from surface-implanted grid electrodes in the temporal lobe while human subjects completed two perceptual tasks. We found that when local population activity is in a synchronized state, network and perceptual performance are enhanced in a detection task and impaired in a discrimination task, but these modulatory effects are reversed when population activity is desynchronized. These findings indicate that the brain has adapted to take advantage of endogenous fluctuations in the state of neural populations in temporal cortex to selectively enhance different modes of sensory processing during perception in a state-dependent manner.

Suppressing feedback signals to visual cortex abolishes attentional modulation.

Attention improves perception by enhancing the neural encoding of sensory information. A long-standing hypothesis is that cortical feedback projections carry top-down signals to influence sensory coding. However, this hypothesis has never been tested to establish causal links. We used viral tools to label feedback connections from cortical area V4 targeting early visual cortex (area V1). While monkeys performed a visual-spatial attention task, inactivating feedback axonal terminals in V1 without altering local intracortical and feedforward inputs reduced the response gain of single cells and impaired the accuracy of neural populations for encoding external stimuli. These effects are primarily manifested in the superficial layers of V1 and propagate to downstream area V4. Attention enhances sensory coding across visual cortex by specifically altering the strength of corticocortical feedback in a layer-dependent manner.

Adaptive coding across visual features during free-viewing and fixation conditions.

Theoretical studies have long proposed that adaptation allows the brain to effectively use the limited response range of sensory neurons to encode widely varying natural inputs. However, despite this influential view, experimental studies have exclusively focused on how the neural code adapts to a range of stimuli lying along a single feature axis, such as orientation or contrast. Here, we performed electrical recordings in macaque visual cortex (area V4) to reveal significant adaptive changes in the neural code of single cells and populations across multiple feature axes. Both during free viewing and passive fixation, populations of cells improved their ability to encode image features after rapid exposure to stimuli lying on orthogonal feature axes even in the absence of initial tuning to these stimuli. These results reveal a remarkable adaptive capacity of visual cortical populations to improve network computations relevant for natural viewing despite the modularity of the functional cortical architecture.

Brain state limits propagation of neural signals in laminar cortical circuits.

Our perception of the environment relies on the efficient propagation of neural signals across cortical networks. During the time course of a day, neural responses fluctuate dramatically as the state of the brain changes to possibly influence how electrical signals propagate across neural circuits. Despite the importance of this issue, how patterns of spiking activity propagate within neuronal circuits in different brain states remains unknown. Here, we used multielectrode laminar arrays to reveal that brain state strongly modulates the propagation of neural activity across the layers of early visual cortex (V1). We optogenetically induced synchronized state transitions within a group of neurons and examined how far electrical signals travel during wakefulness and rest. Although optogenetic stimulation elicits stronger neural responses during wakefulness relative to rest, signals propagate only weakly across the cortical column during wakefulness, and the extent of spread is inversely related to arousal level. In contrast, the light-induced population activity vigorously propagates throughout the entire cortical column during rest, even when neurons are in a desynchronized wake-like state prior to light stimulation. Mechanistically, the influence of global brain state on the propagation of spiking activity across laminar circuits can be explained by state-dependent changes in the coupling between neurons. Our results impose constraints on the conclusions of causal manipulation studies attempting to influence neural function and behavior, as well as on previous computational models of perception assuming robust signal propagation across cortical layers and areas.

Learning by Exposure in the Visual System.

It is increasingly being understood that perceptual learning involves different types of plasticity. Thus, whereas the practice-based improvement in the ability to perform specific tasks is believed to rely on top-down plasticity, the capacity of sensory systems to passively adapt to the stimuli they are exposed to is believed to rely on bottom-up plasticity. However, top-down and bottom-up plasticity have never been investigated concurrently, and hence their relationship is not well understood. To examine whether passive exposure influences perceptual performance, we asked subjects to test their orientation discrimination performance around and orthogonal to the exposed orientation axes, at an exposed and an unexposed location while oriented sine-wave gratings were presented in a fixed position. Here we report that repetitive passive exposure to oriented sequences that are not linked to a specific task induces a persistent, bottom-up form of learning that is stronger than top-down practice learning and generalizes across complex stimulus dimensions. Importantly, orientation-specific exposure learning led to a robust improvement in the discrimination of complex stimuli (shapes and natural scenes). Our results indicate that long-term sensory adaptation by passive exposure should be viewed as a form of perceptual learning that is complementary to practice learning in that it reduces constraints on speed and generalization.

High-order interactions explain the collective behavior of cortical populations in executive but not sensory areas.

One influential view in neuroscience is that pairwise cell interactions explain the firing patterns of large populations. Despite its prevalence, this view originates from studies in the retina and visual cortex of anesthetized animals. Whether pairwise interactions predict the firing patterns of neurons across multiple brain areas in behaving animals remains unknown. Here, we performed multi-area electrical recordings to find that 2nd-order interactions explain a high fraction of entropy of the population response in macaque cortical areas V1 and V4. Surprisingly, despite the brain-state modulation of neuronal responses, the model based on pairwise interactions captured ∼90% of the spiking activity structure during wakefulness and sleep. However, regardless of brain state, pairwise interactions fail to explain experimentally observed entropy in neural populations from the prefrontal cortex. Thus, while simple pairwise interactions explain the collective behavior of visual cortical networks across brain states, explaining the population dynamics in downstream areas involves higher-order interactions.

Heterogeneous side effects of cortical inactivation in behaving animals.

Cortical inactivation represents a key causal manipulation allowing the study of cortical circuits and their impact on behavior. A key assumption in inactivation studies is that the neurons in the target area become silent while the surrounding cortical tissue is only negligibly impacted. However, individual neurons are embedded in complex local circuits composed of excitatory and inhibitory cells with connections extending hundreds of microns. This raises the possibility that silencing one part of the network could induce complex, unpredictable activity changes in neurons outside the targeted inactivation zone. These off-target side effects can potentially complicate interpretations of inactivation manipulations, especially when they are related to changes in behavior. Here, we demonstrate that optogenetic inactivation of glutamatergic neurons in the superficial layers of monkey primary visual cortex (V1) induces robust suppression at the light-targeted site, but destabilizes stimulus responses in the neighboring, untargeted network. We identified four types of stimulus-evoked neuronal responses within a cortical column, ranging from full suppression to facilitation, and a mixture of both. Mixed responses were most prominent in middle and deep cortical layers. These results demonstrate that response modulation driven by lateral network connectivity is diversely implemented throughout a cortical column. Importantly, consistent behavioral changes induced by optogenetic inactivation were only achieved when cumulative network activity was homogeneously suppressed. Therefore, careful consideration of the full range of network changes outside the inactivated cortical region is required, as heterogeneous side effects can confound interpretation of inactivation experiments.

A distinct population of heterogeneously color-tuned neurons in macaque visual cortex.

Color is a key feature of natural environments that higher mammals routinely use to detect food, avoid predators, and interpret social signals. The distribution of color signals in natural scenes is widely variable, ranging from uniform patches to highly nonuniform regions in which different colors lie in close proximity. Whether individual neurons are tuned to this high degree of variability of color signals is unknown. Here, we identified a distinct population of cells in macaque visual cortex (area V4) that have a heterogeneous receptive field (RF) structure in which individual subfields are tuned to different colors even though the full RF is only weakly tuned. This spatial heterogeneity in color tuning indicates a higher degree of complexity of color-encoding mechanisms in visual cortex than previously believed to efficiently extract chromatic information from the environment.

Perceptually unidentifiable stimuli influence cortical processing and behavioral performance.

Our daily behavior is dynamically influenced by conscious and unconscious processes. Although the neural bases of conscious experience have been extensively investigated over the past several decades, how unconscious information impacts neural circuitry and behavior remains unknown. Here, we recorded populations of neurons in macaque primary visual cortex (V1) to find that perceptually unidentifiable stimuli repeatedly presented in the absence of awareness are encoded by neural populations in a way that facilitates their future processing in the context of a behavioral task. Such exposure increases stimulus sensitivity and information encoded in cell populations, even though animals are unaware of stimulus identity. This phenomenon is consistent with a Hebbian mechanism underlying an increase in functional connectivity specifically for the neurons activated by subthreshold stimuli. This form of unsupervised adaptation may constitute a vestigial pre-attention system using the mere frequency of stimulus occurrence to change stimulus representations even when sensory inputs are perceptually invisible.

Pairwise Synchrony and Correlations Depend on the Structure of the Population Code in Visual Cortex.

In visual areas of primates, neurons activate in parallel while the animal is engaged in a behavioral task. In this study, we examine the structure of the population code while the animal performs delayed match-to-sample tasks on complex natural images. The macaque monkeys visualized two consecutive stimuli that were either the same or different, while being recorded with laminar arrays across the cortical depth in cortical areas V1 and V4. We decode correct choice behavior from neural populations of simultaneously recorded units. Utilizing decoding weights, we divide neurons into most informative and less informative and show that most informative neurons in V4, but not in V1, are more strongly synchronized, coupled, and correlated than less informative neurons. Because neurons are divided into two coding pools according to their coding preference, in V4, but not in V1, spiking synchrony, coupling, and correlations within the coding pool are stronger than across coding pools.

Precise measurement of correlations between frequency coupling and visual task performance.

Functional connectivity analyses focused on frequency-domain relationships, i.e. frequency coupling, powerfully reveal neurophysiology. Coherence is commonly used but neural activity does not follow its Gaussian assumption. The recently introduced mutual information in frequency (MIF) technique makes no model assumptions and measures non-Gaussian and nonlinear relationships. We develop a powerful MIF estimator optimized for correlating frequency coupling with task performance and other relevant task phenomena. In light of variance reduction afforded by multitaper spectral estimation, which is critical to precisely measuring such correlations, we propose a multitaper approach for MIF and compare its performance with coherence in simulations. Additionally, multitaper MIF and coherence are computed between macaque visual cortical recordings and their correlation with task performance is analyzed. Our multitaper MIF estimator produces low variance and performs better than all other estimators in simulated correlation analyses. Simulations further suggest that multitaper MIF captures more information than coherence. For the macaque data set, coherence and our new MIF estimator largely agree. Overall, we provide a new way to precisely estimate frequency coupling that sheds light on task performance and helps neuroscientists accurately capture correlations between coupling and task phenomena in general. Additionally, we make an MIF toolbox available for the first time.

An Open Resource for Non-human Primate Optogenetics.

Optogenetics has revolutionized neuroscience in small laboratory animals, but its effect on animal models more closely related to humans, such as non-human primates (NHPs), has been mixed. To make evidence-based decisions in primate optogenetics, the scientific community would benefit from a centralized database listing all attempts, successful and unsuccessful, of using optogenetics in the primate brain. We contacted members of the community to ask for their contributions to an open science initiative. As of this writing, 45 laboratories around the world contributed more than 1,000 injection experiments, including precise details regarding their methods and outcomes. Of those entries, more than half had not been published. The resource is free for everyone to consult and contribute to on the Open Science Framework website. Here we review some of the insights from this initial release of the database and discuss methodological considerations to improve the success of optogenetic experiments in NHPs.

Dynamic states of population activity in prefrontal cortical networks of freely-moving macaque.

Neural responses in the cerebral cortex change dramatically between the 'synchronized' state during sleep and 'desynchronized' state during wakefulness. Our understanding of cortical state emerges largely from experiments performed in sensory areas of head-fixed or tethered rodents due to technical limitations of recording from larger freely-moving animals for several hours. Here, we report a system integrating wireless electrophysiology, wireless eye tracking, and real-time video analysis to examine the dynamics of population activity in a high-level, executive area - dorsolateral prefrontal cortex (dlPFC) of unrestrained monkey. This technology allows us to identify cortical substates during quiet and active wakefulness, and transitions in population activity during rest. We further show that narrow-spiking neurons exhibit stronger synchronized fluctuations in population activity than broad-spiking neurons regardless of state. Our results show that cortical state is controlled by behavioral demands and arousal by asymmetrically modulating the slow response fluctuations of local excitatory and inhibitory cell populations.

Reading-out task variables as a low-dimensional reconstruction of neural spike trains in single trials.

We propose a new model of the read-out of spike trains that exploits the multivariate structure of responses of neural ensembles. Assuming the point of view of a read-out neuron that receives synaptic inputs from a population of projecting neurons, synaptic inputs are weighted with a heterogeneous set of weights. We propose that synaptic weights reflect the role of each neuron within the population for the computational task that the network has to solve. In our case, the computational task is discrimination of binary classes of stimuli, and weights are such as to maximize the discrimination capacity of the network. We compute synaptic weights as the feature weights of an optimal linear classifier. Once weights have been learned, they weight spike trains and allow to compute the post-synaptic current that modulates the spiking probability of the read-out unit in real time. We apply the model on parallel spike trains from V1 and V4 areas in the behaving monkey macaca mulatta, while the animal is engaged in a visual discrimination task with binary classes of stimuli. The read-out of spike trains with our model allows to discriminate the two classes of stimuli, while population PSTH entirely fails to do so. Splitting neurons in two subpopulations according to the sign of the weight, we show that population signals of the two functional subnetworks are negatively correlated. Disentangling the superficial, the middle and the deep layer of the cortex, we show that in both V1 and V4, superficial layers are the most important in discriminating binary classes of stimuli.

Synergistic Coding of Visual Information in Columnar Networks.

Incoming stimuli are encoded collectively by populations of cortical neurons, which transmit information by using a neural code thought to be predominantly redundant. Redundant coding is widely believed to reflect a design choice whereby neurons with overlapping receptive fields sample environmental stimuli to convey similar information. Here, we performed multi-electrode laminar recordings in awake monkey V1 to report significant synergistic interactions between nearby neurons within a cortical column. These interactions are clustered non-randomly across cortical layers to form synergy and redundancy hubs. Homogeneous sub-populations comprising synergy hubs decode stimulus information significantly better compared to redundancy hubs or heterogeneous sub-populations. Mechanistically, synergistic interactions emerge from the stimulus dependence of correlated activity between neurons. Our findings suggest a refinement of the prevailing ideas regarding coding schemes in sensory cortex: columnar populations can efficiently encode information due to synergistic interactions even when receptive fields overlap and shared noise between cells is high.

Integration of cortical population signals for visual perception.

Visual stimuli evoke heterogeneous responses across nearby neural populations. These signals must be locally integrated to contribute to perception, but the principles underlying this process are unknown. Here, we exploit the systematic organization of orientation preference in macaque primary visual cortex (V1) and perform causal manipulations to examine the limits of signal integration. Optogenetic stimulation and visual stimuli are used to simultaneously drive two neural populations with overlapping receptive fields. We report that optogenetic stimulation raises firing rates uniformly across conditions, but improves the detection of visual stimuli only when activating cells that are preferentially-tuned to the visual stimulus. Further, we show that changes in correlated variability are exclusively present when the optogenetically and visually-activated populations are functionally-proximal, suggesting that correlation changes represent a hallmark of signal integration. Our results demonstrate that information from functionally-proximal neurons is pooled for perception, but functionally-distal signals remain independent.