Altered task demands lead to a division of labour for sensory and cognitive processing in the middle temporal area.

Neurons in the primate middle temporal (MT) area signal information about visual motion and work together with the lateral prefrontal cortex (LPFC) to support memory-guided comparisons of visual motion direction. These areas are reciprocally connected, and both contain neurons that signal visual motion direction in the strength of their responses. Previously, LPFC was shown to display marked changes in stimulus coding with altered task demands, including changes in selectivity for motion direction, trial-to-trial variability in responses and comparison effects. Since MT and LPFC are directly interconnected, we sought to determine if MT neurons display similar dependence on task demands. We found that active participation in a motion direction comparison task affected both sensory and nonsensory activity in MT neurons. In fact, neurons that became less selective for motion direction during the active task showed increased signalling for cognitive aspects of the task. This heterogeneity in neural modification with heightened task demands suggests a division of labour in MT, whereby sensory and cognitive signals are both heightened in different subpopulations of neurons.

Dynamic attention signalling in V4: Relation to fast-spiking/non-fast-spiking cell class and population coupling.

The computational role of a neuron during attention depends on its firing properties, neurotransmitter expression and functional connectivity. Neurons in the visual cortical area V4 are reliably engaged by selective attention but exhibit diversity in the effect of attention on firing rates and correlated variability. It remains unclear what specific neuronal properties shape these attention effects. In this study, we quantitatively characterised the distribution of attention modulation of firing rates across populations of V4 neurons. Neurons exhibited a continuum of time-varying attention effects. At one end of the continuum, neurons' spontaneous firing rates were slightly depressed with attention (compared to when unattended), whereas their stimulus responses were enhanced with attention. The other end of the continuum showed the converse pattern: attention depressed stimulus responses but increased spontaneous activity. We tested whether the particular pattern of time-varying attention effects that a neuron exhibited was related to the shape of their actions potentials (so-called 'fast-spiking' [FS] neurons have been linked to inhibition) and the strength of their coupling to the overall population. We found an interdependence among neural attention effects, neuron type and population coupling. In particular, we found neurons for which attention enhanced spontaneous activity but suppressed stimulus responses were less likely to be fast-spiking (more likely to be non-fast-spiking) and tended to have stronger population coupling, compared to neurons with other types of attention effects. These results add important information to our understanding of visual attention circuits at the cellular level.

EEG Signals Index a Global Signature of Arousal Embedded in Neuronal Population Recordings.

Electroencephalography (EEG) has long been used to index brain states, from early studies describing activity in the presence and absence of visual stimulation to modern work employing complex perceptual tasks. These studies have shed light on brain-wide signals but often lack explanatory power at the single neuron level. Similarly, single neuron recordings can suffer from an inability to measure brain-wide signals accessible using EEG. Here, we combined these techniques while monkeys performed a change detection task and discovered a novel link between spontaneous EEG activity and a neural signal embedded in the spiking responses of neuronal populations. This "slow drift" was associated with fluctuations in the subjects' arousal levels over time: decreases in prestimulus α power were accompanied by increases in pupil size and decreases in microsaccade rate. These results show that brain-wide EEG signals can be used to index modes of activity present in single neuron recordings, that in turn reflect global changes in brain state that influence perception and behavior.

The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons.

Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.

A Stable Population Code for Attention in Prefrontal Cortex Leads a Dynamic Attention Code in Visual Cortex.

Attention often requires maintaining a stable mental state over time while simultaneously improving perceptual sensitivity. These requirements place conflicting demands on neural populations, as sensitivity implies a robust response to perturbation by incoming stimuli, which is antithetical to stability. Functional specialization of cortical areas provides one potential mechanism to resolve this conflict. We reasoned that attention signals in executive control areas might be highly stable over time, reflecting maintenance of the cognitive state, thereby freeing up sensory areas to be more sensitive to sensory input (i.e., unstable), which would be reflected by more dynamic attention signals in those areas. To test these predictions, we simultaneously recorded neural populations in prefrontal cortex (PFC) and visual cortical area V4 in rhesus macaque monkeys performing an endogenous spatial selective attention task. Using a decoding approach, we found that the neural code for attention states in PFC was substantially more stable over time compared with the attention code in V4 on a moment-by-moment basis, in line with our guiding thesis. Moreover, attention signals in PFC predicted the future attention state of V4 better than vice versa, consistent with a top-down role for PFC in attention. These results suggest a functional specialization of attention mechanisms across cortical areas with a division of labor. PFC signals the cognitive state and maintains this state stably over time, whereas V4 responds to sensory input in a manner dynamically modulated by that cognitive state.SIGNIFICANCE STATEMENT Attention requires maintaining a stable mental state while simultaneously improving perceptual sensitivity. We hypothesized that these two demands (stability and sensitivity) are distributed between prefrontal and visual cortical areas, respectively. Specifically, we predicted attention signals in visual cortex would be less stable than in prefrontal cortex, and furthermore prefrontal cortical signals would predict attention signals in visual cortex in line with the hypothesized role of prefrontal cortex in top-down executive control. Our results are consistent with suggestions deriving from previous work using separate recordings in the two brain areas in different animals performing different tasks and represent the first direct evidence in support of this hypothesis with simultaneous multiarea recordings within individual animals.

Bridging neuronal correlations and dimensionality reduction.

Two commonly used approaches to study interactions among neurons are spike count correlation, which describes pairs of neurons, and dimensionality reduction, applied to a population of neurons. Although both approaches have been used to study trial-to-trial neuronal variability correlated among neurons, they are often used in isolation and have not been directly related. We first established concrete mathematical and empirical relationships between pairwise correlation and metrics of population-wide covariability based on dimensionality reduction. Applying these insights to macaque V4 population recordings, we found that the previously reported decrease in mean pairwise correlation associated with attention stemmed from three distinct changes in population-wide covariability. Overall, our work builds the intuition and formalism to bridge between pairwise correlation and population-wide covariability and presents a cautionary tale about the inferences one can make about population activity by using a single statistic, whether it be mean pairwise correlation or dimensionality.

Slow Drift of Neural Activity as a Signature of Impulsivity in Macaque Visual and Prefrontal Cortex.

An animal's decision depends not only on incoming sensory evidence but also on its fluctuating internal state. This state embodies multiple cognitive factors, such as arousal and fatigue, but it is unclear how these factors influence the neural processes that encode sensory stimuli and form a decision. We discovered that, unprompted by task conditions, animals slowly shifted their likelihood of detecting stimulus changes over the timescale of tens of minutes. Neural population activity from visual area V4, as well as from prefrontal cortex, slowly drifted together with these behavioral fluctuations. We found that this slow drift, rather than altering the encoding of the sensory stimulus, acted as an impulsivity signal, overriding sensory evidence to dictate the final decision. Overall, this work uncovers an internal state embedded in population activity across multiple brain areas and sheds further light on how internal states contribute to the decision-making process.

Distinct Sources of Variability Affect Eye Movement Preparation.

The sequence of events leading to an eye movement to a target begins the moment visual information has reached the brain, well in advance of the eye movement itself. The process by which visual information is encoded and used to generate a motor plan has been the focus of substantial interest partly because of the rapid and reproducible nature of saccadic eye movements, and the key role that they play in primate behavior. Signals related to eye movements are present in much of the primate brain, yet most neurophysiological studies of the transition from vision to eye movements have measured the activity of one neuron at a time. Less is known about how the coordinated action of populations of neurons contribute to the initiation of eye movements. One cortical area of particular interest in this process is the frontal eye fields, a region of prefrontal cortex that has descending projections to oculomotor control centers. We recorded from populations of frontal eye field neurons in macaque monkeys engaged in a memory-guided saccade task. We found a variety of neurons with visually evoked responses, saccade-aligned responses, and mixtures of both. We took advantage of the simultaneous nature of the recordings to measure variability in individual neurons and pairs of neurons from trial-to-trial, as well as the moment-to-moment population activity structure. We found that these measures were related to saccadic reaction times, suggesting that the population-level organization of frontal eye field activity is important for the transition from perception to movement.SIGNIFICANCE STATEMENT The transition from perception to action involves coordination among neurons across the brain. In the case of eye movements, visual and motor signals coexist in individual neurons as well as in neighboring neurons. We used a task designed to compartmentalize the visual and motor aspects of this transition and studied populations of neurons in the frontal eye fields, a key cortical area containing neurons that are implicated in the transition from vision to eye movements. We found that the time required for subjects to produce an eye movement could be predicted from the statistics of the neuronal response of populations of frontal eye field neurons, suggesting that these neurons coordinate their activity to optimize the transition from perception to action.

Distinct population codes for attention in the absence and presence of visual stimulation.

Visual neurons respond more vigorously to an attended stimulus than an unattended one. How the brain prepares for response gain in anticipation of that stimulus is not well understood. One prominent proposal is that anticipation is characterized by gain-like modulations of spontaneous activity similar to gains in stimulus responses. Here we test an alternative idea: anticipation is characterized by a mixture of both increases and decreases of spontaneous firing rates. Such a strategy would be adaptive as it supports a simple linear scheme for disentangling internal, modulatory signals from external, sensory inputs. We recorded populations of V4 neurons in monkeys performing an attention task, and found that attention states are signaled by different mixtures of neurons across the population in the presence or absence of a stimulus. Our findings support a move from a stimulation-invariant account of anticipation towards a richer view of attentional modulation in a diverse neuronal population.

What does scalp electroencephalogram coherence tell us about long-range cortical networks?

Long-range interactions between cortical areas are undoubtedly a key to the computational power of the brain. For healthy human subjects, the premier method for measuring brain activity on fast timescales is electroencephalography (EEG), and coherence between EEG signals is often used to assay functional connectivity between different brain regions. However, the nature of the underlying brain activity that is reflected in EEG coherence is currently the realm of speculation, because seldom have EEG signals been recorded simultaneously with intracranial recordings near cell bodies in multiple brain areas. Here, we take the early steps towards narrowing this gap in our understanding of EEG coherence by measuring local field potentials with microelectrode arrays in two brain areas (extrastriate visual area V4 and dorsolateral prefrontal cortex) simultaneously with EEG at the nearby scalp in rhesus macaque monkeys. Although we found inter-area coherence at both scales of measurement, we did not find that scalp-level coherence was reliably related to coherence between brain areas measured intracranially on a trial-to-trial basis, despite that scalp-level EEG was related to other important features of neural oscillations, such as trial-to-trial variability in overall amplitudes. This suggests that caution must be exercised when interpreting EEG coherence effects, and new theories devised about what aspects of neural activity long-range coherence in the EEG reflects.

Early steps toward understanding neuronal communication.

PURPOSE OF REVIEW: The computational power of the brain arises from the complex interactions between neurons. One straightforward method to quantify the strength of neuronal interactions is by measuring correlation and coherence. Efforts to measure correlation have been advancing rapidly of late, spurred by the development of advanced recording technologies enabling recording from many neurons and brain areas simultaneously. This review highlights recent results that provide clues into the principles of neural coordination, connections to cognitive and neurological phenomena, and key directions for future research. RECENT FINDINGS: The correlation structure of neural activity in the brain has important consequences for the encoding properties of neural populations. Recent studies have shown that this correlation structure is not fixed, but adapts in a variety of contexts in ways that appear beneficial to task performance. By studying these changes in biological neural networks and computational models, researchers have improved our understanding of the principles guiding neural communication. SUMMARY: Correlation and coherence are highly informative metrics for studying coding and communication in the brain. Recent findings have emphasized how the brain modifies correlation structure dynamically in order to improve information-processing in a goal-directed fashion. One key direction for future research concerns how to leverage these dynamic changes for therapeutic purposes.

Population activity structure of excitatory and inhibitory neurons.

Many studies use population analysis approaches, such as dimensionality reduction, to characterize the activity of large groups of neurons. To date, these methods have treated each neuron equally, without taking into account whether neurons are excitatory or inhibitory. We studied population activity structure as a function of neuron type by applying factor analysis to spontaneous activity from spiking networks with balanced excitation and inhibition. Throughout the study, we characterized population activity structure by measuring its dimensionality and the percentage of overall activity variance that is shared among neurons. First, by sampling only excitatory or only inhibitory neurons, we found that the activity structures of these two populations in balanced networks are measurably different. We also found that the population activity structure is dependent on the ratio of excitatory to inhibitory neurons sampled. Finally we classified neurons from extracellular recordings in the primary visual cortex of anesthetized macaques as putative excitatory or inhibitory using waveform classification, and found similarities with the neuron type-specific population activity structure of a balanced network with excitatory clustering. These results imply that knowledge of neuron type is important, and allows for stronger statistical tests, when interpreting population activity structure.

Dynamics of excitatory and inhibitory networks are differentially altered by selective attention.

Inhibition and excitation form two fundamental modes of neuronal interaction, yet we understand relatively little about their distinct roles in service of perceptual and cognitive processes. We developed a multidimensional waveform analysis to identify fast-spiking (putative inhibitory) and regular-spiking (putative excitatory) neurons in vivo and used this method to analyze how attention affects these two cell classes in visual area V4 of the extrastriate cortex of rhesus macaques. We found that putative inhibitory neurons had both greater increases in firing rate and decreases in correlated variability with attention compared with putative excitatory neurons. Moreover, the time course of attention effects for putative inhibitory neurons more closely tracked the temporal statistics of target probability in our task. Finally, the session-to-session variability in a behavioral measure of attention covaried with the magnitude of this effect. Together, these results suggest that selective targeting of inhibitory neurons and networks is a critical mechanism for attentional modulation.

Establishing a Statistical Link between Network Oscillations and Neural Synchrony.

Pairs of active neurons frequently fire action potentials or "spikes" nearly synchronously (i.e., within 5 ms of each other). This spike synchrony may occur by chance, based solely on the neurons' fluctuating firing patterns, or it may occur too frequently to be explicable by chance alone. When spike synchrony above chances levels is present, it may subserve computation for a specific cognitive process, or it could be an irrelevant byproduct of such computation. Either way, spike synchrony is a feature of neural data that should be explained. A point process regression framework has been developed previously for this purpose, using generalized linear models (GLMs). In this framework, the observed number of synchronous spikes is compared to the number predicted by chance under varying assumptions about the factors that affect each of the individual neuron's firing-rate functions. An important possible source of spike synchrony is network-wide oscillations, which may provide an essential mechanism of network information flow. To establish the statistical link between spike synchrony and network-wide oscillations, we have integrated oscillatory field potentials into our point process regression framework. We first extended a previously-published model of spike-field association and showed that we could recover phase relationships between oscillatory field potentials and firing rates. We then used this new framework to demonstrate the statistical relationship between oscillatory field potentials and spike synchrony in: 1) simulated neurons, 2) in vitro recordings of hippocampal CA1 pyramidal cells, and 3) in vivo recordings of neocortical V4 neurons. Our results provide a rigorous method for establishing a statistical link between network oscillations and neural synchrony.

Stimulus-dependent spiking relationships with the EEG.

The development and refinement of noninvasive techniques for imaging neural activity is of paramount importance for human neuroscience. Currently, the most accessible and popular technique is electroencephalography (EEG). However, nearly all of what we know about the neural events that underlie EEG signals is based on inference, because of the dearth of studies that have simultaneously paired EEG recordings with direct recordings of single neurons. From the perspective of electrophysiologists there is growing interest in understanding how spiking activity coordinates with large-scale cortical networks. Evidence from recordings at both scales highlights that sensory neurons operate in very distinct states during spontaneous and visually evoked activity, which appear to form extremes in a continuum of coordination in neural networks. We hypothesized that individual neurons have idiosyncratic relationships to large-scale network activity indexed by EEG signals, owing to the neurons' distinct computational roles within the local circuitry. We tested this by recording neuronal populations in visual area V4 of rhesus macaques while we simultaneously recorded EEG. We found substantial heterogeneity in the timing and strength of spike-EEG relationships and that these relationships became more diverse during visual stimulation compared with the spontaneous state. The visual stimulus apparently shifts V4 neurons from a state in which they are relatively uniformly embedded in large-scale network activity to a state in which their distinct roles within the local population are more prominent, suggesting that the specific way in which individual neurons relate to EEG signals may hold clues regarding their computational roles.

Global network influences on local functional connectivity.

A central neuroscientific pursuit is understanding neuronal interactions that support computations underlying cognition and behavior. Although neurons interact across disparate scales, from cortical columns to whole-brain networks, research has been restricted to one scale at a time. We measured local interactions through multi-neuronal recordings while accessing global networks using scalp electroencephalography (EEG) in rhesus macaques. We measured spike count correlation, an index of functional connectivity with computational relevance, and EEG oscillations, which have been linked to various cognitive functions. We found a non-monotonic relationship between EEG oscillation amplitude and spike count correlation, contrary to the intuitive expectation of a direct relationship. With a widely used network model, we replicated these findings by incorporating a private signal targeting inhibitory neurons, a common mechanism proposed for gain modulation. Finally, we found that spike count correlation explained nonlinearities in the relationship between EEG oscillations and response time in a spatial selective attention task.

Correlations in V1 are reduced by stimulation outside the receptive field.

The trial-to-trial response variability of nearby cortical neurons is correlated. These correlations may strongly influence population coding performance. Numerous studies have shown that correlations can be dynamically modified by attention, adaptation, learning, and potent stimulus drive. However, the mechanisms that influence correlation strength remain poorly understood. Here we test whether correlations are influenced by presenting stimuli outside the classical receptive field (RF) of visual neurons, where they recruit a normalization signal termed surround suppression. We recorded simultaneously the activity of dozens of cells using microelectrode arrays implanted in the superficial layers of V1 in anesthetized, paralyzed macaque monkeys. We presented annular stimuli that encircled--but did not impinge upon--the RFs of the recorded cells. We found that these "extra-classical" stimuli reduced correlations in the absence of stimulation of the RF, closely resembling the decorrelating effects of stimulating the RFs directly. Our results suggest that normalization signals may be an important mechanism for modulating correlations.

Variance in population firing rate as a measure of slow time-scale correlation.

Correlated variability in the spiking responses of pairs of neurons, also known as spike count correlation, is a key indicator of functional connectivity and a critical factor in population coding. Underscoring the importance of correlation as a measure for cognitive neuroscience research is the observation that spike count correlations are not fixed, but are rather modulated by perceptual and cognitive context. Yet while this context fluctuates from moment to moment, correlation must be calculated over multiple trials. This property undermines its utility as a dependent measure for investigations of cognitive processes which fluctuate on a trial-to-trial basis, such as selective attention. A measure of functional connectivity that can be assayed on a moment-to-moment basis is needed to investigate the single-trial dynamics of populations of spiking neurons. Here, we introduce the measure of population variance in normalized firing rate for this goal. We show using mathematical analysis, computer simulations and in vivo data how population variance in normalized firing rate is inversely related to the latent correlation in the population, and how this measure can be used to reliably classify trials from different typical correlation conditions, even when firing rate is held constant. We discuss the potential advantages for using population variance in normalized firing rate as a dependent measure for both basic and applied neuroscience research.

Oscillatory alpha-band suppression mechanisms during the rapid attentional shifts required to perform an anti-saccade task.

Neuroimaging has demonstrated anatomical overlap between covert and overt attention systems, although behavioral and electrophysiological studies have suggested that the two systems do not rely on entirely identical circuits or mechanisms. In a parallel line of research, topographically-specific modulations of alpha-band power (~8-14 Hz) have been consistently correlated with anticipatory states during tasks requiring covert attention shifts. These tasks, however, typically employ cue-target-interval paradigms where attentional processes are examined across relatively protracted periods of time and not at the rapid timescales implicated during overt attention tasks. The anti-saccade task, where one must first covertly attend for a peripheral target, before executing a rapid overt attention shift (i.e. a saccade) to the opposite side of space, is particularly well-suited for examining the rapid dynamics of overt attentional deployments. Here, we asked whether alpha-band oscillatory mechanisms would also be associated with these very rapid overt shifts, potentially representing a common neural mechanism across overt and covert attention systems. High-density electroencephalography in conjunction with infra-red eye-tracking was recorded while participants engaged in both pro- and anti-saccade task blocks. Alpha power, time-locked to saccade onset, showed three distinct phases of significantly lateralized topographic shifts, all occurring within a period of less than 1s, closely reflecting the temporal dynamics of anti-saccade performance. Only two such phases were observed during the pro-saccade task. These data point to substantially more rapid temporal dynamics of alpha-band suppressive mechanisms than previously established, and implicate oscillatory alpha-band activity as a common mechanism across both overt and covert attentional deployments.

Pitting binding against selection--electrophysiological measures of feature-based attention are attenuated by Gestalt object grouping.

Humans have limited cognitive resources to process the nearly limitless information available in the environment. Endogenous, or 'top-down', selective attention to basic visual features such as color or motion is a common strategy for biasing resources in favor of the most relevant information sources in a given context. Opposing this top-down separation of features is a 'bottom-up' tendency to integrate, or bind, the various features that constitute objects. We pitted these two processes against each other in an electrophysiological experiment to test if top-down selective attention can overcome constitutive binding processes. Our results demonstrate that bottom-up binding processes can dominate top-down feature-based attention even when explicitly detrimental to task performance.