Dependence of Contextual Modulation in Macaque V1 on Interlaminar Signal Flow.

In visual cortex, neural correlates of subjective perception can be generated by modulation of activity from beyond the classical receptive field (CRF). In macaque V1, activity generated by nonclassical receptive field (nCRF) stimulation involves different intracortical circuitry than activity generated by CRF stimulation, suggesting that interactions between neurons across V1 layers differ under CRF and nCRF stimulus conditions. We measured border ownership modulation within large populations of V1 neurons. We found that neurons in single columns preferred the same side of objects located outside of the CRF. In addition, we found that interactions between pairs of neurons situated across feedback/horizontal and input layers differed between CRF and nCRF stimulation. Furthermore, the magnitude of border ownership modulation was predicted by greater information flow from feedback/horizontal to input layers. These results demonstrate that the flow of signals between layers covaries with the degree to which neurons integrate information from beyond the CRF.

Dissociable components of attention exhibit distinct neuronal signatures in primate visual cortex.

Attention can be deployed in multiple forms and facilitates behavior by influencing perceptual sensitivity and choice bias. Attention is also associated with a myriad of changes in sensory neural activity. Yet, the relationship between the behavioral components of attention and the accompanying changes in neural activity remains largely unresolved. We examined this relationship by quantifying sensitivity and bias in monkeys performing a task that dissociated eye movement responses from the focus of covert attention. Unexpectedly, bias, not sensitivity, increased at the focus of covert attention, whereas sensitivity increased at the location of planned eye movements. Furthermore, neuronal activity within visual area V4 varied robustly with bias, but not sensitivity, at the focus of covert attention. In contrast, correlated variability between neuronal pairs was lowest at the location of planned eye movements, and varied with sensitivity, but not bias. Thus, dissociable behavioral components of attention exhibit distinct neuronal signatures within the visual cortex.

Common and distinct neural mechanisms of attention.

Despite a constant deluge of sensory stimulation, only a fraction of it is used to guide behavior. This selective processing is generally referred to as attention, and much research has focused on the neural mechanisms controlling it. Recently, research has broadened to include more ways by which different species selectively process sensory information, whether due to the sensory input itself or to different behavioral and brain states. This work has produced a complex and disjointed body of evidence across different species and forms of attention. However, it has also provided opportunities to better understand the breadth of attentional mechanisms. Here, we summarize the evidence that suggests that different forms of selective processing are supported by mechanisms both common and distinct.

Dissociating the Contributions of Frontal Eye Field Activity to Spatial Working Memory and Motor Preparation.

Neurons within dorsolateral prefrontal cortex (PFC) of primates are characterized by robust persistent spiking activity exhibited during the delay period of working memory tasks. This includes the frontal eye field (FEF) where nearly half of the neurons are active when spatial locations are held in working memory. Past evidence has established the FEF's contribution to the planning and triggering of saccadic eye movements as well as to the control of visual spatial attention. However, it remains unclear whether persistent delay activity reflects a similar dual role in movement planning and visuospatial working memory. We trained male monkeys to alternate between different forms of a spatial working memory task which could dissociate remembered stimulus locations from planned eye movements. We tested the effects of inactivation of FEF sites on behavioral performance in the different tasks. Consistent with previous studies, FEF inactivation impaired the execution of memory-guided saccades (MGSs), and impaired performance when remembered locations matched the planned eye movement. In contrast, memory performance was largely unaffected when the remembered location was dissociated from the correct eye movement response. Overall, the inactivation effects demonstrated clear deficits in eye movements, regardless of task type, but little or no evidence of a deficit in spatial working memory. Thus, our results indicate that persistent delay activity in the FEF contributes primarily to the preparation of eye movements and not to spatial working memory.SIGNIFICANCE STATEMENT Many frontal eye field (FEF) neurons exhibit spatially tuned persistent spiking activity during the delay period of working memory tasks. However, the role of the FEF in spatial working memory remains unresolved. We tested the effects of inactivation of FEF sites on behavioral performance in different forms of a spatial working memory task, one of which dissociated the remembered stimulus locations from planned eye movements. We found that FEF inactivation produced clear deficits in eye movements, regardless of task type, but no deficit in spatial working memory when dissociated from those movements.

Dissociating the Contributions of Frontal Eye Field Activity to Spatial Working Memory and Motor Preparation.

Neurons within dorsolateral prefrontal cortex of primates are characterized by robust persistent spiking activity exhibited during the delay period of working memory tasks. This includes the frontal eye field (FEF) where nearly half of the neurons are active when spatial locations are held in working memory. Past evidence has established the FEF's contribution to the planning and triggering of saccadic eye movements as well as to the control of visual spatial attention. However, it remains unclear if persistent delay activity reflects a similar dual role in movement planning and visuospatial working memory. We trained monkeys to alternate between different forms of a spatial working memory task which could dissociate remembered stimulus locations from planned eye movements. We tested the effects of inactivation of FEF sites on behavioral performance in the different tasks. Consistent with previous studies, FEF inactivation impaired the execution of memory-guided saccades, and impaired performance when remembered locations matched the planned eye movement. In contrast, memory performance was largely unaffected when the remembered location was dissociated from the correct eye movement response. Overall, the inactivation effects demonstrated clear deficits on eye movements, regardless of task type, but little or no evidence of a deficit in spatial working memory. Thus, our results indicate that persistent delay activity in the FEF contributes primarily to the preparation of eye movements and not to spatial working memory.

Pupil size predicts the onset of exploration in brain and behavior.

In uncertain environments, intelligent decision-makers exploit actions that have been rewarding in the past, but also explore actions that could be even better. Several neuromodulatory systems are implicated in exploration, based, in part, on work linking exploration to pupil size-a peripheral correlate of neuromodulatory tone and index of arousal. However, pupil size could instead track variables that make exploration more likely, like volatility or reward, without directly predicting either exploration or its neural bases. Here, we simultaneously measured pupil size, exploration, and neural population activity in the prefrontal cortex while two rhesus macaques explored and exploited in a dynamic environment. We found that pupil size under constant luminance specifically predicted the onset of exploration, beyond what could be explained by reward history. Pupil size also predicted disorganized patterns of prefrontal neural activity at both the single neuron and population levels, even within periods of exploitation. Ultimately, our results support a model in which pupil-linked mechanisms promote the onset of exploration via driving the prefrontal cortex through a critical tipping point where prefrontal control dynamics become disorganized and exploratory decisions are possible.

Large-scale high-density brain-wide neural recording in nonhuman primates.

High-density, integrated silicon electrodes have begun to transform systems neuroscience, by enabling large-scale neural population recordings with single cell resolution. Existing technologies, however, have provided limited functionality in nonhuman primate species such as macaques, which offer close models of human cognition and behavior. Here, we report the design, fabrication, and performance of Neuropixels 1.0-NHP, a high channel count linear electrode array designed to enable large-scale simultaneous recording in superficial and deep structures within the macaque or other large animal brain. These devices were fabricated in two versions: 4416 electrodes along a 45 mm shank, and 2496 along a 25 mm shank. For both versions, users can programmatically select 384 channels, enabling simultaneous multi-area recording with a single probe. We demonstrate recording from over 3000 single neurons within a session, and simultaneous recordings from over 1000 neurons using multiple probes. This technology represents a significant increase in recording access and scalability relative to existing technologies, and enables new classes of experiments involving fine-grained electrophysiological characterization of brain areas, functional connectivity between cells, and simultaneous brain-wide recording at scale.

Intrinsic timescales in the visual cortex change with selective attention and reflect spatial connectivity.

Intrinsic timescales characterize dynamics of endogenous fluctuations in neural activity. Variation of intrinsic timescales across the neocortex reflects functional specialization of cortical areas, but less is known about how intrinsic timescales change during cognitive tasks. We measured intrinsic timescales of local spiking activity within columns of area V4 in male monkeys performing spatial attention tasks. The ongoing spiking activity unfolded across at least two distinct timescales, fast and slow. The slow timescale increased when monkeys attended to the receptive fields location and correlated with reaction times. By evaluating predictions of several network models, we found that spatiotemporal correlations in V4 activity were best explained by the model in which multiple timescales arise from recurrent interactions shaped by spatially arranged connectivity, and attentional modulation of timescales results from an increase in the efficacy of recurrent interactions. Our results suggest that multiple timescales may arise from the spatial connectivity in the visual cortex and flexibly change with the cognitive state due to dynamic effective interactions between neurons.

Functional interactions among neurons within single columns of macaque V1.

Recent developments in high-density neurophysiological tools now make it possible to record from hundreds of single neurons within local, highly interconnected neural networks. Among the many advantages of such recordings is that they dramatically increase the quantity of identifiable, functional interactions between neurons thereby providing an unprecedented view of local circuits. Using high-density, Neuropixels recordings from single neocortical columns of primary visual cortex in nonhuman primates, we identified 1000s of functionally interacting neuronal pairs using established crosscorrelation approaches. Our results reveal clear and systematic variations in the synchrony and strength of functional interactions within single cortical columns. Despite neurons residing within the same column, both measures of interactions depended heavily on the vertical distance separating neuronal pairs, as well as on the similarity of stimulus tuning. In addition, we leveraged the statistical power afforded by the large numbers of functionally interacting pairs to categorize interactions between neurons based on their crosscorrelation functions. These analyses identified distinct, putative classes of functional interactions within the full population. These classes of functional interactions were corroborated by their unique distributions across defined laminar compartments and were consistent with known properties of V1 cortical circuitry, such as the lead-lag relationship between simple and complex cells. Our results provide a clear proof-of-principle for the use of high-density neurophysiological recordings to assess circuit-level interactions within local neuronal networks.

Cortical state dynamics and selective attention define the spatial pattern of correlated variability in neocortex.

Correlated activity fluctuations in the neocortex influence sensory responses and behavior. Neural correlations reflect anatomical connectivity but also change dynamically with cognitive states such as attention. Yet, the network mechanisms defining the population structure of correlations remain unknown. We measured correlations within columns in the visual cortex. We show that the magnitude of correlations, their attentional modulation, and dependence on lateral distance are explained by columnar On-Off dynamics, which are synchronous activity fluctuations reflecting cortical state. We developed a network model in which the On-Off dynamics propagate across nearby columns generating spatial correlations with the extent controlled by attentional inputs. This mechanism, unlike previous proposals, predicts spatially non-uniform changes in correlations during attention. We confirm this prediction in our columnar recordings by showing that in superficial layers the largest changes in correlations occur at intermediate lateral distances. Our results reveal how spatially structured patterns of correlated variability emerge through interactions of cortical state dynamics, anatomical connectivity, and attention.

Working memory gates visual input to primate prefrontal neurons.

Visually guided behavior relies on the integration of sensory input and information held in working memory (WM). Yet it remains unclear how this is accomplished at the level of neural circuits. We studied the direct visual cortical inputs to neurons within a visuomotor area of prefrontal cortex in behaving monkeys. We show that the efficacy of visual input to prefrontal cortex is gated by information held in WM. Surprisingly, visual input to prefrontal neurons was found to target those with both visual and motor properties, rather than preferentially targeting other visual neurons. Furthermore, activity evoked from visual cortex was larger in magnitude, more synchronous, and more rapid, when monkeys remembered locations that matched the location of visual input. These results indicate that WM directly influences the circuitry that transforms visual input into visually guided behavior.

Frontotemporal coordination predicts working memory performance and its local neural signatures.

Neurons in some sensory areas reflect the content of working memory (WM) in their spiking activity. However, this spiking activity is seldom related to behavioral performance. We studied the responses of inferotemporal (IT) neurons, which exhibit object-selective activity, along with Frontal Eye Field (FEF) neurons, which exhibit spatially selective activity, during the delay period of an object WM task. Unlike the spiking activity and local field potentials (LFPs) within these areas, which were poor predictors of behavioral performance, the phase-locking of IT spikes and LFPs with the beta band of FEF LFPs robustly predicted successful WM maintenance. In addition, IT neurons exhibited greater object-selective persistent activity when their spikes were locked to the phase of FEF LFPs. These results reveal that the coordination between prefrontal and temporal cortex predicts the successful maintenance of visual information during WM.

Top-down coordination of local cortical state during selective attention.

Spontaneous fluctuations in cortical excitability influence sensory processing and behavior. These fluctuations, long thought to reflect global changes in cortical state, were recently found to be modulated locally within a retinotopic map during spatially selective attention. We report that periods of vigorous (On) and faint (Off) spiking activity, the signature of cortical state fluctuations, are coordinated across brain areas with retinotopic precision. Top-down attention enhanced interareal local state coordination, traversing along the reverse cortical hierarchy. The extent of local state coordination between areas was predictive of behavioral performance. Our results show that cortical state dynamics are shared across brain regions, modulated by cognitive demands and relevant for behavior.

Separable Influences of Reward on Visual Processing and Choice.

Primate vision is characterized by constant, sequential processing and selection of visual targets to fixate. Although expected reward is known to influence both processing and selection of visual targets, similarities and differences between these effects remain unclear mainly because they have been measured in separate tasks. Using a novel paradigm, we simultaneously measured the effects of reward outcomes and expected reward on target selection and sensitivity to visual motion in monkeys. Monkeys freely chose between two visual targets and received a juice reward with varying probability for eye movements made to either of them. Targets were stationary apertures of drifting gratings, causing the end points of eye movements to these targets to be systematically biased in the direction of motion. We used this motion-induced bias as a measure of sensitivity to visual motion on each trial. We then performed different analyses to explore effects of objective and subjective reward values on choice and sensitivity to visual motion to find similarities and differences between reward effects on these two processes. Specifically, we used different reinforcement learning models to fit choice behavior and estimate subjective reward values based on the integration of reward outcomes over multiple trials. Moreover, to compare the effects of subjective reward value on choice and sensitivity to motion directly, we considered correlations between each of these variables and integrated reward outcomes on a wide range of timescales. We found that, in addition to choice, sensitivity to visual motion was also influenced by subjective reward value, although the motion was irrelevant for receiving reward. Unlike choice, however, sensitivity to visual motion was not affected by objective measures of reward value. Moreover, choice was determined by the difference in subjective reward values of the two options, whereas sensitivity to motion was influenced by the sum of values. Finally, models that best predicted visual processing and choice used sets of estimated reward values based on different types of reward integration and timescales. Together, our results demonstrate separable influences of reward on visual processing and choice, and point to the presence of multiple brain circuits for the integration of reward outcomes.

Differences in Noradrenaline Receptor Expression Across Different Neuronal Subtypes in Macaque Frontal Eye Field.

Cognitive functions such as attention and working memory are modulated by noradrenaline receptors in the prefrontal cortex (PFC). The frontal eye field (FEF) has been shown to play an important role in visual spatial attention. However, little is known about the underlying circuitry. The aim of this study was to characterize the expression of noradrenaline receptors on different pyramidal neuron and inhibitory interneuron subtypes in macaque FEF. Using immunofluorescence, we found broad expression of noradrenaline receptors across all layers of the FEF. Differences in the expression of different noradrenaline receptors were observed across different inhibitory interneuron subtypes. No significant differences were observed in the expression of noradrenaline receptors across different pyramidal neuron subtypes. However, we found that putative long-range projecting pyramidal neurons expressed all noradrenaline receptor subtypes at a much higher proportion than any of the other neuronal subtypes. Nearly all long-range projecting pyramidal neurons expressed all types of noradrenaline receptor, suggesting that there is no receptor-specific machinery acting on these long-range projecting pyramidal neurons. This pattern of expression among long-range projecting pyramidal neurons suggests a mechanism by which noradrenergic modulation of FEF activity influences attention and working memory.

Remote, brain region-specific control of choice behavior with ultrasonic waves.

The ability to modulate neural activity in specific brain circuits remotely and systematically could revolutionize studies of brain function and treatments of brain disorders. Sound waves of high frequencies (ultrasound) have shown promise in this respect, combining the ability to modulate neuronal activity with sharp spatial focus. Here, we show that the approach can have potent effects on choice behavior. Brief, low-intensity ultrasound pulses delivered noninvasively into specific brain regions of macaque monkeys influenced their decisions regarding which target to choose. The effects were substantial, leading to around a 2:1 bias in choices compared to the default balanced proportion. The effect presence and polarity was controlled by the specific target region. These results represent a critical step towards the ability to influence choice behavior noninvasively, enabling systematic investigations and treatments of brain circuits underlying disorders of choice.

Frontal eye field neurons selectively signal the reward value of prior actions.

The consequences of individual actions are typically unknown until well after they are executed. This fact necessitates a mechanism that bridges delays between specific actions and reward outcomes. We looked for the presence of such a mechanism in the post-movement activity of neurons in the frontal eye field (FEF), a visuomotor area in prefrontal cortex. Monkeys performed an oculomotor gamble task in which they made eye movements to different locations associated with dynamically varying reward outcomes. Behavioral data showed that monkeys tracked reward history and made choices according to their own risk preferences. Consistent with previous studies, we observed that the activity of FEF neurons is correlated with the expected reward value of different eye movements before a target appears. Moreover, we observed that the activity of FEF neurons continued to signal the direction of eye movements, the expected reward value, and their interaction well after the movements were completed and when targets were no longer within the neuronal response field. In addition, this post-movement information was also observed in local field potentials, particularly in low-frequency bands. These results show that neural signals of prior actions and expected reward value persist across delays between those actions and their experienced outcomes. These memory traces may serve a role in reward-based learning in which subjects need to learn actions predicting delayed reward.

Parietal Cortex Regulates Visual Salience and Salience-Driven Behavior.

Unique stimuli stand out. Despite an abundance of competing sensory stimuli, the detection of the most salient ones occurs without effort, and that detection contributes to the guidance of adaptive behavior. Neurons sensitive to the salience of visual stimuli are widespread throughout the primate visual system and are thought to shape the selection of visual targets. However, a neural source of salience remains elusive. In an attempt to identify a source of visual salience, we reversibly inactivated parietal cortex and simultaneously recorded salience signals in prefrontal cortex. Inactivation of parietal cortex not only caused pronounced and selective reductions of salience signals in prefrontal cortex but also diminished the influence of salience on visually guided behavior. These observations demonstrate a causal role of parietal cortex in regulating salience signals within the brain and in controlling salience-driven behavior.

Dopamine Receptor Expression Among Local and Visual Cortex-Projecting Frontal Eye Field Neurons.

Dopaminergic modulation of prefrontal cortex plays an important role in numerous cognitive processes, including attention. The frontal eye field (FEF) is modulated by dopamine and has an established role in visual attention, yet the underlying circuitry upon which dopamine acts is not known. We compared the expression of D1 and D2 dopamine receptors (D1Rs and D2Rs) across different classes of FEF neurons, including those projecting to dorsal or ventral extrastriate cortex. First, we found that both D1Rs and D2Rs are more prevalent on pyramidal neurons than on several classes of interneurons and are particularly prevalent on putatively long-range projecting pyramidals. Second, higher proportions of pyramidal neurons express D1Rs than D2Rs. Third, overall a higher proportion of inhibitory neurons expresses D2Rs than D1Rs. Fourth, among inhibitory interneurons, a significantly higher proportion of parvalbumin+ neurons expresses D2Rs than D1Rs, and a significantly higher proportion of calbindin+ neurons expresses D1Rs than D2Rs. Finally, compared with D2Rs, virtually all of the neurons with identified projections to both dorsal and ventral extrastriate visual cortex expressed D1Rs. Our results demonstrate that dopamine tends to act directly on the output of the FEF and that dopaminergic modulation of top-down projections to visual cortex is achieved predominately via D1Rs.