Dynamic fading memory and expectancy effects in the monkey primary visual cortex.

In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.

Joint encoding of stimulus and decision in monkey primary visual cortex.

We investigated whether neurons in monkey primary visual cortex (V1) exhibit mixed selectivity for sensory input and behavioral choice. Parallel multisite spiking activity was recorded from area V1 of awake monkeys performing a delayed match-to-sample task. The monkeys had to make a forced choice decision of whether the test stimulus matched the preceding sample stimulus. The population responses evoked by the test stimulus contained information about both the identity of the stimulus and with some delay but before the onset of the motor response the forthcoming choice. The results of subspace identification analysis indicate that stimulus-specific and decision-related information coexists in separate subspaces of the high-dimensional population activity, and latency considerations suggest that the decision-related information is conveyed by top-down projections.

Stimulus complexity shapes response correlations in primary visual cortex.

Spike count correlations (SCCs) are ubiquitous in sensory cortices, are characterized by rich structure, and arise from structured internal dynamics. However, most theories of visual perception treat contributions of neurons to the representation of stimuli independently and focus on mean responses. Here, we argue that, in a functional model of visual perception, featuring probabilistic inference over a hierarchy of features, inferences about high-level features modulate inferences about low-level features ultimately introducing structured internal dynamics and patterns in SCCs. Specifically, high-level inferences for complex stimuli establish the local context in which neurons in the primary visual cortex (V1) interpret stimuli. Since the local context differentially affects multiple neurons, this conjecture predicts specific modulations in the fine structure of SCCs as stimulus identity and, more importantly, stimulus complexity varies. We designed experiments with natural and synthetic stimuli to measure the fine structure of SCCs in V1 of awake behaving macaques and assessed their dependence on stimulus identity and stimulus statistics. We show that the fine structure of SCCs is specific to the identity of natural stimuli and changes in SCCs are independent of changes in response mean. Critically, we demonstrate that stimulus specificity of SCCs in V1 can be directly manipulated by altering the amount of high-order structure in synthetic stimuli. Finally, we show that simple phenomenological models of V1 activity cannot account for the observed SCC patterns and conclude that the stimulus dependence of SCCs is a natural consequence of structured internal dynamics in a hierarchical probabilistic model of natural images.

Paying attention to natural scenes in area V1.

Natural scene responses in the primary visual cortex are modulated simultaneously by attention and by contextual signals about scene statistics stored across the connectivity of the visual processing hierarchy. We hypothesized that attentional and contextual signals interact in V1 in a manner that primarily benefits the representation of natural stimuli, rich in high-order statistical structure. Recording from two macaques engaged in a spatial attention task, we found that attention enhanced the decodability of stimulus identity from population responses evoked by natural scenes, but not by synthetic stimuli lacking higher-order statistical regularities. Population analysis revealed that neuronal responses converged to a low-dimensional subspace only for natural stimuli. Critically, we determined that the attentional enhancement in stimulus decodability was captured by the natural-scene subspace, indicating an alignment between the attentional and natural stimulus variance. These results suggest that attentional and contextual signals interact in V1 in a manner optimized for natural vision.

Robust encoding of natural stimuli by neuronal response sequences in monkey visual cortex.

Parallel multisite recordings in the visual cortex of trained monkeys revealed that the responses of spatially distributed neurons to natural scenes are ordered in sequences. The rank order of these sequences is stimulus-specific and maintained even if the absolute timing of the responses is modified by manipulating stimulus parameters. The stimulus specificity of these sequences was highest when they were evoked by natural stimuli and deteriorated for stimulus versions in which certain statistical regularities were removed. This suggests that the response sequences result from a matching operation between sensory evidence and priors stored in the cortical network. Decoders trained on sequence order performed as well as decoders trained on rate vectors but the former could decode stimulus identity from considerably shorter response intervals than the latter. A simulated recurrent network reproduced similarly structured stimulus-specific response sequences, particularly once it was familiarized with the stimuli through non-supervised Hebbian learning. We propose that recurrent processing transforms signals from stationary visual scenes into sequential responses whose rank order is the result of a Bayesian matching operation. If this temporal code were used by the visual system it would allow for ultrafast processing of visual scenes.

Predictive coding of natural images by V1 firing rates and rhythmic synchronization.

Predictive coding is an important candidate theory of self-supervised learning in the brain. Its central idea is that sensory responses result from comparisons between bottom-up inputs and contextual predictions, a process in which rates and synchronization may play distinct roles. We recorded from awake macaque V1 and developed a technique to quantify stimulus predictability for natural images based on self-supervised, generative neural networks. We find that neuronal firing rates were mainly modulated by the contextual predictability of higher-order image features, which correlated strongly with human perceptual similarity judgments. By contrast, V1 gamma (γ)-synchronization increased monotonically with the contextual predictability of low-level image features and emerged exclusively for larger stimuli. Consequently, γ-synchronization was induced by natural images that are highly compressible and low-dimensional. Natural stimuli with low predictability induced prominent, late-onset beta (ß)-synchronization, likely reflecting cortical feedback. Our findings reveal distinct roles of synchronization and firing rates in the predictive coding of natural images.

Spontaneous variability in gamma dynamics described by a damped harmonic oscillator driven by noise.

Circuits of excitatory and inhibitory neurons generate gamma-rhythmic activity (30-80 Hz). Gamma-cycles show spontaneous variability in amplitude and duration. To investigate the mechanisms underlying this variability, we recorded local-field-potentials (LFPs) and spikes from awake macaque V1. We developed a noise-robust method to detect gamma-cycle amplitudes and durations, which showed a weak but positive correlation. This correlation, and the joint amplitude-duration distribution, is well reproduced by a noise-driven damped harmonic oscillator. This model accurately fits LFP power-spectra, is equivalent to a linear, noise-driven E-I circuit, and recapitulates two additional features of gamma: (1) Amplitude-duration correlations decrease with oscillation strength; (2) amplitudes and durations exhibit strong and weak autocorrelations, respectively, depending on oscillation strength. Finally, longer gamma-cycles are associated with stronger spike-synchrony, but lower spike-rates in both (putative) excitatory and inhibitory neurons. In sum, V1 gamma-dynamics are well described by the simplest possible model of gamma: A damped harmonic oscillator driven by noise.

Stimulus-specific plasticity of macaque V1 spike rates and gamma.

When a visual stimulus is repeated, average neuronal responses typically decrease, yet they might maintain or even increase their impact through increased synchronization. Previous work has found that many repetitions of a grating lead to increasing gamma-band synchronization. Here, we show in awake macaque area V1 that both repetition-related reductions in firing rate and increases in gamma are specific to the repeated stimulus. These effects show some persistence on the timescale of minutes. Gamma increases are specific to the presented stimulus location. Further, repetition effects on gamma and on firing rates generalize to images of natural objects. These findings support the notion that gamma-band synchronization subserves the adaptive processing of repeated stimulus encounters.

A Distinct Class of Bursting Neurons with Strong Gamma Synchronization and Stimulus Selectivity in Monkey V1.

Cortical computation depends on interactions between excitatory and inhibitory neurons. The contributions of distinct neuron types to sensory processing and network synchronization in primate visual cortex remain largely undetermined. We show that in awake monkey V1, there exists a distinct cell type (>>30% of neurons) that has narrow-waveform (NW) action potentials and high spontaneous discharge rates and fires in high-frequency bursts. These neurons are more stimulus selective and phase locked to 30- to 80-Hz gamma oscillations than other neuron types. Unlike other neuron types, their gamma-phase locking is highly predictive of orientation tuning. We find evidence for strong rhythmic inhibition in these neurons, suggesting that they interact with interneurons to act as excitatory pacemakers for the V1 gamma rhythm. We did not find a similar class of NW bursting neurons in L2-L4 of mouse V1. Given its properties, this class of NW bursting neurons should be pivotal for the encoding and transmission of stimulus information.

High-density electrophysiological recordings in macaque using a chronically implanted 128-channel passive silicon probe.

OBJECTIVE: The analysis of interactions among local populations of neurons in the cerebral cortex (e.g. within cortical microcolumns) requires high resolution and high channel count recordings from chronically implanted laminar microelectrode arrays. The request for high-density recordings of a large number of recording sites can presently only be accomplished by probes realized using complementary metal-oxide-semiconductor (CMOS) technology. In preparation for their use in non-human primates, we aimed for neural probe validation in a head-fixed approach analyzing the long-term recording capability. APPROACH: We examined chronically implanted silicon-based laminar probes, realized using a CMOS technology in combination with micromachining, to record from the primary visual cortex (V1) of a monkey. We used a passive CMOS probe that had 128 electrodes arranged at a pitch of 22.5 µm in four columns and 32 rows on a slender shank. In order to validate the performance of a dedicated microdrive, the overall dimensions of probe and interface boards were chosen to be compatible with the final active CMOS probe comprising integrated circuitry. MAIN RESULTS: Using the passive probe, we recorded simultaneously local field potentials (LFP) and spiking multiunit activity (MUA) in V1 of an awake behaving macaque monkey. We found that an insertion through the dura and subsequent readjustments of the chronically implanted neural probe was possible and allowed us to record stable LFPs for more than five months. The quality of MUA degraded within the first month but remained sufficiently high to permit mapping of receptive fields during the full recording period. SIGNIFICANCE: We conclude that the passive silicon probe enables semi-chronic recordings of high quality of LFP and MUA for a time span exceeding five months. The new microdrive compatible with a commercial recording chamber successfully demonstrated the readjustment of the probe position while the implemented plug structure effectively reduced brain tissue movement relative to the probe.

Surface color and predictability determine contextual modulation of V1 firing and gamma oscillations.

The integration of direct bottom-up inputs with contextual information is a core feature of neocortical circuits. In area V1, neurons may reduce their firing rates when their receptive field input can be predicted by spatial context. Gamma-synchronized (30-80 Hz) firing may provide a complementary signal to rates, reflecting stronger synchronization between neuronal populations receiving mutually predictable inputs. We show that large uniform surfaces, which have high spatial predictability, strongly suppressed firing yet induced prominent gamma synchronization in macaque V1, particularly when they were colored. Yet, chromatic mismatches between center and surround, breaking predictability, strongly reduced gamma synchronization while increasing firing rates. Differences between responses to different colors, including strong gamma-responses to red, arose from stimulus adaptation to a full-screen background, suggesting prominent differences in adaptation between M- and L-cone signaling pathways. Thus, synchrony signaled whether RF inputs were predicted from spatial context, while firing rates increased when stimuli were unpredicted from context.

In vivo Recording Quality of Mechanically Decoupled Floating Versus Skull-Fixed Silicon-Based Neural Probes.

Throughout the past decade, silicon-based neural probes have become a driving force in neural engineering. Such probes comprise sophisticated, integrated CMOS electronics which provide a large number of recording sites along slender probe shanks. Using such neural probes in a chronic setting often requires them to be mechanically anchored with respect to the skull. However, any relative motion between brain and implant causes recording instabilities and tissue responses such as glial scarring, thereby shielding recordable neurons from the recording sites integrated on the probe and thus decreasing the signal quality. In the current work, we present a comparison of results obtained using mechanically fixed and floating silicon neural probes chronically implanted into the cortex of a non-human primate. We demonstrate that the neural signal quality estimated by the quality of the spiking and local field potential (LFP) recordings over time is initially superior for the floating probe compared to the fixed device. Nonetheless, the skull-fixed probe also allowed long-term recording of multi-unit activity (MUA) and low frequency signals over several months, especially once pulsations of the brain were properly controlled.