Neuronal and behavioral responses to naturalistic texture im-ages in macaque monkeys.

The visual world is richly adorned with texture, which can serve to delineate important elements of natural scenes. In anes-thetized macaque monkeys, selectivity for the statistical features of natural texture is weak in V1, but substantial in V2, sug-gesting that neuronal activity in V2 might directly support texture perception. To test this, we investigated the relation between single cell activity in macaque V1 and V2 and simultaneously measured behavioral judgments of texture. We generated stim-uli along a continuum between naturalistic texture and phase-randomized noise and trained two macaque monkeys to judge whether a sample texture more closely resembled one or the other extreme. Analysis of responses revealed that individual V1 and V2 neurons carried much less information about texture naturalness than behavioral reports. However, the sensitivity of V2 neurons, especially those preferring naturalistic textures, was significantly closer to that of behavior compared with V1. The firing of both V1 and V2 neurons predicted perceptual choices in response to repeated presentations of the same ambiguous stimulus in one monkey, despite low individual neural sensitivity. However, neither population predicted choice in the second monkey. We conclude that neural responses supporting texture perception likely continue to develop downstream of V2. Fur-ther, combined with neural data recorded while the same two monkeys performed an orientation discrimination task, our results demonstrate that choice-correlated neural activity in early sensory cortex is unstable across observers and tasks, untethered from neuronal sensitivity, and thus unlikely to reflect a critical aspect of the formation of perceptual decisions.Significance statement As visual signals propagate along the cortical hierarchy, they encode increasingly complex aspects of the sensory environment and likely have a more direct relationship with perceptual experience. We replicate and extend previous results from anes-thetized monkeys differentiating the selectivity of neurons along the first step in cortical vision from area V1 to V2. However, our results further complicate efforts to establish neural signatures that reveal the relationship between perception and the neu-ronal activity of sensory populations. We find that choice-correlated activity in V1 and V2 is unstable across different observers and tasks, and also untethered from neuronal sensitivity and other features of nonsensory response modulation.

Development of radial frequency pattern perception in macaque monkeys.

Infant primates see poorly, and most perceptual functions mature steadily beyond early infancy. Behavioral studies on human and macaque infants show that global form perception, as measured by the ability to integrate contour information into a coherent percept, improves dramatically throughout the first several years after birth. However, it is unknown when sensitivity to curvature and shape emerges in early life or how it develops. We studied the development of shape sensitivity in 18 macaques, aged 2 months to 10 years. Using radial frequency stimuli, circular targets whose radii are modulated sinusoidally, we tested monkeys' ability to radial frequency stimuli from circles as a function of the depth and frequency of sinusoidal modulation. We implemented a new four-choice oddity task and compared the resulting data with that from a traditional two-alternative forced choice task. We found that radial frequency pattern perception was measurable at the youngest age tested (2 months). Behavioral performance at all radial frequencies improved with age. Performance was better for higher radial frequencies, suggesting the developing visual system prioritizes processing of fine visual details that are ecologically relevant. By using two complementary methods, we were able to capture a comprehensive developmental trajectory for shape perception.

Sensitivity to naturalistic texture relies primarily on high spatial frequencies.

Natural images contain information at multiple spatial scales. Though we understand how early visual mechanisms split multiscale images into distinct spatial frequency channels, we do not know how the outputs of these channels are processed further by mid-level visual mechanisms. We have recently developed a texture discrimination task that uses synthetic, multi-scale, "naturalistic" textures to isolate these mid-level mechanisms. Here, we use three experimental manipulations (image blur, image rescaling, and eccentric viewing) to show that perceptual sensitivity to naturalistic structure is strongly dependent on features at high object spatial frequencies (measured in cycles/image). As a result, sensitivity depends on a texture acuity limit, a property of the visual system that sets the highest retinal spatial frequency (measured in cycles/degree) at which observers can detect naturalistic features. Analysis of the texture images using a model observer analysis shows that naturalistic image features at high object spatial frequencies carry more task-relevant information than those at low object spatial frequencies. That is, the dependence of sensitivity on high object spatial frequencies is a property of the texture images, rather than a property of the visual system. Accordingly, we find human observers' ability to extract naturalistic information (their efficiency) is similar for all object spatial frequencies. We conclude that the mid-level mechanisms that underlie perceptual sensitivity effectively extract information from all image features below the texture acuity limit, regardless of their retinal and object spatial frequency.

Laminar Differences in Responses to Naturalistic Texture in Macaque V1 and V2.

Most single units recorded from macaque secondary visual cortex (V2) respond with higher firing rates to synthetic texture images containing "naturalistic" higher-order statistics than to spectrally matched "noise" images lacking these statistics. In contrast, few single units in V1 show this property. We explored how the strength and dynamics of response vary across the different layers of visual cortex by recording multiunit (defined as high-frequency power in the local field potential) and gamma-band activity evoked by brief presentations of naturalistic and noise images in V1 and V2 of anesthetized macaque monkeys of both sexes. As previously reported, recordings in V2 showed consistently stronger responses to naturalistic texture than to spectrally matched noise. In contrast to single-unit recordings, V1 multiunit activity showed a preference for images with naturalistic statistics, and in gamma-band activity this preference was comparable across V1 and V2. Sensitivity to naturalistic image structure was strongest in the supragranular and infragranular layers of V1, but weak in granular layers, suggesting that it might reflect feedback from V2. Response timing was consistent with this idea. Visual responses appeared first in V1, followed by V2. Sensitivity to naturalistic texture emerged first in V2, followed by the supragranular and infragranular layers of V1, and finally in the granular layers of V1. Our results demonstrate laminar differences in the encoding of higher-order statistics of natural texture, and suggest that this sensitivity first arises in V2 and is fed back to modulate activity in V1.SIGNIFICANCE STATEMENT The circuit mechanisms responsible for visual representations of intermediate complexity are largely unknown. We used a well validated set of synthetic texture stimuli to probe the temporal and laminar profile of sensitivity to the higher-order statistical structure of natural images. We found that this sensitivity emerges first and most strongly in V2 but soon after in V1. However, sensitivity in V1 is higher in the laminae (extragranular) and recording modalities (local field potential) most likely affected by V2 connections, suggesting a feedback origin. Our results show how sensitivity to naturalistic image structure emerges across time and circuitry in the early visual cortex.

Responses of neurons in macaque MT to unikinetic plaids.

Response properties of MT neurons are often studied with "bikinetic" plaid stimuli, which consist of two superimposed sine wave gratings moving in different directions. Oculomotor studies using "unikinetic plaids" in which only one of the two superimposed gratings moves suggest that the eyes first move reflexively in the direction of the moving grating and only later converge on the perceived direction of the moving pattern. MT has been implicated as the source of visual signals that drives these responses. We wanted to know whether stationary gratings, which have little effect on MT cells when presented alone, would influence MT responses when paired with a moving grating. We recorded extracellularly from neurons in area MT and measured responses to stationary and moving gratings, and to their sums: bikinetic and unikinetic plaids. As expected, stationary gratings presented alone had a very modest influence on the activity of MT neurons. Responses to moving gratings and bikinetic plaids were similar to those previously reported and revealed cells selective for the motion of plaid patterns and of their components (pattern and component cells). When these neurons were probed with unikinetic plaids, pattern cells shifted their direction preferences in a way that revealed the influence of the static grating. Component cell preferences shifted little or not at all. These results support the notion that pattern-selective neurons in area MT integrate component motions that differ widely in speed, and that they do so in a way that is consistent with an intersection-of-constraints model.NEW & NOTEWORTHY Human perceptual and eye movement responses to moving gratings are influenced by adding a second, static grating to create a "unikinetic" plaid. Cells in MT do not respond to static gratings, but those gratings still influence the direction selectivity of some MT cells. The cells influenced by static gratings are those tuned for the motion of global patterns, but not those tuned only for the individual components of moving targets.

Altered functional interactions between neurons in primary visual cortex of macaque monkeys with experimental amblyopia.

Amblyopia, a disorder in which vision through one of the eyes is degraded, arises because of defective processing of information by the visual system. Amblyopia often develops in humans after early misalignment of the eyes (strabismus) and can be simulated in macaque monkeys by artificially inducing strabismus. In such amblyopic animals, single-unit responses in primary visual cortex (V1) are appreciably reduced when evoked by the amblyopic eye compared with the other (fellow) eye. However, this degradation in single V1 neuron responsivity is not commensurate with the marked losses in visual sensitivity and resolution measured behaviorally. Here we explored the idea that changes in patterns of coordinated activity across populations of V1 neurons may contribute to degraded visual representations in amblyopia, potentially making it more difficult to read out evoked activity to support perceptual decisions. We studied the visually evoked activity of V1 neuronal populations in three macaques (Macaca nemestrina) with strabismic amblyopia and in one control animal. Activity driven through the amblyopic eye was diminished, and these responses also showed more interneuronal correlation at all stimulus contrasts than responses driven through the fellow eye or responses in the control animal. A decoding analysis showed that responses driven through the amblyopic eye carried less visual information than other responses. Our results suggest that part of the reduced visual capacity of amblyopes may be due to changes in the patterns of functional interaction among neurons in V1.NEW & NOTEWORTHY Previous work on the neurophysiological basis of amblyopia has largely focused on relating behavioral deficits to changes in visual processing by single neurons in visual cortex. In this study, we recorded simultaneously from populations of primary visual cortical (V1) neurons in macaques with amblyopia. We found changes in the strength and pattern of shared response variability between neurons. These changes in neuronal interactions could impair the visual representations of V1 populations driven by the amblyopic eye.

Selectivity and tolerance for visual texture in macaque V2.

As information propagates along the ventral visual hierarchy, neuronal responses become both more specific for particular image features and more tolerant of image transformations that preserve those features. Here, we present evidence that neurons in area V2 are selective for local statistics that occur in natural visual textures, and tolerant of manipulations that preserve these statistics. Texture stimuli were generated by sampling from a statistical model, with parameters chosen to match the parameters of a set of visually distinct natural texture images. Stimuli generated with the same statistics are perceptually similar to each other despite differences, arising from the sampling process, in the precise spatial location of features. We assessed the accuracy with which these textures could be classified based on the responses of V1 and V2 neurons recorded individually in anesthetized macaque monkeys. We also assessed the accuracy with which particular samples could be identified, relative to other statistically matched samples. For populations of up to 100 cells, V1 neurons supported better performance in the sample identification task, whereas V2 neurons exhibited better performance in texture classification. Relative to V1, the responses of V2 show greater selectivity and tolerance for the representation of texture statistics.

Dissociation of Choice Formation and Choice-Correlated Activity in Macaque Visual Cortex.

Responses of individual task-relevant sensory neurons can predict monkeys' trial-by-trial choices in perceptual decision-making tasks. Choice-correlated activity has been interpreted as evidence that the responses of these neurons are causally linked to perceptual judgments. To further test this hypothesis, we studied responses of orientation-selective neurons in V1 and V2 while two macaque monkeys performed a fine orientation discrimination task. Although both animals exhibited a high level of neuronal and behavioral sensitivity, only one exhibited choice-correlated activity. Surprisingly, this correlation was negative: when a neuron fired more vigorously, the animal was less likely to choose the orientation preferred by that neuron. Moreover, choice-correlated activity emerged late in the trial, earlier in V2 than in V1, and was correlated with anticipatory signals. Together, these results suggest that choice-correlated activity in task-relevant sensory neurons can reflect postdecision modulatory signals.SIGNIFICANCE STATEMENT When observers perform a difficult sensory discrimination, repeated presentations of the same stimulus can elicit different perceptual judgments. This behavioral variability often correlates with variability in the activity of sensory neurons driven by the stimulus. Traditionally, this correlation has been interpreted as suggesting a causal link between the activity of sensory neurons and perceptual judgments. More recently, it has been argued that the correlation instead may originate in recurrent input from other brain areas involved in the interpretation of sensory signals. Here, we call both hypotheses into question. We show that choice-related activity in sensory neurons can be highly variable across observers and can reflect modulatory processes that are dissociated from perceptual decision-making.

Asymmetric Dichoptic Masking in Visual Cortex of Amblyopic Macaque Monkeys.

In amblyopia, abnormal visual experience leads to an extreme form of eye dominance, in which vision through the nondominant eye is degraded. A key aspect of this disorder is perceptual suppression: the image seen by the stronger eye often dominates during binocular viewing, blocking the image of the weaker eye from reaching awareness. Interocular suppression is the focus of ongoing work aimed at understanding and treating amblyopia, yet its physiological basis remains unknown. We measured binocular interactions in visual cortex of anesthetized amblyopic monkeys (female Macaca nemestrina), using 96-channel "Utah" arrays to record from populations of neurons in V1 and V2. In an experiment reported recently (Hallum et al., 2017), we found that reduced excitatory input from the amblyopic eye (AE) revealed a form of balanced binocular suppression that is unaltered in amblyopia. Here, we report on the modulation of the gain of excitatory signals from the AE by signals from its dominant fellow eye (FE). Using a dichoptic masking technique, we found that AE responses to grating stimuli were attenuated by the presentation of a noise mask to the FE, as in a normal control animal. Responses to FE stimuli, by contrast, could not be masked from the AE. We conclude that a weakened ability of the amblyopic eye to modulate cortical response gain creates an imbalance of suppression that favors the dominant eye.SIGNIFICANCE STATEMENT In amblyopia, vision in one eye is impaired as a result of abnormal early visual experience. Behavioral observations in humans with amblyopia suggest that much of their visual loss is due to active suppression of their amblyopic eye. Here we describe experiments in which we studied binocular interactions in macaques with experimentally induced amblyopia. In normal monkeys, the gain of neuronal response to stimulation of one eye is modulated by contrast in the other eye, but in monkeys with amblyopia the balance of gain modulation is altered so that the weaker, amblyopic eye has little effect while the stronger fellow eye has a strong effect. This asymmetric suppression may be a key component of the perceptual losses in amblyopia.

Altered Balance of Receptive Field Excitation and Suppression in Visual Cortex of Amblyopic Macaque Monkeys.

In amblyopia, a visual disorder caused by abnormal visual experience during development, the amblyopic eye (AE) loses visual sensitivity whereas the fellow eye (FE) is largely unaffected. Binocular vision in amblyopes is often disrupted by interocular suppression. We used 96-electrode arrays to record neurons and neuronal groups in areas V1 and V2 of six female macaque monkeys (Macaca nemestrina) made amblyopic by artificial strabismus or anisometropia in early life, as well as two visually normal female controls. To measure suppressive binocular interactions directly, we recorded neuronal responses to dichoptic stimulation. We stimulated both eyes simultaneously with large sinusoidal gratings, controlling their contrast independently with raised-cosine modulators of different orientations and spatial frequencies. We modeled each eye's receptive field at each cortical site using a difference of Gaussian envelopes and derived estimates of the strength of central excitation and surround suppression. We used these estimates to calculate ocular dominance separately for excitation and suppression. Excitatory drive from the FE dominated amblyopic visual cortex, especially in more severe amblyopes, but suppression from both the FE and AEs was prevalent in all animals. This imbalance created strong interocular suppression in deep amblyopes: increasing contrast in the AE decreased responses at binocular cortical sites. These response patterns reveal mechanisms that likely contribute to the interocular suppression that disrupts vision in amblyopes.SIGNIFICANCE STATEMENT Amblyopia is a developmental visual disorder that alters both monocular vision and binocular interaction. Using microelectrode arrays, we examined binocular interaction in primary visual cortex and V2 of six amblyopic macaque monkeys (Macaca nemestrina) and two visually normal controls. By stimulating the eyes dichoptically, we showed that, in amblyopic cortex, the binocular combination of signals is altered. The excitatory influence of the two eyes is imbalanced to a degree that can be predicted from the severity of amblyopia, whereas suppression from both eyes is prevalent in all animals. This altered balance of excitation and suppression reflects mechanisms that may contribute to the interocular perceptual suppression that disrupts vision in amblyopes.

Contextual modulation of sensitivity to naturalistic image structure in macaque V2.

The stimulus selectivity of neurons in V1 is well known, as is the finding that their responses can be affected by visual input to areas outside of the classical receptive field. Less well understood are the ways selectivity is modified as signals propagate to visual areas beyond V1, such as V2. We recently proposed a role for V2 neurons in representing the higher order statistical dependencies found in images of naturally occurring visual texture. V2 neurons, but not V1 neurons, respond more vigorously to "naturalistic" images that contain these dependencies than to "noise" images that lack them. In this work, we examine the dependency of these effects on stimulus size. For most V2 neurons, the preference for naturalistic over noise stimuli was modest when presented in small patches and gradually strengthened with increasing size, suggesting that the mechanisms responsible for this enhanced sensitivity operate over regions of the visual field that are larger than the classical receptive field. Indeed, we found that surround suppression was stronger for noise than for naturalistic stimuli and that the preference for large naturalistic stimuli developed over a delayed time course consistent with lateral or feedback connections. These findings are compatible with a spatially broad facilitatory mechanism that is absent in V1 and suggest that a distinct role for the receptive field surround emerges in V2 along with sensitivity for more complex image structure. NEW & NOTEWORTHY The responses of neurons in visual cortex are often affected by visual input delivered to regions of the visual field outside of the conventionally defined receptive field, but the significance of such contextual modulations are not well understood outside of area V1. We studied the importance of regions beyond the receptive field in establishing a novel form of selectivity for the statistical dependencies contained in natural visual textures that first emerges in area V2.

Slow gain fluctuations limit benefits of temporal integration in visual cortex.

Sensory neurons represent stimulus information with sequences of action potentials that differ across repeated measurements. This variability limits the information that can be extracted from momentary observations of a neuron's response. It is often assumed that integrating responses over time mitigates this limitation. However, temporal response correlations can reduce the benefits of temporal integration. We examined responses of individual orientation-selective neurons in the primary visual cortex of two macaque monkeys performing an orientation-discrimination task. The signal-to-noise ratio of temporally integrated responses increased for durations up to a few hundred milliseconds but saturated for longer durations. This was true even when cells exhibited little or no adaptation in their response levels. These observations are well explained by a statistical response model in which spikes arise from a Poisson process whose stimulus-dependent rate is modulated by slow, stimulus-independent fluctuations in gain. The response variability arising from the Poisson process is reduced by temporal integration, but the slow modulatory nature of variability due to gain fluctuations is not. Slow gain fluctuations therefore impose a fundamental limit on the benefits of temporal integration.

A Convolutional Subunit Model for Neuronal Responses in Macaque V1.

The response properties of neurons in the early stages of the visual system can be described using the rectified responses of a set of self-similar, spatially shifted linear filters. In macaque primary visual cortex (V1), simple cell responses can be captured with a single filter, whereas complex cells combine a set of filters, creating position invariance. These filters cannot be estimated using standard methods, such as spike-triggered averaging. Subspace methods like spike-triggered covariance can recover multiple filters but require substantial amounts of data, and recover an orthogonal basis for the subspace in which the filters reside, rather than the filters themselves. Here, we assume a linear-nonlinear-linear-nonlinear (LN-LN) cascade model in which the first LN stage consists of shifted ("convolutional") copies of a single filter, followed by a common instantaneous nonlinearity. We refer to these initial LN elements as the "subunits" of the receptive field, and we allow two independent sets of subunits, each with its own filter and nonlinearity. The second linear stage computes a weighted sum of the subunit responses and passes the result through a final instantaneous nonlinearity. We develop a procedure to directly fit this model to electrophysiological data. When fit to data from macaque V1, the subunit model significantly outperforms three alternatives in terms of cross-validated accuracy and efficiency, and provides a robust, biologically plausible account of receptive field structure for all cell types encountered in V1. SIGNIFICANCE STATEMENT: We present a new subunit model for neurons in primary visual cortex that significantly outperforms three alternative models in terms of cross-validated accuracy and efficiency, and provides a robust and biologically plausible account of the receptive field structure in these neurons across the full spectrum of response properties.

Properties of pattern and component direction-selective cells in area MT of the macaque.

Neurons in area MT/V5 of the macaque visual cortex encode visual motion. Some cells are selective for the motion of oriented features (component direction-selective, CDS); others respond to the true direction of complex patterns (pattern-direction selective, PDS). There is a continuum of selectivity in MT, with CDS cells at one extreme and PDS cells at the other; we compute a pattern index that captures this variation. It is unknown how a neuron's pattern index is related to its other tuning characteristics. We therefore analyzed the responses of 792 MT cells recorded in the course of other experiments from opiate-anesthetized macaque monkeys, as a function of the direction, spatial frequency, drift rate, size, and contrast of sinusoidal gratings and of the direction and speed of random-dot textures. We also compared MT responses to those of 718 V1 cells. As expected, MT cells with higher pattern index tended to have stronger direction selectivity and broader direction tuning to gratings, and they responded better to plaids than to gratings. Strongly PDS cells also tended to have smaller receptive fields and stronger surround suppression. Interestingly, they also responded preferentially to higher drift rates and higher speeds of moving dots. The spatial frequency preferences of PDS cells depended strongly on their preferred temporal frequencies, whereas these preferences were independent in component-selective cells. Pattern direction selectivity is statistically associated with many response properties of MT cells but not strongly associated with any particular property. Pattern-selective signals are thus available in association with most other signals exported by MT.

Saccadic latency in amblyopia.

We measured saccadic latencies in a large sample (total n = 459) of individuals with amblyopia or risk factors for amblyopia, e.g., strabismus or anisometropia, and normal control subjects. We presented an easily visible target randomly to the left or right, 3.5° from fixation. The interocular difference in saccadic latency is highly correlated with the interocular difference in LogMAR (Snellen) acuity-as the acuity difference increases, so does the latency difference. Strabismic and strabismic-anisometropic amblyopes have, on average, a larger difference between their eyes in LogMAR acuity than anisometropic amblyopes and thus their interocular latency difference is, on average, significantly larger than anisometropic amblyopes. Despite its relation to LogMAR acuity, the longer latency in strabismic amblyopes cannot be attributed either to poor resolution or to reduced contrast sensitivity, because their interocular differences in grating acuity and in contrast sensitivity are roughly the same as for anisometropic amblyopes. The correlation between LogMAR acuity and saccadic latency arises because of the confluence of two separable effects in the strabismic amblyopic eye-poor letter recognition impairs LogMAR acuity while an intrinsic sluggishness delays reaction time. We speculate that the frequent microsaccades and the accompanying attentional shifts, made while strabismic amblyopes struggle to maintain fixation with their amblyopic eyes, result in all types of reactions being irreducibly delayed.

Temporal and spatial limits of pattern motion sensitivity in macaque MT neurons.

Many neurons in visual cortical area MT signal the direction of motion of complex visual patterns, such as plaids composed of two superimposed drifting gratings. To compute the direction of pattern motion, MT neurons combine component motion signals over time and space. To determine the spatial and temporal limits of signal integration, we measured the responses of single MT neurons to a novel set of "pseudoplaid" stimuli in which the component gratings were alternated in time or space. As the temporal or spatial separation of the component gratings increased, neuronal selectivity for the direction of pattern motion decreased. Using descriptive models of signal integration, we inferred the temporal and spatial structure of the mechanisms that compute pattern direction selectivity. The median time constant for integration was roughly 10 ms, a timescale characteristic of integration by single cortical pyramidal neurons. The median spatial integration field was roughly one-third of the MT receptive field diameter, suggesting that the spatial limits are set by stages of processing in earlier areas of visual cortex where receptive fields are smaller than in MT. Interestingly, pattern direction-selective neurons had shorter temporal integration times than component direction-selective neurons but similar spatial integration windows. We conclude that pattern motion can only be signaled by MT neurons when the component motion signals co-occur within relatively narrow spatial and temporal limits. We interpret these results in the framework of recent hierarchical models of MT.

Visual response properties of V1 neurons projecting to V2 in macaque.

Visual area V2 of the primate cortex receives the largest projection from area V1. V2 is thought to use its striate inputs as the basis for computations that are important for visual form processing, such as signaling angles, object borders, illusory contours, and relative binocular disparity. However, it remains unclear how selectivity for these stimulus properties emerges in V2, in part because the functional properties of the inputs are unknown. We used antidromic electrical stimulation to identify V1 neurons that project directly to V2 (10% of all V1 neurons recorded) and characterized their electrical and visual responses. V2-projecting neurons were concentrated in the superficial and middle layers of striate cortex, consistent with the known anatomy of this cortico-cortical circuit. Most were fast conducting and temporally precise in their electrical responses, and had broad spike waveforms consistent with pyramidal regular-spiking excitatory neurons. Overall, projection neurons were functionally diverse. Most, however, were tuned for orientation and binocular disparity and were strongly suppressed by large stimuli. Projection neurons included those selective and invariant to spatial phase, with roughly equal proportions. Projection neurons found in superficial layers had longer conduction times, broader spike waveforms, and were more responsive to chromatic stimuli; those found in middle layers were more strongly selective for motion direction and binocular disparity. Collectively, these response properties may be well suited for generating complex feature selectivity in and beyond V2.

Modulation of visual responses by gaze direction in human visual cortex.

To locate visual objects, the brain combines information about retinal location and direction of gaze. Studies in monkeys have demonstrated that eye position modulates the gain of visual signals with "gain fields," so that single neurons represent both retinotopic location and eye position. We wished to know whether eye position and retinotopic stimulus location are both represented in human visual cortex. Using functional magnetic resonance imaging, we measured separately for each of several different gaze positions cortical responses to stimuli that varied periodically in retinal locus. Visually evoked responses were periodic following the periodic retinotopic stimulation. Only the response amplitudes depended on eye position; response phases were indistinguishable across eye positions. We used multivoxel pattern analysis to decode eye position from the spatial pattern of response amplitudes. The decoder reliably discriminated eye position in five of the early visual cortical areas by taking advantage of a spatially heterogeneous eye position-dependent modulation of cortical activity. We conclude that responses in retinotopically organized visual cortical areas are modulated by gain fields qualitatively similar to those previously observed neurophysiologically.

Shared Mechanisms Drive Ocular Following and Motion Perception.

How features of complex visual patterns are combined to drive perception and eye movements is not well understood. Here we simultaneously assessed human observers' perceptual direction estimates and ocular following responses (OFR) evoked by moving plaids made from two summed gratings with varying contrast ratios. When the gratings were of equal contrast, observers' eye movements and perceptual reports followed the motion of the plaid pattern. However, when the contrasts were unequal, eye movements and reports during early phases of the OFR were biased toward the direction of the high-contrast grating component; during later phases, both responses followed the plaid pattern direction. The shift from component- to pattern-driven behavior resembles the shift in tuning seen under similar conditions in neuronal responses recorded from monkey MT. Moreover, for some conditions, pattern tracking and perceptual reports were correlated on a trial-by-trial basis. The OFR may therefore provide a precise behavioral readout of the dynamics of neural motion integration for complex visual patterns.