Target selection for saccadic eye movements: direction-selective visual responses in the superior colliculus.

We investigated the role of the superior colliculus (SC) in saccade target selection in rhesus monkeys who were trained to perform a direction-discrimination task. In this task, the monkey discriminated between opposed directions of visual motion and indicated its judgment by making a saccadic eye movement to one of two visual targets that were spatially aligned with the two possible directions of motion in the display. Thus the neural circuits that implement target selection in this task are likely to receive directionally selective visual inputs and be closely linked to the saccadic system. We therefore studied prelude neurons in the intermediate and deep layers of the SC that can discharge up to several seconds before an impending saccade, indicating a relatively high-level role in saccade planning. We used the direction-discrimination task to identify neurons whose prelude activity "predicted" the impending perceptual report several seconds before the animal actually executed the operant eye movement; these "choice predicting" cells comprised approximately 30% of the neurons we encountered in the intermediate and deep layers of the SC. Surprisingly, about half of these prelude cells yielded direction-selective responses to our motion stimulus during a passive fixation task. In general, these neurons responded to motion stimuli in many locations around the visual field including the center of gaze where the visual discriminanda were positioned during the direction-discrimination task. Preferred directions generally pointed toward the location of the movement field of the SC neuron in accordance with the sensorimotor demands of the discrimination task. Control experiments indicate that the directional responses do not simply reflect covertly planned saccades. Our results indicate that a small population of SC prelude neurons exhibits properties appropriate for linking stimulus cues to saccade target selection in the context of a visual discrimination task.

Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task.

We investigated the role of the superior colliculus (SC) in saccade target selection while macaque monkeys performed a direction-discrimination task. The monkeys selected one of two possible saccade targets based on the direction of motion in a stochastic random-dot display; the difficulty of the task was varied by adjusting the strength of the motion signal in the display. One of the two saccade targets was positioned within the movement field of the SC neuron under study while the other target was positioned well outside the movement field. Approximately 30% of the neurons in the intermediate and deep layers of the SC discharged target-specific preludes of activity that "predicted" target choices well before execution of the saccadic eye movement. Across the population of neurons, the strength of the motion signal in the display influenced the intensity of this "predictive" prelude activity: SC activity signaled the impending saccade more reliably when the motion signal was strong than when it was weak. The dependence of neural activity on motion strength could not be explained by small variations in the metrics of the saccadic eye movements. Predictive activity was particularly strong in a subpopulation of neurons with directional visual responses that we have described previously. For a subset of SC neurons, therefore, prelude activity reflects the difficulty of the direction discrimination in addition to the target of the impending saccade. These results are consistent with the notion that a restricted network of SC neurons plays a role in the process of saccade target selection.

Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey.

We recorded the activity of single neurons in the posterior parietal cortex (area LIP) of two rhesus monkeys while they discriminated the direction of motion in random-dot visual stimuli. The visual task was similar to a motion discrimination task that has been used in previous investigations of motion-sensitive regions of the extrastriate cortex. The monkeys were trained to decide whether the direction of motion was toward one of two choice targets that appeared on either side of the random-dot stimulus. At the end of the trial, the monkeys reported their direction judgment by making an eye movement to the appropriate target. We studied neurons in LIP that exhibited spatially selective persistent activity during delayed saccadic eye movement tasks. These neurons are thought to carry high-level signals appropriate for identifying salient visual targets and for guiding saccadic eye movements. We arranged the motion discrimination task so that one of the choice targets was in the LIP neuron's response field (RF) while the other target was positioned well away from the RF. During motion viewing, neurons in LIP altered their firing rate in a manner that predicted the saccadic eye movement that the monkey would make at the end of the trial. The activity thus predicted the monkey's judgment of motion direction. This predictive activity began early in the motion-viewing period and became increasingly reliable as the monkey viewed the random-dot motion. The neural activity predicted the monkey's direction judgment on both easy and difficult trials (strong and weak motion), whether or not the judgment was correct. In addition, the timing and magnitude of the response was affected by the strength of the motion signal in the stimulus. When the direction of motion was toward the RF, stronger motion led to larger neural responses earlier in the motion-viewing period. When motion was away from the RF, stronger motion led to greater suppression of ongoing activity. Thus the activity of single neurons in area LIP reflects both the direction of an impending gaze shift and the quality of the sensory information that instructs such a response. The time course of the neural response suggests that LIP accumulates sensory signals relevant to the selection of a target for an eye movement.

Correlated firing in macaque visual area MT: time scales and relationship to behavior.

We studied the simultaneous activity of pairs of neurons recorded with a single electrode in visual cortical area MT while monkeys performed a direction discrimination task. Previously, we reported the strength of interneuronal correlation of spike count on the time scale of the behavioral epoch (2 sec) and noted its potential impact on signal pooling (Zohary et al., 1994). We have now examined correlation at longer and shorter time scales and found that pair-wise cross-correlation was predominantly short term (10-100 msec). Narrow, central peaks in the spike train cross-correlograms were largely responsible for correlated spike counts on the time scale of the behavioral epoch. Longer-term (many seconds to minutes) changes in the responsiveness of single neurons were observed in auto-correlations; however, these slow changes in time were on average uncorrelated between neurons. Knowledge of the limited time scale of correlation allowed the derivation of a more efficient metric for spike count correlation based on spike timing information, and it also revealed a potential relative advantage of larger neuronal pools for shorter integration times. Finally, correlation did not depend on the presence of the visual stimulus or the behavioral choice of the animal. It varied little with stimulus condition but was stronger between neurons with similar direction tuning curves. Taken together, our results strengthen the view that common input, common stimulus selectivity, and common noise are tightly linked in functioning cortical circuits.

Somatosensation: Touching the mind's fingers.

Whether mental operations can be reduced to the biological properties of the brain has intrigued scientists and philosophers alike for millennia. New microstimulation experiments on awake, behaving monkeys establish causality between activity of specialized cortical neurons and a controlled behavior.

Visuo-motor control: giving the brain a hand.

Sensory information is acquired in spatial coordinate systems linked to sense organs, yet movement must be executed in coordinate systems linked to motor effector organs. Neurophysiological experiments are yielding new insights into how the brain transforms coordinate systems to facilitate movement.

The neurobiology of cognition.

Perhaps the deepest mysteries facing the natural sciences concern the higher functions of the central nervous system. Understanding how the brain gives rise to mental experiences looms as one of the central challenges for science in the new millennium.

Motion opponency in visual cortex.

Perceptual studies suggest that visual motion perception is mediated by opponent mechanisms that correspond to mutually suppressive populations of neurons sensitive to motions in opposite directions. We tested for a neuronal correlate of motion opponency using functional magnetic resonance imaging (fMRI) to measure brain activity in human visual cortex. There was strong motion opponency in a secondary visual cortical area known as the human MT complex (MT+), but there was little evidence of motion opponency in primary visual cortex. To determine whether the level of opponency in human and monkey are comparable, a variant of these experiments was performed using multiunit electrophysiological recording in areas MT and MST of the macaque monkey brain. Although there was substantial variability in the degree of opponency between recording sites, the monkey and human data were qualitatively similar on average. These results provide further evidence that: (1) direction-selective signals underly human MT+ responses, (2) neuronal signals in human MT+ support visual motion perception, (3) human MT+ is homologous to macaque monkey MT and adjacent motion sensitive brain areas, and (4) that fMRI measurements are correlated with average spiking activity.

Separate signals for target selection and movement specification in the superior colliculus.

At any given instant, multiple potential targets for saccades are present in the visual world, implying that a "selection process" within the brain determines the target of the next eye movement. Some superior colliculus (SC) neurons begin discharging seconds before saccade initiation, suggesting involvement in target selection or, alternatively, in postselectional saccade preparation. SC neurons were recorded in monkeys who selected saccade targets on the basis of motion direction in a visual display. Some neurons carried a direction-selective visual signal, consistent with a role in target selection in this task, whereas other SC neurons appeared to be more involved in postselection specification of saccade parameters.

Effect of spatial attention on the responses of area MT neurons.

This study examines the influence of spatial attention on the responses of neurons in the middle temporal visual area (MT or V5) of extrastriate cortex. Two monkeys were trained to perform a direction-discrimination task. On each trial, two apertures of random-dot stimuli appeared simultaneously at two spatially separated locations; the monkeys were required to discriminate the direction of stimulus motion at one location while ignoring the stimulus at the other location. After extensive training, we recorded the responses of MT neurons in two configurations: 1) Both apertures placed "within" the neuron's receptive field (RF) and 2) one aperture covering the RF while the other was presented at a "remote" location. For each unit we compared the responses to identical stimulus displays when the monkey was instructed to attend to one or the other aperture. The responses of MT neurons were 8.7% stronger, on average, when the monkey attended to the spatial location that contained motion in the "preferred" direction. Attentional effects were equal, on average, in the within RF and remote configurations. The attentional modulations began approximately 300 ms after stimulus onset, gradually increased throughout the trial, and peaked near stimulus offset. An analysis of the neuronal responses on error trials suggests that the monkeys failed to attend to the appropriate spatial location on these trials. The relatively weak attentional effects that we observed contrast strikingly with recent results of Treue and Maunsell, who demonstrated very strong attentional modulations (median effect >80%) in MT in a task that shares many features with ours. Our results suggest that spatial attention alone is not sufficient to induce strong attentional effects in MT even when two competing motion stimuli appear within the RF of the recorded neuron. The difference between our results and those of Treue and Maunsell suggests that the magnitude of the attentional effects in MT may depend critically on how attention is directed to a particular stimulus and on the precise demands of the task.

Organization of disparity-selective neurons in macaque area MT.

Neurons selective for binocular disparity are found in a number of visual cortical areas in primates, but there is little evidence that any of these areas are specialized for disparity processing. We have examined the organization of disparity-selective neurons in the middle temporal visual area (MT), an area shown previously to contain an abundance of disparity-sensitive neurons. We recorded extracellularly from MT neurons at regularly spaced intervals along electrode penetrations that passed through MT either normal to the cortical surface or at a shallow oblique angle. Comparison of multiunit and single-unit recordings shows that neurons are clustered in MT according to their disparity selectivity. Across the surface of MT, disparity-selective neurons are found in discrete patches that are separated by regions of MT that exhibit poor disparity tuning. Within disparity-selective patches of MT, we typically observe a smooth progression of preferred disparities (e.g. , near to far) as our electrode travels parallel to the cortical surface. In electrode penetrations normal to the cortical surface, on the other hand, MT neurons generally have similar disparity tuning, with little variation from one recording site to the next. Thus disparity-tuned neurons are organized into cortical columns by preferred disparity, and preferred disparity is mapped systematically within larger, disparity-tuned patches of MT. Combined with other recent findings, the data suggest that MT plays an important role in stereoscopic depth perception in addition to its well known role in motion perception.

Color signals in human motion-selective cortex.

The neural basis for the effects of color and contrast on perceived speed was examined using functional magnetic resonance imaging (fMRI). Responses to S cone (blue-yellow) and L + M cone (luminance) patterns were measured in area V1 and in the motion area MT+. The MT+ responses were quantitatively similar to perceptual speed judgments of color patterns but not to color detection measures. We also measured cortical motion responses in individuals lacking L and M cone function (S cone monochromats). The S cone monochromats have clear motion-responsive regions in the conventional MT+ position, and their contrast-response functions there have twice the responsivity of S cone contrast-response functions in normal controls. But, their responsivity is far lower than the normals' responsivity to luminance contrast. Thus, the powerful magnocellular input to MT+ is either weak or silent during photopic vision in S cone monochromats.

Color signals in area MT of the macaque monkey.

The relationship between the neural processing of color and motion information has been a contentious issue in visual neuroscience. We examined this relationship directly by measuring neural responses to isoluminant S cone signals in extrastriate area MT of the macaque monkey. S cone stimuli produced robust, direction-selective responses at most recording sites, indicating that color signals are present in MT. While these responses were unequivocal, S cone contrast sensitivity was, on average, 1.0-1.3 log units lower than luminance contrast sensitivity. The presence of S cone responses and the relative sensitivity of MT neurons to S cone and luminance signals agree with functional magnetic resonance imaging (fMRI) measurements in human MT+. The results are consistent with the hypothesis that color signals in MT influence behavior in speed judgment tasks.

Cortical area MT and the perception of stereoscopic depth.

Stereopsis is the perception of depth based on small positional differences between images formed on the two retinae (known as binocular disparity). Neurons that respond selectively to binocular disparity were first described three decades ago, and have since been observed in many visual areas of the primate brain, including V1, V2, V3, MT and MST. Although disparity-selective neurons are thought to form the neural substrate for stereopsis, the mere existence of disparity-selective neurons does not guarantee that they contribute to stereoscopic depth perception. Some disparity-selective neurons may play other roles, such as guiding vergence eye movements. Thus, the roles of different visual areas in stereopsis remain poorly defined. Here we show that visual area MT is important in stereoscopic vision: electrical stimulation of clusters of disparity-selective MT neurons can bias perceptual judgements of depth, and the bias is predictable from the disparity preference of neurons at the stimulation site. These results show that behaviourally relevant signals concerning stereoscopic depth are present in MT.

Tuning bandwidths for near-threshold stimuli in area MT.

It is not known whether psychophysical performance depends primarily on small numbers of neurons optimally tuned to specific visual stimuli, or on larger populations of neurons that vary widely in their properties. Tuning bandwidths of single cells can provide important insight into this issue, yet most bandwidth measurements have been made using suprathreshold visual stimuli, whereas psychophysical measurements are frequently obtained near threshold. We therefore examined the directional tuning of cells in the middle temporal area (MT, or V5) using perithreshold, stochastic motion stimuli that we have employed extensively in combined psychophysical and physiological studies. The strength of the motion signal (coherence) in these displays can be varied independently of its direction. For each MT neuron, we characterized the directional bandwidth by fitting Gaussian functions to directional tuning data obtained at each of several motion coherences. Directional bandwidth increased modestly as the coherence of the stimulus was reduced. We then assessed the ability of MT neurons to discriminate opposed directions of motion along six equally spaced axes of motion spanning 180 degrees. A signal detection analysis yielded neurometric functions for each axis of motion, from which neural thresholds could be extracted. Neural thresholds remained surprisingly low as the axis of motion diverged from the neuron's preferred-null axis, forming a plateau of high to medium sensitivity that extended approximately 45 degrees on either side of the preferred-null axis. We conclude that directional tuning remains broad in MT when motion signals are reduced to near-threshold values. Thus directional information is widely distributed in MT, even near the limits of psychophysical performance. These observations support models in which relatively large numbers of signals are pooled to inform psychophysical decisions.

Temporal gating of neural signals during performance of a visual discrimination task.

The flow of neural signals within the cerebral cortex must be subject to multiple controls as behaviour unfolds in time. In a visual discrimination task that includes a delay period, the transmission of sensory signals to circuitry that mediates memory, decision-making and motor-planning must be governed closely by 'filtering' or 'gating' mechanisms so that extraneous events occurring before, during or after presentation of the critical visual stimulus have little or no effect on the subject's behavioural responses. Here we study one such mechanism physiologically by applying electrical microstimulation to columns of directionally selective neurons in the middle temporal visual area at varying times during single trials of a direction-discrimination task. The behavioural effects of microstimulation varied strikingly according to the timing of delivery within the trial, indicating that signals produced by microstimulation may be subject to active 'gating'. Our results show several important features of this gating process: first, signal flow is modulated upwards on onset of the visual stimulus and downwards, typically with a slower time course, after stimulus offset; second, gating efficacy can be modified by behavioural training; and third, gating is implemented primarily downstream of the middle temporal visual area.

The variable discharge of cortical neurons: implications for connectivity, computation, and information coding.

Cortical neurons exhibit tremendous variability in the number and temporal distribution of spikes in their discharge patterns. Furthermore, this variability appears to be conserved over large regions of the cerebral cortex, suggesting that it is neither reduced nor expanded from stage to stage within a processing pathway. To investigate the principles underlying such statistical homogeneity, we have analyzed a model of synaptic integration incorporating a highly simplified integrate and fire mechanism with decay. We analyzed a "high-input regime" in which neurons receive hundreds of excitatory synaptic inputs during each interspike interval. To produce a graded response in this regime, the neuron must balance excitation with inhibition. We find that a simple integrate and fire mechanism with balanced excitation and inhibition produces a highly variable interspike interval, consistent with experimental data. Detailed information about the temporal pattern of synaptic inputs cannot be recovered from the pattern of output spikes, and we infer that cortical neurons are unlikely to transmit information in the temporal pattern of spike discharge. Rather, we suggest that quantities are represented as rate codes in ensembles of 50-100 neurons. These column-like ensembles tolerate large fractions of common synaptic input and yet covary only weakly in their spike discharge. We find that an ensemble of 100 neurons provides a reliable estimate of rate in just one interspike interval (10-50 msec). Finally, we derived an expression for the variance of the neural spike count that leads to a stable propagation of signal and noise in networks of neurons-that is, conditions that do not impose an accumulation or diminution of noise. The solution implies that single neurons perform simple algebra resembling averaging, and that more sophisticated computations arise by virtue of the anatomical convergence of novel combinations of inputs to the cortical column from external sources.

Neurophysiology: sensing and categorizing.

Objects differ along many stimulus dimensions, but observers typically group them into fewer 'categories' according to their potential use or behavioral relevance. New experiments in awake, behaving monkeys open a window onto the process of stimulus categorization within the central nervous system.