Distracter suppression dominates attentional modulation of responses to multiple stimuli inside the receptive fields of middle temporal neurons.

Single-cell studies in macaques have shown that attending to one of two stimuli, positioned inside a visual neuron's receptive field (RF), modulates the neuron's response to reflect the features of the attended stimulus. Such a modulation has been described as a 'push-pull' effect relative to a reference response: a neuron's response increases when attention is directed to a preferred stimulus, and decreases when attention is directed to a non-preferred stimulus. It has been further suggested that the response increase when attending to a preferred stimulus is the predominant effect. Here, we show that the observed attentional modulation depends on the reference response. We recorded neuronal responses in motion processing area middle temporal (MT) of macaques to two moving random dot patterns positioned inside neurons' RF. One pattern always moved in the neuron's antipreferred direction (null pattern), while the other moved in one of 12 directions (tuning pattern). At the beginning of a trial, a cue indicated the location and direction of the target. The animal was required to release a lever when a change in the target direction occurred, and to ignore changes in the distracter. Relative to neurons' initial responses to the dual stimuli (when attention was less likely to modulate responses), attending to the tuning pattern did not significantly modulate responses over time. However, attending to the null pattern progressively decreased responses over time. These results were quantitatively described by filter and input gain models, characterising a predominant response suppression relative to a reference response, rather than response enhancement.

Effects of attention and distractor contrast on the responses of middle temporal area neurons to transient motion direction changes.

The ability of primates to detect transient changes in a visual scene can be influenced by the allocation of attention, as well as by the presence of distractors. We investigated the neural substrates of these effects by recording the responses of neurons in the middle temporal area (MT) of two monkeys while they detected a transient motion direction change in a moving target. We found that positioning a distractor near the target impaired the change-detection performance of the animals. This impairment monotonically decreased as the distractor's contrast decreased. A neural correlate of this effect was a decrease in the ability of MT neurons to signal the direction change (detection sensitivity or DS) when a distractor was near the target, both located inside the neuron's receptive field. Moreover, decreasing distractor contrast increased neuronal DS. On the other hand, directing attention away from the target decreased neuronal DS. At the level of individual neurons, we found a negative correlation between the degree of response normalization and the DS. Finally, the intensity of a neuron's response to the change was predictive of the animal's reaction time, suggesting that the activity of our recorded neurons was linked to the animal's detection performance. Our results suggest that the ability of an MT neuron to signal a transient direction change is regulated by the degree of inhibitory drive into the cell. The presence of distractors, their contrast and the allocation of attention influence such inhibitory drive, therefore modulating the ability of the neurons to signal transient changes in stimulus features and consequently behavioral performance.

Multifocal attention filters targets from distracters within and beyond primate MT neurons' receptive field boundaries.

Visual attention has been classically described as a spotlight that enhances the processing of a behaviorally relevant object. However, in many situations, humans and animals must simultaneously attend to several relevant objects separated by distracters. To account for this ability, various models of attention have been proposed including splitting of the attentional spotlight into multiple foci, zooming of the spotlight over a region of space, and switching of the spotlight among objects. We investigated this controversial issue by recording neuronal activity in visual area MT of two macaques while they attended to two translating objects that circumvented a third distracter object located inside the neurons' receptive field. We found that when the attended objects passed through or nearby the receptive field, neuronal responses to the distracter were either decreased or remained unaltered. These results demonstrate that attention can split into multiple spotlights corresponding to relevant objects while filtering out interspersed distracters.

Expansion of MT neurons excitatory receptive fields during covert attentive tracking.

Primates can attentively track moving objects while keeping gaze stationary. The neural mechanisms underlying this ability are poorly understood. We investigated this issue by recording responses of neurons in area MT of two rhesus monkeys while they performed two different tasks. During the Attend-Fixation task, two moving random dot patterns (RDPs) translated across a screen at the same speed and in the same direction while the animals directed gaze to a fixation spot and detected a change in its luminance. During the Tracking task, the animals kept gaze on the fixation spot and attentively tracked the two RDPs to report a change in the local speed of one of the patterns' dots. In both conditions, neuronal responses progressively increased as the RDPs entered the neurons' receptive field (RF), peaked when they reached its center, and decreased as they translated away. This response profile was well described by a Gaussian function with its center of gravity indicating the RF center and its flanks the RF excitatory borders. During Tracking, responses were increased relative to Attend-Fixation, causing the Gaussian profiles to expand. Such increases were proportionally larger in the RF periphery than at its center, and were accompanied by a decrease in the trial-to-trial response variability (Fano factor) relative to Attend-Fixation. These changes resulted in an increase in the neurons' performance at detecting targets at longer distances from the RF center. Our results show that attentive tracking dynamically changes MT neurons' RF profiles, ultimately improving the neurons' ability to encode the tracked stimulus features.

A metric-based analysis of the contribution of spike timing to contrast and motion direction coding by single neurons in macaque area MT.

Spike timing is thought to contribute to the coding of motion direction information by neurons in macaque area MT. Here, we examined whether spike timing also contributes to the coding of stimulus contrast. We applied a metric-based approach to spike trains fired by MT neurons in response to stimuli that varied in contrast, or direction. We assessed the performance of three metrics, D(spike) and D(product) (containing spike count and timing information), and the spike count metric D(count). We analyzed responses elicited during the first 200 msec of stimulus presentation from 205 neurons. For both contrast and direction, the large majority of neurons showed the highest mutual information using D(spike), followed by D(product), and D(count). This was corroborated by the performance of a theoretical observer model at discriminating contrast and direction using the three metrics. Our results demonstrate that spike timing can contribute to contrast coding in MT neurons, and support previous reports of its potential contribution to direction coding. Furthermore, they suggest that a combination of spike count with periodic and non-periodic spike timing information (contained in D(spike), but not in D(product) and D(count) which are insensitive to spike counts and timing respectively) provides the largest coding advantage in spike trains fired by MT neurons during contrast and direction discrimination.

Neuronal activity in the visual cortex reveals the temporal order of cognitive operations.

Most mental processes consist of a number of processing steps that are executed sequentially. The timing of the individual mental operations can usually only be estimated indirectly, from the pattern of reaction times. In vision, however, many processing steps are associated with the modulation of neuronal activity in early visual areas. Here we exploited this association to elucidate the time course of neuronal activity related to each of the self-paced mental processing steps in complex visual tasks. We trained monkeys to perform two tasks, search-trace and trace-search, which required performing a sequence of two operations: a visual search for a specific color and the mental tracing of a curve. We used multielectrode recording techniques to monitor the representations of multiple visual items in area V1 at the same time and found that the relevant curve as well as the target of visual search evoked enhanced neuronal activity with a timing that depended on the order of operations. This modulation of neuronal activity in early visual areas could allow these areas to (1) act as a cognitive blackboard that permits the exchange of information between successive processing steps of a sequential visual task and to (2) contribute to the orderly progression of task-dependent endogenous attention shifts that are driven by task structure and evolve over hundreds of milliseconds.

Frequency-dependent attentional modulation of local field potential signals in macaque area MT.

Visual attention modulates neuronal responses in primate motion processing area MT. However, whether it modulates the strength local field potentials (LFP-power) within this area remains unexplored, as well as how this modulation relates to the one of the neurons' response. We investigated these issues by simultaneously recording LFPs and neuronal responses evoked by moving random dot patterns of varying direction and contrast in area MT of two male monkeys (Macaca mulatta) during different behavioral conditions. We found that: (1) LFP-power in the gamma (30-120 Hz), but not in the delta (2-4 Hz), (4-8 Hz), alpha (8-12 Hz), beta(1) (12-20 Hz), and beta(2) (20-30 Hz) frequency bands, was tuned for motion direction and contrast, similarly to the neurons' response, (2) shifting attention into a neuron's receptive field (RF) decreased LFP-power in the bands below 30 Hz (except the band), whereas shifting attention to a stimulus motion direction outside the RF had no effect in these bands, (3) LFP-power in the gamma band, however, exhibited both spatial- and motion direction-dependent attentional modulation (increase or decrease), which was highly correlated with the modulation of the neurons' response. These results demonstrate that in area MT, shifting attention into the RFs of neurons in the vicinity of the recording electrode, or to the direction of a moving stimulus located far away from these RFs, distinctively modulates LFP-power in the various frequency bands. They further suggest differences in the neural mechanisms underlying these types of attentional modulation of visual processing.

Attention differentially modulates similar neuronal responses evoked by varying contrast and direction stimuli in area MT.

The effects of attention on the responses of visual neurons have been described as a scaling or additive modulation independent of stimulus features and contrast, or as a contrast-dependent modulation. We explored these alternatives by recording neuronal responses in macaque area MT to moving stimuli that evoked similar firing rates but varied in contrast and direction. We presented two identical pairs of stimuli, one inside the neurons' receptive field and the other outside, in the opposite hemifield. One stimulus of each pair always had high contrast and moved in the recorded cell's antipreferred direction (AP pattern), while the other (test pattern) could either move in the cell's preferred direction and vary in contrast, or have the same contrast as the AP pattern and vary in direction. For different stimulus pairs evoking similar responses, switching attention between the two AP patterns, or directing attention from a fixation spot to the AP pattern inside or outside the receptive field, produced a stronger suppression of responses to varying contrast pairs, reaching a maximum ( approximately 20%) at intermediate contrast. For invariable contrast pairs, switching attention from the fixation spot to the AP pattern produced a modulation that ranged from 10% suppression when the test pattern moved in the cells preferred direction to 14% enhancement when it moved in a direction 90 degrees away from that direction. Our results are incompatible with a scaling or additive modulation of MT neurons' response by attention, but support models where spatial and feature-based attention modulate input signals into the area normalization circuit.

Different processing phases for features, figures, and selective attention in the primary visual cortex.

Our visual system imposes structure onto images that usually contain a diversity of surfaces, contours, and colors. Psychological theories propose that there are multiple steps in this process that occur in hierarchically organized regions of the cortex: early visual areas register basic features, higher areas bind them into objects, and yet higher areas select the objects that are relevant for behavior. Here we test these theories by recording from the primary visual cortex (area V1) of monkeys. We demonstrate that the V1 neurons first register the features (at a latency of 48 ms), then segregate figures from the background (after 57 ms), and finally select relevant figures over irrelevant ones (after 137 ms). We conclude that the psychological processing stages map onto distinct time episodes that unfold in the visual cortex after the presentation of a new stimulus, so that area V1 may contribute to all these processing steps.

Attention lights up new object representations before the old ones fade away.

We investigated how attention shifts from one object to another by recording neuronal activity in the primary visual cortex. Monkeys performed a contour-grouping task in which they had to select a target curve and ignore a distractor curve. Some trials required a shift of attention, because the target and distractor curves were switched during the course of the trial. We monitored the dynamics of this attention shift in area V1, in which neuronal responses evoked by the target curve are stronger than those evoked by the distractor. The reallocation of attention was associated with a rapid and strong enhancement of responses to the newly attended curve, followed, after approximately 60 ms, by a weaker suppression of responses to the curve from which attention was removed. We conclude that attention can be rapidly allocated to a new object before it disengages from the previously attended one.

Visual information transfer across eye movements in the monkey.

During normal viewing, the eyes move from one location to another in order to sample the visual environment. Information acquired before the eye movement facilitates post-saccadic processing. This "preview effect" indicates that some information is maintained in transsaccadic memory and combined with information acquired at the next fixation. However, the nature of transsaccadic memory remains a subject of debate. Here, we investigate preview effects in monkeys that carry out a contour-grouping (curve-tracing) task, by manipulating the consistency between pre- and post-saccadic information. The results show that consistent information causes a preview benefit, whereas inconsistent information causes a preview cost. These preview effects are relatively independent of the pre-saccadic viewing duration, and they occur even when the stimulus is exposed for only approximately 10 ms. The results further demonstrate that an entire relevant curve is stored in transsaccadic memory, instead of just the items at the saccade goal. They suggest that preview effects are caused by a mechanism that stores attended sensory information to make it available at the next fixation. The results are discussed within a theoretical framework that establishes an intimate relationship between attention, short-term memory and transsaccadic memory.

Correlates of transsaccadic integration in the primary visual cortex of the monkey.

We make several eye movements per second when we explore a visual scene. Each eye movement sweeps the scene's projection across the retina and changes its representation in retinotopic areas of the visual cortex, but we nevertheless perceive a stable world. Here we investigate the neuronal correlates of visual stability in the primary visual cortex. Monkeys were trained to make two saccades along a single curve and to ignore another, distracting curve. Attention enhanced neuronal responses to the entire relevant curve before the first saccade. This response enhancement was rapidly reestablished after the saccade, although the image was shifted across the primary visual cortex. We argue that this fast postsaccadic restoration of the attentional response enhancement contributes to the stability of vision across eye movements, and reduces the impact of saccades on visual cognition.

Subtask sequencing in the primary visual cortex.

Complex visual tasks can usually be decomposed into a number of simpler subtasks. Whether such subtasks are solved serially or in parallel is subject to considerable debate. Here we investigate how subtasks are coordinated in time by recording from the primary visual cortex of macaque monkeys. The animals were trained to perform both a simple and a composite task. In the simple task, they had to mentally trace a target curve while ignoring a distractor curve. Neuronal responses in the primary visual cortex to the target curve were enhanced relative to responses to the distractor curve 130 ms after stimulus appearance. In the composite task, the monkeys searched for a colored marker and traced a curve that was attached to this marker. In an initial phase of the trials, neuronal responses reflected visual search, and the response enhancement due to curve tracing now occurred after 230 ms, 100 ms later than in the simple task. We conclude that subtasks of the composite task are carried out in a structured and sequential manner that can be monitored in the primary visual cortex.