Multivariate analysis of EEG activity indexes contingent attentional capture.

An extensive body of work has shown that attentional capture is contingent on the goals of the observer: Capture is strongly reduced or even eliminated when an irrelevant singleton stimulus does not match the target-defining properties (Folk et al., 1992). There has been a long-standing debate on whether attentional capture can be explained by goal-driven and/or stimulus-driven accounts. Here, we shed further light on this matter by using EEG activity (raw EEG and alpha power) to provide a time-resolved index of attentional orienting towards salient stimuli that either matched or did not match target-defining properties. A search display containing the target stimulus was preceded by a spatially uninformative singleton cue that either matched the color of the upcoming target (contingent cues), or that appeared in an irrelevant color (non-contingent cues). Multivariate analysis of raw EEG and alpha power revealed preferential tuning to the location of both contingent and non-contingent cues, with a stronger bias towards contingent than non-contingent cues. The time course of these effects, however, depended on the neural signal. Raw EEG data revealed attentional orienting towards the contingent cue early on in the trial (>156 ms), while alpha power revealed sustained spatial selection in the cued locations at a later moment in the trial (>250 ms). Moreover, while raw EEG showed stronger capture by contingent cues during this early time window, an advantage for contingent cues arose during a later time window in alpha band activity. Thus, our findings suggest that raw EEG activity and alpha-band power tap into distinct neural processes that index separate aspects of covert spatial attention.

Shifting attention within memory representations involves early visual areas.

Prior studies have shown that spatial attention modulates early visual cortex retinotopically, resulting in enhanced processing of external perceptual representations. However, it is not clear whether the same visual areas are modulated when attention is focused on, and shifted within a working memory representation. In the current fMRI study participants were asked to memorize an array containing four stimuli. After a delay, participants were presented with a verbal cue instructing them to actively maintain the location of one of the stimuli in working memory. Additionally, on a number of trials a second verbal cue instructed participants to switch attention to the location of another stimulus within the memorized representation. Results of the study showed that changes in the BOLD pattern closely followed the locus of attention within the working memory representation. A decrease in BOLD-activity (V1-V3) was observed at ROIs coding a memory location when participants switched away from this location, whereas an increase was observed when participants switched towards this location. Continuous increased activity was obtained at the memorized location when participants did not switch. This study shows that shifting attention within memory representations activates the earliest parts of visual cortex (including V1) in a retinotopic fashion. We conclude that even in the absence of visual stimulation, early visual areas support shifting of attention within memorized representations, similar to when attention is shifted in the outside world. The relationship between visual working memory and visual mental imagery is discussed in light of the current findings.

Early multisensory interactions affect the competition among multiple visual objects.

In dynamic cluttered environments, audition and vision may benefit from each other in determining what deserves further attention and what does not. We investigated the underlying neural mechanisms responsible for attentional guidance by audiovisual stimuli in such an environment. Event-related potentials (ERPs) were measured during visual search through dynamic displays consisting of line elements that randomly changed orientation. Search accuracy improved when a target orientation change was synchronized with an auditory signal as compared to when the auditory signal was absent or synchronized with a distractor orientation change. The ERP data show that behavioral benefits were related to an early multisensory interaction over left parieto-occipital cortex (50-60 ms post-stimulus onset), which was followed by an early positive modulation (80-100 ms) over occipital and temporal areas contralateral to the audiovisual event, an enhanced N2pc (210-250 ms), and a contralateral negative slow wave (CNSW). The early multisensory interaction was correlated with behavioral search benefits, indicating that participants with a strong multisensory interaction benefited the most from the synchronized auditory signal. We suggest that an auditory signal enhances the neural response to a synchronized visual event, which increases the chances of selection in a multiple object environment.

Abrupt onsets capture attention independent of top-down control settings II: additivity is no evidence for filtering.

Is attentional capture contingent on top-down control settings or involuntarily driven by salient stimuli? Supporting the stimulus-driven attentional capture view, Schreij, Owens, and Theeuwes (2008) found that an onset distractor caused a response delay, in spite of participants' having adopted an attentional set for a color feature. However, Folk, Remington, and Wu (2009) claimed that this delay reflects separate, nonspatial filtering costs instead, because the onset effects were additive with color-based capture effects, and capture should have caused underadditivity. The present Experiment 1 shows that contingent capture caused by additional color cues is also additive, just like the onset effect. This makes additivity a dubious diagnostic with regard to spatial capture. Experiment 2 demonstrates that it is possible to obtain underadditivity when attention-demanding distractors have sufficient capturing power. Experiment 3 shows that the abrupt onset interference turns into a benefit when the locations of the onset and the target coincide. Together, these results argue in favor of stimulus-driven attentional capture by abrupt onsets.

What is top-down about contingent capture?

In the present study, we explored the mechanisms involved in the contingent capture phenomenon, using a variant of the classic precuing paradigm of Folk, Remington, and Johnston (1992). Rather than keeping the target fixed over a whole block of trials (as has traditionally been done with contingent capture experiments), we encouraged participants to adopt a top-down set before each trial. If top-down attentional set determines which property captures attention, as is claimed by the contingent capture hypothesis, one would expect that only properties that match the top-down set would capture attention. We showed that even though participants knew what the target would be on the upcoming trial, both relevant and irrelevant properties captured attention (Experiment 1). An intertrial analysis (Experiments 1 and 2) showed that previous contingent capture findings may, to a large extent, be explained by intertrial priming. In addition, when participants were further forced into adopting the required top-down set (Experiments 3 and 4), irrelevant cues were suppressed, suggesting that top-down control might operate through disengagement of attention from the location of a property that does not match top-down goals. The present findings suggest that top-down control and intertrial priming make their own distinct contributions to the contingent capture phenomenon.

Audiovisual semantic interference and attention: evidence from the attentional blink paradigm.

In the present study we investigate the role of attention in audiovisual semantic interference, by using an attentional blink paradigm. Participants were asked to make an unspeeded response to the identity of a visual target letter. This target letter was preceded at various SOAs by a synchronized audiovisual letter-pair, which was either congruent (e.g. hearing an "F" and viewing an "F") or incongruent (e.g. hearing an "F" and viewing a "Z"). In Experiment 1, participants were asked to match the members of the audiovisual letter-pair. In Experiment 2, participants were asked to ignore the synchronized audiovisual letter-pairs altogether and only report the visual target. In Experiment 3, participants were asked to identify only one of the audiovisual letters (identify the auditory letter, and ignore the synchronized visual letter, or vice versa). An attentional blink was found in all three experiments indicating that the audiovisual letter-pairs were processed. However, a congruency effect on subsequent target detection was observed in Experiments 1 and 3, but not in Experiment 2. The results indicate that attention to the semantic contents of at least one modality is necessary to establish audiovisual semantic interference.

Pip and pop: nonspatial auditory signals improve spatial visual search.

Searching for an object within a cluttered, continuously changing environment can be a very time-consuming process. The authors show that a simple auditory pip drastically decreases search times for a synchronized visual object that is normally very difficult to find. This effect occurs even though the pip contains no information on the location or identity of the visual object. The experiments also show that the effect is not due to general alerting (because it does not occur with visual cues), nor is it due to top-down cuing of the visual change (because it still occurs when the pip is synchronized with distractors on the majority of trials). Instead, we propose that the temporal information of the auditory signal is integrated with the visual signal, generating a relatively salient emergent feature that automatically draws attention. Phenomenally, the synchronous pip makes the visual object pop out from its complex environment, providing a direct demonstration of spatially nonspecific sounds affecting competition in spatial visual processing.

Abrupt onsets capture attention independent of top-down control settings.

Previous research using a spatial cuing paradigm in which a distractor cue preceded the target has shown that new objects presented with abrupt onsets only capture attention when observers are set to look for them (e.g., Folk, Remington, & Johnston, 1992). In the present study, we used the same spatial cuing paradigm as Folk et al. (1992) to demonstrate that even when observers have an attentional set for a color singleton or a specific color feature, an irrelevant new object presented with an abrupt onset interfered with search. We also show that the identity of the abrupt-onset distractor affects responses to the target, indicating that at some point spatial attention was allocated to the abrupt onset. We conclude that abrupt onsets ornew objects override a top-down set for color. Abrupt onsets or new objects appear to capture attention independently of top-down control settings.