Attention deployment in natural scenes: Higher-order scene statistics rather than semantics modulate the N2pc component.

Which properties of a natural scene affect visual search? We consider the alternative hypotheses that low-level statistics, higher-level statistics, semantics, or layout affect search difficulty in natural scenes. Across three experiments (n = 20 each), we used four different backgrounds that preserve distinct scene properties: (a) natural scenes (all experiments); (b) 1/f noise (pink noise, which preserves only low-level statistics and was used in Experiments 1 and 2); (c) textures that preserve low-level and higher-level statistics but not semantics or layout (Experiments 2 and 3); and (d) inverted (upside-down) scenes that preserve statistics and semantics but not layout (Experiment 2). We included "split scenes" that contained different backgrounds left and right of the midline (Experiment 1, natural/noise; Experiment 3, natural/texture). Participants searched for a Gabor patch that occurred at one of six locations (all experiments). Reaction times were faster for targets on noise and slower on inverted images, compared to natural scenes and textures. The N2pc component of the event-related potential, a marker of attentional selection, had a shorter latency and a higher amplitude for targets in noise than for all other backgrounds. The background contralateral to the target had an effect similar to that on the target side: noise led to faster reactions and shorter N2pc latencies than natural scenes, although we observed no difference in N2pc amplitude. There were no interactions between the target side and the non-target side. Together, this shows that-at least when searching simple targets without own semantic content-natural scenes are more effective distractors than noise and that this results from higher-order statistics rather than from semantics or layout.

The Distractor Positivity Component and the Inhibition of Distracting Stimuli.

There has been a long-lasting debate about whether salient stimuli, such as uniquely colored objects, have the ability to automatically distract us. To resolve this debate, it has been suggested that salient stimuli do attract attention but that they can be suppressed to prevent distraction. Some research supporting this viewpoint has focused on a newly discovered ERP component called the distractor positivity (PD), which is thought to measure an inhibitory attentional process. This collaborative review summarizes previous research relying on this component with a specific emphasis on how the PD has been used to understand the ability to ignore distracting stimuli. In particular, we outline how the PD component has been used to gain theoretical insights about how search strategy and learning can influence distraction. We also review alternative accounts of the cognitive processes indexed by the PD component. Ultimately, we conclude that the PD component is a useful tool for understanding inhibitory processes related to distraction and may prove to be useful in other areas of study related to cognitive control.

Electrophysiological correlates of attentional capture in joint action.

In joint action, agents are assumed to represent their partner's task to optimize joint performance. However, the neurophysiological processes underlying the processing of the partner's task have not been widely investigated. Pairs of participants were asked to perform a joint version of a visual search task in either a cooperative or a competitive social context. During the task, one agent's neural activity was recorded using electroencephalography (EEG). The alpha-lateralization index was calculated as [(contralateral - ipsilateral)/(contralateral + ipsilateral)] × 100 to examine attentional selection or suppression of the laterally presented stimulus. A negative alpha-lateralization indicates lower alpha-band power over the contralateral sites compared with the ipsilateral sites and was related to attentional selection. A positive alpha-lateralization indicates higher alpha-band power over the contralateral sites compared with the ipsilateral sites and was related to attentional suppression. Behavioural results showed impeded search performance when the partner target was present. Furthermore, EEG time-frequency results showed that the partner target induced a negative parieto-occipital alpha-lateralization, indicating that it captured attention, when the agent target was absent. When the agent target was present, the parieto-occipital alpha-lateralization index was negative for laterally presented partner target in the cooperative and positive in the competitive social context, indicative of attentional capture in the cooperative condition and suppression of the partner target in the competitive condition. In sum, our study showed that humans tune their attentional processing towards a partner target in a joint action task. This attentional tuning was shown to be affected by social context and the presence of the agent's own target.

Differing Time Courses of Reward-Related Attentional Processing: An EEG Source-Space Analysis.

Since our environment typically contains more information than can be processed at any one time due to the limited capacity of our visual system, we are bound to differentiate between relevant and irrelevant information. This process, termed attentional selection, is usually categorized into bottom-up and top-down processes. However, recent research suggests reward might also be an important factor in guiding attention. Monetary reward can bias attentional selection in favor of task-relevant targets and reduce the efficiency of visual search when a reward-associated, but task-irrelevant distractor is present. This study is the first to investigate reward-related target and distractor processing in an additional singleton task using neurophysiological measures and source space analysis. Based on previous studies, we hypothesized that source space analysis would find enhanced neural activity in regions of the value-based attention network, such as the visual cortex and the anterior cingulate. Additionally, we went further and explored the time courses of the underlying attentional mechanisms. Our neurophysiological results showed that rewarding distractors led to a stronger attentional capture. In line with this, we found that reward-associated distractors (compared with reward-associated targets) enhanced activation in frontal regions, indicating the involvement of top-down control processes. As hypothesized, source space analysis demonstrated that reward-related targets and reward-related distractors elicited activation in regions of the value-based attention network. However, these activations showed time-dependent differences, indicating that the neural mechanisms underlying reward biasing might be different for task-relevant and task-irrelevant stimuli.

Local and global context repetitions in contextual cueing.

In contextual cueing tasks, participants can use a repeating local context to learn to detect the target, yet most contextual cueing studies have relied on repeating global context properties. We examined whether observers can use local context repetitions in a similar manner as they use global context repetitions. In addition, we examined how reward-predicting context features modulate the use of local and global contexts. Participants searched through contexts in which either the entire context configuration or only a local context around the target repeated, intermixed with novel contexts. Half of the context items appeared in a color signaling either low or high reward. We found that local context repetitions led to comparable benefits in response times and fixation count as global context repetitions did. Surprisingly, reward magnitude did not affect performance in local nor in global contexts. The results suggest that a local chunk of distractors can be used for context learning and attention guidance in a similar manner as the global context configuration. We suggest that the proportion of repeated and novel context trials is crucial for context learning and that our combination of locally and globally repeating contexts provided an environment that facilitated learning in both context types because it allowed predicting the target location from the context in most of the trials.

Failed Suppression of Salient Stimuli Precedes Behavioral Errors.

Our visual system is constantly confronted with more information than it can process. To deal with the limited capacity, attention allows us to enhance relevant information and suppress irrelevant information. Particularly, the suppression of salient irrelevant stimuli has shown to be important as it prevents attention to be captured and thus attentional resources to be wasted. This study aimed at directly connecting failures to suppress distraction with a neural marker of suppression, the distractor positivity (Pd). We measured participants' EEG signal while they performed a visual search task in which they had to report a digit inside a shape target while ignoring distractors, one of which could be a salient color singleton. Reports of target digits served as a behavioral index of enhancement, and reports of color distractor digits served as a behavioral index of failed suppression, each measured against reports of neutral distractor digits serving as a baseline. Participants reported the target identity more often than any distractor identity. The singleton identity was reported least often, suggesting suppression of the singleton below baseline. Suppression of salient stimuli was absent in the beginning and then increased throughout the experiment. When the singleton identity was reported, the Pd was observed in a later time window, suggesting that behavioral errors were preceded by failed suppression. Our results provide evidence for the signal suppression hypothesis that states salient items have to be actively suppressed to avoid attentional capture. Our results also provide direct evidence that the Pd is reflecting such active suppression.

Voluntary Control of Task Selection Does Not Eliminate the Impact of Selection History on Attention.

The human visual system can only process a fraction of the information present in a typical visual scene, and selection is historically framed as the outcome of bottom-up and top-down control processes. In this study, we evaluated how a third factor, an individual's selection history, interacts with top-down control mechanisms during visual search. Participants in our task were assigned to one of two groups in which they developed a history of either shape or color selection in one task, while searching for a shape singleton in a second task. A voluntary task selection procedure allowed participants to choose which task they would perform on each trial, thereby maximizing their top-down preparation. We recorded EEG throughout and extracted lateralized ERP components that index target selection (NT) and distractor suppression (PD). Our results showed that selection history continued to guide attention during visual search, even when top-down control mechanisms were maximized with voluntary task selection. For participants with a history of color selection, the NT component elicited by a shape target was attenuated when accompanied by a color distractor, and the distractor itself elicited a larger PD component. In addition, task-switching results revealed that participants in the color group had larger, asymmetric switch costs implying increased competition between task sets. Our results support the notion that selection history is a significant factor in attention guidance, orienting the visual system reflexively to objects that contradict an individual's current goals-even when these goals are intrinsically selected and prepared ahead of time.

Cueing distraction: electrophysiological evidence for anticipatory active suppression of distractor location.

It is well known that processing at upcoming target locations can be facilitated, but mixed results have been obtained regarding the inhibition of irrelevant locations when advance information about distractors is available on a trial-to-trial basis. Here, we provide electrophysiological evidence that distractor locations can be anticipatorily suppressed. In an additional singleton search task, distractor cues were presented before the search display, which were either fully predictive or non-predictive of the location of the upcoming salient colour distractor. The PD component of the event-related potential, a marker of active suppression, was elicited by lateral singletons and smaller following predictive than non-predictive cues, indicating that less suppression was required upon presentation of the distractor when its location was known in advance. Presumably, excitability of regions processing the predictively cued locations was anticipatorily reduced to prevent distraction. This idea was further supported by the finding that larger individual cueing benefits in reaction time were associated with stronger reductions of the PD. There was no behavioural benefit at the group level, however, and implications for the role of individual differences and for the measurement of inhibition in distractor cueing tasks are discussed. The enhancement of target locations, reflected by the NT component, was not modulated by the predictiveness of the cues. Overall, our findings add to a growing literature highlighting the importance of inhibitory mechanisms for the guidance of spatial attention by showing that irrelevant locations can be anticipatorily suppressed in a top-down fashion, reducing the impact of even salient stimuli.

Reward expectation facilitates context learning and attentional guidance in visual search.

Modulations of visual attention due to expectation of reward were frequently reported in recent years. Recent studies revealed that reward can modulate the implicit learning of repeated context configurations (e.g., Tseng & Lleras, 2013). We investigated the influence of reward expectations on context learning by associating colors to different reward magnitudes. Participants searched through contexts consisting of spatially distributed L-shaped distractors and a T-shaped target, with half of these objects appearing in a color associated with low, medium, or high reward. Half of these context configurations were repeatedly presented in every experimental block, whereas the other half was generated newly for every trial. Results showed an earlier and more pronounced contextual cueing effect in contexts associated with high reward compared with low reward contexts. This was visible as faster decline of response times to targets in repeated contexts associated with high reward compared with repeated low reward and novel contexts, and was reflected in the eye movement pattern as shorter distance of the first fixation to the target location. These results suggest that expectation of high reward magnitude facilitates subsequent learning of repeated context configurations. High reward also increases the efficiency of attention guidance toward the target location.

Separate and combined effects of action relevance and motivational value on visual working memory.

Visual working memory contents can be selectively weighted according to differences in their task-relevance. In the present study, we examined the influence of two more indirect selection biases established by a concurrent task or learned reward associations: action relevance and motivational value. In three experiments, memory performance was assessed with the same color change detection task. Potential action relevance and motivational value were each determined by a specific feature of the memory items (location or shape, respectively) and manipulated orthogonally. Investigated separately (Experiments 1A and 1B), both selection biases modulated visual working memory. In combination (Experiment 2), action relevance and motivational value still each exerted an influence, but not in a fully independent and additive manner. While action relevance impacted performance irrespective of the reward associated with the items, an effect of motivational value was only observed for action-relevant items. These results support the notion that visual working memory is automatically biased as an inherent part of action planning. More generally, these findings highlight the versatile nature of visual working memory: Contents can be flexibly weighted to reflect differences in their importance, taking into account several sources of information.

Action relevance induces an attentional weighting of representations in visual working memory.

Information maintained in visual working memory (VWM) can be strategically weighted according to its task-relevance. This is typically studied by presenting cues during the maintenance interval, but under natural conditions, the importance of certain aspects of our visual environment is mostly determined by intended actions. We investigated whether representations in VWM are also weighted with respect to their potential action relevance. In a combined memory and movement task, participants memorized a number of items and performed a pointing movement during the maintenance interval. The test item in the memory task was subsequently presented either at the movement goal or at another location. We found that performance was better for test items presented at a location that corresponded to the movement goal than for test items presented at action-irrelevant locations. This effect was sensitive to the number of maintained items, suggesting that preferential maintenance of action relevant information becomes particularly important when the demand on VWM is high. We argue that weighting according to action relevance is mediated by the deployment of spatial attention to action goals, with representations spatially corresponding to the action goal benefitting from this attentional engagement. Performance was also better at locations next to the action goal than at locations farther away, indicating an attentional gradient spreading out from the action goal. We conclude that our actions continue to influence visual processing at the mnemonic level, ensuring preferential maintenance of information that is relevant for current behavioral goals.

Feature-based and spatial attentional selection in visual working memory.

The contents of visual working memory (VWM) can be modulated by spatial cues presented during the maintenance interval ("retrocues"). Here, we examined whether attentional selection of representations in VWM can also be based on features. In addition, we investigated whether the mechanisms of feature-based and spatial attention in VWM differ with respect to parallel access to noncontiguous locations. In two experiments, we tested the efficacy of valid retrocues relying on different kinds of information. Specifically, participants were presented with a typical spatial retrocue pointing to two locations, a symbolic spatial retrocue (numbers mapping onto two locations), and two feature-based retrocues: a color retrocue (a blob of the same color as two of the items) and a shape retrocue (an outline of the shape of two of the items). The two cued items were presented at either contiguous or noncontiguous locations. Overall retrocueing benefits, as compared to a neutral condition, were observed for all retrocue types. Whereas feature-based retrocues yielded benefits for cued items presented at both contiguous and noncontiguous locations, spatial retrocues were only effective when the cued items had been presented at contiguous locations. These findings demonstrate that attentional selection and updating in VWM can operate on different kinds of information, allowing for a flexible and efficient use of this limited system. The observation that the representations of items presented at noncontiguous locations could only be reliably selected with feature-based retrocues suggests that feature-based and spatial attentional selection in VWM rely on different mechanisms, as has been shown for attentional orienting in the external world.

Social categorization and cooperation in motor joint action: evidence for a joint end-state comfort.

The present study investigated to what extent group membership affects an actor's representation of their partner's task in cooperative joint action. Participants performed a joint pick-and-place task in a naturalistic, breakfast-table-like paradigm which allowed the demonstration of varying degrees of cooperation. Participants transported a wooden cup from one end of a table to the other, with one actor moving it to an intermediate position from where their partner transported it to a goal position. Hand and finger movements were recorded via 3D motion tracking to assess actors' cooperative behavior. Before the joint action task was performed, participants were categorized as belonging to the same or to different groups, supposedly based on an assessment of their cognitive processing styles. Results showed that the orientation of the actors' fingers when picking up the cup was affected by its required angle at the goal position. When placing the cup at the intermediate position, most actors adapted the rotation of the cup's handle to the joint action goal, thereby facilitating the partner's subsequent movement. Male actors demonstrated such cooperative behavior only when performing the task together with an ingroup partner, while female actors demonstrated cooperative behavior irrespective of social categorization. These results suggest that actors tend to represent a partner's end-state comfort and integrate it into their own movement planning in cooperative joint action. However, social factors like group membership may modulate this tendency.

Adapting attentional control settings in a shape-changing environment.

In rich visual environments, humans have to adjust their attentional control settings in various ways, depending on the task. Especially if the environment changes dynamically, it remains unclear how observers adapt to these changes. In two experiments (online and lab-based versions of the same task), we investigated how observers adapt their target choices while searching for color singletons among shape distractor contexts that changed over trials. The two equally colored targets had shapes that differed from each other and matched a varying number of distractors. Participants were free to select either target. The results show that participants adjusted target choices to the shape ratio of distractors: even though the task could be finished by focusing on color only, participants showed a tendency to choose targets matching with fewer distractors in shape. The time course of this adaptation showed that the regularities in the changing environment were taken into account. A Bayesian modeling approach was used to provide a fine-grained picture of how observers adapted their behavior to the changing shape ratio with three parameters: the strength of adaptation, its delay relative to the objective distractor shape ratio, and a general bias toward specific shapes. Overall, our findings highlight that systematic changes in shape, even when it is not a target-defining feature, influence how searchers adjust their attentional control settings. Furthermore, our comparison between lab-based and online assessments with this paradigm suggests that shape is a good choice as a feature dimension in adaptive choice online experiments.

Terms of debate: Consensus definitions to guide the scientific discourse on visual distraction.

Hypothesis-driven research rests on clearly articulated scientific theories. The building blocks for communicating these theories are scientific terms. Obviously, communication - and thus, scientific progress - is hampered if the meaning of these terms varies idiosyncratically across (sub)fields and even across individual researchers within the same subfield. We have formed an international group of experts representing various theoretical stances with the goal to homogenize the use of the terms that are most relevant to fundamental research on visual distraction in visual search. Our discussions revealed striking heterogeneity and we had to invest much time and effort to increase our mutual understanding of each other's use of central terms, which turned out to be strongly related to our respective theoretical positions. We present the outcomes of these discussions in a glossary and provide some context in several essays. Specifically, we explicate how central terms are used in the distraction literature and consensually sharpen their definitions in order to enable communication across theoretical standpoints. Where applicable, we also explain how the respective constructs can be measured. We believe that this novel type of adversarial collaboration can serve as a model for other fields of psychological research that strive to build a solid groundwork for theorizing and communicating by establishing a common language. For the field of visual distraction, the present paper should facilitate communication across theoretical standpoints and may serve as an introduction and reference text for newcomers.

Task set flexibility and feature specificity modulate the limits of temporal attention.

The consequences of maintaining a task set in the context of the (speeded) attentional blink were investigated in a series of experiments. Observers were asked to either attend or ignore the first of two target stimuli (T1 and T2). The results showed that when T1 and T2 shared a task relevant feature that was unique to T2, but not to T1, a shallow attentional blink was observed, as well as a lack of Lag 1 sparing. In comparison, when the targets shared a feature that was uniquely task relevant to both targets, the blink could not be avoided. Conversely, when no feature was shared between targets, ignoring T1 was successful and virtually no attentional costs were apparent. A similar lack of costs was also observed when targets shared a task relevant feature that was unique to T1 but not to T2. Finally, matching the feature dimension of a target feature that was unique to T2, but not T1, also strongly attenuated the blink. However, it did not completely abolish Lag 1 sparing. The results are interpreted in the context of current models of the attentional blink.

Attentional control and competition between episodic representations.

The relationship between attentional control and episodic representation was investigated in six experiments that employed a variant of the classic attentional blink paradigm. We introduced a task-irrelevant (unpredictive) color match between the first and second target stimulus in a three-stream rapid serial visual presentation task. When this match was present, the first target reliably elicited a priming benefit to the identification of the second, lateralized target. However, this was only the case when the identities of the targets did not belong to the same category (digits, letters, or symbols). When targets did belong to the same category, interference was observed instead of priming, particularly at Lag 1. Furthermore, when color was the target-defining feature, interference at Lag 1 gave way to priming at longer lags. The interference effect is attributed to partial overlap between competing episodic target representations, which affects the availability of their overlapping features for successive attentional selection in rapid serial visual presentation.

Context homogeneity facilitates both distractor inhibition and target enhancement.

Homogeneous contexts were shown to result in prioritized processing of embedded targets compared to heterogeneous contexts (Duncan & Humphreys, 1989). The present experiment used behavioral and ERP measures to examine whether context homogeneity affects both enhancing relevant information and inhibiting irrelevant in contexts of varying homogeneity. Targets and distractors were presented laterally or on the vertical midline which allowed disentangling target- and distractor-related activity in the lateralized ERP (Hickey, diLollo, & McDonald, 2009). In homogeneous contexts, targets elicited an NT component from 150 ms on and a PD component from 200 ms on, showing early attention deployment at target locations and active suppression of distractors. In heterogeneous contexts, an NT component was also found from 150 ms on and PD was found from 250 ms on, suggesting delayed suppression of the distractor. Before 250 ms, distractors in heterogeneous contexts elicited a contralateral negativity, indicating attentional capture of the distractor prior to active suppression. In sum the present results suggest that top-down control of attention is more pronounced in homogeneous than in heterogeneous contexts.

Target templates and the time course of distractor location learning.

When searching for a shape target, colour distractors typically capture our attention. Capture is smaller when observers search for a fixed target that allows for a feature-specific target template compared to a varying shape singleton target. Capture is also reduced when observers learn to predict the likely distractor location. We investigated how the precision of the target template modulates distractor location learning in an additional singleton search task. As observers are less prone to capture with a feature-specific target, we assumed that distractor location learning is less beneficial and therefore less pronounced than with a mixed-feature target. Hierarchical Bayesian parameter estimation was used to fit fine-grained distractor location learning curves. A model-based analysis of the time course of distractor location learning revealed an effect on the asymptotic performance level: when searching for a fixed-feature target, the asymptotic distractor cost indicated smaller distractor interference than with a mixed-feature target. Although interference was reduced for distractors at the high-probability location in both tasks, asymptotic distractor suppression was less pronounced with fixed-feature compared to mixed-feature targets. We conclude that with a more precise target template less distractor location learning is required, likely because the distractor dimension is down-weighted and its salience signal reduced.

Selection history and task predictability determine the precision expectations in attentional control.

Predictive processing frameworks have demonstrated the central role that prediction plays in a range of cognitive processes including bottom-up and top-down mechanisms of attention control. However, relatively little is understood about how predictive processes interact with the third main determinant of attentional priority - selection history. In this experiment, participants developed a history of either color or shape selection while we observed the impact of these histories in an additional singleton search task using behavioral measures and ERP measures of attentional control. Throughout the experiment, participants were encouraged to predict the upcoming display, but prediction errors were either high or low depending on session. Persistent group differences in our results showed that selection history contributes to the precision weighting of a stimulus, and that this is mediated by overall prediction error. Color-singleton distractors captured attention and required greater suppression when participants had a history of color selection; however, these participants gained large benefits when the upcoming stimuli were highly predictable. We suggest that selection history modulates the precision expectations for a feature in a persistent and implicit way, producing an attentional bias that predictability can help to counteract, but cannot prevent or eliminate entirely.