Activated long-term memory and visual working memory during hybrid visual search: Effects on target memory search and distractor memory.

In hybrid visual search, observers must maintain multiple target templates and subsequently search for any one of those targets. If the number of potential target templates exceeds visual working memory (VWM) capacity, then the target templates are assumed to be maintained in activated long-term memory (aLTM). Observers must search the array for potential targets (visual search), as well as search through memory (target memory search). Increasing the target memory set size reduces accuracy, increases search response times (RT), and increases dwell time on distractors. However, the extent of observers' memory for distractors during hybrid search is largely unknown. In the current study, the impact of hybrid search on target memory search (measured by dwell time on distractors, false alarms, and misses) and distractor memory (measured by distractor revisits and recognition memory of recently viewed distractors) was measured. Specifically, we aimed to better understand how changes in behavior during hybrid search impacts distractor memory. Increased target memory set size led to an increase in search RTs, distractor dwell times, false alarms, and target identification misses. Increasing target memory set size increased revisits to distractors, suggesting impaired distractor location memory, but had no effect on a two-alternative forced-choice (2AFC) distractor recognition memory test presented during the search trial. The results from the current study suggest a lack of interference between memory stores maintaining target template representations (aLTM) and distractor information (VWM). Loading aLTM with more target templates does not impact VWM for distracting information.

Diminishing sensitivity and absolute difference in value-driven attention.

Kim and Beck (2020b) demonstrated that value-driven attention is based on relative value rather than absolute value, suggesting that prospect theory is relevant to our understanding of value-driven attention. To further this understanding, the present study investigated the impacts of diminishing sensitivity on value-driven attention. According to diminishing sensitivity, changes in outcomes have greater impacts nearer the reference point of 0 than farther from the point. Thus, the difference between $1 and $100 looms larger than that between $901 and $1000, due to their different ratios (100/1 > 1000/901). However, according to the absolute difference hypothesis, the differences should have similar impacts due to the absolute differences being the same (100 - 1 = 1000 - 901). Experiment 1 investigated whether diminishing sensitivity operates in the modified value-driven attention paradigm while controlling the impact of absolute differences. In the training phase, 100-point and 1000-point color targets had references of 1-point and 901-point color targets, respectively. In the test phase, 100-point color distractors attracted attention more than 1000-point color distractors, supporting the diminishing sensitivity hypothesis. Experiment 2 examined the absolute difference hypothesis while controlling the impact of diminishing sensitivity. Contrary to the absolute difference hypothesis, the test phase showed that 1000-point color distractors (compared with 10-point colors for a 990 absolute difference in the training phase) failed to attract attention more than 100-point color distractors (compared with 1-point colors, for a 99 absolute difference). These results suggest that diminishing sensitivity rather than absolute difference influences value-driven attention, further supporting the relevance of prospect theory to value-driven attention.

Not all information in visual working memory is forgotten equally.

To improve maintenance of task-relevant information in visual working memory (VWM), previously encoded, but no longer relevant, information can be suppressed or forgotten. However, it is unclear whether a cue directing attention to a subset of stimuli leads to complete forgetting for non-cued stimuli. The current study utilized a novel method of testing to-be forgotten information to determine if the effectiveness of forgetting differs depending on the type of encoded stimuli. Participants performed a directed forgetting change detection task, and importantly, the changed stimulus could be a novel stimulus or a to-be-forgotten stimulus. Stimulus type (colors, objects, or shapes) was manipulated across two experiments. Results suggest that a cue benefits memory for to-be-remembered information, but performance is not equivalent to never encoding to-be-forgotten information. Furthermore, the type of encoded information impacts the extent of forgetting.

Retrieval from long-term memory reduces working memory representations for visual features and their bindings.

The ability to remember feature bindings is an important measure of the ability to maintain objects in working memory (WM). In this study, we investigated whether both object- and feature-based representations are maintained in WM. Specifically, we tested the hypotheses that retaining a greater number of feature representations (i.e., both as individual features and bound representations) results in a more robust representation of individual features than of feature bindings, and that retrieving information from long-term memory (LTM) into WM would cause a greater disruption to feature bindings. In four experiments, we examined the effects of retrieving a word from LTM on shape and color-shape binding change detection performance. We found that binding changes were more difficult to detect than individual-feature changes overall, but that the cost of retrieving a word from LTM was the same for both individual-feature and binding changes.

Differences in the duration of the attentional blink when viewing nature vs. urban scenes.

The current study examined how viewing nature vs. urban scenes impacts the duration of the attentional blink. Nature scenes produce a broader allocation of attention, allowing attention to spread and reduce the ability to disengage attention. Urban scenes produce a narrowed allocation of attention, allowing efficient encoding of relevant information, inhibition of irrelevant information and a speedier disengagement of attention. Participants viewed a rapid serial visual presentation (RSVP) of either nature or urban scenes. For both scene categories, an attentional blink was evident by reduced accuracy for reporting a second target that occurred two or three scenes after an accurately reported first target. However, the duration of the attentional blink was reduced for urban scenes compared with nature scenes. A peripheral target detection task confirmed a difference in the allocation of attention between scene categories. The peripheral targets were better detected for nature scenes, suggesting that participants have a broader spread of attention for nature scenes, even in an RSVP task. The shorter duration of the attentional blink for urban scenes was consistent across four experiments with small and large sets of urban and nature scenes. Therefore, urban scenes reliably reduce the attentional blink duration compared with nature scenes, and this could be attributed to a narrowed attention allocation that allows speedier disengagement of attention in an RSVP.

Loss aversion in the control of attention.

Loss aversion is a psychological bias where an increase in loss is perceived as being larger than an equivalent increase in gain. In the present study, two experiments were conducted to explore whether attentional control reflects loss aversion. Participants performed a visual search task. On each trial, a red target and a green target were presented simultaneously, and participants were free to search for either one. Participants always gained points when they searched for a gain color target (e.g., red). However, they gained or lost points when they searched for a gain-loss color target (e.g., green). In Experiment 1, the expected values of the gain color and the gain-loss color were equal. Therefore, for maximizing the reward, participants did not need to preferably search for a particular color. However, results showed that participants searched for the gain color target more than the gain-loss color target, suggesting stronger attentional control for the gain color than the gain-loss color. In Experiment 2, even though the expected value of the gain-loss color was greater than that of the gain color, attention was allocated to the gain color more than to the gain-loss color. The results imply that attentional control can operate in accordance with the loss aversion principle when the boundary conditions for loss aversion in a repeated binary decision-making task were met.

Behavioral and electrophysiological evidence for the flexible recruitment of feature- and object-based processing in visual working memory comparison.

Previous research is inconclusive on when visual working memory (VWM) can be object-based or feature-based. Prior event-related potential (ERP) studies using change detection tasks have found that amplitudes of the N200-an ERP index of VWM comparison- are sensitive to changes in both relevant and irrelevant features, suggesting a bias toward object-based processing. To test whether VWM comparison processing can operate in a feature-based manner, we aimed to create circumstances that would support feature-based processing by: 1) using a strong task-relevance manipulation, and 2) repeating features within a display. Participants completed two blocks of a change detection task for four-item displays in which they were told to respond to color changes (task relevant) but not shape changes (task irrelevant). The first block contained only task-relevant changes to create a strong task-relevance manipulation. In the second block, both relevant and irrelevant changes were present. In both blocks, half of the arrays contained within-display feature repetitions (e.g. two items of the same color or shape). We found that during the second block, N200 amplitudes were sensitive to task-relevant but not irrelevant features regardless of repetition status, consistent with feature-based processing. However, analyses of behavioral data and N200 latencies suggested that object-based processing was occurring at some stages of VWM processing on task-irrelevant feature change trials. In particular, task-irrelevant changes may be processed after no task-relevant feature change is revealed. Overall, the results from the current study suggest that the VWM processing is flexible and can be either object- or feature-based.

The change probability effect: incidental learning, adaptability, and shared visual working memory resources.

Statistical properties in the visual environment can be used to improve performance on visual working memory (VWM) tasks. The current study examined the ability to incidentally learn that a change is more likely to occur to a particular feature dimension (shape, color, or location) and use this information to improve change detection performance for that dimension (the change probability effect). Participants completed a change detection task in which one change type was more probable than others. Change probability effects were found for color and shape changes, but not location changes, and intentional strategies did not improve the effect. Furthermore, the change probability effect developed and adapted to new probability information quickly. Finally, in some conditions, an improvement in change detection performance for a probable change led to an impairment in change detection for improbable changes.

Accessing long-term memory representations during visual change detection.

In visual change detection tasks, providing a cue to the change location concurrent with the test image (post-cue) can improve performance, suggesting that, without a cue, not all encoded representations are automatically accessed. Our studies examined the possibility that post-cues can encourage the retrieval of representations stored in long-term memory (LTM). Participants detected changes in images composed of familiar objects. Performance was better when the cue directed attention to the post-change object. Supporting the role of LTM in the cue effect, the effect was similar regardless of whether the cue was presented during the inter-stimulus interval, concurrent with the onset of the test image, or after the onset of the test image. Furthermore, the post-cue effect and LTM performance were similarly influenced by encoding time. These findings demonstrate that monitoring the visual world for changes does not automatically engage LTM retrieval.

Non-spatial context-driven search.

Contexts that predict characteristics of search targets can guide attention by triggering attentional control settings for the characteristics. However, this context-driven search has most commonly been found in the spatial dimension. The present study explored the context-driven search when shape contexts predict the color of targets: non-spatial context-driven search. It has been demonstrated that context-driven search requires cognitive resources, and evidence of non-spatial context-driven search is found when there is an increase in cognitive resources for the shape/color associations. Thus, the scarcity of evidence for non-spatial context-driven search is potentially because the context-driven search requires more cognitive resources for shape/color associations than for spatial/spatial associations. In the current study, we violated a previously 100% consistent shape/color association with two mismatch trials to encourage allocation of cognitive resources to the shape/color association. Three experiments showed that the shape-predicted color cues captured attention more than the non-predicted color cues, indicating that shape contexts triggered attentional control settings for a color predicted by the contexts. Furthermore, the shape contexts guided attention to the predicted color only after the two mismatch trials, suggesting that expression of the non-spatial context-driven search may require cognitive resources more than the spatial context-driven search.

Impact of relative and absolute values on selective attention.

Valuable stimuli receive attentional priority. However, it is unknown whether the mechanism of the attentional priority is based on relative (e.g., higher) or absolute (e.g., 45 points) values. Therefore, we manipulated the relative and absolute values independently in a modified value-driven attentional capture paradigm. In the training phase, where associative learning occurs between color and reward value, two test target colors were each presented with another different target color (reference target colors) in separate context blocks. Therefore, each test target color had different reference points. In the test phase, the two test target colors were used as singleton distractor colors. In the training phase of Experiment 1, the absolute reward value of the test target colors was the same, but one had a higher value than its reference target color and the other had a lower value. In the test phase, the high relative value color distractor captured attention more, suggesting that the relative value of stimuli influenced selective attention. In Experiment 2 the relative value of the test target colors was the same, but the absolute value was higher for one. The high and low absolute value color distractors captured attention equally in the test phase, indicating little impact of the absolute value on selective attention. These findings suggest that the relative value, rather than absolute value, plays a critical role in the allocation of attention. Accordingly, the present study suggests that prospect theory (Kahneman & Tversky, Econometrica, 47 (2), 363-391, 1979) can be extended to earlier cognitive stages such as selective attention.

Strengthening spatial reasoning: elucidating the attentional and neural mechanisms associated with mental rotation skill development.

Spatial reasoning is a critical skill in many everyday tasks and in science, technology, engineering, and mathematics disciplines. The current study examined how training on mental rotation (a spatial reasoning task) impacts the completeness of an encoded representation and the ability to rotate the representation. We used a multisession, multimethod design with an active control group to determine how mental rotation ability impacts performance for a trained stimulus category and an untrained stimulus category. Participants in the experimental group (n = 18) showed greater improvement than the active control group (n = 18) on the mental rotation tasks. The number of saccades between objects decreased and saccade amplitude increased after training, suggesting that participants in the experimental group encoded more of the object and possibly had more complete mental representations after training. Functional magnetic resonance imaging data revealed distinct neural activation associated with mental rotation, notably in the right motor cortex and right lateral occipital cortex. These brain areas are often associated with rotation and encoding complete representations, respectively. Furthermore, logistic regression revealed that activation in these brain regions during the post-training scan significantly predicted training group assignment. Overall, the current study suggests that effective mental rotation training protocols should aim to improve the encoding and manipulation of mental representations.

Implicit learning for probable changes in a visual change detection task.

Previous research demonstrates that implicitly learned probability information can guide visual attention. We examined whether the probability of an object changing can be implicitly learned and then used to improve change detection performance. In a series of six experiments, participants completed 120-130 training change detection trials. In four of the experiments the object that changed color was the same shape (trained shape) on every trial. Participants were not explicitly aware of this change probability manipulation and change detection performance was not improved for the trained shape versus untrained shapes. In two of the experiments, the object that changed color was always in the same general location (trained location). Although participants were not explicitly aware of the change probability, implicit knowledge of it did improve change detection performance in the trained location. These results indicate that improved change detection performance through implicitly learned change probability occurs for location but not shape.

Were you paying attention to where you looked? The role of executive working memory in visual search.

Recent evidence has indicated that performing a working memory task that loads executive working memory leads to less efficient visual search (Han & Kim, 2004). We explored the role that executive functioning plays in visual search by examining the pattern of eye movements while participants performed a search task with or without a secondary executive working memory task. Results indicate that executive functioning plays two roles in visual search: the identification of objects and the control of the disengagement of attention.

Visual search with varying versus consistent attentional templates: Effects on target template establishment, comparison, and guidance.

Attentional templates can be represented in visual working memory (VWM) when the target varies from trial-to-trial and can be represented in long-term memory (LTM) when the target is consistent during trial runs. Given that attentional templates can be represented in either VWM or LTM, are there any differences in how these representations impact visual search when targets are consistent compared with varying? The current study tested the consistent template hypothesis, which predicts faster performance with a consistent target compared with a varying target. Experiment 1 examined whether consistent targets could lead to consistent templates that would improve template establishment, guidance, and/or comparison of the template to search items. Search response time was faster for consistent targets, and consistent targets produced faster comparison processes, but not more efficient guidance. Experiment 2 examined the consistent template restoration hypothesis, which predicts faster template establishment and comparison processes for a previously encountered consistent target. Experiment 2 replicated the consistent template hypothesis and supported the consistent template restoration hypothesis. These studies demonstrate that although attentional guidance is similar with varying and consistent attentional templates, consistent templates improve search performance by speeding template establishment and comparison processes. (PsycINFO Database Record

Attending globally or locally: Incidental learning of optimal visual attention allocation.

Attention allocation determines the information that is encoded into memory. Can participants learn to optimally allocate attention based on what types of information are most likely to change? The current study examined whether participants could incidentally learn that changes to either high spatial frequency (HSF) or low spatial frequency (LSF) Gabor patches were more probable and to use this incidentally learned probability information to bias attention during encoding. Participants detected changes in orientation in arrays of 6 Gabor patches: 3 HSF and 3 LSF. For half of the participants, an HSF patch changed orientation on 75% of the trials, and for the other half, an LSF patch changed orientation on 75% of the trials. Experiment 1 demonstrated a change probability effect and an attention allocation effect. Specifically, change detection performance was highest for the probable-change type, and participants learned to use a global spread of attention (fixating between Gabor patches) when LSF patches were most likely to change and to use a local allocation of attention (fixating directly on Gabor patches) when HSF patches were most likely to change. Experiments 2 and 3 replicated these effects and demonstrated that an internal monitoring system is sufficient for these effects. That is, the effects do not require explicit feedback or point rewards. This study demonstrates that incidental learning of probability information can affect the allocation of attention during encoding and can therefore affect what information is stored in visual working memory. (PsycINFO Database Record

Memory for where, but not what, is used during visual search.

Although the role of memory in visual search is debatable, most researchers agree with a limited-capacity model of memory in visual search. The authors demonstrate the role of memory by replicating previous findings showing that visual search is biased away from old items (previously examined items) and toward new items (nonexamined items). Furthermore, the authors examined the type of memory representations used to bias search by changing an item's individuating feature or location during search. Changing the individuating feature of an item did not disrupt normal search biases. However, when the location of an item changed, normal search biases were disrupted. These results suggest that memory used in visual search is based on items' locations rather than their identity.

Inattentional blindness: A combination of a relational set and a feature inhibition set?

Two experiments were conducted to directly test the feature set hypothesis and the relational set hypothesis in an inattentional blindness task. The feature set hypothesis predicts that unexpected objects that match the to-be-attended stimuli will be reported most. The relational set hypothesis predicts that unexpected objects that match the relationship between the to-be-attended and the to-be-ignored stimuli will be reported the most. Experiment 1 manipulated the luminance of the stimuli. Participants were instructed to monitor the gray letter shapes and to ignore either black or white letter shapes. The unexpected objects that exhibited the luminance relation of the to-be-attended to the to-be-ignored stimuli were reported by participants the most. Experiment 2 manipulated the color of the stimuli. Participants were instructed to monitor the yellower orange or the redder orange letter shapes and to ignore the redder orange or yellower letter shapes. The unexpected objects that exhibited the color relation of the to-be-attended to the to-be-ignored stimuli were reported the most. The results do not support the use of a feature set to accomplish the task and instead support the use of a relational set. In addition, the results point to the concurrent use of multiple attentional sets that are both excitatory and inhibitory.

Binding global and local object features in visual working memory.

When briefly presented with global and local visual information, individuals report global information more quickly and more accurately than local information, a phenomenon known as the global precedence effect (GPE; Navon, 1977). We investigated whether a bias toward global information persists in visual working memory (VWM) and whether the VWM representations for global and local features include information bound to their hierarchical levels and to each other. Navon figures, in which a larger (global) letter is composed of smaller (local) letters, were presented, and participants performed a change detection task that required participants to remember features only (either a global or local letter changed to a new identity); features bound to their hierarchical levels (the global and local letters within an object swapped levels); or features bound to each other within an object (2 letters from the same level swapped between objects). Performance suggested that there was a GPE in VWM (new global letters were more accurately detected than new local letters) and that although global and local features were not necessarily bound together in VWM, they were bound to their corresponding hierarchical levels. These results indicate that level binding in VWM occurs more readily than binding specific object features together. These findings further our understanding of how hierarchical objects are represented in VWM.

Visual working memory organization is subject to top-down control.

The limited capacity of visual working memory (VWM) can be maximized by combining multiple features into a single representation through grouping principles such as connection, proximity, and similarity. In this study, we sought to understand how VWM organizes information by investigating how connection and similarity cues are used either alone or in the presence of another grouping cue. Furthermore, we examined whether the use of one cue over another is within volitional control. Participants remembered displays of objects that contained no grouping cues, connection cues only, similarity cues only, or both connection and similarity cues. We found that it is possible to use either connection or similarity cues, although connection cues tend to dominate if the cues are in conflict with one another. However, it is possible to flexibly use either similarity or connection cues if both are present, depending on the task goals.