Surprise! Draw the scene: Visual recall reveals poor incidental working memory following visual search in natural scenes.

Searching within natural scenes can induce incidental encoding of information about the scene and the target, particularly when the scene is complex or repeated. However, recent evidence from attribute amnesia (AA) suggests that in some situations, searchers can find a target without building a robust incidental memory of it's task relevant features. Through drawing-based visual recall and an AA search task, we investigated whether search in natural scenes necessitates memory encoding. Participants repeatedly searched for and located an easily detected item in novel scenes for numerous trials before being unexpectedly prompted to draw either the entire scene (Experiment 1) or their search target (Experiment 2) directly after viewing the search image. Naïve raters assessed the similarity of the drawings to the original information. We found that surprise-trial drawings of the scene and search target were both poorly recognizable, but the same drawers produced highly recognizable drawings on the next trial when they had an expectation to draw the image. Experiment 3 further showed that the poor surprise trial memory could not merely be attributed to interference from the surprising event. Our findings suggest that even for searches done in natural scenes, it is possible to locate a target without creating a robust memory of either it or the scene it was in, even if attended to just a few seconds prior. This disconnection between attention and memory might reflect a fundamental property of cognitive computations designed to optimize task performance and minimize resource use.

Attention with or without working memory: mnemonic reselection of attended information.

Attention has been regarded as the 'gatekeeper' controlling what information gets selected into working memory. However, a new perspective has emerged with the discovery of attribute amnesia, a phenomenon revealing that people are frequently unable to report information they have just attended to moments ago. This report failure is thought to stem from a lack of consolidating the attended information into working memory, indicating a dissociation between attention and working memory. Building on these findings, a new concept called memory reselection is proposed to describe a secondary round of selection among the attended information. These discoveries challenge the conventional view of how attention and working memory are related and shed new light onto modeling attention and memory as dissociable processes.

Slipping through the cracks: The peril of unexpected interruption on the contents of working memory.

Working memory allows us to hold specific pieces of information in an active and easily retrieved state, but what happens to that information during an unexpected interruption between study and test? To answer this question, we used a surprise trial paradigm in which an unexpected event precedes a probe of the observer's memory for a search target. In the first set of experiments, participants were tasked to report the identity of the target letter before unexpectedly being asked to read a task-irrelevant passage. We observed that the introduction of this passage interfered with the observer's memory of the target letter, but this interference only occurred after participants had experience completing the task without interruption. However, a remember cue placed just prior to the reading prompt reduced this cost, suggesting that participants can rapidly reinforce information about the target in working memory to resist the interference. We then used this same cuing manipulation to test whether information in an attribute amnesia paradigm, which unexpectedly probes an attribute relevant to target selection but irrelevant to participant's response expectations, could also be protected against unexpected interference. Using this paradigm, we observed that a remember cue did not improve performance following the surprising event, which supports theories that attribute amnesia is not caused solely by interference. These results reveal both the vulnerability and flexibility of working memory and demonstrate the importance of understanding how task experience establishes expectations that impact the underlying cognitive representations formed by the observer. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The influence of category representativeness on the low prevalence effect in visual search.

Visual search is greatly affected by the appearance rate of given target types, such that low-prevalence items are harder to detect, which has consequences for real-world search tasks where target frequency cannot be balanced. However, targets that are highly representative of a categorically defined task set are also easier to find. We hypothesized that targets that are highly representative are less vulnerable to low-prevalence effects because an observer's attentional set prioritizes guidance toward them even when they are rare. We assessed this hypothesis by first determining the categorical structure of "prohibited carry-ons" via an exemplar-naming task, and used this structure to assess how category representativeness interacted with prevalence. Specifically, from the exemplar-naming task we selected a commonly named (knives) and rarely named (gas cans) target for a search task in which one of the targets was shown infrequently. As predicted, highly representative targets were found more easily than their less representative counterparts, but they also were less affected by prevalence manipulations. Experiment 1b replicated the results with targets matched for emotional valence (water bottles and fireworks). These findings demonstrate the powerful explanatory power of theories of attentional guidance that incorporate the dynamic influence of recent experience with the knowledge that comes from life experience to better predict behavioral outcomes associated with high-stakes search environments.

The early attentional pancake: Minimal selection in depth for rapid attentional cueing.

There have been conflicting findings on the degree to which rapidly deployed visual attention is selective for depth, and this issue has important implications for attention models. Previous findings have attempted to find depth-based cueing effects on such attention using reaction time (RT) measures for stimuli presented in stereo goggles with a display screen. Results stemming from such approaches have been mixed, depending on whether target/distractor discrimination was required. To help clarify the existence of such depth effects, we have developed a paradigm that measures accuracy rather than RT in an immersive virtual-reality environment, providing a more appropriate context of depth. Three modified Posner Cueing paradigms were run to test for depth-specific rapid attentional selectivity. Participants fixated a cross while attempting to identify a rapidly masked black letter preceded by a red cue that could be valid in depth, side, or both. In Experiment 1a, a potent cueing effect was found for lateral cueing validity, but a weak effect was found for depth despite an extreme difference in virtual depth (1 vs. 300 m). In Experiment 1b, a near-replication of 1a, the lateral effect replicated while the depth effect did not. Finally, in Experiment 2, to increase the depth cue's effectiveness, the letter matched the cue's color, and the presentation duration was increased; however, again only a minimal depth-based cueing effect - no greater than that of Experiment 1a - was observed. Thus, we conclude that rapidly deployed attention is driven largely by spatiotopic rather than depth-based information.

A model of working memory for latent representations.

We propose a mechanistic explanation of how working memories are built and reconstructed from the latent representations of visual knowledge. The proposed model features a variational autoencoder with an architecture that corresponds broadly to the human visual system and an activation-based binding pool of neurons that links latent space activities to tokenized representations. The simulation results revealed that new pictures of familiar types of items can be encoded and retrieved efficiently from higher levels of the visual hierarchy, whereas truly novel patterns are better stored using only early layers. Moreover, a given stimulus in working memory can have multiple codes, which allows representation of visual detail in addition to categorical information. Finally, we validated our model's assumptions by testing a series of predictions against behavioural results obtained from working memory tasks. The model provides a demonstration of how visual knowledge yields compact visual representation for efficient memory encoding.

And like that, they were gone: A failure to remember recently attended unique faces.

Attribute amnesia (AA) is a phenomenon in which participants have difficulty answering an unexpected question about an attended attribute of the most recent target stimulus. A similar situation can occur in cases of real-life eyewitness identification when the eyewitness did not explicitly try to remember the alleged perpetrator's face despite having attended to it. We found that AA is generalizable to novel faces, such that when participants were unexpectedly asked to identify a face, performance was poor, even though they had just attended to that face seconds ago (N = 40 each in an initial experiment and its replication). This finding shows that unexpected face identification is inaccurate even when the face had just been attended to and suffered minimal decay and interference, implying that AA can explain some cases of failure of eyewitness identification that cannot be attributed to a lack of attention or post-event interference.

No explicit memory for individual trial display configurations in a visual search task.

Previous evidence demonstrated that individuals can recall a target's location in a search display even if location information is completely task-irrelevant. This finding raises the question: does this ability to automatically encode a single item's location into a reportable memory trace extend to other aspects of spatial information as well? We tested this question using a paradigm designed to elicit attribute amnesia (Chen & Wyble, Psychological Science, 26(2) 203-210, 2015a). Participants were initially asked to report the location of a target letter among digits with stimuli arranged to form one of two or four spatial configurations varying randomly across trials. After completing numerous trials that matched their expectations, participants were surprised with a series of unexpected questions probing their memory for various aspects of the display they had just viewed. Participants had a profound inability to report which spatial configuration they had just perceived when the target's location was not unique to a specific configuration (i.e., orthogonal). Despite being unable to report the most recent configuration, answer choices on the surprise trial were focused around previously seen configurations, rather than novel configurations. Thus, there were clear memories of the set of configurations that had been viewed during the experiment but not of the specific configuration from the most recent trial. This finding helps to set boundary conditions on previous findings regarding the automatic encoding of location information into memory.

The functional arrangement of objects biases gaze direction.

A growing number of studies suggest that semantic knowledge can influence the control of gaze in scenes. For example, observers are more likely to look toward objects that are semantically related to the currently fixated object. Recent evidence also suggests that an object's functional orientation can bias gaze direction. However, it is unknown whether these semantic and functional relationships can interact to determine gaze control. To address this issue, the present study assessed whether the functional arrangement of multiple objects can influence gaze control. Participants fixated a central object (e.g., a key) flanked by two peripheral objects. After a brief delay, participants were free to shift their gaze toward the peripheral object of their choice. One of the peripheral objects was semantically related to the central object (e.g., a lock), and the objects were arranged to depict a functional or non-functional interaction (e.g., a key pointing toward or away from a lock). When the orientation of the central object was manipulated, participants were more likely to look in the direction this object was pointing. Moreover, the functional arrangement of objects modulated this central orienting bias. However, when the orientation of the peripheral objects was manipulated, only the peripheral objects' semantic relationships influenced gaze control. Together, these findings suggest that functional relationships play an important role in the allocation of gaze, and can interact with semantic relationships to determine gaze control.

Learning how to exploit sources of information.

How is our strategy for forming memories shaped by experience with a task? Previous work using surprise questions (i.e., unexpected by the participant) has shown a remarkable inability to report attributes of an attended target in a search display. This representational poverty presumably reflects a form of information exploitation, in which control processes specialize the conversion of available information into memory representations. We hypothesize that such control is refined by repeated experience with a task, and as a result, memory representations will specialize as task experience accrues, such that report accuracy for an unexpected question will progressively worsen as the number of preceding trials increases. To test this, subjects were asked to report the location of a letter among three digits. The ability to respond correctly to a surprise question about the identity of that letter became worse as the experiment progressed. A follow-up study evaluated whether this incremental worsening of report accuracy could be explained as a buildup of proactive interference by varying the set of letters for the surprise test. The results were unchanged relative to the original experiment, which argues against a primary contribution of proactive interference in the worsening performance. The effect was replicated in a similar paradigm using color disks. These findings illustrate that repeated performance of a prescriptive task engages an adaptive modification of control processes that focus information processing on specific attributes of a stimulus that are expected to be necessary in the future, regardless of their immediate task relevance.

Semantic and functional relationships among objects increase the capacity of visual working memory.

Visual working memory (VWM) has a limited capacity of approximately 3-4 visual objects. Current theories of VWM propose that a limited pool of resources can be flexibly allocated to objects, allowing them to be represented at varying levels of precision. Factors that influence the allocation of these resources, such as the complexity and perceptual grouping of objects, can thus affect the capacity of VWM. We sought to identify whether semantic and functional relationships between objects could influence the grouping of objects, thereby increasing the functional capacity of VWM. Observers viewed arrays of 8 to-be-remembered objects arranged into 4 pairs. We manipulated both the semantic association and functional interaction between the objects, then probed participants' memory for the arrays. When objects were semantically related, participants' memory for the arrays improved. Participants' memory further improved when semantically related objects were positioned to interact with each other. However, when we increased the spacing between the objects in each pair, the benefits of functional but not semantic relatedness were eliminated. These findings suggest that action-relevant properties of objects can increase the functional capacity of VWM, but only when objects are positioned to directly interact with each other. (PsycINFO Database Record