Foreground bias: Semantic consistency effects modulated when searching across depth.

When processing visual scenes, we tend to prioritize information in the foreground, often at the expense of background information. The foreground bias has been supported by data demonstrating that there are more fixations to foreground, and faster and more accurate detection of targets embedded in foreground. However, it is also known that semantic consistency is associated with more efficient search. Here, we examined whether semantic context interacts with foreground prioritization, either amplifying or mitigating the effect of target semantic consistency. For each scene, targets were placed in the foreground or background and were either semantically consistent or inconsistent with the context of immediately surrounding depth region. Results indicated faster response times (RTs) for foreground and semantically consistent targets, replicating established effects. More importantly, we found the magnitude of the semantic consistency effect was significantly smaller in the foreground than background region. To examine the robustness of this effect, in Experiment 2, we strengthened the reliability of semantics by increasing the proportion of targets consistent with the scene region to 80%. We found the overall results pattern to replicate the incongruous effect of semantic consistency across depth observed in Experiment 1. This suggests foreground bias modulates the effects of semantics so that performance is less impacted in near space.

Visual search for reach targets in actionable space is influenced by movement costs imposed by obstacles.

Real world search tasks often involve action on a target object once it has been located. However, few studies have examined whether movement-related costs associated with acting on located objects influence visual search. Here, using a task in which participants reached to a target object after locating it, we examined whether people take into account obstacles that increase movement-related costs for some regions of the reachable search space but not others. In each trial, a set of 36 objects (4 targets and 32 distractors) were displayed on a vertical screen and participants moved a cursor to a target after locating it. Participants had to fixate on an object to determine whether it was a target or distractor. A rectangular obstacle, of varying length, location, and orientation, was briefly displayed at the start of the trial. Participants controlled the cursor by moving the handle of a robotic manipulandum in a horizontal plane. The handle applied forces to simulate contact between the cursor and the unseen obstacle. We found that search, measured using eye movements, was biased to regions of the search space that could be reached without moving around the obstacle. This result suggests that when deciding where to search, people can incorporate the physical structure of the environment so as to reduce the movement-related cost of subsequently acting on the located target.

The influence of movement-related costs when searching to act and acting to search.

Real-world search behavior often involves limb movements, either during search or after search. Here we investigated whether movement-related costs influence search behavior in two kinds of search tasks. In our visual search tasks, participants made saccades to find a target object among distractors and then moved a cursor, controlled by the handle of a robotic manipulandum, to the target. In our manual search tasks, participants moved the cursor to perform the search, placing it onto objects to reveal their identity as either a target or a distractor. In all tasks, there were multiple targets. Across experiments, we manipulated either the effort or time costs associated with movement such that these costs varied across the search space. We varied effort by applying different resistive forces to the handle, and we varied time costs by altering the speed of the cursor. Our analysis of cursor and eye movements during manual and visual search, respectively, showed that effort influenced manual search but did not influence visual search. In contrast, time costs influenced both visual and manual search. Our results demonstrate that, in addition to perceptual and cognitive factors, movement-related costs can also influence search behavior.NEW & NOTEWORTHY Numerous studies have investigated the perceptual and cognitive factors that influence decision making about where to look, or move, in search tasks. However, little is known about how search is influenced by movement-related costs associated with acting on an object once it has been visually located or acting during manual search. In this article, we show that movement time costs can bias visual and manual search and that movement effort costs bias manual search.

The Foreground Bias: Initial Scene Representations Across the Depth Plane.

When you walk into a large room, you perceive visual information that is both close to you in depth and farther in the background. Here, we investigated how initial scene representations are affected by information across depth. We examined the role of background and foreground information on scene gist by using chimera scenes (images with a foreground and background from different scene categories). Across three experiments, we found a foreground bias: Information in the foreground initially had a strong influence on the interpretation of the scene. This bias persisted when the initial fixation position was on the scene background and when the task was changed to emphasize scene information. We concluded that the foreground bias arises from initial processing of scenes for understanding and suggests that scene information closer to the observer is initially prioritized. We discuss the implications for theories of scene and depth perception.

Rethinking Space: A Review of Perception, Attention, and Memory in Scene Processing.

Scene processing is fundamentally influenced and constrained by spatial layout and spatial associations with objects. However, semantic information has played a vital role in propelling our understanding of real-world scene perception forward. In this article, we review recent advances in assessing how spatial layout and spatial relations influence scene processing. We examine the organization of the larger environment and how we take full advantage of spatial configurations independently of semantic information. We demonstrate that a clear differentiation of spatial from semantic information is necessary to advance research in the field of scene processing.

The Changing Landscape: High-Level Influences on Eye Movement Guidance in Scenes.

The use of eye movements to explore scene processing has exploded over the last decade. Eye movements provide distinct advantages when examining scene processing because they are both fast and spatially measurable. By using eye movements, researchers have investigated many questions about scene processing. Our review will focus on research performed in the last decade examining: (1) attention and eye movements; (2) where you look; (3) influence of task; (4) memory and scene representations; and (5) dynamic scenes and eye movements. Although typically addressed as separate issues, we argue that these distinctions are now holding back research progress. Instead, it is time to examine the intersections of these seemingly separate influences and examine the intersectionality of how these influences interact to more completely understand what eye movements can tell us about scene processing.

Attentional capture is contingent on scene region: Using surface guidance framework to explore attentional mechanisms during search.

Studies have established that scene context guides attention during visual search, but it is not yet clear how. In this study, we examined how attention is deployed across scenes using an attentional capture paradigm. Using the Surface Guidance Framework (Castelhano & Pereira, 2019), we defined target-relevant and target-irrelevant scene regions for each target object and compared how attentional capture of a suddenly onsetting distractor differs for object and letter searches. We found an enhancement of capture effects when distractors appeared within target-relevant regions, with greater proportions of distractors fixated and greater proportions of saccades made toward the distractor for object searches, but not for letter searches. Thus, attention in the real world can be flexibly and spatially distributed on the basis of contextual information, with the Surface Guidance Framework presenting a powerful tool for exploring attentional guidance in real-world scenes.

Examining the hierarchical nature of scene representations in memory.

How are scene representations stored in memory? Researchers have often posited that scene representations have a hierarchical structure with background elements providing a scaffold for more detailed foreground elements. To further investigate scene representation and the role of background and foreground information, we introduced a new stimulus set: chimera scenes, which have the central block of objects belonging to one scene category (foreground), and the surrounding structure belonging to another (background). We used a contextual cueing paradigm and emphasized the relative importance of each by having the target placed on either the background or foreground. In a transfer block, we found that though changes to the background were highly detrimental to search performance for background targets, search performance was only slightly affected by changes to either the foreground or the background for foreground targets. These results indicate that rather than a fixed hierarchy, the structure of scene representations are more aptly captured by a parallel model that stores information flexibly. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The influence of scene context on parafoveal processing of objects.

Many studies in reading have shown the enhancing effect of context on the processing of a word before it is directly fixated (parafoveal processing of words). Here, we examined whether scene context influences the parafoveal processing of objects and enhances the extraction of object information. Using a modified boundary paradigm called the Dot-Boundary paradigm, participants fixated on a suddenly onsetting cue before the preview object would onset 4° away. The preview object could be identical to the target, visually similar, visually dissimilar or a control (black rectangle). The preview changed to the target object once a saccade toward the object was made. Critically, the objects were presented on either a consistent or an inconsistent scene background. Results revealed that there was a greater processing benefit for consistent than inconsistent scene backgrounds and that identical and visually similar previews produced greater processing benefits than other previews. In the second experiment, we added an additional context condition in which the target location was inconsistent, but the scene semantics remained consistent. We found that changing the location of the target object disrupted the processing benefit derived from the consistent context. Most importantly, across both experiments, the effect of preview was not enhanced by scene context. Thus, preview information and scene context appear to independently boost the parafoveal processing of objects without any interaction from object-scene congruency.

Linking contemporary research to the classics: Celebrating 125 years at APA.

APA is celebrating 125 years this year and at the journal we are commemorating this milestone with a special issue. The inspiration came from our editorial team, who wished to acknowledge the links between game-changing articles that have influenced our research community in the past-we call them classics for short-and contemporary works. The main idea was to feature the work of nine contemporary research teams, while at the same time drawing readers' attention to their links with the classics. In this introduction, we have organized the articles according to several broad themes: active perception, perception for action, action alters perception, perception of our bodies in action, and acting on selective perceptions. As all who have read and contributed to the journal over the past few years have come to realize, it is no longer possible to study perception without considering its role in action. Nor is it possible to study action (formerly called performance, as reflected in the journal title) without understanding the perceptual contributions to action. These nine articles each exemplify, in their own way, how these dynamic interactions play out in contemporary research in our field. (PsycINFO Database Record

How You Use It Matters: Object Function Guides Attention During Visual Search in Scenes.

How does one know where to look for objects in scenes? Objects are seen in context daily, but also used for specific purposes. Here, we examined whether an object's function can guide attention during visual search in scenes. In Experiment 1, participants studied either the function (function group) or features (feature group) of a set of invented objects. In a subsequent search, the function group located studied objects faster than novel (unstudied) objects, whereas the feature group did not. In Experiment 2, invented objects were positioned in locations that were either congruent or incongruent with the objects' functions. Search for studied objects was faster for function-congruent locations and hampered for function-incongruent locations, relative to search for novel objects. These findings demonstrate that knowledge of object function can guide attention in scenes, and they have important implications for theories of visual cognition, cognitive neuroscience, and developmental and ecological psychology.

Looking, seeing and believing in autism: Eye movements reveal how subtle cognitive processing differences impact in the social domain.

Adults with High Functioning Autism Spectrum Disorders (ASD) viewed scenes with people in them, while having their eye movements recorded. The task was to indicate, using a button press, whether the pictures were normal, or in some way weird or odd. Oddities in the pictures were categorized as violations of either perceptual or social norms. Compared to a Typically Developed (TD) control group, the ASD participants were equally able to categorize the scenes as odd or normal, but they took longer to respond. The eye movement patterns showed that the ASD group made more fixations and revisits to the target areas in the odd scenes compared with the TD group. Additionally, when the ASD group first fixated the target areas in the scenes, they failed to initially detect the social oddities. These two findings have clear implications for processing difficulties in ASD for the social domain, where it is important to detect social cues on-line, and where there is little opportunity to go back and recheck possible cues in fast dynamic interactions. Autism Res 2016, 9: 879-887. © 2015 International Society for Autism Research, Wiley Periodicals, Inc.

Movement coordination during conversation.

Behavioral coordination and synchrony contribute to a common biological mechanism that maintains communication, cooperation and bonding within many social species, such as primates and birds. Similarly, human language and social systems may also be attuned to coordination to facilitate communication and the formation of relationships. Gross similarities in movement patterns and convergence in the acoustic properties of speech have already been demonstrated between interacting individuals. In the present studies, we investigated how coordinated movements contribute to observers' perception of affiliation (friends vs. strangers) between two conversing individuals. We used novel computational methods to quantify motor coordination and demonstrated that individuals familiar with each other coordinated their movements more frequently. Observers used coordination to judge affiliation between conversing pairs but only when the perceptual stimuli were restricted to head and face regions. These results suggest that observed movement coordination in humans might contribute to perceptual decisions based on availability of information to perceivers.

Peripheral guidance in scenes: The interaction of scene context and object content.

In the present study, we examined how gaze guidance is affected by immediately available information in the periphery and investigated how search strategies differed across manipulations in the availability of scene context and object content information. Across 3 experiments, participants performed a visual search task in scenes while using a gaze-contingent moving-window paradigm. Extrafoveal information was manipulated across conditions to examine the contributions of object content, scene context, or some combination of the two. Experiment 1 demonstrated a possible interaction between scene context and object content information in improving guidance. Experiments 2 and 3 supported the notion that object content is selected for further scrutiny based on its position within scene context. These results suggest a prioritization of object information based on scene context, such that contextual information acts as a framework in the selection of relevant regions, and object information can then affect which specific locations in those regions are selected for further examination.

I spy with my little eye: cognitive processing of framed physical activity messages.

The primary purpose was to examine the relative cognitive processing of gain-framed versus loss-framed physical activity messages following exposure to health risk information. Guided by the Extended Parallel Process Model, the secondary purpose was to examine the relation between dwell time, message recall, and message-relevant thoughts, as well as perceived risk, personal relevance, and fear arousal. Baseline measures of perceived risk for inactivity-related disease and health problems were administered to 77 undergraduate students. Participants read population-specific health risk information while wearing a head-mounted eye tracker, which measured dwell time on message content. Perceived risk was then reassessed. Next, participants read PA messages while the eye tracker measured dwell time on message content. Immediately following message exposure, recall, thought-listing, fear arousal, and personal relevance were measured. Dwell time on gain-framed messages was significantly greater than loss-framed messages. However, message recall and thought-listing did not differ by message frame. Dwell time was not significantly related to recall or thought-listing. Consistent with the Extended Parallel Process Model, fear arousal was significantly related to recall, thought-listing, and personal relevance. In conclusion, gain-framed messages may evoke greater dwell time than loss-famed messages. However, dwell time alone may be insufficient for evoking further cognitive processing.

The art of gaze guidance.

An ongoing challenge in scene perception is identifying the factors that influence how we explore our visual world. By using multiple versions of paintings as a tool to control for high-level influences, we show that variation in the visual details of a painting causes differences in observers' gaze despite constant task and content. Further, we show that by switching locations of highly salient regions through textural manipulation, a corresponding switch in eye movement patterns is observed. Our results present the finding that salient regions and gaze behavior are not simply correlated; variation in saliency through textural differences causes an observer to direct their viewing accordingly. This work demonstrates the direct contribution of low-level factors in visual exploration by showing that examination of a scene, even for aesthetic purposes, can be easily manipulated by altering the low-level properties and hence, the saliency of the scene.

Eye movements reveal no immediate "WOW" ("which one's weird") effect in autism spectrum disorder.

Autism spectrum disorder (ASD) and typically developed (TD) adult participants viewed pairs of scenes for a simple "spot the difference" (STD) and a complex "which one's weird" (WOW) task. There were no group differences in the STD task. In the WOW task, the ASD group took longer to respond manually and to begin fixating the target "weird" region. Additionally, as indexed by the first-fixation duration into the target region, the ASD group failed to "pick up" immediately on what was "weird". The findings are discussed with reference to the complex information processing theory of ASD (Minshew & Goldstein, 1998 ).

Scene context influences without scene gist: eye movements guided by spatial associations in visual search.

Although the use of semantic information about the world seems ubiquitous in every task we perform, it is not clear whether we rely on a scene's semantic information to guide attention when searching for something in a specific scene context (e.g., keys in one's living room). To address this question, we compared contribution of a scene's semantic information (i.e., scene gist) versus learned spatial associations between objects and context. Using the flash-preview-moving-window paradigm Castelhano and Henderson (Journal of Experimental Psychology: Human Perception and Performance 33:753-763, 2007), participants searched for target objects that were placed in either consistent or inconsistent locations and were semantically consistent or inconsistent with the scene gist. The results showed that learned spatial associations were used to guide search even in inconsistent contexts, providing evidence that scene context can affect search performance without consistent scene gist information. We discuss the results in terms of hierarchical organization of top-down influences of scene context.

Eye Movement Sequences during Simple versus Complex Information Processing of Scenes in Autism Spectrum Disorder.

Minshew and Goldstein (1998) postulated that autism spectrum disorder (ASD) is a disorder of complex information processing. The current study was designed to investigate this hypothesis. Participants with and without ASD completed two scene perception tasks: a simple "spot the difference" task, where they had to say which one of a pair of pictures had a detail missing, and a complex "which one's weird" task, where they had to decide which one of a pair of pictures looks "weird". Participants with ASD did not differ from TD participants in their ability to accurately identify the target picture in both tasks. However, analysis of the eye movement sequences showed that participants with ASD viewed scenes differently from normal controls exclusively for the complex task. This difference in eye movement patterns, and the method used to examine different patterns, adds to the knowledge base regarding eye movements and ASD. Our results are in accordance with Minshew and Goldstein's theory that complex, but not simple, information processing is impaired in ASD.

Eye movements of older and younger readers when reading disappearing text.

Older and younger readers read sentences in which target words were masked 40 to 60 ms after fixation onset. Masking only the target word caused more disruption than did masking each word in the sentence, and this effect was stronger for the younger readers than for the older readers. Although older readers had longer eye fixations than did younger readers, the results indicated that the masking effect was comparable for the 2 groups. However, for both groups, how long the eyes remained in place was strongly influenced by the frequency of the fixated word (even though it had been rapidly replaced by the mask and was no longer there when the eyes did move). This is compelling evidence that for both older and younger readers, cognitive/lexical processing has a very strong influence on when the eyes move in reading.