Cognitive and neural bases of visual-context-guided decision-making.

Humans adjust their behavioral strategies based on feedback, a process that may depend on intrinsic preferences and contextual factors such as visual salience. In this study, we hypothesized that decision-making based on visual salience is influenced by habitual and goal-directed processes, which can be evidenced by changes in attention and subjective valuation systems. To test this hypothesis, we conducted a series of studies to investigate the behavioral and neural mechanisms underlying visual salience-driven decision-making. We first established the baseline behavioral strategy without salience in Experiment 1 (n = 21). We then highlighted the utility or performance dimension of the chosen outcome using colors in Experiment 2 (n = 30). We demonstrated that the difference in staying frequency increased along the salient dimension, confirming a salience effect. Furthermore, the salience effect was abolished when directional information was removed in Experiment 3 (n = 28), suggesting that the salience effect is feedback-specific. To generalize our findings, we replicated the feedback-specific salience effects using eye-tracking and text emphasis. The fixation differences between the chosen and unchosen values were enhanced along the feedback-specific salient dimension in Experiment 4 (n = 48) but unchanged after removing feedback-specific information in Experiment 5 (n = 32). Moreover, the staying frequency was correlated with fixation properties, confirming that salience guides attention deployment. Lastly, our neuroimaging study (Experiment 6, n = 25) showed that the striatum subregions encoded salience-based outcome evaluation, while the vmPFC encoded salience-based behavioral adjustments. The connectivity of the vmPFC-ventral striatum accounted for individual differences in utility-driven, whereas the vmPFC-dmPFC for performance-driven behavioral adjustments. Together, our results provide a neurocognitive account of how task-irrelevant visual salience drives decision-making by involving attention and the frontal-striatal valuation systems. PUBLIC SIGNIFICANCE STATEMENT: Humans may use the current outcome to make behavior adjustments. How this occurs may depend on stable individual preferences and contextual factors, such as visual salience. Under the hypothesis that visual salience determines attention and subsequently modulates subjective valuation, we investigated the underlying behavioral and neural bases of visual-context-guided outcome evaluation and behavioral adjustments. Our findings suggest that the reward system is orchestrated by visual context and highlight the critical role of attention and the frontal-striatal neural circuit in visual-context-guided decision-making that may involve habitual and goal-directed processes.

The effect of narrative coherence and visual salience on children's and adults' gaze while watching video.

Low-level visual features (e.g., motion, contrast) predict eye gaze during video viewing. The current study investigated the effect of narrative coherence on the extent to which low-level visual salience predicts eye gaze. Eye movements were recorded as 4-year-olds (n = 20) and adults (n = 20) watched a cohesive versus random sequence of video shots from a 4.5-min full vignette from Sesame Street. Overall, visual salience was a stronger predictor of gaze in adults than in children, especially when viewing a random shot sequence. The impact of narrative coherence on children's gaze was limited to the short period of time surrounding cuts to new video shots. The discussion considers potential direct effects of visual salience as well as incidental effects due to overlap between salient features and semantic content. The findings are also discussed in the context of developing video comprehension.

Atomic Magnetometer Achieves Visual Salience Analysis in Drosophila.

An atomic magnetometer (AM) was used to non-invasively detect the tiny magnetic field generated by the brain of a single Drosophila. Combined with a visual stimulus system, the AM was used to study the relationship between visual salience and oscillatory activity of the Drosophila brain by analyzing changes in the magnetic field. Oscillatory activity of Drosophila in the 1-20 Hz frequency band was measured with a sensitivity of 20 fT/Hz. The field in the 20-30 Hz band under periodic light stimulation was used to explore the correlation between short-term memory and visual salience. Our method opens a new path to a more flexible method for the investigation of brain activity in Drosophila and other small insects.

Individual differences in visual salience vary along semantic dimensions.

What determines where we look? Theories of attentional guidance hold that image features and task demands govern fixation behavior, while differences between observers are interpreted as a "noise-ceiling" that strictly limits predictability of fixations. However, recent twin studies suggest a genetic basis of gaze-trace similarity for a given stimulus. This leads to the question of how individuals differ in their gaze behavior and what may explain these differences. Here, we investigated the fixations of >100 human adults freely viewing a large set of complex scenes containing thousands of semantically annotated objects. We found systematic individual differences in fixation frequencies along six semantic stimulus dimensions. These differences were large (>twofold) and highly stable across images and time. Surprisingly, they also held for first fixations directed toward each image, commonly interpreted as "bottom-up" visual salience. Their perceptual relevance was documented by a correlation between individual face salience and face recognition skills. The set of reliable individual salience dimensions and their covariance pattern replicated across samples from three different countries, suggesting they reflect fundamental biological mechanisms of attention. Our findings show stable individual differences in salience along a set of fundamental semantic dimensions and that these differences have meaningful perceptual implications. Visual salience reflects features of the observer as well as the image.

Body camera footage leads to lower judgments of intent than dash camera footage.

Police departments use body-worn cameras (body cams) and dashboard cameras (dash cams) to monitor the activity of police officers in the field. Video from these cameras informs review of police conduct in disputed circumstances, often with the goal of determining an officer's intent. Eight experiments (N = 2,119) reveal that body cam video of an incident results in lower observer judgments of intentionality than dash cam video of the same incident, an effect documented with both scripted videos and real police videos. This effect was due, in part, to variation in the visual salience of the focal actor: the body cam wearer is typically less visually salient when depicted in body versus dash cam video, which corresponds with lower observer intentionality judgments. In showing how visual salience of the focal actor may introduce unique effects on observer judgment, this research establishes an empirical platform that may inform public policy regarding surveillance of police conduct.

Amygdala lesions eliminate viewing preferences for faces in rhesus monkeys.

In free-viewing experiments, primates orient preferentially toward faces and face-like stimuli. To investigate the neural basis of this behavior, we measured the spontaneous viewing preferences of monkeys with selective bilateral amygdala lesions. The results revealed that when faces and nonface objects were presented simultaneously, monkeys with amygdala lesions had no viewing preference for either conspecific faces or illusory facial features in everyday objects. Instead of directing eye movements toward socially relevant features in natural images, we found that, after amygdala loss, monkeys are biased toward features with increased low-level salience. We conclude that the amygdala has a role in our earliest specialized response to faces, a behavior thought to be a precursor for efficient social communication and essential for the development of face-selective cortex.

A Comparison of Bottom-Up Models for Spatial Saliency Predictions in Autonomous Driving.

Bottom-up saliency models identify the salient regions of an image based on features such as color, intensity and orientation. These models are typically used as predictors of human visual behavior and for computer vision tasks. In this paper, we conduct a systematic evaluation of the saliency maps computed with four selected bottom-up models on images of urban and highway traffic scenes. Saliency both over whole images and on object level is investigated and elaborated in terms of the energy and the entropy of the saliency maps. We identify significant differences with respect to the amount, size and shape-complexity of the salient areas computed by different models. Based on these findings, we analyze the likelihood that object instances fall within the salient areas of an image and investigate the agreement between the segments of traffic participants and the saliency maps of the different models. The overall and object-level analysis provides insights on the distinctive features of salient areas identified by different models, which can be used as selection criteria for prospective applications in autonomous driving such as object detection and tracking.

Memories Fade: The Relationship Between Memory Vividness and Remembered Visual Salience.

Past events, particularly emotional experiences, are often vividly recollected. However, it remains unclear how qualitative information, such as low-level visual salience, is reconstructed and how the precision and bias of this information relate to subjective memory vividness. Here, we tested whether remembered visual salience contributes to vivid recollection. In three experiments, participants studied emotionally negative and neutral images that varied in luminance and color saturation, and they reconstructed the visual salience of each image in a subsequent test. Results revealed, unexpectedly, that memories were recollected as less visually salient than they were encoded, demonstrating a novel memory-fading effect, whereas negative emotion increased subjective memory vividness and the precision with which visual features were encoded. Finally, memory vividness tracked both the precision and remembered salience (bias) of visual information. These findings provide evidence that low-level visual information fades in memory and contributes to the experience of vivid recollection.

Arousal (but not valence) amplifies the impact of salience.

Previous findings indicate that negative arousal enhances bottom-up attention biases favouring perceptual salient stimuli over less salient stimuli. The current study tests whether those effects were driven by emotional arousal or by negative valence by comparing how well participants could identify visually presented letters after hearing either a negative arousing, positive arousing or neutral sound. On each trial, some letters were presented in a high contrast font and some in a low contrast font, creating a set of targets that differed in perceptual salience. Sounds rated as more emotionally arousing led to more identification of highly salient letters but not of less salient letters, whereas sounds' valence ratings did not impact salience biases. Thus, arousal, rather than valence, is a key factor enhancing visual processing of perceptually salient targets.

Visual salience of the stop-signal affects movement suppression process.

We investigated how the ability to suppress an impending movement is affected by the visual salience of the stop-signal in a reaching countermanding task. We found that when the stop-signal was easy to detect, stop performance was better than when the stop-signal was difficult to detect. In an exploratory analysis, we also found that the change in salience of the stop-signal can have an effect on the speed of response in trials following the stop-signal. This effect occurred together with strategic slowing down after an error in inhibiting was committed and together with a repetition priming effect due to the stop-signal presented in the previous trial. Our results suggest the need to investigate more in depth the afferent processing stage of the inhibitory control of movement and how task demands can affect its functioning.

Reading the landscape: Legible environments and hominin dispersals.

Wayfinding, or the ability to plan and navigate a course over the landscape, is a subject of investigation in geography, neurophysiology, psychology, urban planning, and landscape design. With the prevalence of GPS-assisted navigation systems, or "wayfinders," computer scientists are also increasingly interested in understanding how people plan their movements and guide others. However, the importance of wayfinding as a process that regulates human mobility has only recently been incorporated into archeological research design. Hominin groups were able to disperse widely during the course of prehistory. The scope of these dispersals speaks to the innate navigation abilities of hominins. Their long-term success must have depended on an ability to communicate spatial information effectively. Here, we consider the extent to which some landscapes may have been more conducive to wayfinding than others. We also describe a tool we have created for quantifying landscape legibility (sensu Gollege), a complex and under-explored concept in archeology, with a view to investigating the impact of landscape structure on human wayfinding and thus, patterns of dispersal during prehistory. To this end, we have developed a method for quantifying legibility using a Geographic Information System (GIS) and apply it to a test case in prehistoric Iberia.

Corrigendum: Giving good directions: order of mention reflects visual salience.

[This corrects the article DOI: 10.3389/fpsyg.2015.01793.].

Corrigendum: Where's Wally: the influence of visual salience on referring expression generation.

[This corrects the article DOI: 10.3389/fpsyg.2013.00329.].

The interaction of top-down and bottom-up attention in visual working memory.

Understanding the interplay between top-down and bottom-up attention in visual working memory (VWM) is crucial, although the specific challenges arising from this interaction remain ambiguous. In this study, we address this complexity by examining how cue informativeness and probe status of the salient items influence this interaction. Through three experiments, we manipulated top-down attention by varying probe frequencies using pre-cues and bottom-up attention by varying the visual salience of memory items. Experiment 1 explored cue informativeness at 100% and 50%, while Experiments 2 and 3 maintained cue informativeness at 80% and 50%. Additionally, Experiment 1 tested a few of the salient items, Experiment 2 excluded them, and Experiment 3 tested half of them in each cue condition. Across all experiments, we consistently observed cueing benefits for cue-directed items, albeit with costs to non-cued items. Furthermore, cue informativeness and the probe status of salient items emerged as critical factors influencing the interaction between top-down and bottom-up attention in VWM. These findings underscore the pivotal roles of cue informativeness and salient item relevance in shaping the dynamics of top-down and bottom-up attention within VWM.

Does task-irrelevant music affect gaze allocation during real-world scene viewing?

Gaze control manifests from a dynamic integration of visual and auditory information, with sound providing important cues for how a viewer should behave. Some past research suggests that music, even if entirely irrelevant to the current task demands, may also sway the timing and frequency of fixations. The current work sought to further assess this idea as well as investigate whether task-irrelevant music could also impact how gaze is spatially allocated. In preparation for a later memory test, participants studied pictures of urban scenes in silence or while simultaneously listening to one of two types of music. Eye tracking was recorded, and nine gaze behaviors were measured to characterize the temporal and spatial aspects of gaze control. Findings showed that while these gaze behaviors changed over the course of viewing, music had no impact. Participants in the music conditions, however, did show better memory performance than those who studied in silence. These findings are discussed within theories of multimodal gaze control.

Perceptual salience influences food choices independently of health and taste preferences.

BACKGROUND: Making decisions about food is a critical part of everyday life and a principal concern for a number of public health issues. Yet, the mechanisms involved in how people decide what to eat are not yet fully understood. Here, we examined the role of visual attention in healthy eating intentions and choices. We conducted two-alternative forced choice tests of competing food stimuli that paired healthy and unhealthy foods that varied in taste preference. We manipulated their perceptual salience such that, in some cases, one food item was more perceptually salient than the other. In addition, we manipulated the cognitive load and time pressure to test the generalizability of the salience effect. RESULTS: Manipulating salience had a powerful effect on choice in all situations; even when an unhealthy but tastier food was presented as an alternative, healthy food options were selected more often when they were perceptually salient. Moreover, in a second experiment, food choices on one trial impacted food choices on subsequent trials; when a participant chose the healthy option, they were more likely to choose a healthy option again on the next trial. Furthermore, robust effects of salience on food choice were observed across situations of high cognitive load and time pressure. CONCLUSIONS: These results have implications both for understanding the mechanisms of food-related decision-making and for implementing interventions that might make it easier for people to make healthy eating choices.

A crowd of emotional voices influences the perception of emotional faces: Using adaptation, stimulus salience, and attention to probe audio-visual interactions for emotional stimuli.

Correctly assessing the emotional state of others is a crucial part of social interaction. While facial expressions provide much information, faces are often not viewed in isolation, but occur with concurrent sounds, usually voices, which also provide information about the emotion being portrayed. Many studies have examined the crossmodal processing of faces and sounds, but results have been mixed, with different paradigms yielding different results. Using a psychophysical adaptation paradigm, we carried out a series of four experiments to determine whether there is a perceptual advantage when faces and voices match in emotion (congruent), versus when they do not match (incongruent). We presented a single face and a crowd of voices, a crowd of faces and a crowd of voices, a single face of reduced salience and a crowd of voices, and tested this last condition with and without attention directed to the emotion in the face. While we observed aftereffects in the hypothesized direction (adaptation to faces conveying positive emotion yielded negative, contrastive, perceptual aftereffects), we only found a congruent advantage (stronger adaptation effects) when faces were attended and of reduced salience, in line with the theory of inverse effectiveness.

Interpreting Estonian Demonstratives: The Effects of Referent's Distance and Visual Salience.

Most of the research done with spatial demonstratives (words such as this, here and that, there) have focused on the production, not the interpretation, of these words. In addition, emphasis has been largely on demonstrative pronouns, leaving demonstrative adverbs with relatively little research attention. The present study explores the interpretation of both demonstrative pronouns and demonstrative adverbs in Estonian-a Finno-Ugric language with two dialectal-specific demonstrative pronoun systems. In the South-Estonian (SE) dialectal region, two demonstrative pronouns, see-"this" and too-"that", are used. In the North-Estonian (NE) region, only one, see-"this/that", is used. The aim of this study is twofold. First, we test if the distance and the visual salience of a referent have an effect on the interpretation of demonstratives. Second, we explore if there is a difference in the interpretation of demonstratives between native speakers from SE and NE. We used an interpretation experiment with 30 participants per group (total n = 60) and compared the SE and NE group responses. The results clearly show that the distance of the referent has an effect on how demonstratives are interpreted across the two groups, while the effect of visual salience is inconclusive. There is also a difference in the interpretation of demonstratives between the two dialectal groups. When using the Estonian with an influence of the SE dialect, the NE speakers rely on demonstrative adverbs in interpreting the referential utterance that includes demonstrative pronoun and adverb combinations, whereas the SE speakers also take into account the semantics of demonstrative pronouns. We show that, in addition to an already known difference in the production, there is also a difference in the interpretation of demonstratives between the two groups. In addition, our findings support the recognition that languages that have distance neutral demonstrative pronouns enforce the spatial meaning of a referring utterance by adding demonstrative adverbs. Not only is the interpretation of demonstrative pronouns affected, but the interpretation of demonstrative adverbs as well. The latter shows the importance of studying adverbs also, not just pronouns, and contributes to further knowledge of how demonstratives function.

Validity, reliability, and psychometric properties of a computerized, cognitive assessment test (Cognivue®).

BACKGROUND: Cognitive issues such as Alzheimer's disease and other dementias confer a substantial negative impact. Problems relating to sensitivity, subjectivity, and inherent bias can limit the usefulness of many traditional methods of assessing cognitive impairment. AIM: To determine cut-off scores for classification of cognitive impairment, and assess Cognivue® safety and efficacy in a large validation study. METHODS: Adults (age 55-95 years) at risk for age-related cognitive decline or dementia were invited via posters and email to participate in two cohort studies conducted at various outpatient clinics and assisted- and independent-living facilities. In the cut-off score determination study (n = 92), optimization analyses by positive percent agreement (PPA) and negative percent agreement (NPA), and by accuracy and error bias were conducted. In the clinical validation study (n = 401), regression, rank linear regression, and factor analyses were conducted. Participants in the clinical validation study also completed other neuropsychological tests. RESULTS: For the cut-off score determination study, 92 participants completed St. Louis University Mental Status (SLUMS, reference standard) and Cognivue® tests. Analyses showed that SLUMS cut-off scores of < 21 (impairment) and > 26 (no impairment) corresponded to Cognivue® scores of 54.5 (NPA = 0.92; PPA = 0.64) and 78.5 (NPA = 0.5; PPA = 0.79), respectively. Therefore, conservatively, Cognivue® scores of 55-64 corresponded to impairment, and 74-79 to no impairment. For the clinical validation study, 401 participants completed ≥ 1 testing session, and 358 completed 2 sessions 1-2 wk apart. Cognivue® classification scores were validated, demonstrating good agreement with SLUMS scores (weighted κ 0.57; 95%CI: 0.50-0.63). Reliability analyses showed similar scores across repeated testing for Cognivue® (R 2 = 0.81; r = 0.90) and SLUMS (R 2 = 0.67; r = 0.82). Psychometric validity of Cognivue® was demonstrated vs. traditional neuropsychological tests. Scores were most closely correlated with measures of verbal processing, manual dexterity/speed, visual contrast sensitivity, visuospatial/executive function, and speed/sequencing. CONCLUSION: Cognivue® scores ≤ 50 avoid misclassification of impairment, and scores ≥ 75 avoid misclassification of unimpairment. The validation study demonstrates good agreement between Cognivue® and SLUMS; superior reliability; and good psychometric validity.

Camouflage pattern features interact with movement speed to determine human target detectability.

Applied ergonomics research examines not only the fit, form and function of military uniforms, but also their ability to effectively camouflage personnel as they perform job-related tasks. Many of these job-related tasks involve moving through environments, but existing literature examining camouflage effectiveness often assumes that movement effectively "breaks" even the best camouflage patterns, rendering them of limited utility for reducing the visual signature of a moving target. However, recent research demonstrates that animals equipped with adaptive camouflage change their patterning in predictable ways during movement and this adaptation decreases detectability, suggesting that uniform patterning may still hold value for reducing conspicuity during movement. The present experiment examined whether three visual pattern characteristics, local contrast, orientation, and spatial frequency, would influence the detectability of a moving human target. Participants attempted to detect and localize a simulated human target moving across a background scene, and a factorial design varied target movement speed, and the local contrast, spatial frequency, and orientation of its camouflage patterning. Results showed that target detectability was strongly influenced by target movement rate, pattern local contrast, and pattern spatial frequency, and these effects persisted even under conditions of very fast movement. Importantly, we found that the effect of local contrast was most robust under conditions of movement, suggesting its importance for reducing detectability of moving personnel. We conclude that movement is not always sufficient to break the concealment offered by a pattern with low contrast and a spatial frequency match with its background. Results are discussed in the context of visual processing theories and the application of these findings to the design and development of static and adaptive camouflage patterns for military personnel.