The addition of a spatial auditory cue improves spatial updating in a virtual reality navigation task.

Auditory cues are integrated with vision and body-based self-motion cues for motion perception, balance, and gait, though limited research has evaluated their effectiveness for navigation. Here, we tested whether an auditory cue co-localized with a visual target could improve spatial updating in a virtual reality homing task. Participants navigated a triangular homing task with and without an easily localizable spatial audio signal co-located with the home location. The main outcome was unsigned angular error, defined as the absolute value of the difference between the participant's turning response and the correct response towards the home location. Angular error was significantly reduced in the presence of spatial sound compared to a head-fixed identical auditory signal. Participants' angular error was 22.79° in the presence of spatial audio and 30.09° in its absence. Those with the worst performance in the absence of spatial sound demonstrated the greatest improvement with the added sound cue. These results suggest that auditory cues may benefit navigation, particularly for those who demonstrated the highest level of spatial updating error in the absence of spatial sound.

Effects of older age on visual and self-motion sensory cue integration in navigation.

Older adults demonstrate impairments in navigation that cannot be explained by general cognitive and motor declines. Previous work has shown that older adults may combine sensory cues during navigation differently than younger adults, though this work has largely been done in dark environments where sensory integration may differ from full-cue environments. Here, we test whether aging adults optimally combine cues from two sensory systems critical for navigation: vision (landmarks) and body-based self-motion cues. Participants completed a homing (triangle completion) task using immersive virtual reality to offer the ability to navigate in a well-lit environment including visibility of the ground plane. An optimal model, based on principles of maximum-likelihood estimation, predicts that precision in homing should increase with multisensory information in a manner consistent with each individual sensory cue's perceived reliability (measured by variability). We found that well-aging adults (with normal or corrected-to-normal sensory acuity and active lifestyles) were more variable and less accurate than younger adults during navigation. Both older and younger adults relied more on their visual systems than a maximum likelihood estimation model would suggest. Overall, younger adults' visual weighting matched the model's predictions whereas older adults showed sub-optimal sensory weighting. In addition, high inter-individual differences were seen in both younger and older adults. These results suggest that older adults do not optimally weight each sensory system when combined during navigation, and that older adults may benefit from interventions that help them recalibrate the combination of visual and self-motion cues for navigation.

Perceiving distance in virtual reality: theoretical insights from contemporary technologies.

Decades of research have shown that absolute egocentric distance is underestimated in virtual environments (VEs) when compared with the real world. This finding has implications on the use of VEs for applications that require an accurate sense of absolute scale. Fortunately, this underperception of scale can be attenuated by several factors, making perception more similar to (but still not the same as) that of the real world. Here, we examine these factors as two categories: (i) experience inherent to the observer, and (ii) characteristics inherent to the display technology. We analyse how these factors influence the sources of information for absolute distance perception with the goal of understanding how the scale of virtual spaces is calibrated. We identify six types of cues that change with these approaches, contributing both to a theoretical understanding of depth perception in VEs and a call for future research that can benefit from changing technologies. This article is part of the theme issue 'New approaches to 3D vision'.

New Approaches to 3D Vision.

New approaches to 3D vision are enabling new advances in artificial intelligence and autonomous vehicles, a better understanding of how animals navigate the 3D world, and new insights into human perception in virtual and augmented reality. Whilst traditional approaches to 3D vision in computer vision (SLAM: simultaneous localization and mapping), animal navigation (cognitive maps), and human vision (optimal cue integration) start from the assumption that the aim of 3D vision is to provide an accurate 3D model of the world, the new approaches to 3D vision explored in this issue challenge this assumption. Instead, they investigate the possibility that computer vision, animal navigation, and human vision can rely on partial or distorted models or no model at all. This issue also highlights the implications for artificial intelligence, autonomous vehicles, human perception in virtual and augmented reality, and the treatment of visual disorders, all of which are explored by individual articles. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Evaluating the Visibility of Architectural Features for People with Low Vision -A Quantitative Approach.

Most people with low vision rely on their remaining functional vision for mobility. Our goal is to provide tools to help design architectural spaces in which safe and effective mobility is possible by those with low vision---spaces that we refer to as visually accessible. We describe an approach that starts with a 3D CAD model of a planned space and produces labeled images indicating whether or not structures that are potential mobility hazards are visible at a particular level of low vision. There are two main parts to the analysis. The first, previously described, represents low-vision status by filtering a calibrated luminance image generated from the CAD model and associated lighting and materials information to produce a new image with unseen detail removed. The second part, described in this paper, uses both these filtered images and information about the geometry of the space obtained from the CAD model and related lighting and surface material specifications to produce a quantitative estimate of the likelihood of particular hazards being visible. We provide examples of the workflow required, a discussion of the novelty and implications of the approach, and a short discussion of needed future work.

The relationship between space and time perception: A registered replication of Casasanto and Boroditsky (2008).

Everything in our environment moves through both space and time, and to effectively act we must be aware of both spatial and temporal elements in relation to our own body. Thus, perception of space and time have an intimate relationship. Walsh's a theory of magnitude (ATOM) suggests that space and time perception rely on a general magnitude system and their relationship should be roughly symmetrical. Alternatively, metaphor theory, which is based on the philosophical work of Lakoff and Johnson, argues that we represent time using spatial metaphor and thus the relationship should be asymmetrical (with space influencing time more than time influences space). A compelling line of evidence for metaphor theory comes from the work of Casasanto and Boroditsky who experimentally demonstrated this asymmetric effect. However, in our previous unpublished online replication attempt of this work, we found a roughly symmetrical relationship between space and time, more in line with the theoretical predictions of ATOM. Given this, we performed a registered replication of Casasanto and Boroditsky (2008) in both an online and laboratory environment.

How can basic research on spatial cognition enhance the visual accessibility of architecture for people with low vision?

People with visual impairment often rely on their residual vision when interacting with their spatial environments. The goal of visual accessibility is to design spaces that allow for safe travel for the large and growing population of people who have uncorrectable vision loss, enabling full participation in modern society. This paper defines the functional challenges in perception and spatial cognition with restricted visual information and reviews a body of empirical work on low vision perception of spaces on both local and global navigational scales. We evaluate how the results of this work can provide insights into the complex problem that architects face in the design of visually accessible spaces.

Using virtual reality to assess dynamic self-motion and landmark cues for spatial updating in children and adults.

The relative contribution of different sources of information for spatial updating - keeping track of one's position in an environment - has been highly debated. Further, children and adults may differ in their reliance on visual versus body-based information for spatial updating. In two experiments, we tested children (age 10-12 years) and young adult participants on a virtual point-to-origin task that varied the types of self-motion information available for translation: full-dynamic (walking), visual-dynamic (controller induced), and no-dynamic (teleporting). In Experiment 1, participants completed the three conditions in an indoor virtual environment with visual landmark cues. Adults were more accurate in the full- and visual-dynamic conditions (which did not differ from each other) compared to the no-dynamic condition. In contrast, children were most accurate in the visual-dynamic condition and also least accurate in the no-dynamic condition. Adults outperformed children in all conditions. In Experiment 2, we removed the potential for relying on visual landmarks by running the same paradigm in an outdoor virtual environment with no geometrical room cues. As expected, adults' errors increased in all conditions, but performance was still relatively worse in teleporting. Surprisingly, children showed overall similar accuracy and patterns across locomotion conditions to adults. Together, the results support the importance of dynamic translation information (either visual or body-based) for spatial updating across both age groups, but suggest children may be more reliant on visual information than adults.

Spatial Reference Frame but Neither Age nor Gender Predict Performance on a Water-Level Task in 8- to 11-Year-Old Children.

Successful performance on the water-level task, a common measure of spatial perception, requires adopting an environmental, rather than object-centered, spatial frame of reference. Use of this strategy has not been systematically studied in prepubertal children, a developmental period during which individual differences in spatial abilities start to emerge. In this study, children aged 8 to 11 reported their age and gender, completed a paper-and-pencil water-level task, and drew a map of their neighborhood to assess spontaneous choice of spatial frame of reference. Results showed a surprising lack of age or gender difference in water-level performance, but a significant effect of spatial frame of reference. Although they made up only a small portion of the sample, children who drew allocentric maps had the highest water-level score, with very high accuracy. These results suggest that children who adopt environmental-based reference frames when depicting their familiar environment may also use environmental-based reference frame strategies to solve spatial perception tasks, thereby facilitating highly accurate performance.

A comparison of virtual locomotion methods in movement experts and non-experts: testing the contributions of body-based and visual translation for spatial updating.

Both visual and body-based (vestibular and proprioceptive) information contribute to spatial updating, or the way a navigator keeps track of self-position during movement. Research has tested the relative contributions of these sources of information and found mixed results, with some studies demonstrating the importance of body-based information, especially for translation, and some demonstrating the sufficiency of visual information. Here, we invoke an individual differences approach to test whether some individuals may be more dependent on certain types of information compared to others. Movement experts tend to be dependent on motor processes in small-scale spatial tasks, which can help or hurt performance, but it is unknown if this effect extends into large-scale spatial tasks like spatial updating. In the current study, expert dancers and non-dancers completed a virtual reality point-to-origin task with three locomotion methods that varied the availability of body-based and visual information for translation: walking, joystick, and teleporting. We predicted decrements in performance in both groups as self-motion information was reduced, and that dancers would show a larger cost. Surprisingly, both dancers and non-dancers performed with equal accuracy in walking and joystick and were impaired in teleporting, with no large differences between groups. We found slower response times for both groups with reductions in self-motion information, and minimal evidence for a larger cost for dancers. While we did not see strong dance effects, more participation in spatial activities related to decreased angular error. Together, the results suggest a flexibility in reliance on visual or body-based information for translation in spatial updating that generalizes across dancers and non-dancers, but significant decrements associated with removing both of these sources of information.

Does active learning benefit spatial memory during navigation with restricted peripheral field?

Spatial learning of real-world environments is impaired with severely restricted peripheral field of view (FOV). In prior research, the effects of restricted FOV on spatial learning have been studied using passive learning paradigms - learners walk along pre-defined paths and are told the location of targets to be remembered. Our research has shown that mobility demands and environmental complexity may contribute to impaired spatial learning with restricted FOV through attentional mechanisms. Here, we examine the role of active navigation, both in locomotion and in target search. First, we compared effects of active versus passive locomotion (walking with a physical guide versus being pushed in a wheelchair) on a task of pointing to remembered targets in participants with simulated 10° FOV. We found similar performance between active and passive locomotion conditions in both simpler (Experiment 1) and more complex (Experiment 2) spatial learning tasks. Experiment 3 required active search for named targets to remember while navigating, using both a mild and a severe FOV restriction. We observed no difference in pointing accuracy between the two FOV restrictions but an increase in attentional demands with severely restricted FOV. Experiment 4 compared active and passive search with severe FOV restriction, within subjects. We found no difference in pointing accuracy, but observed an increase in cognitive load in active versus passive search. Taken together, in the context of navigating with restricted FOV, neither locomotion method nor level of active search affected spatial learning. However, the greater cognitive demands could have counteracted the potential advantage of the active learning conditions.

Toward Objective Evaluation of Working Memory in Visualizations: A Case Study Using Pupillometry and a Dual-Task Paradigm.

Cognitive science has established widely used and validated procedures for evaluating working memory in numerous applied domains, but surprisingly few studies have employed these methodologies to assess claims about the impacts of visualizations on working memory. The lack of information visualization research that uses validated procedures for measuring working memory may be due, in part, to the absence of cross-domain methodological guidance tailored explicitly to the unique needs of visualization research. This paper presents a set of clear, practical, and empirically validated methods for evaluating working memory during visualization tasks and provides readers with guidance in selecting an appropriate working memory evaluation paradigm. As a case study, we illustrate multiple methods for evaluating working memory in a visual-spatial aggregation task with geospatial data. The results show that the use of dual-task experimental designs (simultaneous performance of several tasks compared to single-task performance) and pupil dilation can reveal working memory demands associated with task difficulty and dual-tasking. In a dual-task experimental design, measures of task completion times and pupillometry revealed the working memory demands associated with both task difficulty and dual-tasking. Pupillometry demonstrated that participants' pupils were significantly larger when they were completing a more difficult task and when multitasking. We propose that researchers interested in the relative differences in working memory between visualizations should consider a converging methods approach, where physiological measures and behavioral measures of working memory are employed to generate a rich evaluation of visualization effort.

The powerful influence of marks: Visual and knowledge-driven processing in hurricane track displays.

Given the widespread use of visualizations to communicate hazard risks, forecast visualizations must be as effective to interpret as possible. However, despite incorporating best practices, visualizations can influence viewer judgments in ways that the designers did not anticipate. Visualization designers should understand the full implications of visualization techniques and seek to develop visualizations that account for the complexities in decision-making. The current study explores the influence of visualizations of uncertainty by examining a case in which ensemble hurricane forecast visualizations produce unintended interpretations. We show that people estimate more damage to a location that is overlapped by a track in an ensemble hurricane forecast visualization compared to a location that does not coincide with a track. We find that this effect can be partially reduced by manipulating the number of hurricane paths displayed, suggesting the importance of visual features of a display on decision making. Providing instructions about the information conveyed in the ensemble display also reduced the effect, but importantly, did not eliminate it. These findings illustrate the powerful influence of marks and their encodings on decision-making with visualizations. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Navigating with peripheral field loss in a museum: learning impairments due to environmental complexity.

BACKGROUND: Previous research has found that spatial learning while navigating in novel spaces is impaired with extreme restricted peripheral field of view (FOV) (remaining FOV of 4°, but not of 10°) in an indoor environment with long hallways and mostly orthogonal turns. Here we tested effects of restricted peripheral field on a similar real-world spatial learning task in an art museum, a more challenging environment for navigation because of valuable obstacles and unpredictable paths, in which participants were guided along paths through the museum and learned the locations of pieces of art. At the end of each path, participants pointed to the remembered landmarks. Throughout the spatial learning task, participants completed a concurrent auditory reaction time task to measure cognitive load. RESULTS: Unlike the previous study in a typical hallway environment, spatial learning was impaired with a simulated 10° FOV compared to a wider 60° FOV, as indicated by greater average pointing error with restricted FOV. Reaction time to the secondary task also revealed slower responses, suggesting increased attentional demands. CONCLUSIONS: We suggest that the presence of a spatial learning deficit in the current experiment with this level of FOV restriction is due to the complex and unpredictable paths traveled in the museum environment. Our results also convey the importance of the study of low-vision spatial cognition in irregularly structured environments that are representative of many real-world settings, which may increase the difficulty of spatial learning while navigating.

Going the distance and beyond: simulated low vision increases perception of distance traveled during locomotion.

In a series of experiments, we tested the hypothesis that severely degraded viewing conditions during locomotion distort the perception of distance traveled. Some research suggests that there is little-to-no systematic error in perceiving closer distances from a static viewpoint with severely degraded acuity and contrast sensitivity (which we will refer to as blur). However, several related areas of research-extending across domains of perception, attention, and spatial learning-suggest that degraded acuity and contrast sensitivity would affect estimates of distance traveled during locomotion. In a first experiment, we measured estimations of distance traveled in a real-world locomotion task and found that distances were overestimated with blur compared to normal vision using two measures: verbal reports and visual matching (Experiments 1 a, b, and c). In Experiment 2, participants indicated their estimate of the length of a previously traveled path by actively walking an equivalent distance in a viewing condition that either matched their initial path (e.g., blur/blur) or did not match (e.g., blur/normal). Overestimation in blur was found only when participants learned the path in blur and made estimates in normal vision (not in matched blur learning/judgment trials), further suggesting a reliance on dynamic visual information in estimates of distance traveled. In Experiment 3, we found evidence that perception of speed is similarly affected by the blur vision condition, showing an overestimation in perception of speed experienced in wheelchair locomotion during blur compared to normal vision. Taken together, our results demonstrate that severely degraded acuity and contrast sensitivity may increase people's tendency to overestimate perception of distance traveled, perhaps because of an increased perception of speed of self-motion.

Mind the Gap: Gap Affordance Judgments of Children, Teens, and Adults in an Immersive Virtual Environment.

Affordances are possibilities for action that depend on both an observer's capabilities and the properties of the environment. Immersive Virtual Environments (IVEs) have been used to examine affordances in adults, demonstrating that judgments about action capabilities are made similarly to the real world. However, less is known about affordance judgments in middle-aged children and adolescents in IVEs. Differences in rate of growth, decision criteria, and perceived risk could influence affordance judgments for children. In Experiment 1, children, teens, and adults stood in an IVE at ground level or at a height of 15 m, and were asked to view gaps of different widths. Across all age groups, estimates of gap crossing were underestimated at the higher height compared to the ground, consistent with reports of fear and risk of falling. Children, compared to adults, underestimated their maximum crossable gap compared to their actual crossable gap. To test whether this difference was specific to IVEs or a more generalized age effect, children and adults were tested on gap estimates in the real world in Experiment 2. This real world study showed no difference between children and adults, suggesting a unique contribution of the IVE to children's affordance judgments. We discuss the implications for using IVEs to study children's affordances.

Decision making with visualizations: a cognitive framework across disciplines.

Visualizations-visual representations of information, depicted in graphics-are studied by researchers in numerous ways, ranging from the study of the basic principles of creating visualizations, to the cognitive processes underlying their use, as well as how visualizations communicate complex information (such as in medical risk or spatial patterns). However, findings from different domains are rarely shared across domains though there may be domain-general principles underlying visualizations and their use. The limited cross-domain communication may be due to a lack of a unifying cognitive framework. This review aims to address this gap by proposing an integrative model that is grounded in models of visualization comprehension and a dual-process account of decision making. We review empirical studies of decision making with static two-dimensional visualizations motivated by a wide range of research goals and find significant direct and indirect support for a dual-process account of decision making with visualizations. Consistent with a dual-process model, the first type of visualization decision mechanism produces fast, easy, and computationally light decisions with visualizations. The second facilitates slower, more contemplative, and effortful decisions with visualizations. We illustrate the utility of a dual-process account of decision making with visualizations using four cross-domain findings that may constitute universal visualization principles. Further, we offer guidance for future research, including novel areas of exploration and practical recommendations for visualization designers based on cognitive theory and empirical findings.

Visualizing Uncertain Tropical Cyclone Predictions using Representative Samples from Ensembles of Forecast Tracks.

A common approach to sampling the space of a prediction is the generation of an ensemble of potential outcomes, where the ensemble's distribution reveals the statistical structure of the prediction space. For example, the US National Hurricane Center generates multiple day predictions for a storm's path, size, and wind speed, and then uses a Monte Carlo approach to sample this prediction into a large ensemble of potential storm outcomes. Various forms of summary visualizations are generated from such an ensemble, often using spatial spread to indicate its statistical characteristics. However, studies have shown that changes in the size of such summary glyphs, representing changes in the uncertainty of the prediction, are frequently confounded with other attributes of the phenomenon, such as its size or strength. In addition, simulation ensembles typically encode multivariate information, which can be difficult or confusing to include in a summary display. This problem can be overcome by directly displaying the ensemble as a set of annotated trajectories, however this solution will not be effective if ensembles are densely overdrawn or structurally disorganized. We propose to overcome these difficulties by selectively sampling the original ensemble, constructing a smaller representative and spatially well organized ensemble. This can be drawn directly as a set of paths that implicitly reveals the underlying spatial uncertainty distribution of the prediction. Since this approach does not use a visual channel to encode uncertainty, additional information can more easily be encoded in the display without leading to visual confusion. To demonstrate our argument, we describe the development of a visualization for ensembles of tropical cyclone forecast tracks, explaining how their spatial and temporal predictions, as well as other crucial storm characteristics such as size and intensity, can be clearly revealed. We verify the effectiveness of this visualization approach through a cognitive study exploring how storm damage estimates are affected by the density of tracks drawn, and by the presence or absence of annotating information on storm size and intensity.

Not all those who wander are lost: Spatial exploration patterns and their relationship to gender and spatial memory.

When humans and animals navigate through environments, they form spatial memories important for supporting subsequent recall of locations relative to their own position and orientation, as well as to other object locations in the environment. The goal of the current study was to examine whether individual differences in initial exploration of a large-scale novel environment relate to subsequent spatial memories. A majority of studies examining spatial memory formed in large-scale spaces have constrained encoding of the environment by leading participants on pre-determined paths, thereby limiting their free exploration. We allowed participants to freely explore a large-scale, virtual environment to locate a set of objects within. We then tested their ability to navigate back to those objects as well as their ability to point to them from one another. Based on previous work suggesting gender differences in navigation strategies and spatial anxiety, we predicted that males and females would show different patterns of initial exploration and that these exploration patterns would account for gender differences in measures of spatial memory. We found that females revisited previous locations more often and showed lower rates of spreading through an area. These measures of exploration partially accounted for gender differences in efficiency in navigation and pointing accuracy to remembered locations. The results demonstrate the importance of exploration in spatial memory and provide a new perspective on gender differences in spatial cognition.

Correction to: Decision making with visualizations: a cognitive framework across disciplines.

[This corrects the article DOI: 10.1186/s41235-018-0120-9.].