Integration of visual landmark cues in spatial memory.

Over the past two decades, much research has been conducted to investigate whether humans are optimal when integrating sensory cues during spatial memory and navigational tasks. Although this work has consistently demonstrated optimal integration of visual cues (e.g., landmarks) with body-based cues (e.g., path integration) during human navigation, little work has investigated how cues of the same sensory type are integrated in spatial memory. A few recent studies have reported mixed results, with some showing very little benefit to having access to more than one landmark, and others showing that multiple landmarks can be optimally integrated in spatial memory. In the current study, we employed a combination of immersive and non-immersive virtual reality spatial memory tasks to test adult humans' ability to integrate multiple landmark cues across six experiments. Our results showed that optimal integration of multiple landmark cues depends on the difficulty of the task, and that the presence of multiple landmarks can elicit an additional latent cue when estimating locations from a ground-level perspective, but not an aerial perspective.

Mental representations of recently learned nested environments.

Two experiments investigated the mental representations of objects' location in a virtual nested environment. In Experiment 1, participants learned the locations of objects (buildings or related accessories) in an exterior environment and then learned the locations of objects inside one of the centrally located buildings (interior environment). Participants completed judgments of relative direction in which the imagined heading was established by pairs of objects from the interior environment and the target was one of the objects in the exterior environment. Performance was best for the imagined heading and allocentric target direction parallel to the learning heading of the exterior environment, but the effect of allocentric target direction was only significant for the imagined headings aligned with the reference axes of both environments; in addition, performance was best along the front-back egocentric axis (parallel to the imagined heading). Experiment 2 used the same learning procedure. After learning, the viewpoint was moved from the exterior environment along a smooth path into a side entrance of the building/interior environment. There participants saw the array of interior objects in the orientation consistent with their movement (correct cue), the array of objects in an orientation inconsistent with their movement (misleading cue), or no array of objects (no cue), and then pointed to objects in the exterior environment. Pointing performance was best for the correct-cue condition. Collectively the results indicated that memories of nested spaces are segregated by spatial conceptual level, and that spatial relations between levels are specified in terms of the dominant reference directions.

A comparison of methods of assessing cue combination during navigation.

Mobile organisms make use of spatial cues to navigate effectively in the world, such as visual and self-motion cues. Over the past decade, researchers have investigated how human navigators combine spatial cues, and whether cue combination is optimal according to statistical principles, by varying the number of cues available in homing tasks. The methodological approaches employed by researchers have varied, however. One important methodological difference exists in the number of cues available to the navigator during the outbound path for single-cue trials. In some studies, navigators have access to all spatial cues on the outbound path and all but one cue is eliminated prior to execution of the return path in the single-cue conditions; in other studies, navigators only have access to one spatial cue on the outbound and return paths in the single-cue conditions. If navigators can integrate cues along the outbound path, single-cue estimates may be contaminated by the undesired cue, which will in turn affect the predictions of models of optimal cue integration. In the current experiment, we manipulated the number of cues available during the outbound path for single-cue trials, while keeping dual-cue trials constant. This variable did not affect performance in the homing task; in particular, homing performance was better in dual-cue conditions than in single-cue conditions and was statistically optimal. Both methodological approaches to measuring spatial cue integration during navigation are appropriate.

Reference frames in spatial updating when body-based cues are absent.

The current study investigated the reference frame used in spatial updating when idiothetic cues to self-motion were minimized (desktop virtual reality). In Experiment 1, participants learned a layout of eight objects from a single perspective (learning heading) in a virtual environment. After learning, they were placed in the same virtual environment and used a keyboard to navigate to two of the learned objects (visible) before pointing to a third object (invisible). We manipulated participants' starting orientation (initial heading) and final orientation (final heading) before pointing, to examine the reference frame used in this task. We found that participants used the initial heading and the learning heading to establish reference directions. In Experiment 2, the procedure was almost the same as in Experiment 1 except that participants pointed to objects relative to an imagined heading that differed from their final heading in the virtual environment. In this case, pointing performance was only affected by alignment with the learning heading. We concluded that the initial heading played an important role in spatial updating without idiothetic cues, but the representation established at this heading was transient and affected by the interruption of spatial updating; the learning heading, on the other hand, corresponded to an enduring representation which was used consistently.

Optimal combination of environmental cues and path integration during navigation.

Navigation is influenced by body-based self-motion cues that are integrated over time, in a process known as path integration, as well as by environmental cues such as landmarks and room shape. In two experiments we explored whether humans combine path integration and environmental cues (Exp. 1: room shape; Exp. 2: room shape, single landmark, and multiple landmarks) to reduce response variability when returning to a previously visited location. Participants walked an outbound path in an immersive virtual environment before attempting to return to the path origin. Path integration and an environmental cue were both available during the outbound path, but experimental manipulations created single- and dual-cue conditions during the return path. The response variance when returning to the path origin was reduced when both cues were available, consistent with optimal integration predicted on the basis of Bayesian principles. The findings indicate that humans optimally integrate multiple spatial cues during navigation. Additionally, a large (but not a small) cue conflict caused participants to assign a higher weight to path integration than to environmental cues, despite the relatively greater precision afforded by the environmental cues.

Cue combination in human spatial navigation.

This project investigated the ways in which visual cues and bodily cues from self-motion are combined in spatial navigation. Participants completed a homing task in an immersive virtual environment. In Experiments 1A and 1B, the reliability of visual cues and self-motion cues was manipulated independently and within-participants. Results showed that participants weighted visual cues and self-motion cues based on their relative reliability and integrated these two cue types optimally or near-optimally according to Bayesian principles under most conditions. In Experiment 2, the stability of visual cues was manipulated across trials. Results indicated that cue instability affected cue weights indirectly by influencing cue reliability. Experiment 3 was designed to mislead participants about cue reliability by providing distorted feedback on the accuracy of their performance. Participants received feedback that their performance with visual cues was better and that their performance with self-motion cues was worse than it actually was or received the inverse feedback. Positive feedback on the accuracy of performance with a given cue improved the relative precision of performance with that cue. Bayesian principles still held for the most part. Experiment 4 examined the relations among the variability of performance, rated confidence in performance, cue weights, and spatial abilities. Participants took part in the homing task over two days and rated confidence in their performance after every trial. Cue relative confidence and cue relative reliability had unique contributions to observed cue weights. The variability of performance was less stable than rated confidence over time. Participants with higher mental rotation scores performed relatively better with self-motion cues than visual cues. Across all four experiments, consistent correlations were found between observed weights assigned to cues and relative reliability of cues, demonstrating that the cue-weighting process followed Bayesian principles. Results also pointed to the important role of subjective evaluation of performance in the cue-weighting process and led to a new conceptualization of cue reliability in human spatial navigation.

Age and gender differences in spatial perspective taking.

BACKGROUND AND AIMS: It is often necessary in daily experience to change one's point of view to adopt mentally the spatial perspective of other persons, learn the position of different objects in a new environment or even describe an environment to other persons. Hence, the ability to link spatial information from different perspectives seems to be necessary to orient ourselves in the space. Several studies have found gender-related differences in spatial reasoning in younger adults, but little is known about such effects in middle-aged and older adults. METHODS: This research was designed to study how spatial perspective taking is affected by gender and age along the lifespan. The Perspective Taking/Spatial Orientation Test (PPT; Kozhevnikov and Hegarty [1]) was administered to groups of younger, middle-aged, and older adults, with females and males represented in each age group. RESULTS: The performance in the PPT decreased across age groups. All age groups had more errors in items that involved perspective changes of greater than 90º. Males performed better than females on most of the variables; however, no significant differences appeared in the interaction gender × age. CONCLUSION: The present findings showed the relevance of the degree perspective change in visuo-spatial abilities, especially in the older group. In relation with the gender, males outperformed females; however, the interaction gender × age did not show significant differences.

Representations of interobject spatial relations in long-term memory.

A growing body of evidence has indicated that human spatial memory is organized in terms of a small number of reference directions and that interobject spatial relations are represented in terms of these directions (e.g., McNamara, 2003). The goal of the present experiments was to investigate whether the selection of reference directions also affects the fidelity with which interobject spatial relations are represented in memory. In two experiments, participants memorized a layout of nine objects and then performed judgments of relative direction (e.g., "Imagine you are standing at the clock, facing the book. Point to the phone.") at a remote location. Imagined heading (e.g., at the clock, facing the book) and allocentric target direction (e.g., the direction from clock to phone in the allocentric frame of reference used to define imagined heading) were manipulated independently. The results of both experiments showed that the same directions that were benefited in imagined headings were also benefited in allocentric target directions. These findings indicate that interobject spatial relations are preferentially represented when they coincide with a reference direction.

The influence of environmental geometry and spatial symmetry on spatial updating during locomotion.

Spatial updating based on self-motion cues is important to navigation in the absence of familiar landmarks. Previous studies showed that spatial updating without vision was automatic. The goal of the current study was to investigate whether ambiguous orientations indicated by visual cues affect spatial updating based on self-motion. Participants learned an object array in a rectangular room. After the objects were removed, participants maintained their actual perspective or turned 180° to face opposite walls of the room. Participants judged relative directions from imagined perspectives based on the memories of the object array. The actual and imagined perspectives were aligned or misaligned. Better performance for aligned than misaligned perspectives (sensorimotor alignment effects) was used to indicate spontaneous updating of ones' headings relative to the object array. In Experiment 1, participants turned their bodies in the middle of the room so that their distances to the walls of the room looked similar before and after turning (spatial symmetry at the turning position with the rectangular room shape). In Experiments 2-3, participants turned their bodies in a location so that the distances to the facing walls looked different before and after turning (spatial asymmetry at the turning position with the rectangular room shape). The results showed sensorimotor alignment effects in Experiments 2-3 but not in Experiment 1. These results suggest that updating self-orientation based on self-motion was cancelled by ambiguous orientations indicated by spatial symmetry at the turning position, but not cancelled by ambiguous orientations indicated by the rectangular room shape per se. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Statistically Optimal Cue Integration During Human Spatial Navigation.

In 2007, Cheng and colleagues published their influential review wherein they analyzed the literature on spatial cue interaction during navigation through a Bayesian lens, and concluded that models of optimal cue integration often applied in psychophysical studies could explain cue interaction during navigation. Since then, numerous empirical investigations have been conducted to assess the degree to which human navigators are optimal when integrating multiple spatial cues during a variety of navigation-related tasks. In the current review, we discuss the literature on human cue integration during navigation that has been published since Cheng et al.'s original review. Evidence from most studies demonstrate optimal navigation behavior when humans are presented with multiple spatial cues. However, applications of optimal cue integration models vary in their underlying assumptions (e.g., uninformative priors and decision rules). Furthermore, cue integration behavior depends in part on the nature of the cues being integrated and the navigational task (e.g., homing versus non-home goal localization). We discuss the implications of these models and suggest directions for future research.

Local spatial navigation or "steering" in patients with vestibular loss in a virtual reality environment.

BACKGROUND: Patients with vestibular loss have reduced wayfinding ability, but the association between vestibular loss and impaired steering spatial navigation is unclear. OBJECTIVE: To evaluate whether vestibular loss is associated with reduced steering navigation performance in a virtual reality (VR) environment containing obstacles. METHODS: 17 ambulatory adults with vestibular loss were age/sex-matched to healthy controls. Participants traversed a VR hallway with obstacles, and their navigation performance was compared using metrics such as collisions, time, total distance travelled, and speed in single and multivariate analysis. RESULTS: In univariate analysis there was no significant difference in collisions between vestibular patients and controls (1.84 vs. 2.24, p = 0.974). However, vestibular patients took more time, longer routes, and had lower speeds to complete the task (56.9 vs. 43.9 seconds, p < 0.001; 23.1 vs. 22.0 meters, p = 0.0312; 0.417 vs. 0.544 m/s, p < 0.001). These results were confirmed in multivariate analysis. CONCLUSIONS: This study found that patients with vestibular loss displayed slower gait speeds and traveled longer distances, though did not make more collisions, during a VR steering navigation task. Beyond the known influence of vestibular function on gait speed, vestibular loss may also contribute to less efficient steering navigation through an obstacle-laden environment, through neural mechanisms that remain to be elucidated.

Bayesian decision theory and navigation.

Spatial navigation is a complex cognitive activity that depends on perception, action, memory, reasoning, and problem-solving. Effective navigation depends on the ability to combine information from multiple spatial cues to estimate one's position and the locations of goals. Spatial cues include landmarks, and other visible features of the environment, and body-based cues generated by self-motion (vestibular, proprioceptive, and efferent information). A number of projects have investigated the extent to which visual cues and body-based cues are combined optimally according to statistical principles. Possible limitations of these investigations are that they have not accounted for navigators' prior experiences with or assumptions about the task environment and have not tested complete decision models. We examine cue combination in spatial navigation from a Bayesian perspective and present the fundamental principles of Bayesian decision theory. We show that a complete Bayesian decision model with an explicit loss function can explain a discrepancy between optimal cue weights and empirical cues weights observed by (Chen et al. Cognitive Psychology, 95, 105-144, 2017) and that the use of informative priors to represent cue bias can explain the incongruity between heading variability and heading direction observed by (Zhao and Warren 2015b, Psychological Science, 26[6], 915-924). We also discuss (Petzschner and Glasauer's , Journal of Neuroscience, 31(47), 17220-17229, 2011) use of priors to explain biases in estimates of linear displacements during visual path integration. We conclude that Bayesian decision theory offers a productive theoretical framework for investigating human spatial navigation and believe that it will lead to a deeper understanding of navigational behaviors.

A computational cognitive model of judgments of relative direction.

In the past several decades, considerable theoretical progress has been made in understanding the role of reference frames in the encoding and retrieval of spatial information about the environment. Many of these insights have come from participants making judgments of relative direction using their memories of spatial layouts. In this task, participants are asked to imagine standing at a given location and facing a certain direction, and to point to a target location. Although this task has been widely and productively used, a computational cognitive model of judgments of relative direction has yet to be introduced. Computational modeling of judgments of relative direction is a critical next step to formulating and testing hypotheses about the cognitive processes involved in establishing and using spatial reference frames. We present an initial attempt to model judgments of relative direction and fit the model to two datasets exhibiting behavioral patterns commonly observed in the spatial memory literature. The model was able to predict many important features of these data, most notably alignment effects. We discuss directions for future modeling efforts.

Performance in Real World- and Virtual Reality-Based Spatial Navigation Tasks in Patients With Vestibular Dysfunction.

OBJECTIVE: This study evaluated whether vestibular dysfunction is associated with reduced spatial navigation performance. STUDY DESIGN: Cross-sectional study. SETTING: Otolaryngology Clinic in the Johns Hopkins Outpatient Center and an analogous virtual reality (VR) environment. PATIENTS: Eligible patients had diagnosis of unilateral or bilateral vestibular loss. Matched healthy controls were recruited at 1:1 ratio. INTERVENTIONS: The navigation task involved a route-based or place-based strategy in both real world and VR environments. MAIN OUTCOME MEASURES: Navigation performance was measured by distance travelled relative to optimal distance (i.e., path ratio) and the Judgments of Relative Direction (JRD) task, whereby participants had to recall relative angular distances between landmarks. RESULTS: The study sample included 20 patients with vestibular loss (mean age: 61 yrs, SD: 10.2 yrs) and 20 matched controls (mean age: 60 yrs, SD: 10.4 yrs). Patients with vestibular loss travelled significantly greater distance using both route-based (path ratio 1.3 vs. 1.0, p = 0.02) and place-based (path ratio 2.6 vs. 2.0, p = 0.03) strategies in the real world. Overall, participants performed worse in virtual reality compared to real world in both path ratio (2.2 vs. 1.7; p = 0.04) and JRD error (78° vs. 67°; p < 0.01). Furthermore, while controls exhibited significant positive correlations between real world and VR performance in place-based (ß = 0.75; p < 0.001) and JRD tasks (ß = 0.70; p < 0.001), patients with vestibular loss exhibited no similar correlations. CONCLUSIONS: The vestibular system appears to play a role in navigation ability during both actual and virtual navigation, suggesting a role for static vestibular signals in navigation performance.

Layout geometry in encoding and retrieval of spatial memory.

Two experiments investigated whether the spatial reference directions that are used to specify objects' locations in memory can be solely determined by layout geometry. Participants studied a layout of objects from a single viewpoint while their eye movements were recorded. Subsequently, participants used memory to make judgments of relative direction (e.g., "Imagine you are standing at X, facing Y, please point to Z"). When the layout had a symmetric axis that was different from participants' viewing direction, the sequence of eye fixations on objects during learning and the preferred directions in pointing judgments were both determined by the direction of the symmetric axis. These results provide further evidence that interobject spatial relations are represented in memory with intrinsic frames of reference.

Use of self-to-object and object-to-object spatial relations in locomotion.

In 8 experiments, the authors examined the use of representations of self-to-object or object-to-object spatial relations during locomotion. Participants learned geometrically regular or irregular layouts of objects while standing at the edge or in the middle and then pointed to objects while blindfolded in 3 conditions: before turning (baseline), after rotating 240 degrees (updating), and after disorientation (disorientation). The internal consistency of pointing in the disorientation condition was equivalent to that in the updating condition when participants learned the regular layout. The internal consistency of pointing was disrupted by disorientation when participants learned the irregular layout. However, when participants who learned the regular layout were instructed to use self-to-object spatial relations, the effect of disorientation on pointing consistency appeared. When participants who learned the irregular layout at the periphery of the layout were instructed to use object-to-object spatial relations, the effect of disorientation disappeared. These results suggest that people represent both self-to-object and object-to-object spatial relations and primarily use object-to-object spatial representation in a regular layout and self-to-object spatial representation in an irregular layout.

Facilitated pointing to remembered objects in front: evidence for egocentric retrieval or for spatial priming?

Recent spatial memory theories propose that long-term spatial memories are retrieved egocentrically. One source of evidence comes from imagined perspective taking, in which participants learn an object layout, later imagine standing at one object and facing a second (orienting) object, and then point to a third (target) object from the imagined perspective. Pointing is faster for target objects in the anterior than in the posterior half of imaginal space. This "front facilitation" is consistent with asymmetric sensory and biomechanical body properties (favoring the anterior half of body space), supporting claims of egocentric retrieval. However, front facilitation might actually result from spatial priming: Proximity differences might cause orienting objects to prime target objects more in the anterior than in the posterior half of imagined space. Using a modified perspective-taking task that unconfounded front facilitation and spatial priming, two experiments identified separate influences of front facilitation and spatial priming when participants imagined perspectives within the surrounding environment or a remote environment.

Intrinsic orientation and study viewpoint in recognizing spatial structure of a shape.

Two experiments dissociated the roles of intrinsic orientation of a shape and participants' study viewpoint in shape recognition. In Experiment 1, participants learned shapes with a rectangular background that was oriented differently from their viewpoint, and then recognized target shapes, which were created by splitting study shapes along different intrinsic axes, at different views. Results showed that recognition was quicker when the study shapes were split along the axis parallel to the orientation of the rectangular background than when they were split along the axis parallel to participants' viewpoint. In Experiment 2, participants learned shapes without the rectangular background. The results showed that recognition was quicker when the study shape was split along the axis parallel to participants' viewpoint. In both experiments, recognition was quicker at the study view than at a novel view. An intrinsic model of object representation and recognition was proposed to explain these findings.

Individual differences in using geometric and featural cues to maintain spatial orientation: cue quantity and cue ambiguity are more important than cue type.

Two experiments explored the role of environmental cues in maintaining spatial orientation (sense of self-location and direction) during locomotion. Of particular interest was the importance of geometric cues (provided by environmental surfaces) and featural cues (nongeometric properties provided by striped walls) in maintaining spatial orientation. Participants performed a spatial updating task within virtual environments containing geometric or featural cues that were ambiguous or unambiguous indicators of self-location and direction. Cue type (geometric or featural) did not affect performance, but the number and ambiguity of environmental cues did. Gender differences, interpreted as a proxy for individual differences in spatial ability and/or experience, highlight the interaction between cue quantity and ambiguity. When environmental cues were ambiguous, men stayed oriented with either one or two cues, whereas women stayed oriented only with two. When environmental cues were unambiguous, women stayed oriented with one cue.

Manipulating the visibility of barriers to improve spatial navigation efficiency and cognitive mapping.

Previous studies from psychology, neuroscience and geography showed that environmental barriers fragment the representation of the environment, reduce spatial navigation efficiency, distort distance estimation and make spatial updating difficult. Despite these negative effects, limited research has examined how to overcome barriers and if individual differences mediate their causes and potential interventions. We hypothesize that the reduced visibility caused by barriers plays a major role in accumulating error in spatial updating and encoding spatial relationships. We tested this using virtual navigation to grant participants 'X-ray' vision during environment encoding (i.e., barriers become translucent) and quantifying cognitive mapping benefits of counteracting fragmented visibility. We found that compared to the participants trained with naturalistic environment visibility, participants trained in the translucent environment had better performance in wayfinding and pointing tasks, which are theorized to measure navigation efficiency and cognitive mapping. Interestingly, these benefits were only observed in participants with high self-report sense of direction. Together, our results provide important insight into (1) how perceptual barrier effects manifest, even when physical fragmentation of space is held constant, (2) establish a novel intervention that can improve spatial learning, and (3) provide evidence that individual differences modulate perceptual barrier effects and the efficacy of such interventions.