Choosing and using geospatial displays: effects of design on performance and metacognition.

Interactive display systems give users flexibility to tailor their visual displays to different tasks and situations. However, in order for such flexibility to be beneficial, users need to understand how to tailor displays to different tasks (to possess "metarepresentational competence"). Recent research suggests that people may desire more complex and realistic displays than are most effective (Smallman & St. John, 2005). In Experiment 1, undergraduate students were tested on a comprehension task with geospatial displays (weather maps) that varied in the number of extraneous variables displayed. Their metacognitive judgments about the relative effectiveness of the displays were also solicited. Extraneous variables slowed response time and increased errors, but participants favored complex maps that looked more realistic about one third of the time. In Experiment 2, the eye fixations of undergraduate students were monitored as they performed the comprehension task. Complex maps that looked more realistic led to more eye fixations on both task-relevant and task-irrelevant regions of the displays. Experiment 3 compared performance of experienced meteorologists and undergraduate students on the comprehension and metacognitive tasks. Meteorologists were as likely as undergraduate students to prefer geographically complex (realistic) displays and more likely than undergraduates to opt for displays that added extraneous weather variables. However, meteorologists were also slower and less accurate with complex than with simple displays. This work highlights the importance of empirically testing principles of visual display design and suggests some limits to metarepresentational competence.

Naïve realism: folk fallacies in the design and use of visual displays.

Often implicit in visual display design and development is a gold standard of photorealism. By approximating direct perception, photorealism appeals to users and designers by being both attractive and apparently effortless. The vexing result from numerous performance evaluations, though, is that increasing realism often impairs performance. Smallman and St. John (2005) labeled misplaced faith in realistic information display Naïve Realism and theorized it resulted from a triplet of folk fallacies about perception. Here, we illustrate issues associated with the wider trend towards realism by focusing on a specific current trend for high-fidelity perspective view (3D) geospatial displays. In two experiments, we validated Naïve Realism for different terrain understanding tasks, explored whether certain individuals are particularly prone to Naïve Realism, and determined the ability of task feedback to mitigate Naïve Realism. Performance was measured for laying and judging a concealed route across realistic terrain shown in different display formats. Task feedback was either implicit, in Experiment 1, or explicit in Experiment 2. Prospective and retrospective intuitions about the best display formats for the tasks were recorded and then related to task performance and participant spatial ability. Participants generally intuited they would perform tasks better with more realism than they actually required. For example, counter to intuitions, lowering fidelity of the terrain display revealed the gross scene layout needed to lay a well-concealed route. Individuals of high spatial ability calibrated their intuitions with only implicit task feedback, whereas those of low spatial ability required salient, explicit feedback to calibrate their intuitions about display realism. Results are discussed in the wider context of applying perceptual science to display design, and combating folk fallacies.

Human factors of the confirmation bias in intelligence analysis: decision support from graphical evidence landscapes.

OBJECTIVE: This study addresses the human factors challenge of designing and validating decision support to promote less biased intelligence analysis. BACKGROUND: The confirmation bias can compromise objectivity in ambiguous medical and military decision making through neglect of conflicting evidence and judgments not reflective of the entire evidence spectrum. Previous debiasing approaches have had mixed success and have tended to place additional demands on users' decision making. METHOD: Two new debiasing interventions that help analysts picture the full spectrum of evidence, the relation of evidence to a hypothesis, and other analysts' evidence assessments were manipulated in a repeated-measures design: (a) an integrated graphical evidence layout, compared with a text baseline; and (b) evidence tagged with other analysts' assessments, compared with participants' own assessments. Twenty-seven naval trainee analysts and reservists assessed, selected, and prioritized evidence in analysis vignettes carefully constructed to have balanced supporting and conflicting evidence sets. Bias was measured for all three evidence analysis steps. RESULTS: A bias to select a skewed distribution of confirming evidence occurred across conditions. However, graphical evidence layout, but not other analysts' assessments, significantly reduced this selection bias, resulting in more balanced evidence selection. Participants systematically prioritized the most supportive evidence as most important. CONCLUSION: Domain experts exhibited confirmation bias in a realistic intelligence analysis task and apparently conflated evidence supportiveness with importance. Graphical evidence layout promoted more balanced and less biased evidence selection. APPLICATION: Results have application to real-world decision making, implications for basic decision theory, and lessons for how shrewd visualization can help reduce bias.

Egocentric depth judgments in optical, see-through augmented reality.

Abstract-A fundamental problem in optical, see-through augmented reality (AR) is characterizing how it affects the perception of spatial layout and depth. This problem is important because AR system developers need to both place graphics in arbitrary spatial relationships with real-world objects, and to know that users will perceive them in the same relationships. Furthermore, AR makes possible enhanced perceptual techniques that have no real-world equivalent, such as x-ray vision, where AR users are supposed to perceive graphics as being located behind opaque surfaces. This paper reviews and discusses protocols for measuring egocentric depth judgments in both virtual and augmented environments, and discusses the well-known problem of depth underestimation in virtual environments. It then describes two experiments that measured egocentric depth judgments in AR. Experiment I used a perceptual matching protocol to measure AR depth judgments at medium and far-field distances of 5 to 45 meters. The experiment studied the effects of upper versus lower visual field location, the x-ray vision condition, and practice on the task. The experimental findings include evidence for a switch in bias, from underestimating to overestimating the distance of AR-presented graphics, at approximately 23 meters, as well as a quantification of how much more difficult the x-ray vision condition makes the task. Experiment II used blind walking and verbal report protocols to measure AR depth judgments at distances of 3 to 7 meters. The experiment examined real-world objects, real-world objects seen through the AR display, virtual objects, and combined real and virtual objects. The results give evidence that the egocentric depth of AR objects is underestimated at these distances, but to a lesser degree than has previously been found for most virtual reality environments. The results are consistent with previous studies that have implicated a restricted field-of-view, combined with an inability for observers to scan the ground plane in a near-to-far direction, as explanations for the observed depth underestimation.

Heuristic automation for decluttering tactical displays.

Tactical displays can quickly become cluttered with large numbers of symbols that can compromise effective monitoring. Here, we studied how heuristic automation can aid users by intelligently "decluttering" the display. In a realistic simulated naval air defense task, 27 experienced U.S. Navy users monitored a cluttered airspace and executed defensive responses against significant threats. An algorithm continuously evaluated aircraft for their levels of threat and decluttered the less threatening ones by dimming their symbols. Users appropriately distrusted and spot-checked the automation's assessments, and decluttering had very little effect on which aircraft were judged as significantly threatening. Nonetheless, decluttering improved the timeliness of responses to threatening aircraft by 25% as compared with a baseline display with no decluttering; it was especially beneficial for threats in more peripheral locations, and 25 of 27 participants preferred decluttering. Heuristic automation, when properly designed to guide users' attention by decluttering less important objects, may prove valuable in many cluttered monitoring situations, including air traffic management, crisis team management, and tactical situation awareness in general.

Visual function before and after the removal of bilateral congenital cataracts in adulthood.

Subject Peter Doyle (PD) had congenital bilateral cataracts removed at the age of 43. Pre-operatively PD's visual acuity was 20/80, with a resolution limit around 15 cpd, and he experienced monocular diplopia with high contrast stimuli. Post-operatively PD's visual acuity improved to approximately 20/40, with a resolution limit around 25 cpd. Using a variety of pre- and post-operative tests we have documented a wide range of neural adaptations to his limited and distorted visual input, and have found a limited amount of post-operative adaptation to his newly improved visual input. These results show that the human visual system is capable of significant adaptation to the particular optical input that is experienced.