Pathway HUDs: are they viable?

We describe two experiments that examine 3D pathway displays in a head-up location for aircraft landing and taxi. We address both guidance performance and pilot strategies in dividing, focusing, and allocating attention between flight path information and event monitoring. In Experiment 1 the 3D pathway head-up display (HUD) was compared with a conventional 2D HUD. The former was found to produce better guidance, with few costs to event detection. Some evidence was provided that attentional tunneling of the pathway HUD inhibits the detection of unexpected traffic events. In Experiment 2, the pathway display was compared in a head-up versus a head-down location. Excellent guidance was achieved in both locations. A slight HUD cost for vertical tracking in the air was offset by a HUD benefit for event detection and for lateral tracking during taxi (i.e., on the ground). The results of both experiments are interpreted within the framework of object- and space-based theories of visual attention and point to the conclusion that pathway HUDs combine the independent advantages of pathways and HUDs, particularly during ground operations. Actual or potential applications include understanding the costs and benefits of positioning a 3D pathway display in a head-up location.

Attentional filtering in the design of electronic map displays: a comparison of color coding, intensity coding, and decluttering techniques.

In a series of experiments color coding, intensity coding, and decluttering were compared in order to assess their potential benefits for accessing information from electronic map displays. Participants viewed electronic battlefield maps containing 5 classes of information discriminable by color or intensity, or, in the decluttering condition, displayed or removed entirely by a key press. Participants were asked questions requiring them to focus on objects within a class (objects presented at the same color or intensity) or to integrate data between objects in different classes (objects presented at different colors and intensities). The results suggested that the benefits of color and intensity coding appear to be in segregating the visual field rather than calling attention to the objects presented at a certain color or intensity. Interactivity proved to be a disadvantage; the time cost of information retrieval outweighed the time benefits of presenting less information on the display or even allowing map users to customize their displays. Potential applications of this research include a cost-benefit analysis for the use of 3 attentional filtering techniques and an attempt to quantitatively measure map complexity.

Display signaling in augmented reality: effects of cue reliability and image realism on attention allocation and trust calibration.

This experiment seeks to examine the relationships among three advanced technology features (presentation of target cuing, reliability of target cuing, and level of image reality and the attention and trust given to that information). The participants were 16 military personnel who piloted an unmanned air vehicle and searched for targets camouflaged in terrain, which was presented at two levels of image realism. Cuing was available for some targets, and the reliability of this information was manipulated at two levels (100% and 75%). The results showed that the presence of cuing aided target detection for expected targets but drew attention away from the presence of unexpected targets. Cuing benefits and attentional tunneling were both reduced when cuing became less reliable. Increasing image realism was compelling but increased reliance on the cuing information when those data were reliable. Potential applications include a cost-benefit analysis of how trust modulates attention in the use of automated target recognition systems and the extent to which increased realism may influence this trust.

A model for types and levels of human interaction with automation.

Technical developments in computer hardware and software now make it possible to introduce automation into virtually all aspects of human-machine systems. Given these technical capabilities, which system functions should be automated and to what extent? We outline a model for types and levels of automation that provides a framework and an objective basis for making such choices. Appropriate selection is important because automation does not merely supplant but changes human activity and can impose new coordination demands on the human operator. We propose that automation can be applied to four broad classes of functions: 1) information acquisition; 2) information analysis; 3) decision and action selection; and 4) action implementation. Within each of these types, automation can be applied across a continuum of levels from low to high, i.e., from fully manual to fully automatic. A particular system can involve automation of all four types at different levels. The human performance consequences of particular types and levels of automation constitute primary evaluative criteria for automation design using our model. Secondary evaluative criteria include automation reliability and the costs of decision/action consequences, among others. Examples of recommended types and levels of automation are provided to illustrate the application of the model to automation design.

Frames of reference for the display of battlefield information: judgment-display dependencies.

In 2 experiments, U.S. Army soldiers viewed computer-generated displays that presented battlefield information from 3 different frames of reference: a 2D plan view display (with contour lines), a 3D exocentric perspective display, and an interactive 3D immersed display. In Experiment 1, soldiers made geographical judgments. The results suggested that both 3D displays suffered from ambiguity of distance estimates but that the 3D immersed display was most accurate for judging whether a location is directly visible from another. In Experiment 2, the 3D exocentric display was compared with a 3D immersed view, coupled with a small 2D inset map, in a more continuous battlefield scenario in which judgments of enemy activity were made. The findings of 3D ambiguity were replicated from Experiment 1. The accuracy of judgments of enemy activity suffered with the immersed display when information necessary to answer correctly did not appear in the initial forward view and required panning to acquire, reflecting the cognitive demands of integration across different views. This display also hindered soldiers' ability to report changes in enemy activity from one scene to the next. The results of this research will help to provide guidelines for the appropriate choice of computer display technology to assist in designing battlefield visualization aids. Caution should be exercised in choosing immersive viewpoints.

Target cuing in visual search: the effects of conformality and display location on the allocation of visual attention.

Two experiments were performed to examine how frame of reference (world-referenced vs. screen-referenced) and target expectancy can modulate the effects of target cuing in directing attention for see-through helmet-mounted displays (HMDs). In the first experiment, the degree of world referencing was varied by the spatial accuracy of the cue; in the second, the degree of world referencing was varied more radically between a world-referenced HMD and a hand-held display. Participants were asked to detect, identify, and give azimuth information for targets hidden in terrain presented in the far domain (i.e., the world) while performing a monitoring task in the near domain (i.e., the display). The results of both experiments revealed a cost-benefit trade-off for cuing such that the presence of cuing aided the target detection task for expected targets but drew attention away from the presence of unexpected targets in the environment. Analyses support the observation that this effect can be mediated by the display: The world-referenced display reduced the cost of cognitive tunneling relative to the screen-referenced display in Experiment 1; this cost was further reduced in Experiment 2 when participants were using a hand-held display. Potential applications of this research include important design guidelines and specifications for automated target recognition systems as well as any terrain-and-targeting display system in which superimposed symbology is included, specifically in assessing the costs and benefits of attentional cuing and the means by which this information is displayed.

Head-up displays: effects of clutter, display intensity, and display location on pilot performance.

Two experiments examined the effects of display location (head-up and head-down), display clutter, and display intensity on pilot performance in a general aviation-cruise flight environment. In Experiment 1, a low-fidelity simulation revealed that the detection of commanded flight changes and flight-path tracking performance was better in the head-down condition as compared to the head-up condition. In contrast, midair traffic detection was superior with the head-up display (HUD), reflecting an attentional trade-off. Experiment 2 used the same paradigm in a high-fidelity visual simulation. Flight performance was equivalent between HUD and head-down locations. Detection of commanded changes and traffic was better in the HUD condition, revealing the HUD benefits of reduced scanning. The presence of clutter inhibited detection of command changes and traffic in both head-up and head-down conditions. Lowlighting the task-irrelevant clutter did not facilitate detection of commanded changes, however, the clutter cost for detecting traffic was diminished if the added information was lowlighted in the head-down location. The data suggested that attention was modulated between tasks (flight control and detection), and between display areas (head-up and head-down).

Visual scanning and pilot expertise: the role of attentional flexibility and mental model development.

In order to examine differences in flying expertise, 12 novice and 12 expert pilots flew a 7-segment simulation pattern under specific attentional constraints while cockpit instrument visual scan was recorded. Flight segments involved various combinations of maneuvering of heading, altitude and airspeed. Expert pilots performed better than novices on vertical and longitudinal, but not lateral control. They accomplished their superior vertical tracking by allocating more control resources to the vertical control. Analyses of scanning strategies revealed that experts: a) had shorter dwells and more frequent visits to most instruments; b) adapted their visiting strategy more flexibly in response to changing task demands; c) demonstrated a better mental model of cross-coupling and predictive relations between and within axes; and d) showed more frequent checking of axes whose values remained constant. The data is discussed in terms of their implications in pilot cockpit scan training program development.

Information access in a dual-task context: testing a model of optimal strategy selection.

Pilots were required to access information from a hierarchical aviation database by navigating under single-task conditions (Experiment 1) and when this task was time-shared with an altitude-monitoring task of varying bandwidth and priority (Experiment 2). In dual-task conditions, pilots had 2 viewports available, 1 always used for the information task and the other to be allocated to either task. Dual-task strategy, inferred from the decision of which task to allocate to the 2nd viewport, revealed that allocation was generally biased in favor of the monitoring task and was only partly sensitive to the difficulty of the 2 tasks and their relative priorities. Some dominant sources of navigational difficulties failed to adaptively influence selection strategy. The implications of the results are to provide tools for jumping to the top of the database, to provide 2 viewports into the common database, and to provide training as to the optimum viewport management strategy in a multitask environment.

Superimposition, symbology, visual attention, and the head-up display.

In two experiments we examined a number of related factors postulated to influence head-up display (HUD) performance. We addressed the benefit of reduced scanning and the cost of increasing the number of elements in the visual field by comparing a superimposed HUD with an identical display in a head-down position in varying visibility conditions. We explored the extent to which the characteristics of HUD symbology support a division of attention by contrasting conformal symbology (which links elements of the display image to elements of the far domain) with traditional instrument landing system (ILS) symbology. Together the two experiments provide strong evidence that minimizing scanning between flight instruments and the far domain contributes substantially to the observed HUD performance advantage. Experiment 1 provides little evidence for a performance cost attributable to visual clutter. In Experiment 2 the pattern of differences in lateral tracking error between conformal and traditional ILS symbology supports the hypothesis that, to the extent that the symbology forms an object with the far domain, attention may be divided between the superimposed image and its counterpart in the far domain.

Electronic maps for terminal area navigation: effects of frame of reference and dimensionality.

Two experiments are reported that contrast rotating versus fixed electronic map displays, which pilots used for a simulated approach to a landing. In Experiment 1, a rotating versus fixed-map display was experimentally crossed with a two-dimensional (2D) versus three-dimensional (3D) view (perspective map) as pilots' ability to maintain the flight path and demonstrate awareness of the location of surrounding terrain features were assessed. Rotating displays supported better flight path guidance and did not substantially harm performance on terrain awareness tasks. 3D displays led to a substantial cost for vertical control but did not differ from 2D displays in lateral control. In Experiment 2, pilots flew with the rotating 2D display and with an improved version of the rotating 3D display, designed to reduce the ambiguity of representing altitude information. Vertical control improved as a result of the 3D display design improvement, but lateral control did not. The results are discussed in terms of the costs and benefits of presenting information in 3D, ego-referenced format for both flight path control and terrain awareness.

Role of multiple resources in predicting time-sharing efficiency: evaluation of three workload models in a multiple-task setting.

The goal of our study was to assess the validity of the assumptions underlying three prominent workload models: the Time-Line Analysis and Prediction workload model (Parks & Boucek, 1989), the VACP workload model (Aldrich, Szabo, & Bierbaum, 1989), and the W/INDEX model (North & Riley, 1989). Sixteen subjects flew a low-fidelity flight simulation. Subjects were required to perform a two-axis tracking task, a concurrent visual-monitoring task, and a discrete decision task. The decision task had 16 variations defined by two levels on each of the following dimensions: input modality (visual vs. auditory), processing code (spatial vs. verbal), difficulty (easy vs. hard), and response modality (manual vs. voice). Dual-task costs were found only for the tracking task. The tracking data were then analyzed using two approaches: a traditional analysis of variance (ANOVA) and a correlational analysis of tracking performance versus model predictions. The ANOVA revealed that performance on the tracking task was better when the concurrent decision task was responded to vocally and was easy. Input modality and processing code of the concurrent decision task had no significant effect on tracking performance. The correlational analysis was used to evaluate each of the three models, to determine what features were responsible for improving the models' fit, and to compare their performance with a pure time-line model that makes no multiple-resource assumptions. All three models did a good job of predicting variance between experimental conditions, accounting for between 56% and 84% of the variance in our data and between 10% and 40% of an earlier data set. Different features of each model that affect the fit are then discussed. We conclude that it is important for models to retain a multiple-resource coding, although the best features of that coding remain to be determined. Coding tasks by their demand level appears to be less critical.

Mental workload and cognitive task automaticity: an evaluation of subjective and time estimation metrics.

The evaluation of mental workload is becoming increasingly important in system design and analysis. The present study examined the structure and assessment of mental workload in performing decision and monitoring tasks by focusing on two mental workload measurements: subjective assessment and time estimation. The task required the assignment of a series of incoming customers to the shortest of three parallel service lines displayed on a computer monitor. The subject was either in charge of the customer assignment (manual mode) or was monitoring an automated system performing the same task (automatic mode). In both cases, the subjects were required to detect the non-optimal assignments that they or the computer had made. Time pressure was manipulated by the experimenter to create fast and slow conditions. The results revealed a multi-dimensional structure of mental workload and a multi-step process of subjective workload assessment. The results also indicated that subjective workload was more influenced by the subject's participatory mode than by the factor of task speed. The time estimation intervals produced while performing the decision and monitoring tasks had significantly greater length and larger variability than those produced while either performing no other tasks or performing a well practised customer assignment task. This result seemed to indicate that time estimation was sensitive to the presence of perceptual/cognitive demands, but not to response related activities to which behavioural automaticity has developed.

Implications of graphics enhancements for the visualization of scientific data: dimensional integrality, stereopsis, motion, and mesh.

This study examines the effectiveness of four techniques to assist scientists in evaluating multidimensional data. Subjects viewed a series of complex 3D data sets, each representing an underlying complex surface, from which a set of discrete points or observations were sampled. From each sample they answered questions that required focus of attention on certain data points or integration across varying numbers of data points and dimensions. After a number of samples were viewed from each surface, subjects were tested for their retention of the surface characteristics. In Experiment 1, 3D (perspective) representations were found to support superior performance to 2D (planar) representations, but only for more integrative questions. Animated motion provided no benefits. In Experiment 2, stereoptic views of a 3D display were also found to support performance, particularly for integrative questions, but the ability to rotate the data space (motion parallax) and the presence of a mesh surface connecting the points did not. The posttests revealed some evidence that 3D representations improved the ability to visualize the surface, but neither 3D renderings nor stereopsis led to a better abstract representation of the data.

Assessment of pilot performance and mental workload in rotary wing aircraft.

This research examined the processing demands imposed upon experienced pilots by two different communication formats, digital and verbal, in a high fidelity simulation of an advanced multi-function helicopter. The mental workload imposed by the type and magnitude of communications was assessed by a battery of subjective, performance, secondary, and physiological measures. The performance data indicated that the pilots had difficulty adhering to the Nap of the Earth altitude criterion with high communication demands, particularly with the digital communication system. This was presumably due to the requirement to spend more time scanning the multi-function displays with the digital than with the verbal communication system. On the other hand, the pilots were less prone to task shedding when they used the digital communication system possibly due to the provision of a permanent list of queries that was unavailable with the verbal system. Measures of heart rate variability and blink rate were larger with the verbal than with the digital system, presumably reflecting increased respiratory demands in the verbal condition as well as increased visual processing demands with the digital format. Finally, the probe evoked P300 component decreased in amplitude as a function of increases in the magnitude of communications. The results are discussed in terms of the structural and capacity demands of the communications systems that were proposed for the advanced multi-function helicopter.

Distance and organization in multifunction displays.

One approach to organizing information in a multifunction display (MFD) is to place related screens of information closer to each other. This study identified three metrics that could be used to operationalize the concept of distance in an MFD. The proposed distance metrics-navigational (the number of choice points lying between two screens), organizational (the hierarchical structure of the data base), and the cognitive (the user's perception of relationships among screens)-were empirically examined by using a simulated, hierarchically arranged, menu-driven MFD in an aviation context. Subjects engaged in two tasks that required them to access different target screens from various starting screens in a 290-screen MFD. The tasks differed in the navigational mechanisms subjects were allowed to use to navigate around the MFD and the relationships between the starting and target screens. The results suggest that the three distance metrics are meaningful within the context of a multifunction display.

Tongue oximetry in children with extensive thermal injury: comparison with peripheral oximetry.

We undertook a prospective study of standard peripheral pulse oximetry versus a modified pulse oximeter probe applied to the tongue in order to determine the efficacy of this alternative monitoring site in children with thermal injuries. Ten patients with a mean age (+/- SD) of 7.5 +/- 4.5 yr were studied on 15 occasions. The mean weight (+/- SD) was 31.4 +/- 13.7 kg and percent surface area burn (+/- SD) was 56 +/- 21%. A total of 1,992 min of anaesthesia time was monitored. Both sites functioned simultaneously 47% of the time; the lingual but not the peripheral site functioned 28% of the time and only the peripheral site and not the lingual functioned 22% of the time. Neither site functioned 3% of the time. The tongue oximeter provided 563 min more monitoring time than the peripheral sites. The tongue oximeter also functioned in children with peripheral vasoconstriction when the peripheral sensor failed and was less susceptible to electrocautery interference. The tongue oximeter is a reasonable adjunct but not a substitute for peripheral oximetry since its application is limited to paralyzed, intubated patients.

Visual scanning with or without spatial uncertainty and divided and selective attention.

An experiment was conducted to address the relation between theories of selective attention and theories of divided attention by examining the pattern of task interference between visual scanning as a sequential and selective attention process and other concurrent spatial or verbal processing tasks. A distinction is proposed between visual scanning with or without spatial uncertainty regarding their possible differential effects on interference with other concurrent processes. The experiment required the subjects to perform a primary tracking task, which was concurrently performed with a secondary spatial or verbal decision task. The relevant information that was needed to perform the decision tasks was displayed with or without spatial uncertainty. The results provide evidence that visual scanning as a spatial exploratory activity produces greater task interference with concurrent spatial tasks than with verbal tasks. Furthermore, spatial uncertainty in scanning is identified to be the crucial factor in producing this differential effect.

Integrated displays and the perception of graphical data.

Three experiments are presented that apply a principle of compatibility of proximity to the perception of graphical data. These experiments demonstrate that the merits and costs of integral displays relative to separable displays depend in part on the task being performed. Experiment 1 employs a data extrapolation task in which information must be integrated. Here an integral display is found to be superior to a separable display. Experiment 2 employed a data perception task that requires focused attention. This reveals superior performance with separable displays. Experiment 3 employed a multiple cue judgement task in which information integration could be manipulated. Data from Experiment 3 were analysed using the Brunswick lens procedures, and indicated that knowledge of the task structure was influenced by the display type. When selective attention was required, knowledge of the task was superior with separable displays. The results are discussed with reference to the principle of compatibility of proximity, and the implications of the results for the perception of scientific data are noted.

Event-related brain potentials as indices of information extraction and response priming.

Measures of overt response and of the event-related brain potential (ERP) were used to investigate the processing of a priming stimulus varying in its information content. Subjects were shown sequences of 2 letters that served as a priming and an imperative stimulus. In 3 randomly interspersed conditions the imperative stimulus had a 0.80, 0.50, or 0.20 probability of physically matching the priming letter. The different probability conditions were signaled by the position of a dot flanking the priming letter. Reaction time and accuracy data indicated that the subjects primed their responses as a function of the information conveyed by the priming stimulus. The amplitude and latency of the P300 to the priming stimulus were sensitive to the amount of information conveyed by the priming stimulus and the duration of the processing required. The readiness potential in the foreperiod was lateralized as a function of the priming stimulus. Furthermore, the larger the amplitude of the P300 to the priming stimulus, the larger the lateralization of the readiness potential, indicating that information extraction, indexed by the P300, was related to response priming, indexed by the readiness potential. The results indicate that ERP measures make manifest covert aspects of the priming process occurring in the foreperiod.