Quantitative effects of overlay clutter and information access effort: Examining the scan-clutter trade-off in displays with geospatial maps.

Overlaying images from multiple geospatial databases increases clutter and imposes attentional costs by disrupting focusing attention on each database and dividing attention when comparing databases. Costs of overlay clutter may offset the benefits of reduced scanning between two images displayed separately. In two experiments, we examine these attention issues using computational metrics to quantify clutter. We also examine how the scan-clutter trade-off is modified by different levels of clutter, display separation, and task attentional requirements. Participants viewed information from a geographical terrain database and a schematic map database and made judgments that required focusing attention on either database or integrating information across both. In Experiment 1, databases were presented as either overlaid or adjacent displays, and in Experiment 2, as either overlay, adjacent, or more separated displays. Results showed that response time was modulated by the magnitude of clutter, spatial separation, and task type. Results also revealed that clutter costs dominated those of spatial separation, particularly in tasks requiring focused attention. A computational feature congestion metric of clutter effectively predicted performance but could be improved by incorporating an overlay component, which amplified the costs of clutter. The results provide design guidelines for overlay displays (e.g., head-mounted displays) that will minimize the scan-clutter trade-off. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Beyond the Wizard of Oz: Negative Effects of Imperfect Machine Learning to Examine the Impact of Reliability of Augmented Reality Cues on Visual Search Performance.

Despite knowing exactly what an object looks like, searching for it in a person's visual field is a time-consuming and error-prone experience. In Augmented Reality systems, new algorithms are proposed to speed up search time and reduce human errors. However, these algorithms might not always provide 100% accurate visual cues, which might affect users' perceived reliability of the algorithm and, thus, search performance. Here, we examined the detrimental effects of automation bias caused by imperfect cues presented in the Augmented Reality head-mounted display using the YOLOv5 machine learning model. 53 participants in the two groups received either 100% accurate visual cues or 88.9% accurate visual cues. Their performance was compared with the control condition, which did not include any additional cues. The results show how cueing may increase performance and shorten search times. The results also showed that performance with imperfect automation was much worse than perfect automation and that, consistent with automation bias, participants were frequently enticed by incorrect cues.

Information Access Effort: The Role of Head Movements for Information Presented at Increasing Eccentricity on Flat Panel and Head-Mounted Displays.

OBJECTIVE: This experiment examined performance costs when processing two sources of information positioned at increasing distances using a flat panel display and an augmented reality head-mounted display (AR-HMD). BACKGROUND: The AR-HMD enables positioning virtual information at various distances in space. However, the proximity compatibility principle suggests that closer separation when two sources of information require mental integration assists performance, whereas increased separation between two sources hurts integration performance more than when a single source requires focused attention. Previous studies have provided inconsistent findings regarding costs associated with increased separation. Few of these experiments have examined separation for both focused and integration tasks, compared vertical and lateral separation, or measured head movements. METHOD: Three experiments collectively examined these issues using a flat panel display and a virtual display presented with an HMD, where the separation of information varied laterally or vertically during a focused attention (digit reading) task and an information integration (mental subtraction) task. RESULTS: There was no performance cost for either display when information was increasingly separated. However, head movements mitigated performance costs by preserving accuracy at larger separations without increasing response time. CONCLUSION: Head movements appear to mitigate performance costs associated with presenting information increasingly far apart on flat panel displays and HMDs. Both eye scanning and head movements appear to be less effortful than expected. APPLICATION: These findings have important implications for design guidelines regarding the placement of information presented on flat panel displays and, more specifically, HMDs, which can present information 360° around the user.

Survey of Annotations in Extended Reality Systems.

Annotation in 3D user interfaces such as Augmented Reality (AR) and Virtual Reality (VR) is a challenging and promising area; however, there are not currently surveys reviewing these contributions. In order to provide a survey of annotations for Extended Reality (XR) environments, we conducted a structured literature review of papers that used annotation in their AR/VR systems from the period between 2001 and 2021. Our literature review process consists of several filtering steps which resulted in 103 XR publications with a focus on annotation. We classified these papers based on the display technologies, input devices, annotation types, target object under annotation, collaboration type, modalities, and collaborative technologies. A survey of annotation in XR is an invaluable resource for researchers and newcomers. Finally, we provide a database of the collected information for each reviewed paper. This information includes applications, the display technologies and its annotator, input devices, modalities, annotation types, interaction techniques, collaboration types, and tasks for each paper. This database provides a rapid access to collected data and gives users the ability to search or filter the required information. This survey provides a starting point for anyone interested in researching annotation in XR environments.

Virtual reality assessment of walking in a modifiable urban environment: a feasibility and acceptability study.

Physical activity is known to be one of the most health-beneficial behaviors, and salutogenic design modifications to the built environment can facilitate increased physical activity. Unfortunately, it is not often clear in advance which environmental and urban design implementations will generate increases in activities such as walking, and which will have little impact or even reduce walking. The present study tested the feasibility and acceptability of a virtual reality (VR) model for pre-testing urban designs for their impact on walking. Using a wearable VR head-mounted display/computer, young adults (n = 40) walked freely through a large indoor gymnasium, simultaneously walking through a virtual model of an urban streetscape that was designed to be modifiable and allow for testing impacts on walking of various changes to the urban environment. The majority of participants found the experience to be acceptable: pleasant and nonaversive, and they walked freely through the VR model for approximately 20 min, on average. Using modifiable VR models to pre-test built-environment changes for their impacts on walking behavior appears to be a feasible and acceptable approach and worthy of continued research investigation.

Mitigating the Costs of Spatial Transformations With a Situation Awareness Augmented Reality Display: Assistance for the Joint Terminal Attack Controller 3-17.

OBJECTIVE: Evaluate and model the advantage of a situation awareness (SA) supported by an augmented reality (AR) display for the ground-based joint terminal attack Controller (JTAC), in judging and describing the spatial relations between objects in a hostile zone. BACKGROUND: The accurate world-referenced description of relative locations of surface objects, when viewed from an oblique slant angle (aircraft, observation post) is hindered by (1) the compression of the visual scene, amplified at a lower slang angle, (2) the need for mental rotation, when viewed from a non-northerly orientation. APPROACH: Participants viewed a virtual reality (VR)-simulated four-object scene from either of two slant angles, at each of four compass orientations, either unaided, or aided by an AR head-mounted display (AR-HMD), depicting the scene from a top-down (avoiding compression) and north-up (avoiding mental rotation) perspective. They described the geographical layout of four objects within the display. RESULTS: Compared with the control condition, that condition supported by the north-up SA display shortened the description time, particularly on non-northerly orientations (9 s, 30% benefit), and improved the accuracy of description, particularly for the more compressed scene (lower slant angle), as fit by a simple computational model. CONCLUSION: The SA display provides large, significant benefits to this critical phase of ground-air communications in managing an attack-as predicted by the task analysis of the JTAC. APPLICATION: Results impact the design of the AR-HMD to support combat ground-air communications and illustrate the magnitude by which basic cognitive principles "scale up" to realistically simulated real-world tasks such as search and rescue.

The Impacts of Referent Display on Gesture and Speech Elicitation.

Elicitation studies have become a popular method of participatory design. While traditionally used to examine unimodal gesture interactions, elicitation has started being used with other novel interaction modalities. Unfortunately, there has been no work that examines the impact of referent display on elicited interaction proposals. To address that concern this work provides a detailed comparison between two elicitation studies that were similar in design apart from the way that participants were prompted for interaction proposals (i.e., the referents). Based on this comparison the impact of referent display on speech and gesture interaction proposals are each discussed. The interaction proposals between these elicitation studies were not identical. Gesture proposals were the least impacted by referent display, showing high proposal similarity between the two works. Speech proposals were highly biased by text referents with proposals directly mirroring text-based referents an average of 69.36% of the time. In short, the way that referents are presented during elicitation studies can impact the resulting interaction proposals; however, the level of impact found is dependent on the modality of input elicited.

Off-line and on-line stress detection through processing of the pupil diameter signal.

The pupil diameter (PD), controlled by the autonomic nervous system, seems to provide a strong indication of affective arousal, as found by previous research, but it has not been investigated fully yet. In this study, new approaches based on monitoring and processing the PD signal for off-line and on-line "relaxation" vs. "stress" differentiation are proposed. For the off-line approach, wavelet denoising, Kalman filtering, data normalization, and feature extraction are sequentially utilized. For the on-line approach, a hard threshold, a moving average window and three stress detection steps are implemented. In order to use only the most reliable data, two types of data selection methods (paired t test based on galvanic skin response (GSR) data and subject self-evaluation) are applied, achieving average classification accuracies up to 86.43 and 87.20% for off-line and 72.30 and 73.55% for on-line algorithms, with each set of selected data, respectively. The GSR was also monitored and processed in our experiments for comparison purposes, with the highest classification rate achieved being only 63.57% (based on the off-line processing algorithm). The overall results show that the PD signal is more effective and robust for differentiating "relaxation" vs. "stress," in comparison with the traditionally used GSR signal.