Effects of Augmented Reality-Based Remote Mentoring on Task Performance and Communication: A Simulation Study in the Context of Emergency Medical Services.

Background: Augmented reality head-worn displays (HWDs) may enable efficient remote support in the prehospital environment due to their hand-free operability, their "see-what-I-see" features, and their ability to superimpose digital content over the environment. Methods: In this simulation-based randomized controlled study, a remote mentor used either a phone or HWD to instruct 23 physicians on how to insert a Multi-Lumen Access Catheter into a mannequin. In the phone condition, information could be exchanged only verbally. In the HWD condition, the mentor could additionally see the participant's first-person view and show reference images. We hypothesized that participants who received instructions via the HWD would achieve better procedural performance (lower task completion times, fewer errors advancing the catheter) and exhibit different communication patterns than participants who received instructions via phone. Results: The HWD did not significantly reduce task completion times or errors during catheter advancement. However, by analyzing the frequency of communication events with a Poisson regression, we could demonstrate that with the HWD, the mentor had to request situation reports less often (p < 0.001) but provided more instructions (p = 0.004) and more feedback (p = 0.008). As a possible consequence, participants in the HWD condition rated their workload as lower than participants who used a phone to communicate (p = 0.45). Conclusion: The study demonstrates that HWD-based telemedicine systems can be rated positively by physicians, can benefit communication, and can provide more opportunities for the detection of clinical errors.

Attention to Changes on a Head-Worn Display: Two Preclinical Studies with Healthcare Scenarios.

OBJECTIVE: In two experiments, we examined how quickly different visual alerts on a head-worn display (HWD) would capture participants' attention to a matrix of patient vital sign values, while multitasking. BACKGROUND: An HWD could help clinicians monitor multiple patients, regardless of where the clinician is located. We sought effective ways for HWDs to alert multitasking wearers to important events. METHODS: In two preclinical experiments, university student participants performed a visuomotor tracking task while simultaneously monitoring simulated patient vital signs on an HWD to detect abnormal values. Methods to attract attention to abnormal values included highlighting abnormal vital signs and imposing a white flash over the entire display. RESULTS: Experiment 1 found that participants detected abnormal values faster with high contrast than low contrast greyscale highlights, even while performing difficult tracking. In Experiment 2, a white flash of the entire screen quickly and reliably captured attention to vital signs, but less so on an HWD than on a conventional screen. CONCLUSION: Visual alerts on HWDs can direct users' attention to patient transition events (PTEs) even under high visual-perceptual load, but not as quickly as visual alerts on fixed displays. Aspects of the results have since been tested in a healthcare context. APPLICATION: Potential applications include informing the design of HWD interfaces for monitoring multiple processes and informing future research on capturing attention to HWDs.

An exploratory clinical evaluation of a head-worn display based multiple-patient monitoring application: impact on supervising anesthesiologists' situation awareness.

PURPOSE: Supervising anesthesiologists overseeing several operating rooms must be aware of the status of multiple patients, so they can consult with the anesthetist in single operating rooms or respond quickly to critical events. However, maintaining good situation awareness can be challenging when away from patient bedsides or a central monitoring station. In this proof-of-concept study, we evaluated the potential of a head-worn display that showed multiple patients' vital signs and alarms to improve supervising anesthesiologists' situation awareness. METHODS: Eight supervising anesthesiologists each monitored the vital signs of patients in six operating rooms for 3 h with the head-worn display, and for another 3 h without the head-worn display. In interviews with each anesthesiologist, we assessed in which situations the head-worn display was used and whether the continuous availability of the vital signs improved situation awareness. We also measured situation awareness quantitatively from six of the eight anesthesiologists, by instructing them to press a button whenever they noticed a patient alarm. RESULTS: The median number of patient alarms occurring was similar when the anesthesiologists monitored with the head-worn display (42.0) and without the head-worn display (40.5). However, the anesthesiologists noticed significantly more patient alarms with the head-worn display (66.7%) than without (7.1%), P = 0.028, and they reported improved situation awareness with the head-worn display. The head-worn display helped the anesthesiologists to perceive and comprehend patients' current status and to anticipate future developments. A negative effect of the head-worn display was its tendency to distract during demanding procedures. CONCLUSIONS: Head-worn displays can improve supervising anesthesiologists' situation awareness in multiple-patient monitoring situations. The anesthesiologists who participated in the study expressed enthusiasm about monitoring patients with a head-worn display and wished to use and evaluate it further.