A mobile head-worn projection display.

A recent advancement was achieved in the integration and miniaturization of a binocular head-worn projection display (HWPD) conceived for fully mobile users. The devised display, referred to as Mobile HWPD (M-HWPD), offers see-through capability through custom-designed, light-weight projection optics and an integrated commercial-off-the-shelf (COTS) retro-reflective screen to display full color stereoscopic rendered images augmenting the real world. Moreover, the light-weight optical device (i.e., approximately 8g per eye) has the ability to project clear images at three different locations within near- or far-field observation depths without loss of image quality. In this paper, we first demonstrate the miniaturization of the optics, the optical performance, and the integration of these components with the retro-reflective screen to produce an M-HWPD prototype. We then show results that demonstrate the feasibility of superimposing computer-generated images on a real outdoor scene with the M-HWPD.

Albertian errors in head-mounted displays: I. Choice of eye-point location for a near- or far-field task visualization.

A theoretical investigation of rendered depth and angular errors, or Albertian errors, linked to natural eye movements in binocular head-mounted displays (HMDs) is presented for three possible eye-point locations: the center of the entrance pupil, the nodal point, and the center of rotation of the eye. A numerical quantification was conducted for both the pupil and the center of rotation of the eye under the assumption that the user will operate solely in either the near field under an associated instrumentation setting or the far field under a different setting. Under these conditions, the eyes are taken to gaze in the plane of the stereoscopic images. Across conditions, results show that the center of the entrance pupil minimizes rendered angular errors, while the center of rotation minimizes rendered position errors. Significantly, this investigation quantifies that under proper setting of the HMD and correct choice of the eye points, rendered depth and angular errors can be brought to be either negligible or within specification of even the most stringent applications in performance of tasks in either the near field or the far field.

Design of an ultralight and compact projection lens.

Driven by the need for lightweight head-mounted displays, we present the design of an ultralight and compact projection lens for a head-mounted projective display (HMPD). An HMPD consists of a pair of miniature projection lenses, beam splitters, and miniature displays mounted on the helmet and retroreflective sheeting materials placed strategically in the environment. The HMPD has been proposed recently as an alternative modality for three-dimensional visualization. After demonstrating the concept, building a first-generation custom-designed prototype, and investigating perception issues and application potentials, we designed an ultralight and compact projective lens with a diffractive optical element (DOE), plastic components, and aspheric surfaces for the next-generation prototype. The key contribution here lies in the conception, optimization, and assessment of the projection optics. Thus a brief review of the HMPD technology and related research is followed by a detail discussion of the conception and optimization of the ultralight and high-performance projection optics. The design of the DOE will be particularly described in detail. Finally, the diffraction efficiency of the DOE will be evaluated, and the overall performance of the optics will be assessed in both object space for the optical designer and visual space for possible end-users of the technology.

Development of a training tool for endotracheal intubation: distributed augmented reality.

The authors introduce a tool referred to as the Ultimate Intubation Head (UIH) to train medical practitioners' hand-eye coordination in performing endotracheal intubation with the help of augmented reality methods. In this paper we describe the integration of a deployable UIH and present methods for augmented reality registration of real and virtual anatomical models. The assessment of the 52 degrees field of view optics of the custom-designed and built head-mounted display is less than 1.5 arc minutes in the amount of blur and astigmatism, the two limiting optical aberrations. Distortion is less than 2.5%. Preliminary results of the registration of a physical phantom mandible on its virtual counterpart yields less than 3mm rms. in registration. Finally we describe an approach to distributed visualization where a given training procedure may be visualized and shared at various remote locations. Basic assessments of delays within two scenarios of data distribution were conducted and reported.

Optical assessment of head-mounted displays in visual space.

The optics of head-mounted displays (HMDs) is designed from the pupil of the eye to the miniature display, and the optics is thus commonly solely assessed in the plane of the miniature display. Such assessment does not provide information that usefully interfaces with task-based performance metrics. We present a comprehensive framework for the assessment of the optics of HMDs in visual space, which applies to nonrotationally symmetric systems as well. Four key measures of visual performance are presented, and macro files were implemented to validate the framework. We illustrate the methods using an Erfle eyepiece.

Augmented reality and training for airway management procedures.

Augmented reality is often used for interactive, three-dimensional visualization within the medical community. To this end, we present the integration of an augmented reality system that will be used to train military medics in airway management. The system demonstrates how a head-mounted projective display can be integrated with a desktop PC to create an augmented reality visualization. Furthermore, the system, which uses a lightweight optical tracker, demonstrates the low cost and the portability of the application.