Ghost image analysis for pancake virtual reality systems.

Pancake optics (also known as polarization-based catadioptric system) has been widely used as the imaging lens for virtual reality (VR) and mixed reality (MR) headsets because of its compact formfactor and excellent image quality. However, such a folded pancake optics not only dramatically lowers the optical efficiency to 25% because of the utilization of a half mirror, but also suffers from ghost images due to the stray light from multiple surface reflections and imperfect polarization control inside the optical system. In this paper, the origins including the light paths of the ghost images are explored by experiment and then analyzed by simulation. The effect of different incident angles on the intensity of each ghost is also investigated.

Achromatic diffractive liquid-crystal optics for virtual reality displays.

Diffractive liquid-crystal optics is a promising optical element for virtual reality (VR) and mixed reality as it provides an ultrathin formfactor and lightweight for human factors and ergonomics. However, its severe chromatic aberrations impose a big challenge for full-color display applications. In this study, we demonstrate an achromatic diffractive liquid-crystal device to overcome this longstanding chromatic aberration issue. The proposed device consists of three stacked diffractive liquid crystal optical elements with specifically designed spectral response and polarization selectivity. The concept is validated by both simulations and experiments. Our experimental results show a significant improvement in imaging performance with two types of light engines: a laser projector and an organic light-emitting diode display panel. In addition, our simulation results indicate that the lateral color shift is reduced by ~100 times in comparison with conventional broadband diffractive liquid-crystal lens. Potential applications for VR-enabled metaverse, spatial computing, and digital twins that have found widespread applications in smart tourism, smart education, smart healthcare, smart manufacturing, and smart construction are foreseeable.

Novel developments in computational spectropolarimeter.

Compared to conventional bulky spectropolarimeters, computational spectropolarimeters which reconstruct light-field information such as polarization and spectrum in a compact form factor, are critical equipment enabling new applications. The key component of a computational spectropolarimeter is a tunable light-field modulator, in which liquid crystal-based device is a promising candidate. By varying the applied voltage, the tunable liquid crystal metasurface can modulate the phase and spectral information of the incident light, and after a few trials, this important information can be decoded mathematically. Such a novel approach paves the foundation for developing compact and low-cost spectropolarimetric imaging devices with widespread applications in biomedical imaging, remote sensing, and optical communications.

Planar Alvarez tunable lens based on polymetric liquid crystal Pancharatnam-Berry optical elements.

Virtual reality (VR) and augmented reality (AR) have widespread applications. The vergence-accommodation conflict (VAC), which causes 3D visual fatigue, has become an urgent challenge for VR and AR displays. Alvarez lenses, with precise and continuously tunable focal length based on the lateral shift of its two sub-elements, are a promising candidate as the key electro-optical component in vari-focal AR display systems to solve the VAC problem. In this paper, we propose and fabricate a compact Alvarez lens based on planar polymetric liquid crystal Pancharatnam-Berry optical elements. It can provide continuous diopter change from -1.4 D to 1.4 D at the wavelength of 532 nm with the lateral shift ranging from -5 mm to 5 mm. We also demonstrate an AR display system using this proposed Alvarez lens, where virtual images are augmented on the real world at different depths.

Correcting the wavelength-induced phase deviation of Pancharatnam-Berry lenses.

Liquid-crystal-based Pancharatnam-Berry optical elements are widely used in virtual reality and augmented reality. However, the mismatch between exposure wavelength and operating wavelength leads to an undesirable phase deviation to the lenses, which in turn causes severe aberration especially when the f-number is small. To overcome the mismatched wavelength problem and to obtain a nearly ideal lens phase profile, a new exposure method using two template lenses with different focal lengths is proposed and experimentally validated. Our results indicate that such a lens indeed exhibits a better imaging performance than that fabricated by traditional interference method.

Ultracompact virtual reality system with a Pancharatnam-Berry phase deflector.

We propose an ultracompact virtual reality (VR) system with three optical components: a lenslet array, a Pancharatnam-Berry phase deflector (PBD), and a deflector array. The lenslet array aims to collect and collimate the input light from the display panel. The PBD steers the deviated beams after the lenslet array toward the optical axis so that the image uniformity and angular resolution can be enhanced, which plays a key role to enable this ultracompact design. Finally, the deflector array deflects the collimated beam from each lenslet to the exit pupil to widen the field of view. Such an ultracompact design is particularly attractive for next-generation glasses-like, lightweight VR headsets.

Advanced liquid crystal devices for augmented reality and virtual reality displays: principles and applications.

Liquid crystal displays (LCDs) and photonic devices play a pivotal role to augmented reality (AR) and virtual reality (VR). The recently emerging high-dynamic-range (HDR) mini-LED backlit LCDs significantly boost the image quality and brightness and reduce the power consumption for VR displays. Such a light engine is particularly attractive for compensating the optical loss of pancake structure to achieve compact and lightweight VR headsets. On the other hand, high-resolution-density, and high-brightness liquid-crystal-on-silicon (LCoS) is a promising image source for the see-through AR displays, especially under high ambient lighting conditions. Meanwhile, the high-speed LCoS spatial light modulators open a new door for holographic displays and focal surface displays. Finally, the ultrathin planar diffractive LC optical elements, such as geometric phase LC grating and lens, have found useful applications in AR and VR for enhancing resolution, widening field-of-view, suppressing chromatic aberrations, creating multiplanes to overcome the vergence-accommodation conflict, and dynamic pupil steering to achieve gaze-matched Maxwellian displays, just to name a few. The operation principles, potential applications, and future challenges of these advanced LC devices will be discussed.

Holo-imprinting polarization optics with a reflective liquid crystal hologram template.

Liquid crystal polarization optics based on photoalignment technique has found pervasive applications in next-generation display platforms like virtual reality and augmented reality. Its large-scale fabrication, however, remains a big challenge due to the high demands in small feature size, fast processing speed, and defects-free alignment quality during the photoalignment process, especially for large-angle reflective devices. Here we propose a new concept of holo-imprinting based on non-contact replication of polarization pattern with a reflective liquid crystal hologram as a template. Our theoretical analysis and experimental results validate the possibility of generating a high-quality polarization pattern exploiting the self-interfering beams of reflective holograms. The method can be extended to numerous devices, from transmissive to reflective, from small angle to large angle, and from grating, lens, to freeform optics. Its widespread impact on the fabrication of liquid crystal polarization optics for advanced display and imaging systems is foreseeable.

Tailoring the light distribution of micro-LED displays with a compact compound parabolic concentrator and an engineered diffusor.

We propose a novel optical design to tailor the angular distribution of a micro-LED (µLED) display system and use vehicle display as an example to illustrate the design principles. The display system consists of a µLED array with a tailored LED structure, a small formfactor compound parabolic concentrator (CPC) system, and a functional engineered diffusor. It provides high efficiency, high peak brightness, and small formfactor. In the design process, a mix-level optical simulation model, including the angular distribution of polarized emission dipole (dipole emission characteristics), Fabry-Perot cavity effect (wave optics), and light propagation process (ray optics), is established to analyze the angular distribution of µLEDs. Such an optical design process from dipole emission to display radiation pattern can be extended to other µLED display systems for different applications.

Augmented reality and virtual reality displays: emerging technologies and future perspectives.

With rapid advances in high-speed communication and computation, augmented reality (AR) and virtual reality (VR) are emerging as next-generation display platforms for deeper human-digital interactions. Nonetheless, to simultaneously match the exceptional performance of human vision and keep the near-eye display module compact and lightweight imposes unprecedented challenges on optical engineering. Fortunately, recent progress in holographic optical elements (HOEs) and lithography-enabled devices provide innovative ways to tackle these obstacles in AR and VR that are otherwise difficult with traditional optics. In this review, we begin with introducing the basic structures of AR and VR headsets, and then describing the operation principles of various HOEs and lithography-enabled devices. Their properties are analyzed in detail, including strong selectivity on wavelength and incident angle, and multiplexing ability of volume HOEs, polarization dependency and active switching of liquid crystal HOEs, device fabrication, and properties of micro-LEDs (light-emitting diodes), and large design freedoms of metasurfaces. Afterwards, we discuss how these devices help enhance the AR and VR performance, with detailed description and analysis of some state-of-the-art architectures. Finally, we cast a perspective on potential developments and research directions of these photonic devices for future AR and VR displays.

Dual-depth augmented reality display with reflective polarization-dependent lenses.

Vergence-accommodation conflict (VAC) is a common annoying issue in near-eye displays using stereoscopy technology to provide the perception of three-dimensional (3D) depth. By generating multiple image planes, the depth cues can be corrected to accommodate a comfortable 3D viewing experience. In this study, we propose a multi-plane optical see-through augmented reality (AR) display with customized reflective polarization-dependent lenses (PDLs). Leveraging the different optical powers of two PDLs, a proof-of-concept dual-plane AR device is realized. The proposed design paves the way to a compact, lightweight, and fatigue-free AR display.

Doubling the optical efficiency of VR systems with a directional backlight and a diffractive deflection film.

We demonstrate an approach to double the optical efficiency of virtual reality (VR) systems based on a directional backlight and a diffractive deflection film (DDF). The directional backlight consists of a commercial collimated light-emitting diode (LED) array and a two-layer privacy film, while the DDF is a three-domain Pancharatnam-Berry (PB) phase lens. Such a PB phase lens was fabricated by the zone exposure and spin-coating method. The focal length of each domain is designed according to the imaging optics of the VR system. Our approach works well in both Fresnel and "pancake" VR systems. We also build the corresponding models in LightTools, and the simulation results are in good agreement with experiment. In experiment, we achieved a 2.25x optical efficiency enhancement for both systems, which agrees with the simulation results (2.48x for Fresnel and 2.44x for "pancake" systems) well. Potential application for high efficiency VR displays is foreseeable.

Miniature planar telescopes for efficient, wide-angle, high-precision beam steering.

Non-mechanical beam steerers with lightweight, compact, high-efficiency, high-precision, and/or large-angle are pivotal for light detection and ranging (LiDAR) of autonomous vehicles, eye-tracking for near-eye displays, microscopy, optical tweezers, and high-precision three-dimensional (3D) printing. However, even the most matured optical phased array can only provide quasi-continuous, efficient beam steering within a small angle range. A telescope module with an angle magnification function can be coupled to enlarge the steering range or precision. But obtaining a compact, low-cost, lightweight, high-quality telescope module with conventional optics remains challenging. Patterned liquid crystal-based planar optical elements offer great design freedom for manipulating the phase profile of light in 2D space. Owing to the advantages of high efficiency, thinness, low cost, easy processing, flexibility, and response to environmental stimuli, a plethora of high-quality optical devices have been demonstrated. Here, a miniature planar telescope mediated by liquid crystal polymers is proposed to offer angle magnification independent of incident spatial location. It consists of two cascaded liquid crystal planar optical elements, each performing a predefined mathematical transformation. By this concept, planar optical elements are fabricated using a new exposure method and assembled into planar telescopes with different magnification factors. Within the incident field range, over 84.6% optical efficiency is achieved with small wavefront distortion. Such a miniature planar telescope shows the potential of cascaded liquid crystal planar optical elements for realizing functionalities that cannot be fulfilled by single optical elements, and enables lightweight, low loss, passive optical transmitters for widespread applications.

Doubling the FOV of AR displays with a liquid crystal polarization-dependent combiner.

We propose a glasses-like augmented reality (AR) display with an extended field-of-view (FOV) using a liquid crystal polarization-dependent combiner (PDC). Such a PDC consists of two polarization volume lenses (PVLs) that are based on patterned liquid crystals to selectively control the beam path according to the right-handed or left-handed circularly polarized light. By encoding the left and right half of the FOV into two orthogonal polarization states, the overall horizontal FOV can be doubled while maintaining an ultrathin and flat form factor. Based on this multiplexing concept, the FOV can be further extended by integrating more PVLs with different diffraction angles. The proposed configuration with polarization-time multiplexing provides a promising solution for overcoming the limited FOV issue in AR displays.

Aberration-free pupil steerable Maxwellian display for augmented reality with cholesteric liquid crystal holographic lenses.

Maxwellian displays offer unique features like always-in-focus quality, high efficiency, and large field-of-view, but its small eyebox remains a major challenge for augmented reality. To enlarge the eyebox, pupil steering is a promising approach. However, previous pupil steering methods generally rely on changing the incident light angle on the lens coupler, which results in serious aberrations. In this Letter, we demonstrate a pupil steerable see-through Maxwellian display incorporating novel cholesteric liquid crystal (CLC) holographic lenses. By actively modulating the polarization state of the incident light, we can schematically choose which holographic lens to function, which fundamentally eliminates the aberrations.

Peculiar polarization response in chiral liquid crystal stacks for multispectral camouflage.

Chiral liquid crystals are self-organized Bragg reflectors which respond to circularly polarized light. Manipulation of the chiral structure has aroused great research interest. The x-y plane two-dimensional patterning of chiral liquid crystals leads to reflective planar optics, and the z-axis modulation results in a variety of photonic bandgap controls. Here, the optical properties of even-number left- and right-handed chiral liquid crystal stacks are investigated, with emphasis on the linear polarization response. Under certain conditions, a linearly polarized incidence can result in a linearly polarized reflected light. More intriguingly, the linear polarization has different forms of response to thick and thin chiral liquid crystal sublayers and responds to the rotation of liquid crystal alignment. Based on the peculiar polarization response, a new type of wavelength-response camouflage and anti-counterfeiting is conceptually proposed, which can hide two different images simultaneously within a small spectral range. Our work paves the way for three-dimensional manipulation of chiral liquid crystals and enlightens novel applications.

Broadband cholesteric liquid crystal lens for chromatic aberration correction in catadioptric virtual reality optics.

A planar and broadband cholesteric liquid crystal (CLC) lens is designed, fabricated, and hybridized with a refractive lens to form a catadioptric pancake lens for virtual reality (VR) displays. Due to their opposite optical dispersion behaviors, the chromatic aberration of the assembled pancake lens is dramatically suppressed, as verified by both ray-tracing analysis and experimental results. The demonstrated catadioptric pancake lens has great potential for next-generation VR displays.

Large-angle two-dimensional grating with hybrid mechanisms.

We demonstrate a large-diffraction-angle two-dimensional (2D) grating based on cholesteric liquid crystal (CLC). One dimension is a polarization volume grating (PVG) working in the Bragg regime, which is produced by a patterned photoalignment layer. The other dimension is a CLC grating working in the Raman-Nath regime, which is introduced by CLC self-assembly under a weak anchoring energy condition. The condition for the coexistence of the CLC Raman-Nath grating (RNG) and PVG is analyzed, and the efficiency and grating period of the CLC RNG are also characterized. Potential application of this 2D grating for enlarging the eyebox of augmented reality displays is discussed.

Enhancing the Efficiency of Color Conversion Micro-LED Display with a Patterned Cholesteric Liquid Crystal Polymer Film.

Color-converted micro-light-emitting diode (micro-LED) displays with wide color gamut, high ambient contrast ratio, and fast response time are emerging as a potentially disruptive technology. However, due to limited optical density and thickness of the color-conversion film, the blue light leakage and low color-conversion efficiency still hinder their widespread applications. In this paper, we demonstrate a patterned cholesteric liquid crystal (CLC) polymer film with two special optical functionalities. On the green and red sub-pixels, the corresponding planar CLC texture acts as a distributed Bragg reflector for the blue light, which in turn improves the color conversion efficiency and expands the color gamut. On the blue sub-pixels, the corresponding focal-conic CLC texture acts as light scattering medium, which helps to reduce the angular color shift. Further analysis reveals that the patterned CLC film can alleviate the crosstalk between green and blue color filters. Therefore, compared to the display system without such a CLC film, our proposed device structure increases the color conversion efficiency by 143% (at ~90% Rec. 2020) and reduces average angular color shift Δu'v' from 0.03 to 0.018 at the viewing angle with the most severe color shift. Such a patterned CLC film is applicable to all kinds of color-conversion display systems, including organic and inorganic phosphors.

Patterning Liquid-Crystal Alignment for Ultrathin Flat Optics.

Liquid-crystal (LC)-based ultrathin flat optical elements (FOEs) exhibit several attractive properties, such as a high degree of optical tunability, strong polarization selectivity, nearly 100% diffraction efficiency, and a simple fabrication process. Investigating the alignment patterning of LC-FOEs to diversify their performance has attracted broad interest in the optics field. In this mini-review, we start from the photoalignment (PA) process and then dive into device structures and performances. By generating and recording the desired polarization fields on the PA layer, the LC molecules will follow the recorded patterns and establish the phase profiles for different functionalities, such as gratings and lenses. Because of the polarization dependency, LC-FOEs have found useful applications in near-eye displays. Understanding the interactions between the PA mechanism and LC molecules helps to optimize the device performance for novel optical systems.